Nov 04 05:27:54.069814 ip-10-0-133-170 systemd[1]: Starting Kubernetes Kubelet...
Nov 04 05:27:54.466571 ip-10-0-133-170 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 05:27:54.466571 ip-10-0-133-170 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Nov 04 05:27:54.466571 ip-10-0-133-170 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 05:27:54.466571 ip-10-0-133-170 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 05:27:54.471068 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471004    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:27:54.471068 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471068    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:27:54.471068 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471071    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:27:54.471156 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471075    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:27:54.471156 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471079    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:27:54.471156 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471082    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:27:54.471156 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471084    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:27:54.471156 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471087    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:27:54.471156 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471090    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:27:54.471156 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471094    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:27:54.471156 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471099    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:27:54.471156 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471102    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:27:54.471156 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471105    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:27:54.471156 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471108    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:27:54.471156 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471111    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:27:54.471156 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471114    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:27:54.471156 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471117    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:27:54.471156 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471120    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:27:54.471156 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471122    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:27:54.471156 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471125    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:27:54.471156 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471128    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:27:54.471156 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471139    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:27:54.471616 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471143    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:27:54.471616 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471147    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:27:54.471616 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471150    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:27:54.471616 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471153    2575 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:27:54.471616 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471155    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:27:54.471616 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471158    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:27:54.471616 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471161    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:27:54.471616 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471164    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:27:54.471616 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471167    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:27:54.471616 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471170    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:27:54.471616 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471173    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:27:54.471616 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471175    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:27:54.471616 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471178    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:27:54.471616 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471181    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:27:54.471616 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471183    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:27:54.471616 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471186    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:27:54.471616 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471188    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:27:54.471616 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471191    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:27:54.471616 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471193    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:27:54.472061 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471196    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:27:54.472061 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471199    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:27:54.472061 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471201    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:27:54.472061 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471204    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:27:54.472061 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471206    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:27:54.472061 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471209    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:27:54.472061 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471211    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:27:54.472061 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471214    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:27:54.472061 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471216    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:27:54.472061 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471219    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:27:54.472061 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471221    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:27:54.472061 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471224    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:27:54.472061 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471227    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:27:54.472061 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471234    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:27:54.472061 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471239    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:27:54.472061 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471241    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:27:54.472061 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471244    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:27:54.472061 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471247    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:27:54.472061 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471250    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:27:54.472495 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471254    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:27:54.472495 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471256    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:27:54.472495 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471259    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:27:54.472495 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471262    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:27:54.472495 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471264    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:27:54.472495 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471267    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:27:54.472495 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471270    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:27:54.472495 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471273    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:27:54.472495 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471276    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:27:54.472495 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471278    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:27:54.472495 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471281    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:27:54.472495 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471284    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:27:54.472495 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471287    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:27:54.472495 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471289    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:27:54.472495 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471292    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:27:54.472495 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471294    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:27:54.472495 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471297    2575 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:27:54.472495 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471300    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:27:54.472495 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471302    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:27:54.472495 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471305    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:27:54.472981 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471308    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:27:54.472981 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471311    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:27:54.472981 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471314    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:27:54.472981 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471317    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:27:54.472981 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471320    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:27:54.472981 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471323    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:27:54.472981 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471326    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:27:54.472981 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471329    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:27:54.472981 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471332    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:27:54.472981 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471334    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:27:54.472981 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471337    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:27:54.472981 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471340    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:27:54.472981 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471343    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:27:54.472981 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471345    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:27:54.472981 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471348    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:27:54.472981 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471351    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:27:54.472981 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471353    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:27:54.472981 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471357    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:27:54.472981 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471360    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:27:54.472981 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471362    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:27:54.473449 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471365    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:27:54.473449 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471367    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:27:54.473449 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471389    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:27:54.473449 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471394    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:27:54.473449 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471397    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:27:54.473449 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.471400    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:27:54.473449 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472170    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:27:54.473449 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472177    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:27:54.473449 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472182    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:27:54.473449 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472185    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:27:54.473449 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472188    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:27:54.473449 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472191    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:27:54.473449 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472193    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:27:54.473449 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472196    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:27:54.473449 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472199    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:27:54.473449 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472203    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:27:54.473449 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472207    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:27:54.473449 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472211    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:27:54.473449 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472213    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:27:54.473938 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472217    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:27:54.473938 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472220    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:27:54.473938 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472222    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:27:54.473938 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472225    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:27:54.473938 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472228    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:27:54.473938 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472231    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:27:54.473938 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472233    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:27:54.473938 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472236    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:27:54.473938 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472238    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:27:54.473938 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472241    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:27:54.473938 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472244    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:27:54.473938 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472246    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:27:54.473938 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472249    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:27:54.473938 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472251    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:27:54.473938 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472254    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:27:54.473938 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472257    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:27:54.473938 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472260    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:27:54.473938 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472263    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:27:54.473938 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472266    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:27:54.474398 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472268    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:27:54.474398 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472271    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:27:54.474398 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472274    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:27:54.474398 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472276    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:27:54.474398 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472279    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:27:54.474398 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472282    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:27:54.474398 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472285    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:27:54.474398 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472288    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:27:54.474398 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472290    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:27:54.474398 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472293    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:27:54.474398 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472296    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:27:54.474398 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472298    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:27:54.474398 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472301    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:27:54.474398 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472304    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:27:54.474398 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472307    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:27:54.474398 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472310    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:27:54.474398 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472312    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:27:54.474398 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472315    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:27:54.474398 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472318    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:27:54.474398 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472320    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:27:54.474964 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472323    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:27:54.474964 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472326    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:27:54.474964 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472328    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:27:54.474964 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472331    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:27:54.474964 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472333    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:27:54.474964 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472336    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:27:54.474964 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472339    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:27:54.474964 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472343    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:27:54.474964 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472348    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:27:54.474964 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472351    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:27:54.474964 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472354    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:27:54.474964 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472357    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:27:54.474964 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472359    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:27:54.474964 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472362    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:27:54.474964 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472365    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:27:54.474964 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472367    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:27:54.474964 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472370    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:27:54.474964 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472374    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:27:54.474964 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472377    2575 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:27:54.475412 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472380    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:27:54.475412 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472382    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:27:54.475412 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472385    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:27:54.475412 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472388    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:27:54.475412 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472391    2575 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:27:54.475412 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472393    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:27:54.475412 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472396    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:27:54.475412 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472399    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:27:54.475412 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472402    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:27:54.475412 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472405    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:27:54.475412 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472408    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:27:54.475412 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472410    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:27:54.475412 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472413    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:27:54.475412 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472415    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:27:54.475412 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472418    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:27:54.475412 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472421    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:27:54.475412 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472423    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:27:54.475412 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472426    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:27:54.475412 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472429    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:27:54.475412 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472431    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:27:54.475899 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472434    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:27:54.475899 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472437    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:27:54.475899 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472439    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:27:54.475899 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472442    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:27:54.475899 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472444    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:27:54.475899 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472447    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:27:54.475899 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472450    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:27:54.475899 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472452    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:27:54.475899 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472455    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:27:54.475899 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472458    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:27:54.475899 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472462    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:27:54.475899 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472464    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:27:54.475899 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472467    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:27:54.475899 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472471    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:27:54.475899 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.472474    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:27:54.475899 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473009    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:27:54.475899 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473016    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:27:54.475899 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473019    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:27:54.475899 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473022    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:27:54.476552 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473025    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:27:54.476552 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473027    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:27:54.476552 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473031    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:27:54.476552 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473034    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:27:54.476552 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473036    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:27:54.476552 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473039    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:27:54.476552 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473041    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:27:54.476552 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473044    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:27:54.476552 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473047    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:27:54.476552 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473049    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:27:54.476552 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473052    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:27:54.476552 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473054    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:27:54.476552 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473058    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:27:54.476552 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473060    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:27:54.476552 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473063    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:27:54.476552 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473066    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:27:54.476552 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473068    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:27:54.476552 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473071    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:27:54.476552 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473073    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:27:54.476552 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473076    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:27:54.477150 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473078    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:27:54.477150 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473081    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:27:54.477150 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473083    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:27:54.477150 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473087    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:27:54.477150 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473090    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:27:54.477150 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473092    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:27:54.477150 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473095    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:27:54.477150 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473098    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:27:54.477150 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473102    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:27:54.477150 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473105    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:27:54.477150 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473108    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:27:54.477150 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473111    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:27:54.477150 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473114    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:27:54.477150 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473117    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:27:54.477150 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473119    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:27:54.477150 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473122    2575 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:27:54.477150 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473125    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:27:54.477150 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473127    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:27:54.477150 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473130    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:27:54.477619 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473133    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:27:54.477619 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473135    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:27:54.477619 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473138    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:27:54.477619 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473140    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:27:54.477619 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473143    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:27:54.477619 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473146    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:27:54.477619 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473148    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:27:54.477619 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473151    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:27:54.477619 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473153    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:27:54.477619 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473156    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:27:54.477619 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473159    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:27:54.477619 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473161    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:27:54.477619 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473164    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:27:54.477619 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473166    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:27:54.477619 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473169    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:27:54.477619 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473172    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:27:54.477619 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473176    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:27:54.477619 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473179    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:27:54.477619 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473181    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:27:54.478064 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473184    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:27:54.478064 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473188    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:27:54.478064 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473191    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:27:54.478064 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473194    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:27:54.478064 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473196    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:27:54.478064 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473199    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:27:54.478064 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473202    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:27:54.478064 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473205    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:27:54.478064 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473207    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:27:54.478064 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473210    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:27:54.478064 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473213    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:27:54.478064 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473215    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:27:54.478064 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473218    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:27:54.478064 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473221    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:27:54.478064 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473224    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:27:54.478064 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473226    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:27:54.478064 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473229    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:27:54.478064 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473231    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:27:54.478064 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473234    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:27:54.478064 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473237    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:27:54.478554 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473239    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:27:54.478554 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473242    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:27:54.478554 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473245    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:27:54.478554 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473248    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:27:54.478554 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473250    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:27:54.478554 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473253    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:27:54.478554 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473255    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:27:54.478554 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473258    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:27:54.478554 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473261    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:27:54.478554 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473264    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:27:54.478554 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473266    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:27:54.478554 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473269    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:27:54.478554 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473271    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:27:54.478554 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473276    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:27:54.478554 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473278    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:27:54.478554 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473281    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:27:54.478554 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473284    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:27:54.478554 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473286    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:27:54.478554 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473289    2575 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:27:54.478554 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473294    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:27:54.479058 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473298    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:27:54.479058 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473301    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:27:54.479058 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473303    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:27:54.479058 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.473307    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:27:54.479058 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474379    2575 flags.go:64] FLAG: --address="0.0.0.0"
Nov 04 05:27:54.479058 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474393    2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Nov 04 05:27:54.479058 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474399    2575 flags.go:64] FLAG: --anonymous-auth="true"
Nov 04 05:27:54.479058 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474404    2575 flags.go:64] FLAG: --application-metrics-count-limit="100"
Nov 04 05:27:54.479058 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474409    2575 flags.go:64] FLAG: --authentication-token-webhook="false"
Nov 04 05:27:54.479058 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474412    2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Nov 04 05:27:54.479058 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474417    2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Nov 04 05:27:54.479058 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474421    2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Nov 04 05:27:54.479058 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474424    2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Nov 04 05:27:54.479058 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474427    2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Nov 04 05:27:54.479058 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474431    2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Nov 04 05:27:54.479058 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474434    2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Nov 04 05:27:54.479058 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474437    2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Nov 04 05:27:54.479058 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474440    2575 flags.go:64] FLAG: --cgroup-root=""
Nov 04 05:27:54.479058 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474443    2575 flags.go:64] FLAG: --cgroups-per-qos="true"
Nov 04 05:27:54.479058 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474446    2575 flags.go:64] FLAG: --client-ca-file=""
Nov 04 05:27:54.479058 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474449    2575 flags.go:64] FLAG: --cloud-provider="external"
Nov 04 05:27:54.479058 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474452    2575 flags.go:64] FLAG: --cluster-dns="[]"
Nov 04 05:27:54.479058 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474458    2575 flags.go:64] FLAG: --cluster-domain=""
Nov 04 05:27:54.479613 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474461    2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Nov 04 05:27:54.479613 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474464    2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Nov 04 05:27:54.479613 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474469    2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Nov 04 05:27:54.479613 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474472    2575 flags.go:64] FLAG: --container-log-max-files="5"
Nov 04 05:27:54.479613 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474476    2575 flags.go:64] FLAG: --container-log-max-size="10Mi"
Nov 04 05:27:54.479613 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474479    2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Nov 04 05:27:54.479613 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474483    2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Nov 04 05:27:54.479613 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474486    2575 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Nov 04 05:27:54.479613 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474489    2575 flags.go:64] FLAG: --contention-profiling="false"
Nov 04 05:27:54.479613 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474492    2575 flags.go:64] FLAG: --cpu-cfs-quota="true"
Nov 04 05:27:54.479613 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474495    2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Nov 04 05:27:54.479613 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474498    2575 flags.go:64] FLAG: --cpu-manager-policy="none"
Nov 04 05:27:54.479613 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474501    2575 flags.go:64] FLAG: --cpu-manager-policy-options=""
Nov 04 05:27:54.479613 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474506    2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Nov 04 05:27:54.479613 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474510    2575 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Nov 04 05:27:54.479613 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474522    2575 flags.go:64] FLAG: --enable-debugging-handlers="true"
Nov 04 05:27:54.479613 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474526    2575 flags.go:64] FLAG: --enable-load-reader="false"
Nov 04 05:27:54.479613 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474530    2575 flags.go:64] FLAG: --enable-server="true"
Nov 04 05:27:54.479613 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474533    2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Nov 04 05:27:54.479613 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474537    2575 flags.go:64] FLAG: --event-burst="100"
Nov 04 05:27:54.479613 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474540    2575 flags.go:64] FLAG: --event-qps="50"
Nov 04 05:27:54.479613 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474543    2575 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Nov 04 05:27:54.479613 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474547    2575 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Nov 04 05:27:54.479613 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474550    2575 flags.go:64] FLAG: --eviction-hard=""
Nov 04 05:27:54.480206 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474554    2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Nov 04 05:27:54.480206 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474557    2575 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Nov 04 05:27:54.480206 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474560    2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Nov 04 05:27:54.480206 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474563    2575 flags.go:64] FLAG: --eviction-soft=""
Nov 04 05:27:54.480206 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474566    2575 flags.go:64] FLAG: --eviction-soft-grace-period=""
Nov 04 05:27:54.480206 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474569    2575 flags.go:64] FLAG: --exit-on-lock-contention="false"
Nov 04 05:27:54.480206 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474572    2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Nov 04 05:27:54.480206 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474575    2575 flags.go:64] FLAG: --experimental-mounter-path=""
Nov 04 05:27:54.480206 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474578    2575 flags.go:64] FLAG: --fail-cgroupv1="true"
Nov 04 05:27:54.480206 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474581    2575 flags.go:64] FLAG: --fail-swap-on="true"
Nov 04 05:27:54.480206 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474586    2575 flags.go:64] FLAG: --feature-gates=""
Nov 04 05:27:54.480206 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474590    2575 flags.go:64] FLAG: --file-check-frequency="20s"
Nov 04 05:27:54.480206 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474593    2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Nov 04 05:27:54.480206 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474596    2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Nov 04 05:27:54.480206 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474600    2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Nov 04 05:27:54.480206 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474603    2575 flags.go:64] FLAG: --healthz-port="10248"
Nov 04 05:27:54.480206 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474607    2575 flags.go:64] FLAG: --help="false"
Nov 04 05:27:54.480206 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474609    2575 flags.go:64] FLAG: --hostname-override="ip-10-0-133-170.us-east-2.compute.internal"
Nov 04 05:27:54.480206 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474613    2575 flags.go:64] FLAG: --housekeeping-interval="10s"
Nov 04 05:27:54.480206 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474616    2575 flags.go:64] FLAG: --http-check-frequency="20s"
Nov 04 05:27:54.480206 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474619    2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Nov 04 05:27:54.480206 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474622    2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Nov 04 05:27:54.480206 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474627    2575 flags.go:64] FLAG: --image-gc-high-threshold="85"
Nov 04 05:27:54.480768 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474630    2575 flags.go:64] FLAG: --image-gc-low-threshold="80"
Nov 04 05:27:54.480768 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474633    2575 flags.go:64] FLAG: --image-service-endpoint=""
Nov 04 05:27:54.480768 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474637    2575 flags.go:64] FLAG: --kernel-memcg-notification="false"
Nov 04 05:27:54.480768 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474640    2575 flags.go:64] FLAG: --kube-api-burst="100"
Nov 04 05:27:54.480768 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474644    2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Nov 04 05:27:54.480768 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474647    2575 flags.go:64] FLAG: --kube-api-qps="50"
Nov 04 05:27:54.480768 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474650    2575 flags.go:64] FLAG: --kube-reserved=""
Nov 04 05:27:54.480768 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474653    2575 flags.go:64] FLAG: --kube-reserved-cgroup=""
Nov 04 05:27:54.480768 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474656    2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Nov 04 05:27:54.480768 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474659    2575 flags.go:64] FLAG: --kubelet-cgroups=""
Nov 04 05:27:54.480768 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474662    2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Nov 04 05:27:54.480768 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474665    2575 flags.go:64] FLAG: --lock-file=""
Nov 04 05:27:54.480768 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474668    2575 flags.go:64] FLAG: --log-cadvisor-usage="false"
Nov 04 05:27:54.480768 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474671    2575 flags.go:64] FLAG: --log-flush-frequency="5s"
Nov 04 05:27:54.480768 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474674    2575 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Nov 04 05:27:54.480768 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474684    2575 flags.go:64] FLAG: --log-json-split-stream="false"
Nov 04 05:27:54.480768 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474687    2575 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Nov 04 05:27:54.480768 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474690    2575 flags.go:64] FLAG: --log-text-split-stream="false"
Nov 04 05:27:54.480768 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474693    2575 flags.go:64] FLAG: --logging-format="text"
Nov 04 05:27:54.480768 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474697    2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Nov 04 05:27:54.480768 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474701    2575 flags.go:64] FLAG: --make-iptables-util-chains="true"
Nov 04 05:27:54.480768 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474704    2575 flags.go:64] FLAG: --manifest-url=""
Nov 04 05:27:54.480768 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474707    2575 flags.go:64] FLAG: --manifest-url-header=""
Nov 04 05:27:54.480768 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474711    2575 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Nov 04 05:27:54.480768 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474714    2575 flags.go:64] FLAG: --max-open-files="1000000"
Nov 04 05:27:54.481367 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474718    2575 flags.go:64] FLAG: --max-pods="110"
Nov 04 05:27:54.481367 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474721    2575 flags.go:64] FLAG: --maximum-dead-containers="-1"
Nov 04 05:27:54.481367 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474724    2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Nov 04 05:27:54.481367 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474727    2575 flags.go:64] FLAG: --memory-manager-policy="None"
Nov 04 05:27:54.481367 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474730    2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Nov 04 05:27:54.481367 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474733    2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Nov 04 05:27:54.481367 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474736    2575 flags.go:64] FLAG: --node-ip="0.0.0.0"
Nov 04 05:27:54.481367 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474739    2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Nov 04 05:27:54.481367 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474746    2575 flags.go:64] FLAG: --node-status-max-images="50"
Nov 04 05:27:54.481367 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474752    2575 flags.go:64] FLAG: --node-status-update-frequency="10s"
Nov 04 05:27:54.481367 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474755    2575 flags.go:64] FLAG: --oom-score-adj="-999"
Nov 04 05:27:54.481367 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474758    2575 flags.go:64] FLAG: --pod-cidr=""
Nov 04 05:27:54.481367 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474761    2575 flags.go:64] FLAG: --pod-manifest-path=""
Nov 04 05:27:54.481367 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474764    2575 flags.go:64] FLAG: --pod-max-pids="-1"
Nov 04 05:27:54.481367 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474767    2575 flags.go:64] FLAG: --pods-per-core="0"
Nov 04 05:27:54.481367 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474770    2575 flags.go:64] FLAG: --port="10250"
Nov 04 05:27:54.481367 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474773    2575 flags.go:64] FLAG: --protect-kernel-defaults="false"
Nov 04 05:27:54.481367 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474776    2575 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-07076f06eba7dd60c"
Nov 04 05:27:54.481367 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474780    2575 flags.go:64] FLAG: --qos-reserved=""
Nov 04 05:27:54.481367 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474783    2575 flags.go:64] FLAG: --read-only-port="10255"
Nov 04 05:27:54.481367 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474786    2575 flags.go:64] FLAG: --register-node="true"
Nov 04 05:27:54.481367 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474789    2575 flags.go:64] FLAG: --register-with-taints=""
Nov 04 05:27:54.481367 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474793    2575 flags.go:64] FLAG: --registry-burst="10"
Nov 04 05:27:54.481367 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474796    2575 flags.go:64] FLAG: --registry-qps="5"
Nov 04 05:27:54.481367 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474799    2575 flags.go:64] FLAG: --reserved-cpus=""
Nov 04 05:27:54.481367 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474802    2575 flags.go:64] FLAG: --reserved-memory=""
Nov 04 05:27:54.481995 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474807    2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Nov 04 05:27:54.481995 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474811    2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Nov 04 05:27:54.481995 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474814    2575 flags.go:64] FLAG: --rotate-certificates="false"
Nov 04 05:27:54.481995 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474817    2575 flags.go:64] FLAG: --rotate-server-certificates="false"
Nov 04 05:27:54.481995 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474820    2575 flags.go:64] FLAG: --runonce="false"
Nov 04 05:27:54.481995 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474823    2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Nov 04 05:27:54.481995 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474826    2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Nov 04 05:27:54.481995 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474829    2575 flags.go:64] FLAG: --seccomp-default="false"
Nov 04 05:27:54.481995 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474832    2575 flags.go:64] FLAG: --serialize-image-pulls="true"
Nov 04 05:27:54.481995 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474835    2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Nov 04 05:27:54.481995 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474838    2575 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Nov 04 05:27:54.481995 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474841    2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Nov 04 05:27:54.481995 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474844    2575 flags.go:64] FLAG: --storage-driver-password="root"
Nov 04 05:27:54.481995 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474847    2575 flags.go:64] FLAG: --storage-driver-secure="false"
Nov 04 05:27:54.481995 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474851    2575 flags.go:64] FLAG: --storage-driver-table="stats"
Nov 04 05:27:54.481995 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474855    2575 flags.go:64] FLAG: --storage-driver-user="root"
Nov 04 05:27:54.481995 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474858    2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Nov 04 05:27:54.481995 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474861    2575 flags.go:64] FLAG: --sync-frequency="1m0s"
Nov 04 05:27:54.481995 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474864    2575 flags.go:64] FLAG: --system-cgroups=""
Nov 04 05:27:54.481995 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474867    2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Nov 04 05:27:54.481995 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474873    2575 flags.go:64] FLAG: --system-reserved-cgroup=""
Nov 04 05:27:54.481995 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474875    2575 flags.go:64] FLAG: --tls-cert-file=""
Nov 04 05:27:54.481995 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474878    2575 flags.go:64] FLAG: --tls-cipher-suites="[]"
Nov 04 05:27:54.481995 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474882    2575 flags.go:64] FLAG: --tls-min-version=""
Nov 04 05:27:54.481995 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474885    2575 flags.go:64] FLAG: --tls-private-key-file=""
Nov 04 05:27:54.482648 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474888    2575 flags.go:64] FLAG: --topology-manager-policy="none"
Nov 04 05:27:54.482648 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474891    2575 flags.go:64] FLAG: --topology-manager-policy-options=""
Nov 04 05:27:54.482648 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474894    2575 flags.go:64] FLAG: --topology-manager-scope="container"
Nov 04 05:27:54.482648 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474897    2575 flags.go:64] FLAG: --v="2"
Nov 04 05:27:54.482648 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474902    2575 flags.go:64] FLAG: --version="false"
Nov 04 05:27:54.482648 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474906    2575 flags.go:64] FLAG: --vmodule=""
Nov 04 05:27:54.482648 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474910    2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Nov 04 05:27:54.482648 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.474915    2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Nov 04 05:27:54.482648 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475045    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:27:54.482648 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475049    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:27:54.482648 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475052    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:27:54.482648 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475056    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:27:54.482648 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475058    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:27:54.482648 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475061    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:27:54.482648 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475064    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:27:54.482648 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475067    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:27:54.482648 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475069    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:27:54.482648 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475072    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:27:54.482648 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475075    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:27:54.482648 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475077    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:27:54.482648 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475080    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:27:54.482648 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475082    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:27:54.483168 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475087    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:27:54.483168 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475090    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:27:54.483168 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475093    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:27:54.483168 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475096    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:27:54.483168 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475098    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:27:54.483168 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475101    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:27:54.483168 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475104    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:27:54.483168 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475106    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:27:54.483168 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475109    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:27:54.483168 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475111    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:27:54.483168 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475115    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:27:54.483168 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475119    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:27:54.483168 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475122    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:27:54.483168 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475125    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:27:54.483168 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475128    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:27:54.483168 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475130    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:27:54.483168 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475133    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:27:54.483168 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475137    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:27:54.483168 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475140    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:27:54.483634 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475142    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:27:54.483634 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475168    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:27:54.483634 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475184    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:27:54.483634 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475189    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:27:54.483634 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475192    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:27:54.483634 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475196    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:27:54.483634 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475199    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:27:54.483634 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475202    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:27:54.483634 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475206    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:27:54.483634 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475209    2575 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:27:54.483634 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475212    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:27:54.483634 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475215    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:27:54.483634 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475218    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:27:54.483634 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475221    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:27:54.483634 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475223    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:27:54.483634 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475226    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:27:54.483634 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475229    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:27:54.483634 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475232    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:27:54.483634 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475235    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:27:54.484080 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475239    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:27:54.484080 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475242    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:27:54.484080 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475244    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:27:54.484080 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475247    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:27:54.484080 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475250    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:27:54.484080 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475252    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:27:54.484080 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475255    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:27:54.484080 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475258    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:27:54.484080 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475261    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:27:54.484080 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475264    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:27:54.484080 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475268    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:27:54.484080 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475271    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:27:54.484080 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475274    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:27:54.484080 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475277    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:27:54.484080 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475280    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:27:54.484080 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475283    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:27:54.484080 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475286    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:27:54.484080 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475289    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:27:54.484080 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475291    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:27:54.484080 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475294    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:27:54.484570 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475297    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:27:54.484570 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475300    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:27:54.484570 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475303    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:27:54.484570 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475306    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:27:54.484570 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475308    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:27:54.484570 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475311    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:27:54.484570 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475314    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:27:54.484570 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475316    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:27:54.484570 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475321    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:27:54.484570 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475325    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:27:54.484570 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475329    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:27:54.484570 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475331    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:27:54.484570 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475334    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:27:54.484570 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475700    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:27:54.484570 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475704    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:27:54.484570 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475707    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:27:54.484570 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475709    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:27:54.484570 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475712    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:27:54.484570 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475715    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:27:54.485013 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475718    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:27:54.485013 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475720    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:27:54.485013 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475724    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:27:54.485013 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475727    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:27:54.485013 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475729    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:27:54.485013 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475732    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:27:54.485013 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475735    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:27:54.485013 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475738    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:27:54.485013 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475741    2575 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:27:54.485013 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475743    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:27:54.485013 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475746    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:27:54.485013 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475749    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:27:54.485013 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475751    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:27:54.485013 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475754    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:27:54.485013 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475757    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:27:54.485013 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.475797    2575 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 05:27:54.485395 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475842    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:27:54.485395 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475847    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:27:54.485395 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475850    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:27:54.485395 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475853    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:27:54.485395 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475856    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:27:54.485395 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475859    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:27:54.485395 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475861    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:27:54.485395 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475864    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:27:54.485395 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475867    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:27:54.485395 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475870    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:27:54.485395 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475873    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:27:54.485395 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475876    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:27:54.485395 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475879    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:27:54.485395 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475882    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:27:54.485395 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475884    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:27:54.485395 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475887    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:27:54.485395 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475890    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:27:54.485395 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475893    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:27:54.485395 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475895    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:27:54.485395 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475898    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:27:54.485916 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475901    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:27:54.485916 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475904    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:27:54.485916 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475907    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:27:54.485916 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475910    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:27:54.485916 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475913    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:27:54.485916 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475916    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:27:54.485916 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475918    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:27:54.485916 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475921    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:27:54.485916 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475925    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:27:54.485916 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475929    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:27:54.485916 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475932    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:27:54.485916 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475935    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:27:54.485916 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475937    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:27:54.485916 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475940    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:27:54.485916 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475943    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:27:54.485916 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475945    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:27:54.485916 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475948    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:27:54.485916 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475950    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:27:54.485916 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475953    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:27:54.486363 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475955    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:27:54.486363 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475958    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:27:54.486363 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475961    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:27:54.486363 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475963    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:27:54.486363 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475966    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:27:54.486363 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.475998    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:27:54.486363 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.476676    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:27:54.486363 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.476688    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:27:54.486363 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.476693    2575 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:27:54.486363 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.476697    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:27:54.486363 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.476702    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:27:54.486363 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.476707    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:27:54.486363 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.476712    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:27:54.486363 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.476717    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:27:54.486363 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.476722    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:27:54.486363 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.476727    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:27:54.486363 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.476732    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:27:54.486363 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.476736    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:27:54.486363 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.476742    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:27:54.486363 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.476752    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:27:54.486833 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.476756    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:27:54.486833 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.476760    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:27:54.486833 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.476765    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:27:54.486833 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.476769    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:27:54.486833 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.476774    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:27:54.486833 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.476778    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:27:54.486833 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.476783    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:27:54.486833 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.476787    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:27:54.486833 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.476792    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:27:54.486833 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.476796    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:27:54.486833 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.476800    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:27:54.486833 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.476809    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:27:54.486833 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.476816    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:27:54.486833 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.476820    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:27:54.486833 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.476825    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:27:54.486833 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.476829    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:27:54.486833 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.476833    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:27:54.486833 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.476837    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:27:54.486833 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.476851    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:27:54.486833 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.476858    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:27:54.487298 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.476907    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:27:54.487298 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.476916    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:27:54.487298 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.476921    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:27:54.487298 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.476926    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:27:54.487298 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.476932    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:27:54.487298 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.476936    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:27:54.487298 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.476940    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:27:54.487298 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.476945    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:27:54.487298 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.476949    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:27:54.487298 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.476959    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:27:54.487298 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.476962    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:27:54.487298 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.476986    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:27:54.487298 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.476989    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:27:54.487298 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.477005    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:27:54.487298 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.477008    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:27:54.487298 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.477011    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:27:54.487298 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.477121    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:27:54.487298 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.477124    2575 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:27:54.487298 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.477127    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:27:54.487783 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.477130    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:27:54.487783 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.477133    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:27:54.487783 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.477136    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:27:54.487783 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.477139    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:27:54.487783 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.477141    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:27:54.487783 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.477145    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:27:54.487783 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.477147    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:27:54.487783 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.477150    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:27:54.487783 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.483029    2575 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Nov 04 05:27:54.487783 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.483132    2575 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Nov 04 05:27:54.487783 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.483148    2575 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Nov 04 05:27:54.487783 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.483153    2575 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Nov 04 05:27:54.487783 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483206    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:27:54.487783 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483210    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:27:54.487783 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483213    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:27:54.487783 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483216    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:27:54.487783 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483219    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:27:54.487783 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483222    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:27:54.487783 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483225    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:27:54.488228 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483227    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:27:54.488228 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483230    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:27:54.488228 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483233    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:27:54.488228 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483235    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:27:54.488228 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483238    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:27:54.488228 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483241    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:27:54.488228 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483243    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:27:54.488228 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483246    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:27:54.488228 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483251    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:27:54.488228 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483255    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:27:54.488228 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483258    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:27:54.488228 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483261    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:27:54.488228 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483264    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:27:54.488228 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483267    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:27:54.488228 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483270    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:27:54.488228 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483272    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:27:54.488228 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483275    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:27:54.488228 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483277    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:27:54.488228 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483280    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:27:54.488228 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483283    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:27:54.488706 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483286    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:27:54.488706 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483288    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:27:54.488706 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483291    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:27:54.488706 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483294    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:27:54.488706 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483297    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:27:54.488706 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483300    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:27:54.488706 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483302    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:27:54.488706 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483305    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:27:54.488706 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483308    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:27:54.488706 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483311    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:27:54.488706 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483314    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:27:54.488706 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483317    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:27:54.488706 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483320    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:27:54.488706 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483322    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:27:54.488706 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483325    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:27:54.488706 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483328    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:27:54.488706 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483331    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:27:54.488706 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483333    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:27:54.488706 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483336    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:27:54.489170 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483339    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:27:54.489170 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483341    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:27:54.489170 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483344    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:27:54.489170 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483346    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:27:54.489170 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483349    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:27:54.489170 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483352    2575 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:27:54.489170 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483355    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:27:54.489170 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483358    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:27:54.489170 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483360    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:27:54.489170 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483363    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:27:54.489170 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483365    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:27:54.489170 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483368    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:27:54.489170 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483371    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:27:54.489170 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483374    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:27:54.489170 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483377    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:27:54.489170 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483379    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:27:54.489170 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483382    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:27:54.489170 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483385    2575 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:27:54.489170 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483388    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:27:54.489170 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483391    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:27:54.489650 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483394    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:27:54.489650 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483397    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:27:54.489650 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483399    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:27:54.489650 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483402    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:27:54.489650 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483405    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:27:54.489650 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483407    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:27:54.489650 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483411    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:27:54.489650 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483413    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:27:54.489650 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483416    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:27:54.489650 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483418    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:27:54.489650 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483421    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:27:54.489650 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483424    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:27:54.489650 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483427    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:27:54.489650 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483430    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:27:54.489650 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483432    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:27:54.489650 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483435    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:27:54.489650 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483438    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:27:54.489650 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483440    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:27:54.489650 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483443    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:27:54.490160 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483446    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:27:54.490160 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483449    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:27:54.490160 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483452    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:27:54.490160 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483454    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:27:54.490160 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483457    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:27:54.490160 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483460    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:27:54.490160 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483462    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:27:54.490160 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483466    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:27:54.490160 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483471    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:27:54.490160 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483474    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:27:54.490160 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483477    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:27:54.490160 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483480    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:27:54.490160 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483483    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:27:54.490160 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483487    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:27:54.490160 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483490    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:27:54.490160 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483493    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:27:54.490160 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483496    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:27:54.490160 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483498    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:27:54.490160 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483501    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:27:54.490642 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483504    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:27:54.490642 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483506    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:27:54.490642 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.483549    2575 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 05:27:54.490642 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483678    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:27:54.490642 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483683    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:27:54.490642 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483686    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:27:54.490642 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483689    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:27:54.490642 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483692    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:27:54.490642 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483695    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:27:54.490642 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483699    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:27:54.490642 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483704    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:27:54.490642 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483708    2575 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:27:54.490642 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483711    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:27:54.490642 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483714    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:27:54.490642 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483717    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:27:54.490995 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483720    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:27:54.490995 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483723    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:27:54.490995 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483725    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:27:54.490995 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483728    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:27:54.490995 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483731    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:27:54.490995 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483734    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:27:54.490995 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483736    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:27:54.490995 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483739    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:27:54.490995 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483742    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:27:54.490995 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483745    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:27:54.490995 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483748    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:27:54.490995 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483750    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:27:54.490995 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483753    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:27:54.490995 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483756    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:27:54.490995 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483758    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:27:54.490995 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483761    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:27:54.490995 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483764    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:27:54.490995 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483766    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:27:54.490995 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483769    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:27:54.490995 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483771    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:27:54.491531 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483774    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:27:54.491531 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483777    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:27:54.491531 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483779    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:27:54.491531 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483782    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:27:54.491531 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483784    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:27:54.491531 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483787    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:27:54.491531 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483789    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:27:54.491531 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483792    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:27:54.491531 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483795    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:27:54.491531 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483798    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:27:54.491531 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483801    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:27:54.491531 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483804    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:27:54.491531 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483806    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:27:54.491531 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483809    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:27:54.491531 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483811    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:27:54.491531 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483814    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:27:54.491531 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483816    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:27:54.491531 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483819    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:27:54.491531 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483821    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:27:54.491998 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483824    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:27:54.491998 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483827    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:27:54.491998 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483831    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:27:54.491998 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483835    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:27:54.491998 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483839    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:27:54.491998 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483842    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:27:54.491998 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483846    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:27:54.491998 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483848    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:27:54.491998 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483851    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:27:54.491998 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483854    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:27:54.491998 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483856    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:27:54.491998 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483859    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:27:54.491998 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483862    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:27:54.491998 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483864    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:27:54.491998 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483867    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:27:54.491998 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483869    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:27:54.491998 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483872    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:27:54.491998 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483875    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:27:54.491998 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483877    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:27:54.492566 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483880    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:27:54.492566 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483882    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:27:54.492566 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483885    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:27:54.492566 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483887    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:27:54.492566 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483891    2575 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:27:54.492566 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483894    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:27:54.492566 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483896    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:27:54.492566 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483899    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:27:54.492566 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483901    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:27:54.492566 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483904    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:27:54.492566 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483907    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:27:54.492566 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483909    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:27:54.492566 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483912    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:27:54.492566 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483915    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:27:54.492566 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483917    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:27:54.492566 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483920    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:27:54.492566 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483923    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:27:54.492566 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483925    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:27:54.492566 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483928    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:27:54.492566 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483931    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:27:54.493031 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483933    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:27:54.493031 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483936    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:27:54.493031 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483938    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:27:54.493031 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483941    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:27:54.493031 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483943    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:27:54.493031 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483946    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:27:54.493031 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483949    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:27:54.493031 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483951    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:27:54.493031 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483954    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:27:54.493031 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483956    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:27:54.493031 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483959    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:27:54.493031 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483961    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:27:54.493031 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483964    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:27:54.493031 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483966    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:27:54.493031 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483969    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:27:54.493031 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.483972    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:27:54.493402 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.483993    2575 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 05:27:54.493402 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484024    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:27:54.493402 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484028    2575 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:27:54.493402 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484031    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:27:54.493402 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484034    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:27:54.493402 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484037    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:27:54.493402 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484039    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:27:54.493402 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484042    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:27:54.493402 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484044    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:27:54.493402 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484047    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:27:54.493402 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484050    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:27:54.493402 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484052    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:27:54.493402 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484055    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:27:54.493402 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484057    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:27:54.493402 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484060    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:27:54.493402 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484063    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:27:54.493940 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484066    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:27:54.493940 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484068    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:27:54.493940 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484071    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:27:54.493940 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484074    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:27:54.493940 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484076    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:27:54.493940 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484082    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:27:54.493940 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484085    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:27:54.493940 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484087    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:27:54.493940 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484090    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:27:54.493940 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484093    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:27:54.493940 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484096    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:27:54.493940 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484098    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:27:54.493940 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484101    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:27:54.493940 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484103    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:27:54.493940 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484106    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:27:54.493940 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484109    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:27:54.493940 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484111    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:27:54.493940 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484114    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:27:54.493940 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484117    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:27:54.494431 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484120    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:27:54.494431 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484122    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:27:54.494431 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484125    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:27:54.494431 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484127    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:27:54.494431 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484130    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:27:54.494431 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484132    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:27:54.494431 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484135    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:27:54.494431 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484138    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:27:54.494431 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484140    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:27:54.494431 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484143    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:27:54.494431 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484146    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:27:54.494431 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484148    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:27:54.494431 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484152    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:27:54.494431 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484156    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:27:54.494431 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484159    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:27:54.494431 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484161    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:27:54.494431 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484164    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:27:54.494431 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484167    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:27:54.494431 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484170    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:27:54.495088 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484173    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:27:54.495088 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484176    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:27:54.495088 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484178    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:27:54.495088 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484181    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:27:54.495088 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484184    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:27:54.495088 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484186    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:27:54.495088 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484190    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:27:54.495088 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484192    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:27:54.495088 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484195    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:27:54.495088 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484198    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:27:54.495088 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484200    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:27:54.495088 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484203    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:27:54.495088 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484205    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:27:54.495088 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484209    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:27:54.495088 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484211    2575 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:27:54.495088 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484214    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:27:54.495088 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484217    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:27:54.495088 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484219    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:27:54.495088 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484222    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:27:54.495088 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484227    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:27:54.495629 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484229    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:27:54.495629 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484232    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:27:54.495629 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484235    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:27:54.495629 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484237    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:27:54.495629 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484240    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:27:54.495629 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484243    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:27:54.495629 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484245    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:27:54.495629 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484248    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:27:54.495629 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484251    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:27:54.495629 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484254    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:27:54.495629 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484256    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:27:54.495629 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484261    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:27:54.495629 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484263    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:27:54.495629 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484266    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:27:54.495629 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484269    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:27:54.495629 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484271    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:27:54.495629 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484274    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:27:54.495629 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484277    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:27:54.495629 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484279    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:27:54.495629 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484282    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:27:54.496099 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484285    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:27:54.496099 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484287    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:27:54.496099 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484290    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:27:54.496099 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484292    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:27:54.496099 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484295    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:27:54.496099 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484298    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:27:54.496099 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484301    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:27:54.496099 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484303    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:27:54.496099 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484306    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:27:54.496099 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484309    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:27:54.496099 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484311    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:27:54.496099 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484315    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:27:54.496099 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:54.484320    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:27:54.496099 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.484365    2575 server.go:957] "Client rotation is on, will bootstrap in background"
Nov 04 05:27:54.496099 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.486129    2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Nov 04 05:27:54.496099 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.486874    2575 server.go:1014] "Starting client certificate rotation"
Nov 04 05:27:54.496099 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.486970    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 04 05:27:54.496099 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.487000    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 04 05:27:54.496506 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.488935    2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 04 05:27:54.496506 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.490003    2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 04 05:27:54.502065 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.502047    2575 log.go:25] "Validated CRI v1 runtime API"
Nov 04 05:27:54.505845 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.505831    2575 log.go:25] "Validated CRI v1 image API"
Nov 04 05:27:54.506625 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.506601    2575 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Nov 04 05:27:54.509937 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.509919    2575 fs.go:135] Filesystem UUIDs: map[018d316d-ce84-4e15-baef-952a0b26637b:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c03728e6-6362-4a82-af6e-bf04c8d171f9:/dev/nvme0n1p3]
Nov 04 05:27:54.510008 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.509936    2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Nov 04 05:27:54.515597 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.515475    2575 manager.go:217] Machine: {Timestamp:2026-11-04 05:27:54.514327989 +0000 UTC m=+0.329651060 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3092628 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec232d82ed9a7e4d7327c1dfa3110cea SystemUUID:ec232d82-ed9a-7e4d-7327-c1dfa3110cea BootID:e86eadbd-3636-4921-83e6-4ae215b66d61 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:fe:01:6c:85 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:fe:01:6c:85 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4e:b7:e8:fa:5a:55 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Nov 04 05:27:54.515597 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.515587    2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Nov 04 05:27:54.515721 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.515678    2575 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Nov 04 05:27:54.516566 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.516551    2575 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Nov 04 05:27:54.518396 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.518370    2575 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Nov 04 05:27:54.518532 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.518400    2575 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-170.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Nov 04 05:27:54.519225 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.519215    2575 topology_manager.go:143] "Creating topology manager with none policy"
Nov 04 05:27:54.519255 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.519228    2575 container_manager_linux.go:311] "Creating device plugin manager"
Nov 04 05:27:54.519284 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.519254    2575 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 04 05:27:54.519284 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.519268    2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 04 05:27:54.519986 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.519977    2575 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Nov 04 05:27:54.523370 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.523359    2575 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Nov 04 05:27:54.523483 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.523474    2575 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Nov 04 05:27:54.523512 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.523504    2575 kubelet.go:493] "Attempting to sync node with API server"
Nov 04 05:27:54.523558 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.523529    2575 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Nov 04 05:27:54.523558 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.523547    2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Nov 04 05:27:54.523614 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.523559    2575 kubelet.go:405] "Adding apiserver pod source"
Nov 04 05:27:54.523614 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.523567    2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Nov 04 05:27:54.523866 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.523855    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 04 05:27:54.525928 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.525910    2575 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Nov 04 05:27:54.530766 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.530753    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 04 05:27:54.531419 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.531405    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dnxtn"
Nov 04 05:27:54.531662 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.531649    2575 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Nov 04 05:27:54.531704 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.531679    2575 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Nov 04 05:27:54.531834 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.531824    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Nov 04 05:27:54.531871 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.531839    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Nov 04 05:27:54.531871 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.531845    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Nov 04 05:27:54.531871 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.531850    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Nov 04 05:27:54.531871 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.531856    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Nov 04 05:27:54.531871 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.531861    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Nov 04 05:27:54.532481 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.532473    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Nov 04 05:27:54.532481 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.532481    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Nov 04 05:27:54.532556 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.532489    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Nov 04 05:27:54.532556 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.532495    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Nov 04 05:27:54.532556 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.532504    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Nov 04 05:27:54.532556 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.532512    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Nov 04 05:27:54.533198 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.533189    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Nov 04 05:27:54.533198 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.533198    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Nov 04 05:27:54.536327 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.536309    2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-170.us-east-2.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Nov 04 05:27:54.537204 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.537190    2575 server.go:1263] "Started kubelet"
Nov 04 05:27:54.537288 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.537268    2575 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Nov 04 05:27:54.537422 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.537384    2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Nov 04 05:27:54.537465 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.537439    2575 server_v1.go:49] "podresources" method="list" useActivePods=true
Nov 04 05:27:54.538496 ip-10-0-133-170 systemd[1]: Started Kubernetes Kubelet.
Nov 04 05:27:54.538632 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.538498    2575 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Nov 04 05:27:54.538683 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.538629    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dnxtn"
Nov 04 05:27:54.539866 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.539851    2575 server.go:317] "Adding debug handlers to kubelet server"
Nov 04 05:27:54.543885 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.543790    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Nov 04 05:27:54.544672 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.544650    2575 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Nov 04 05:27:54.545010 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:54.544962    2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-133-170.us-east-2.compute.internal\" not found"
Nov 04 05:27:54.545351 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.545334    2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Nov 04 05:27:54.545810 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:54.545759    2575 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Nov 04 05:27:54.545897 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.545832    2575 factory.go:55] Registering systemd factory
Nov 04 05:27:54.545897 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.545845    2575 factory.go:223] Registration of the systemd container factory successfully
Nov 04 05:27:54.546051 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.546036    2575 factory.go:153] Registering CRI-O factory
Nov 04 05:27:54.546112 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.546055    2575 factory.go:223] Registration of the crio container factory successfully
Nov 04 05:27:54.546112 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.546107    2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Nov 04 05:27:54.546219 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.546195    2575 volume_manager.go:309] "The desired_state_of_world populator starts"
Nov 04 05:27:54.546219 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.546217    2575 volume_manager.go:311] "Starting Kubelet Volume Manager"
Nov 04 05:27:54.546310 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.546306    2575 reconstruct.go:97] "Volume reconstruction finished"
Nov 04 05:27:54.546359 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.546311    2575 reconciler.go:29] "Reconciler: start to sync state"
Nov 04 05:27:54.546575 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.546552    2575 factory.go:103] Registering Raw factory
Nov 04 05:27:54.546575 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.546576    2575 manager.go:1199] Started watching for new ooms in manager
Nov 04 05:27:54.547391 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.547374    2575 manager.go:319] Starting recovery of all containers
Nov 04 05:27:54.549219 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.549199    2575 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 05:27:54.550344 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.550271    2575 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 05:27:54.551281 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.551264    2575 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 05:27:54.552282 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:54.552261    2575 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-133-170.us-east-2.compute.internal\" not found" node="ip-10-0-133-170.us-east-2.compute.internal"
Nov 04 05:27:54.560949 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.560934    2575 manager.go:324] Recovery completed
Nov 04 05:27:54.565171 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.565157    2575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 05:27:54.566835 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.566818    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-170.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 05:27:54.566915 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.566847    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-170.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 05:27:54.566915 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.566857    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-170.us-east-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 05:27:54.567382 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.567370    2575 cpu_manager.go:226] "Starting" policy="none"
Nov 04 05:27:54.567382 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.567376    2575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 05:27:54.567382 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.567380    2575 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Nov 04 05:27:54.567538 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.567396    2575 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Nov 04 05:27:54.568141 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.568125    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-170.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 05:27:54.568192 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.568157    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-170.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 05:27:54.568192 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.568173    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-170.us-east-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 05:27:54.569389 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.569378    2575 policy_none.go:50] "Start"
Nov 04 05:27:54.569425 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.569392    2575 memory_manager.go:187] "Starting memorymanager" policy="None"
Nov 04 05:27:54.569425 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.569402    2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Nov 04 05:27:54.571368 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.571357    2575 policy_none.go:44] "Start"
Nov 04 05:27:54.604082 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.604055    2575 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Nov 04 05:27:54.607785 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.607772    2575 manager.go:341] "Starting Device Plugin manager"
Nov 04 05:27:54.607879 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:54.607815    2575 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Nov 04 05:27:54.607879 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.607828    2575 server.go:87] "Starting device plugin registration server"
Nov 04 05:27:54.608063 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.608046    2575 eviction_manager.go:194] "Eviction manager: starting control loop"
Nov 04 05:27:54.608159 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.608064    2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Nov 04 05:27:54.608270 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.608174    2575 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Nov 04 05:27:54.608270 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.608247    2575 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Nov 04 05:27:54.608270 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.608256    2575 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Nov 04 05:27:54.608682 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:54.608664    2575 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Nov 04 05:27:54.608764 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:54.608702    2575 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-170.us-east-2.compute.internal\" not found"
Nov 04 05:27:54.709074 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.709050    2575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 05:27:54.711035 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.709906    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-170.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 05:27:54.711035 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.709928    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-170.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 05:27:54.711035 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.709940    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-170.us-east-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 05:27:54.711035 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.709963    2575 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-133-170.us-east-2.compute.internal"
Nov 04 05:27:54.718849 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.718785    2575 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-133-170.us-east-2.compute.internal"
Nov 04 05:27:54.718849 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:54.718804    2575 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-170.us-east-2.compute.internal\": node \"ip-10-0-133-170.us-east-2.compute.internal\" not found"
Nov 04 05:27:54.758136 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.758114    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Nov 04 05:27:54.759257 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.759237    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Nov 04 05:27:54.759257 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.759255    2575 status_manager.go:249] "Starting to sync pod status with apiserver"
Nov 04 05:27:54.759332 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.759271    2575 kubelet.go:2521] "Starting kubelet main sync loop"
Nov 04 05:27:54.759332 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:54.759301    2575 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Nov 04 05:27:54.765859 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.765845    2575 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 05:27:54.859670 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.859649    2575 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-170.us-east-2.compute.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-170.us-east-2.compute.internal"]
Nov 04 05:27:54.861894 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.861880    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-170.us-east-2.compute.internal"
Nov 04 05:27:54.863773 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.863754    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-170.us-east-2.compute.internal"
Nov 04 05:27:54.897045 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.897029    2575 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-170.us-east-2.compute.internal"
Nov 04 05:27:54.903207 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.903191    2575 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-170.us-east-2.compute.internal"
Nov 04 05:27:54.917790 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.917768    2575 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 05:27:54.917872 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.917797    2575 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 05:27:54.948732 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.948708    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/49c578da98535d8878f600c872b7f09a-config\") pod \"kube-apiserver-proxy-ip-10-0-133-170.us-east-2.compute.internal\" (UID: \"49c578da98535d8878f600c872b7f09a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-170.us-east-2.compute.internal"
Nov 04 05:27:54.948821 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.948738    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b29a0db634b87915a8146a0a3af4e909-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-170.us-east-2.compute.internal\" (UID: \"b29a0db634b87915a8146a0a3af4e909\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-170.us-east-2.compute.internal"
Nov 04 05:27:54.948821 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:54.948755    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b29a0db634b87915a8146a0a3af4e909-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-170.us-east-2.compute.internal\" (UID: \"b29a0db634b87915a8146a0a3af4e909\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-170.us-east-2.compute.internal"
Nov 04 05:27:55.049246 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.049192    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/49c578da98535d8878f600c872b7f09a-config\") pod \"kube-apiserver-proxy-ip-10-0-133-170.us-east-2.compute.internal\" (UID: \"49c578da98535d8878f600c872b7f09a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-170.us-east-2.compute.internal"
Nov 04 05:27:55.049246 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.049216    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b29a0db634b87915a8146a0a3af4e909-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-170.us-east-2.compute.internal\" (UID: \"b29a0db634b87915a8146a0a3af4e909\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-170.us-east-2.compute.internal"
Nov 04 05:27:55.049246 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.049234    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b29a0db634b87915a8146a0a3af4e909-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-170.us-east-2.compute.internal\" (UID: \"b29a0db634b87915a8146a0a3af4e909\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-170.us-east-2.compute.internal"
Nov 04 05:27:55.049399 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.049288    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b29a0db634b87915a8146a0a3af4e909-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-170.us-east-2.compute.internal\" (UID: \"b29a0db634b87915a8146a0a3af4e909\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-170.us-east-2.compute.internal"
Nov 04 05:27:55.049399 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.049292    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/49c578da98535d8878f600c872b7f09a-config\") pod \"kube-apiserver-proxy-ip-10-0-133-170.us-east-2.compute.internal\" (UID: \"49c578da98535d8878f600c872b7f09a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-170.us-east-2.compute.internal"
Nov 04 05:27:55.049399 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.049294    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b29a0db634b87915a8146a0a3af4e909-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-170.us-east-2.compute.internal\" (UID: \"b29a0db634b87915a8146a0a3af4e909\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-170.us-east-2.compute.internal"
Nov 04 05:27:55.220895 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.220874    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-170.us-east-2.compute.internal"
Nov 04 05:27:55.223874 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.223857    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-170.us-east-2.compute.internal"
Nov 04 05:27:55.487262 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.487212    2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Nov 04 05:27:55.487655 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.487366    2575 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Nov 04 05:27:55.487655 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.487372    2575 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Nov 04 05:27:55.487655 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.487394    2575 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Nov 04 05:27:55.524159 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.524139    2575 apiserver.go:52] "Watching apiserver"
Nov 04 05:27:55.532801 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.532785    2575 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Nov 04 05:27:55.533038 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.533023    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-x5jbk","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw","openshift-multus/network-metrics-daemon-khrhn","openshift-network-operator/iptables-alerter-cxr2h","openshift-ovn-kubernetes/ovnkube-node-2dlb7","kube-system/global-pull-secret-syncer-8fwjr","kube-system/konnectivity-agent-bwn4l","openshift-image-registry/node-ca-s2tjx","openshift-multus/multus-5gwpr","openshift-network-diagnostics/network-check-target-k54vt","openshift-cluster-node-tuning-operator/tuned-9tmdx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-170.us-east-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-170.us-east-2.compute.internal","openshift-dns/node-resolver-x7zft"]
Nov 04 05:27:55.535381 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.535367    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-x5jbk"
Nov 04 05:27:55.537432 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.537413    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw"
Nov 04 05:27:55.539482 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.539467    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khrhn"
Nov 04 05:27:55.539580 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:55.539556    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khrhn" podUID="2a7a7beb-0136-46a3-84f6-e00b34c4a4a9"
Nov 04 05:27:55.539637 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.539610    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Nov 04 05:27:55.539637 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.539618    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Nov 04 05:27:55.539704 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.539638    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Nov 04 05:27:55.540624 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.540606    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Nov 04 05:27:55.540624 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.540609    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rpj2j\""
Nov 04 05:27:55.540756 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.540665    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Nov 04 05:27:55.540756 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.540677    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Nov 04 05:27:55.540756 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.540696    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Nov 04 05:27:55.540756 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.540729    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Nov 04 05:27:55.540871 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.540831    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-m8rqh\""
Nov 04 05:27:55.541685 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.541670    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cxr2h"
Nov 04 05:27:55.543859 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.543844    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.543946 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.543894    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Nov 04 05:27:55.545286 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.545249    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-03 05:22:54 +0000 UTC" deadline="2028-07-26 01:41:23.138892524 +0000 UTC"
Nov 04 05:27:55.545286 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.545284    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15116h13m27.593610608s"
Nov 04 05:27:55.546145 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.546131    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8fwjr"
Nov 04 05:27:55.546222 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:55.546194    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8fwjr" podUID="b9aa45f3-1a47-489d-ba9d-76cbe630b283"
Nov 04 05:27:55.548253 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.548240    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bwn4l"
Nov 04 05:27:55.550563 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.550544    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s2tjx"
Nov 04 05:27:55.552174 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.552155    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4vgq\" (UniqueName: \"kubernetes.io/projected/1658b916-200e-432c-9ca8-a7814f38e485-kube-api-access-z4vgq\") pod \"multus-additional-cni-plugins-x5jbk\" (UID: \"1658b916-200e-432c-9ca8-a7814f38e485\") " pod="openshift-multus/multus-additional-cni-plugins-x5jbk"
Nov 04 05:27:55.552243 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.552179    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-etc-openvswitch\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.552243 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.552196    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d0adbb13-2521-4805-b5ba-86b9052b6123-device-dir\") pod \"aws-ebs-csi-driver-node-t8sjw\" (UID: \"d0adbb13-2521-4805-b5ba-86b9052b6123\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw"
Nov 04 05:27:55.552243 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.552212    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1658b916-200e-432c-9ca8-a7814f38e485-system-cni-dir\") pod \"multus-additional-cni-plugins-x5jbk\" (UID: \"1658b916-200e-432c-9ca8-a7814f38e485\") " pod="openshift-multus/multus-additional-cni-plugins-x5jbk"
Nov 04 05:27:55.552243 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.552231    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d0adbb13-2521-4805-b5ba-86b9052b6123-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t8sjw\" (UID: \"d0adbb13-2521-4805-b5ba-86b9052b6123\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw"
Nov 04 05:27:55.552416 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.552264    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d0adbb13-2521-4805-b5ba-86b9052b6123-etc-selinux\") pod \"aws-ebs-csi-driver-node-t8sjw\" (UID: \"d0adbb13-2521-4805-b5ba-86b9052b6123\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw"
Nov 04 05:27:55.552416 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.552299    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a7a7beb-0136-46a3-84f6-e00b34c4a4a9-metrics-certs\") pod \"network-metrics-daemon-khrhn\" (UID: \"2a7a7beb-0136-46a3-84f6-e00b34c4a4a9\") " pod="openshift-multus/network-metrics-daemon-khrhn"
Nov 04 05:27:55.552416 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.552320    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t88mv\" (UniqueName: \"kubernetes.io/projected/2a7a7beb-0136-46a3-84f6-e00b34c4a4a9-kube-api-access-t88mv\") pod \"network-metrics-daemon-khrhn\" (UID: \"2a7a7beb-0136-46a3-84f6-e00b34c4a4a9\") " pod="openshift-multus/network-metrics-daemon-khrhn"
Nov 04 05:27:55.552416 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.552337    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-host-kubelet\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.552416 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.552376    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-host-run-netns\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.552676 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.552417    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-var-lib-openvswitch\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.552676 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.552449    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-run-ovn\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.552676 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.552479    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-log-socket\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.552676 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.552498    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.552676 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.552541    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx72x\" (UniqueName: \"kubernetes.io/projected/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-kube-api-access-qx72x\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.552676 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.552578    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1658b916-200e-432c-9ca8-a7814f38e485-cnibin\") pod \"multus-additional-cni-plugins-x5jbk\" (UID: \"1658b916-200e-432c-9ca8-a7814f38e485\") " pod="openshift-multus/multus-additional-cni-plugins-x5jbk"
Nov 04 05:27:55.552676 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.552598    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1658b916-200e-432c-9ca8-a7814f38e485-cni-binary-copy\") pod \"multus-additional-cni-plugins-x5jbk\" (UID: \"1658b916-200e-432c-9ca8-a7814f38e485\") " pod="openshift-multus/multus-additional-cni-plugins-x5jbk"
Nov 04 05:27:55.552676 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.552623    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jqnp\" (UniqueName: \"kubernetes.io/projected/16031827-bc25-4ecd-b902-0161403f7566-kube-api-access-8jqnp\") pod \"iptables-alerter-cxr2h\" (UID: \"16031827-bc25-4ecd-b902-0161403f7566\") " pod="openshift-network-operator/iptables-alerter-cxr2h"
Nov 04 05:27:55.552676 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.552659    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-run-systemd\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.553077 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.552687    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-host-run-ovn-kubernetes\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.553077 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.552713    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b9aa45f3-1a47-489d-ba9d-76cbe630b283-original-pull-secret\") pod \"global-pull-secret-syncer-8fwjr\" (UID: \"b9aa45f3-1a47-489d-ba9d-76cbe630b283\") " pod="kube-system/global-pull-secret-syncer-8fwjr"
Nov 04 05:27:55.553077 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.552736    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1658b916-200e-432c-9ca8-a7814f38e485-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x5jbk\" (UID: \"1658b916-200e-432c-9ca8-a7814f38e485\") " pod="openshift-multus/multus-additional-cni-plugins-x5jbk"
Nov 04 05:27:55.553077 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.552770    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1658b916-200e-432c-9ca8-a7814f38e485-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x5jbk\" (UID: \"1658b916-200e-432c-9ca8-a7814f38e485\") " pod="openshift-multus/multus-additional-cni-plugins-x5jbk"
Nov 04 05:27:55.553077 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.552799    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1658b916-200e-432c-9ca8-a7814f38e485-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x5jbk\" (UID: \"1658b916-200e-432c-9ca8-a7814f38e485\") " pod="openshift-multus/multus-additional-cni-plugins-x5jbk"
Nov 04 05:27:55.553077 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.552837    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d0adbb13-2521-4805-b5ba-86b9052b6123-sys-fs\") pod \"aws-ebs-csi-driver-node-t8sjw\" (UID: \"d0adbb13-2521-4805-b5ba-86b9052b6123\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw"
Nov 04 05:27:55.553077 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.552850    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.553077 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.552862    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/16031827-bc25-4ecd-b902-0161403f7566-iptables-alerter-script\") pod \"iptables-alerter-cxr2h\" (UID: \"16031827-bc25-4ecd-b902-0161403f7566\") " pod="openshift-network-operator/iptables-alerter-cxr2h"
Nov 04 05:27:55.553077 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.552904    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-run-openvswitch\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.553077 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.552928    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-node-log\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.553077 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.552964    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-ovn-node-metrics-cert\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.553077 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.552998    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d0adbb13-2521-4805-b5ba-86b9052b6123-socket-dir\") pod \"aws-ebs-csi-driver-node-t8sjw\" (UID: \"d0adbb13-2521-4805-b5ba-86b9052b6123\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw"
Nov 04 05:27:55.553077 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.553039    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx7g8\" (UniqueName: \"kubernetes.io/projected/d0adbb13-2521-4805-b5ba-86b9052b6123-kube-api-access-bx7g8\") pod \"aws-ebs-csi-driver-node-t8sjw\" (UID: \"d0adbb13-2521-4805-b5ba-86b9052b6123\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw"
Nov 04 05:27:55.553077 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.553071    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/16031827-bc25-4ecd-b902-0161403f7566-host-slash\") pod \"iptables-alerter-cxr2h\" (UID: \"16031827-bc25-4ecd-b902-0161403f7566\") " pod="openshift-network-operator/iptables-alerter-cxr2h"
Nov 04 05:27:55.553600 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.553094    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-systemd-units\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.553600 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.553123    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-host-cni-bin\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.553600 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.553140    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-host-cni-netd\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.553600 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.553166    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-env-overrides\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.553600 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.553199    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d0adbb13-2521-4805-b5ba-86b9052b6123-registration-dir\") pod \"aws-ebs-csi-driver-node-t8sjw\" (UID: \"d0adbb13-2521-4805-b5ba-86b9052b6123\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw"
Nov 04 05:27:55.553600 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.553225    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-host-slash\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.553600 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.553267    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-ovnkube-config\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.553600 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.553292    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b9aa45f3-1a47-489d-ba9d-76cbe630b283-dbus\") pod \"global-pull-secret-syncer-8fwjr\" (UID: \"b9aa45f3-1a47-489d-ba9d-76cbe630b283\") " pod="kube-system/global-pull-secret-syncer-8fwjr"
Nov 04 05:27:55.553600 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.553337    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-ovnkube-script-lib\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.553600 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.553365    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b9aa45f3-1a47-489d-ba9d-76cbe630b283-kubelet-config\") pod \"global-pull-secret-syncer-8fwjr\" (UID: \"b9aa45f3-1a47-489d-ba9d-76cbe630b283\") " pod="kube-system/global-pull-secret-syncer-8fwjr"
Nov 04 05:27:55.554869 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.554857    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k54vt"
Nov 04 05:27:55.554918 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:55.554901    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k54vt" podUID="8a855aab-8901-4d7d-8f10-91a8896d4b71"
Nov 04 05:27:55.557067 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.557052    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:27:55.559166 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.559152    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x7zft"
Nov 04 05:27:55.577188 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.577156    2575 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Nov 04 05:27:55.577255 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.577209    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-crmpf"
Nov 04 05:27:55.581826 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.581811    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-crmpf"
Nov 04 05:27:55.639943 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.639925    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Nov 04 05:27:55.640317 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.640303    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Nov 04 05:27:55.640361 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.640341    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Nov 04 05:27:55.640402 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.640389    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Nov 04 05:27:55.641028 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.641014    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Nov 04 05:27:55.641141 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.641127    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Nov 04 05:27:55.641189 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.641154    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Nov 04 05:27:55.641189 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.641172    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Nov 04 05:27:55.641283 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.641202    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Nov 04 05:27:55.641283 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.641211    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Nov 04 05:27:55.641283 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.641218    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Nov 04 05:27:55.641283 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.641213    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Nov 04 05:27:55.641283 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.641240    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Nov 04 05:27:55.642606 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.642580    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Nov 04 05:27:55.642606 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.642588    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Nov 04 05:27:55.642764 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.642610    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Nov 04 05:27:55.642764 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.642634    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Nov 04 05:27:55.642764 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.642743    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-chnwp\""
Nov 04 05:27:55.643937 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.643922    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Nov 04 05:27:55.643937 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.643930    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Nov 04 05:27:55.644046 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.643965    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fwwlp\""
Nov 04 05:27:55.644100 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.644088    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7x6ks\""
Nov 04 05:27:55.644147 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.644125    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-67qcf\""
Nov 04 05:27:55.644190 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.644148    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xrb2c\""
Nov 04 05:27:55.644190 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.644181    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-4fjpb\""
Nov 04 05:27:55.644260 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.644221    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qlwsz\""
Nov 04 05:27:55.646681 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.646665    2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Nov 04 05:27:55.653553 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.653525    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d0adbb13-2521-4805-b5ba-86b9052b6123-device-dir\") pod \"aws-ebs-csi-driver-node-t8sjw\" (UID: \"d0adbb13-2521-4805-b5ba-86b9052b6123\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw"
Nov 04 05:27:55.653652 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.653560    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d0adbb13-2521-4805-b5ba-86b9052b6123-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t8sjw\" (UID: \"d0adbb13-2521-4805-b5ba-86b9052b6123\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw"
Nov 04 05:27:55.653652 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.653578    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-host-kubelet\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.653652 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.653622    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5510018c-1e4d-4009-bc56-2152f7703f7a-tmp-dir\") pod \"node-resolver-x7zft\" (UID: \"5510018c-1e4d-4009-bc56-2152f7703f7a\") " pod="openshift-dns/node-resolver-x7zft"
Nov 04 05:27:55.653652 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.653635    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-host-kubelet\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.653652 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.653637    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d0adbb13-2521-4805-b5ba-86b9052b6123-device-dir\") pod \"aws-ebs-csi-driver-node-t8sjw\" (UID: \"d0adbb13-2521-4805-b5ba-86b9052b6123\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw"
Nov 04 05:27:55.653652 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.653649    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-etc-kubernetes\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:27:55.653896 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.653650    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d0adbb13-2521-4805-b5ba-86b9052b6123-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t8sjw\" (UID: \"d0adbb13-2521-4805-b5ba-86b9052b6123\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw"
Nov 04 05:27:55.653896 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.653705    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-etc-sysctl-conf\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:27:55.653896 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.653738    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/88680c4d-b306-483c-a5a7-3d559e078c01-etc-tuned\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:27:55.653896 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.653768    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-var-lib-openvswitch\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.653896 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.653793    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx72x\" (UniqueName: \"kubernetes.io/projected/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-kube-api-access-qx72x\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.653896 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.653862    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-host-run-multus-certs\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.654175 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.653886    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-sys\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:27:55.654175 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.653884    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-var-lib-openvswitch\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.654175 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.653940    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-cnibin\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.654175 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.653993    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1658b916-200e-432c-9ca8-a7814f38e485-cnibin\") pod \"multus-additional-cni-plugins-x5jbk\" (UID: \"1658b916-200e-432c-9ca8-a7814f38e485\") " pod="openshift-multus/multus-additional-cni-plugins-x5jbk"
Nov 04 05:27:55.654175 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.654023    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1658b916-200e-432c-9ca8-a7814f38e485-cni-binary-copy\") pod \"multus-additional-cni-plugins-x5jbk\" (UID: \"1658b916-200e-432c-9ca8-a7814f38e485\") " pod="openshift-multus/multus-additional-cni-plugins-x5jbk"
Nov 04 05:27:55.654175 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.654067    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jqnp\" (UniqueName: \"kubernetes.io/projected/16031827-bc25-4ecd-b902-0161403f7566-kube-api-access-8jqnp\") pod \"iptables-alerter-cxr2h\" (UID: \"16031827-bc25-4ecd-b902-0161403f7566\") " pod="openshift-network-operator/iptables-alerter-cxr2h"
Nov 04 05:27:55.654175 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.654088    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1658b916-200e-432c-9ca8-a7814f38e485-cnibin\") pod \"multus-additional-cni-plugins-x5jbk\" (UID: \"1658b916-200e-432c-9ca8-a7814f38e485\") " pod="openshift-multus/multus-additional-cni-plugins-x5jbk"
Nov 04 05:27:55.654175 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.654137    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-host-run-ovn-kubernetes\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.654604 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.654190    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b9aa45f3-1a47-489d-ba9d-76cbe630b283-original-pull-secret\") pod \"global-pull-secret-syncer-8fwjr\" (UID: \"b9aa45f3-1a47-489d-ba9d-76cbe630b283\") " pod="kube-system/global-pull-secret-syncer-8fwjr"
Nov 04 05:27:55.654604 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.654223    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2hgd\" (UniqueName: \"kubernetes.io/projected/02758cc7-baf6-44d1-baa6-87438b8376a2-kube-api-access-n2hgd\") pod \"node-ca-s2tjx\" (UID: \"02758cc7-baf6-44d1-baa6-87438b8376a2\") " pod="openshift-image-registry/node-ca-s2tjx"
Nov 04 05:27:55.654604 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.654257    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/16031827-bc25-4ecd-b902-0161403f7566-iptables-alerter-script\") pod \"iptables-alerter-cxr2h\" (UID: \"16031827-bc25-4ecd-b902-0161403f7566\") " pod="openshift-network-operator/iptables-alerter-cxr2h"
Nov 04 05:27:55.654604 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.654191    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-host-run-ovn-kubernetes\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.654604 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.654293    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-run-openvswitch\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.654604 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:55.654333    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 05:27:55.654604 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.654336    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-ovnkube-script-lib\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.654604 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.654376    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-hostroot\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.654604 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:55.654394    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9aa45f3-1a47-489d-ba9d-76cbe630b283-original-pull-secret podName:b9aa45f3-1a47-489d-ba9d-76cbe630b283 nodeName:}" failed. No retries permitted until 2026-11-04 05:27:56.154379762 +0000 UTC m=+1.969702827 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b9aa45f3-1a47-489d-ba9d-76cbe630b283-original-pull-secret") pod "global-pull-secret-syncer-8fwjr" (UID: "b9aa45f3-1a47-489d-ba9d-76cbe630b283") : object "kube-system"/"original-pull-secret" not registered
Nov 04 05:27:55.654604 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.654421    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-multus-conf-dir\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.654604 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.654545    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-run-openvswitch\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.655273 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.654612    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1658b916-200e-432c-9ca8-a7814f38e485-cni-binary-copy\") pod \"multus-additional-cni-plugins-x5jbk\" (UID: \"1658b916-200e-432c-9ca8-a7814f38e485\") " pod="openshift-multus/multus-additional-cni-plugins-x5jbk"
Nov 04 05:27:55.655273 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.654602    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-multus-daemon-config\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.655273 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.654656    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-etc-sysconfig\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:27:55.655273 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.654704    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx7g8\" (UniqueName: \"kubernetes.io/projected/d0adbb13-2521-4805-b5ba-86b9052b6123-kube-api-access-bx7g8\") pod \"aws-ebs-csi-driver-node-t8sjw\" (UID: \"d0adbb13-2521-4805-b5ba-86b9052b6123\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw"
Nov 04 05:27:55.655273 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.654727    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/16031827-bc25-4ecd-b902-0161403f7566-host-slash\") pod \"iptables-alerter-cxr2h\" (UID: \"16031827-bc25-4ecd-b902-0161403f7566\") " pod="openshift-network-operator/iptables-alerter-cxr2h"
Nov 04 05:27:55.655273 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.654757    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-host-cni-netd\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.655273 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.654779    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-env-overrides\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.655273 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.654797    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-etc-systemd\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:27:55.655273 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.654812    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-lib-modules\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:27:55.655273 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.654884    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m8jk\" (UniqueName: \"kubernetes.io/projected/8a855aab-8901-4d7d-8f10-91a8896d4b71-kube-api-access-5m8jk\") pod \"network-check-target-k54vt\" (UID: \"8a855aab-8901-4d7d-8f10-91a8896d4b71\") " pod="openshift-network-diagnostics/network-check-target-k54vt"
Nov 04 05:27:55.655273 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.654911    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4vgq\" (UniqueName: \"kubernetes.io/projected/1658b916-200e-432c-9ca8-a7814f38e485-kube-api-access-z4vgq\") pod \"multus-additional-cni-plugins-x5jbk\" (UID: \"1658b916-200e-432c-9ca8-a7814f38e485\") " pod="openshift-multus/multus-additional-cni-plugins-x5jbk"
Nov 04 05:27:55.655273 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.654926    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-etc-openvswitch\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.655273 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.654947    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-host-var-lib-cni-multus\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.655273 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.654963    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1658b916-200e-432c-9ca8-a7814f38e485-system-cni-dir\") pod \"multus-additional-cni-plugins-x5jbk\" (UID: \"1658b916-200e-432c-9ca8-a7814f38e485\") " pod="openshift-multus/multus-additional-cni-plugins-x5jbk"
Nov 04 05:27:55.655273 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.654987    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d0adbb13-2521-4805-b5ba-86b9052b6123-etc-selinux\") pod \"aws-ebs-csi-driver-node-t8sjw\" (UID: \"d0adbb13-2521-4805-b5ba-86b9052b6123\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw"
Nov 04 05:27:55.655273 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.655024    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/16031827-bc25-4ecd-b902-0161403f7566-iptables-alerter-script\") pod \"iptables-alerter-cxr2h\" (UID: \"16031827-bc25-4ecd-b902-0161403f7566\") " pod="openshift-network-operator/iptables-alerter-cxr2h"
Nov 04 05:27:55.655913 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.655086    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-ovnkube-script-lib\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.655913 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:55.655115    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 05:27:55.655913 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.655010    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a7a7beb-0136-46a3-84f6-e00b34c4a4a9-metrics-certs\") pod \"network-metrics-daemon-khrhn\" (UID: \"2a7a7beb-0136-46a3-84f6-e00b34c4a4a9\") " pod="openshift-multus/network-metrics-daemon-khrhn"
Nov 04 05:27:55.655913 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.655175    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t88mv\" (UniqueName: \"kubernetes.io/projected/2a7a7beb-0136-46a3-84f6-e00b34c4a4a9-kube-api-access-t88mv\") pod \"network-metrics-daemon-khrhn\" (UID: \"2a7a7beb-0136-46a3-84f6-e00b34c4a4a9\") " pod="openshift-multus/network-metrics-daemon-khrhn"
Nov 04 05:27:55.655913 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.655235    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1658b916-200e-432c-9ca8-a7814f38e485-system-cni-dir\") pod \"multus-additional-cni-plugins-x5jbk\" (UID: \"1658b916-200e-432c-9ca8-a7814f38e485\") " pod="openshift-multus/multus-additional-cni-plugins-x5jbk"
Nov 04 05:27:55.655913 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:55.655250    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a7a7beb-0136-46a3-84f6-e00b34c4a4a9-metrics-certs podName:2a7a7beb-0136-46a3-84f6-e00b34c4a4a9 nodeName:}" failed. No retries permitted until 2026-11-04 05:27:56.155235253 +0000 UTC m=+1.970558318 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a7a7beb-0136-46a3-84f6-e00b34c4a4a9-metrics-certs") pod "network-metrics-daemon-khrhn" (UID: "2a7a7beb-0136-46a3-84f6-e00b34c4a4a9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 05:27:55.655913 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.655293    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/16031827-bc25-4ecd-b902-0161403f7566-host-slash\") pod \"iptables-alerter-cxr2h\" (UID: \"16031827-bc25-4ecd-b902-0161403f7566\") " pod="openshift-network-operator/iptables-alerter-cxr2h"
Nov 04 05:27:55.655913 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.655332    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-host-cni-netd\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.655913 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.655382    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-etc-openvswitch\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.655913 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.655473    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-host-run-netns\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.655913 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.655501    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-run-ovn\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.655913 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.655537    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-log-socket\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.655913 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.655591    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d0adbb13-2521-4805-b5ba-86b9052b6123-etc-selinux\") pod \"aws-ebs-csi-driver-node-t8sjw\" (UID: \"d0adbb13-2521-4805-b5ba-86b9052b6123\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw"
Nov 04 05:27:55.655913 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.655594    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-host-run-netns\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.655913 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.655633    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-log-socket\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.655913 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.655647    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-run-ovn\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.655913 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.655717    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.656459 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.655740    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-env-overrides\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.656459 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.655569    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.656459 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.656007    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/abfc6e5f-914e-4a19-8fd3-c8a844377da3-konnectivity-ca\") pod \"konnectivity-agent-bwn4l\" (UID: \"abfc6e5f-914e-4a19-8fd3-c8a844377da3\") " pod="kube-system/konnectivity-agent-bwn4l"
Nov 04 05:27:55.656459 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.656027    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-multus-cni-dir\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.656459 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.656046    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-multus-socket-dir-parent\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.656459 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.656073    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-etc-kubernetes\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.656459 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.656097    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-etc-sysctl-d\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:27:55.656459 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.656143    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-run-systemd\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.656459 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.656204    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/abfc6e5f-914e-4a19-8fd3-c8a844377da3-agent-certs\") pod \"konnectivity-agent-bwn4l\" (UID: \"abfc6e5f-914e-4a19-8fd3-c8a844377da3\") " pod="kube-system/konnectivity-agent-bwn4l"
Nov 04 05:27:55.656459 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.656208    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-run-systemd\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.656459 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.656252    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-system-cni-dir\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.656459 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.656279    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-host-var-lib-kubelet\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.656459 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.656327    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55vhs\" (UniqueName: \"kubernetes.io/projected/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-kube-api-access-55vhs\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.656459 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.656371    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1658b916-200e-432c-9ca8-a7814f38e485-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x5jbk\" (UID: \"1658b916-200e-432c-9ca8-a7814f38e485\") " pod="openshift-multus/multus-additional-cni-plugins-x5jbk"
Nov 04 05:27:55.656459 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.656439    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1658b916-200e-432c-9ca8-a7814f38e485-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x5jbk\" (UID: \"1658b916-200e-432c-9ca8-a7814f38e485\") " pod="openshift-multus/multus-additional-cni-plugins-x5jbk"
Nov 04 05:27:55.657119 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.656465    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1658b916-200e-432c-9ca8-a7814f38e485-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x5jbk\" (UID: \"1658b916-200e-432c-9ca8-a7814f38e485\") " pod="openshift-multus/multus-additional-cni-plugins-x5jbk"
Nov 04 05:27:55.657119 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.656490    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d0adbb13-2521-4805-b5ba-86b9052b6123-sys-fs\") pod \"aws-ebs-csi-driver-node-t8sjw\" (UID: \"d0adbb13-2521-4805-b5ba-86b9052b6123\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw"
Nov 04 05:27:55.657119 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.656514    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1658b916-200e-432c-9ca8-a7814f38e485-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x5jbk\" (UID: \"1658b916-200e-432c-9ca8-a7814f38e485\") " pod="openshift-multus/multus-additional-cni-plugins-x5jbk"
Nov 04 05:27:55.657119 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.656512    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-node-log\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.657119 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.656576    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d0adbb13-2521-4805-b5ba-86b9052b6123-sys-fs\") pod \"aws-ebs-csi-driver-node-t8sjw\" (UID: \"d0adbb13-2521-4805-b5ba-86b9052b6123\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw"
Nov 04 05:27:55.657119 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.656581    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-ovn-node-metrics-cert\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.657119 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.656606    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b9aa45f3-1a47-489d-ba9d-76cbe630b283-kubelet-config\") pod \"global-pull-secret-syncer-8fwjr\" (UID: \"b9aa45f3-1a47-489d-ba9d-76cbe630b283\") " pod="kube-system/global-pull-secret-syncer-8fwjr"
Nov 04 05:27:55.657119 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.656632    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-node-log\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.657119 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.656634    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-host-var-lib-cni-bin\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.657119 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.656680    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d0adbb13-2521-4805-b5ba-86b9052b6123-socket-dir\") pod \"aws-ebs-csi-driver-node-t8sjw\" (UID: \"d0adbb13-2521-4805-b5ba-86b9052b6123\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw"
Nov 04 05:27:55.657119 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.656686    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b9aa45f3-1a47-489d-ba9d-76cbe630b283-kubelet-config\") pod \"global-pull-secret-syncer-8fwjr\" (UID: \"b9aa45f3-1a47-489d-ba9d-76cbe630b283\") " pod="kube-system/global-pull-secret-syncer-8fwjr"
Nov 04 05:27:55.657119 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.656746    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-systemd-units\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.657119 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.656792    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d0adbb13-2521-4805-b5ba-86b9052b6123-socket-dir\") pod \"aws-ebs-csi-driver-node-t8sjw\" (UID: \"d0adbb13-2521-4805-b5ba-86b9052b6123\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw"
Nov 04 05:27:55.657119 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.656840    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-host-cni-bin\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.657119 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.656840    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-systemd-units\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.657119 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.656893    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/02758cc7-baf6-44d1-baa6-87438b8376a2-host\") pod \"node-ca-s2tjx\" (UID: \"02758cc7-baf6-44d1-baa6-87438b8376a2\") " pod="openshift-image-registry/node-ca-s2tjx"
Nov 04 05:27:55.657119 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.656936    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-host-cni-bin\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.657860 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.656991    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/02758cc7-baf6-44d1-baa6-87438b8376a2-serviceca\") pod \"node-ca-s2tjx\" (UID: \"02758cc7-baf6-44d1-baa6-87438b8376a2\") " pod="openshift-image-registry/node-ca-s2tjx"
Nov 04 05:27:55.657860 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.657034    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-cni-binary-copy\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.657860 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.657069    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-etc-modprobe-d\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:27:55.657860 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.657090    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-run\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:27:55.657860 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.657126    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1658b916-200e-432c-9ca8-a7814f38e485-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x5jbk\" (UID: \"1658b916-200e-432c-9ca8-a7814f38e485\") " pod="openshift-multus/multus-additional-cni-plugins-x5jbk"
Nov 04 05:27:55.657860 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.657143    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d0adbb13-2521-4805-b5ba-86b9052b6123-registration-dir\") pod \"aws-ebs-csi-driver-node-t8sjw\" (UID: \"d0adbb13-2521-4805-b5ba-86b9052b6123\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw"
Nov 04 05:27:55.657860 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.657182    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d0adbb13-2521-4805-b5ba-86b9052b6123-registration-dir\") pod \"aws-ebs-csi-driver-node-t8sjw\" (UID: \"d0adbb13-2521-4805-b5ba-86b9052b6123\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw"
Nov 04 05:27:55.657860 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.657193    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-host-slash\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.657860 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.657218    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-ovnkube-config\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.657860 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.657249    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-host-slash\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.657860 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.657271    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b9aa45f3-1a47-489d-ba9d-76cbe630b283-dbus\") pod \"global-pull-secret-syncer-8fwjr\" (UID: \"b9aa45f3-1a47-489d-ba9d-76cbe630b283\") " pod="kube-system/global-pull-secret-syncer-8fwjr"
Nov 04 05:27:55.657860 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.657285    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1658b916-200e-432c-9ca8-a7814f38e485-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x5jbk\" (UID: \"1658b916-200e-432c-9ca8-a7814f38e485\") " pod="openshift-multus/multus-additional-cni-plugins-x5jbk"
Nov 04 05:27:55.657860 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.657327    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-host\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:27:55.657860 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.657353    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b9aa45f3-1a47-489d-ba9d-76cbe630b283-dbus\") pod \"global-pull-secret-syncer-8fwjr\" (UID: \"b9aa45f3-1a47-489d-ba9d-76cbe630b283\") " pod="kube-system/global-pull-secret-syncer-8fwjr"
Nov 04 05:27:55.657860 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.657358    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-host-run-k8s-cni-cncf-io\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.657860 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.657387    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-var-lib-kubelet\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:27:55.657860 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.657415    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/88680c4d-b306-483c-a5a7-3d559e078c01-tmp\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:27:55.658346 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.657444    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjmnx\" (UniqueName: \"kubernetes.io/projected/88680c4d-b306-483c-a5a7-3d559e078c01-kube-api-access-pjmnx\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:27:55.658346 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.657498    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5510018c-1e4d-4009-bc56-2152f7703f7a-hosts-file\") pod \"node-resolver-x7zft\" (UID: \"5510018c-1e4d-4009-bc56-2152f7703f7a\") " pod="openshift-dns/node-resolver-x7zft"
Nov 04 05:27:55.658346 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.657531    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlb7q\" (UniqueName: \"kubernetes.io/projected/5510018c-1e4d-4009-bc56-2152f7703f7a-kube-api-access-vlb7q\") pod \"node-resolver-x7zft\" (UID: \"5510018c-1e4d-4009-bc56-2152f7703f7a\") " pod="openshift-dns/node-resolver-x7zft"
Nov 04 05:27:55.658346 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.657527    2575 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Nov 04 05:27:55.658346 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.657594    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-host-run-netns\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.658657 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.658642    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-ovnkube-config\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.660891 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.660876    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-ovn-node-metrics-cert\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.662348 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.662327    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jqnp\" (UniqueName: \"kubernetes.io/projected/16031827-bc25-4ecd-b902-0161403f7566-kube-api-access-8jqnp\") pod \"iptables-alerter-cxr2h\" (UID: \"16031827-bc25-4ecd-b902-0161403f7566\") " pod="openshift-network-operator/iptables-alerter-cxr2h"
Nov 04 05:27:55.662426 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.662380    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx72x\" (UniqueName: \"kubernetes.io/projected/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-kube-api-access-qx72x\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.668030 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.668005    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx7g8\" (UniqueName: \"kubernetes.io/projected/d0adbb13-2521-4805-b5ba-86b9052b6123-kube-api-access-bx7g8\") pod \"aws-ebs-csi-driver-node-t8sjw\" (UID: \"d0adbb13-2521-4805-b5ba-86b9052b6123\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw"
Nov 04 05:27:55.668286 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.668268    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t88mv\" (UniqueName: \"kubernetes.io/projected/2a7a7beb-0136-46a3-84f6-e00b34c4a4a9-kube-api-access-t88mv\") pod \"network-metrics-daemon-khrhn\" (UID: \"2a7a7beb-0136-46a3-84f6-e00b34c4a4a9\") " pod="openshift-multus/network-metrics-daemon-khrhn"
Nov 04 05:27:55.668331 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.668309    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4vgq\" (UniqueName: \"kubernetes.io/projected/1658b916-200e-432c-9ca8-a7814f38e485-kube-api-access-z4vgq\") pod \"multus-additional-cni-plugins-x5jbk\" (UID: \"1658b916-200e-432c-9ca8-a7814f38e485\") " pod="openshift-multus/multus-additional-cni-plugins-x5jbk"
Nov 04 05:27:55.758478 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.758314    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/abfc6e5f-914e-4a19-8fd3-c8a844377da3-konnectivity-ca\") pod \"konnectivity-agent-bwn4l\" (UID: \"abfc6e5f-914e-4a19-8fd3-c8a844377da3\") " pod="kube-system/konnectivity-agent-bwn4l"
Nov 04 05:27:55.758478 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.758464    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-multus-cni-dir\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.758719 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.758480    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-multus-socket-dir-parent\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.758719 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.758501    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-etc-kubernetes\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.758719 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.758516    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-etc-sysctl-d\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:27:55.758719 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.758591    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-multus-socket-dir-parent\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.758719 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.758598    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-etc-kubernetes\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.758719 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.758612    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/abfc6e5f-914e-4a19-8fd3-c8a844377da3-agent-certs\") pod \"konnectivity-agent-bwn4l\" (UID: \"abfc6e5f-914e-4a19-8fd3-c8a844377da3\") " pod="kube-system/konnectivity-agent-bwn4l"
Nov 04 05:27:55.758719 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.758627    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-multus-cni-dir\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.758719 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.758648    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-system-cni-dir\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.758719 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.758668    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-host-var-lib-kubelet\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.758719 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.758684    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55vhs\" (UniqueName: \"kubernetes.io/projected/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-kube-api-access-55vhs\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.758719 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.758707    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-host-var-lib-cni-bin\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.758719 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.758714    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-etc-sysctl-d\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:27:55.759306 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.758732    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/02758cc7-baf6-44d1-baa6-87438b8376a2-host\") pod \"node-ca-s2tjx\" (UID: \"02758cc7-baf6-44d1-baa6-87438b8376a2\") " pod="openshift-image-registry/node-ca-s2tjx"
Nov 04 05:27:55.759306 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.758758    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/02758cc7-baf6-44d1-baa6-87438b8376a2-serviceca\") pod \"node-ca-s2tjx\" (UID: \"02758cc7-baf6-44d1-baa6-87438b8376a2\") " pod="openshift-image-registry/node-ca-s2tjx"
Nov 04 05:27:55.759306 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.758767    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-host-var-lib-cni-bin\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.759306 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.758780    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-cni-binary-copy\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.759306 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.758765    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-host-var-lib-kubelet\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.759306 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.758819    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/02758cc7-baf6-44d1-baa6-87438b8376a2-host\") pod \"node-ca-s2tjx\" (UID: \"02758cc7-baf6-44d1-baa6-87438b8376a2\") " pod="openshift-image-registry/node-ca-s2tjx"
Nov 04 05:27:55.759306 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.758832    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/abfc6e5f-914e-4a19-8fd3-c8a844377da3-konnectivity-ca\") pod \"konnectivity-agent-bwn4l\" (UID: \"abfc6e5f-914e-4a19-8fd3-c8a844377da3\") " pod="kube-system/konnectivity-agent-bwn4l"
Nov 04 05:27:55.759306 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.758851    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-etc-modprobe-d\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:27:55.759306 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.758832    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-system-cni-dir\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.759306 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.758879    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-run\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:27:55.759306 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.758915    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-run\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:27:55.759306 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.758926    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-etc-modprobe-d\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:27:55.759306 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.758944    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-host\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:27:55.759306 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.758990    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-host\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:27:55.759306 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.759002    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-host-run-k8s-cni-cncf-io\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.759306 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.759039    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-var-lib-kubelet\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:27:55.759306 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.759062    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/88680c4d-b306-483c-a5a7-3d559e078c01-tmp\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:27:55.759306 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.759082    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjmnx\" (UniqueName: \"kubernetes.io/projected/88680c4d-b306-483c-a5a7-3d559e078c01-kube-api-access-pjmnx\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:27:55.760574 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.759106    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5510018c-1e4d-4009-bc56-2152f7703f7a-hosts-file\") pod \"node-resolver-x7zft\" (UID: \"5510018c-1e4d-4009-bc56-2152f7703f7a\") " pod="openshift-dns/node-resolver-x7zft"
Nov 04 05:27:55.760574 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.759128    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlb7q\" (UniqueName: \"kubernetes.io/projected/5510018c-1e4d-4009-bc56-2152f7703f7a-kube-api-access-vlb7q\") pod \"node-resolver-x7zft\" (UID: \"5510018c-1e4d-4009-bc56-2152f7703f7a\") " pod="openshift-dns/node-resolver-x7zft"
Nov 04 05:27:55.760574 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.759129    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-var-lib-kubelet\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:27:55.760574 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.759179    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5510018c-1e4d-4009-bc56-2152f7703f7a-hosts-file\") pod \"node-resolver-x7zft\" (UID: \"5510018c-1e4d-4009-bc56-2152f7703f7a\") " pod="openshift-dns/node-resolver-x7zft"
Nov 04 05:27:55.760574 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.759220    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-host-run-k8s-cni-cncf-io\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.760574 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.759239    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/02758cc7-baf6-44d1-baa6-87438b8376a2-serviceca\") pod \"node-ca-s2tjx\" (UID: \"02758cc7-baf6-44d1-baa6-87438b8376a2\") " pod="openshift-image-registry/node-ca-s2tjx"
Nov 04 05:27:55.760574 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.759312    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-host-run-netns\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.760574 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.759363    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5510018c-1e4d-4009-bc56-2152f7703f7a-tmp-dir\") pod \"node-resolver-x7zft\" (UID: \"5510018c-1e4d-4009-bc56-2152f7703f7a\") " pod="openshift-dns/node-resolver-x7zft"
Nov 04 05:27:55.760574 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.759384    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-etc-kubernetes\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:27:55.760574 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.759385    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-host-run-netns\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.760574 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.759420    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-etc-sysctl-conf\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:27:55.760574 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.759436    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-etc-kubernetes\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:27:55.760574 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.759454    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/88680c4d-b306-483c-a5a7-3d559e078c01-etc-tuned\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:27:55.760574 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.759472    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-host-run-multus-certs\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.760574 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.759487    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-sys\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:27:55.760574 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.759516    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-etc-sysctl-conf\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:27:55.760574 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.759546    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-sys\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:27:55.760574 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.759543    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-host-run-multus-certs\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.761405 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.759568    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-cnibin\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.761405 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.759590    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-cnibin\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.761405 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.759622    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2hgd\" (UniqueName: \"kubernetes.io/projected/02758cc7-baf6-44d1-baa6-87438b8376a2-kube-api-access-n2hgd\") pod \"node-ca-s2tjx\" (UID: \"02758cc7-baf6-44d1-baa6-87438b8376a2\") " pod="openshift-image-registry/node-ca-s2tjx"
Nov 04 05:27:55.761405 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.759639    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-hostroot\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.761405 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.759682    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-multus-conf-dir\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.761405 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.759709    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-hostroot\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.761405 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.759718    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-multus-conf-dir\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.761405 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.759713    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-multus-daemon-config\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.761405 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.759764    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-etc-sysconfig\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:27:55.761405 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.759792    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-etc-systemd\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:27:55.761405 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.759816    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-lib-modules\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:27:55.761405 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.759840    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m8jk\" (UniqueName: \"kubernetes.io/projected/8a855aab-8901-4d7d-8f10-91a8896d4b71-kube-api-access-5m8jk\") pod \"network-check-target-k54vt\" (UID: \"8a855aab-8901-4d7d-8f10-91a8896d4b71\") " pod="openshift-network-diagnostics/network-check-target-k54vt"
Nov 04 05:27:55.761405 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.759898    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-etc-systemd\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:27:55.761405 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.759908    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-cni-binary-copy\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.761405 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.759950    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-host-var-lib-cni-multus\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.761405 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.760009    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-lib-modules\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:27:55.761405 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.760045    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-host-var-lib-cni-multus\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.761405 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.760068    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-etc-sysconfig\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:27:55.762371 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.760079    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5510018c-1e4d-4009-bc56-2152f7703f7a-tmp-dir\") pod \"node-resolver-x7zft\" (UID: \"5510018c-1e4d-4009-bc56-2152f7703f7a\") " pod="openshift-dns/node-resolver-x7zft"
Nov 04 05:27:55.762371 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.760223    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-multus-daemon-config\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.762371 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.761326    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/88680c4d-b306-483c-a5a7-3d559e078c01-tmp\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:27:55.762371 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.761331    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/abfc6e5f-914e-4a19-8fd3-c8a844377da3-agent-certs\") pod \"konnectivity-agent-bwn4l\" (UID: \"abfc6e5f-914e-4a19-8fd3-c8a844377da3\") " pod="kube-system/konnectivity-agent-bwn4l"
Nov 04 05:27:55.762371 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.761897    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/88680c4d-b306-483c-a5a7-3d559e078c01-etc-tuned\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:27:55.765731 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:55.765712    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 05:27:55.765857 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:55.765739    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 05:27:55.765857 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:55.765748    2575 projected.go:196] Error preparing data for projected volume kube-api-access-5m8jk for pod openshift-network-diagnostics/network-check-target-k54vt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 05:27:55.765857 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:55.765806    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a855aab-8901-4d7d-8f10-91a8896d4b71-kube-api-access-5m8jk podName:8a855aab-8901-4d7d-8f10-91a8896d4b71 nodeName:}" failed. No retries permitted until 2026-11-04 05:27:56.265790834 +0000 UTC m=+2.081113909 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5m8jk" (UniqueName: "kubernetes.io/projected/8a855aab-8901-4d7d-8f10-91a8896d4b71-kube-api-access-5m8jk") pod "network-check-target-k54vt" (UID: "8a855aab-8901-4d7d-8f10-91a8896d4b71") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 05:27:55.766918 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.766900    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjmnx\" (UniqueName: \"kubernetes.io/projected/88680c4d-b306-483c-a5a7-3d559e078c01-kube-api-access-pjmnx\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:27:55.767138 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.767117    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2hgd\" (UniqueName: \"kubernetes.io/projected/02758cc7-baf6-44d1-baa6-87438b8376a2-kube-api-access-n2hgd\") pod \"node-ca-s2tjx\" (UID: \"02758cc7-baf6-44d1-baa6-87438b8376a2\") " pod="openshift-image-registry/node-ca-s2tjx"
Nov 04 05:27:55.767422 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.767404    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55vhs\" (UniqueName: \"kubernetes.io/projected/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-kube-api-access-55vhs\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.767485 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.767439    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlb7q\" (UniqueName: \"kubernetes.io/projected/5510018c-1e4d-4009-bc56-2152f7703f7a-kube-api-access-vlb7q\") pod \"node-resolver-x7zft\" (UID: \"5510018c-1e4d-4009-bc56-2152f7703f7a\") " pod="openshift-dns/node-resolver-x7zft"
Nov 04 05:27:55.875109 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.875069    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-x5jbk"
Nov 04 05:27:55.882316 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.882292    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw"
Nov 04 05:27:55.895945 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:55.895913    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0adbb13_2521_4805_b5ba_86b9052b6123.slice/crio-9dbd08147bd975458dcd09f3f470eed4905c8ffd40ab7f10e2446a57560c5936 WatchSource:0}: Error finding container 9dbd08147bd975458dcd09f3f470eed4905c8ffd40ab7f10e2446a57560c5936: Status 404 returned error can't find the container with id 9dbd08147bd975458dcd09f3f470eed4905c8ffd40ab7f10e2446a57560c5936
Nov 04 05:27:55.896391 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:55.896369    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49c578da98535d8878f600c872b7f09a.slice/crio-23db902d108e6ad7aa3e5f6405eed3de64a22e6b9bb89b97d764b3c812ab8288 WatchSource:0}: Error finding container 23db902d108e6ad7aa3e5f6405eed3de64a22e6b9bb89b97d764b3c812ab8288: Status 404 returned error can't find the container with id 23db902d108e6ad7aa3e5f6405eed3de64a22e6b9bb89b97d764b3c812ab8288
Nov 04 05:27:55.896999 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:55.896978    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1658b916_200e_432c_9ca8_a7814f38e485.slice/crio-ba5a651f7972fefaffd70ce2ab493ac67758f6a7dc6f2c49aaea67d2b59f6454 WatchSource:0}: Error finding container ba5a651f7972fefaffd70ce2ab493ac67758f6a7dc6f2c49aaea67d2b59f6454: Status 404 returned error can't find the container with id ba5a651f7972fefaffd70ce2ab493ac67758f6a7dc6f2c49aaea67d2b59f6454
Nov 04 05:27:55.898309 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:55.898287    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb29a0db634b87915a8146a0a3af4e909.slice/crio-63d2c3ec19119f421c5939d5a79172820f2092b27c3c65986172f455daaf12c6 WatchSource:0}: Error finding container 63d2c3ec19119f421c5939d5a79172820f2092b27c3c65986172f455daaf12c6: Status 404 returned error can't find the container with id 63d2c3ec19119f421c5939d5a79172820f2092b27c3c65986172f455daaf12c6
Nov 04 05:27:55.900763 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.900742    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cxr2h"
Nov 04 05:27:55.901729 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.901708    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 05:27:55.909601 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:55.909583    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16031827_bc25_4ecd_b902_0161403f7566.slice/crio-c540ca4082a2572416f5eb3c894e2b1f425a58fba6cce894b6c3ae0c172fefd0 WatchSource:0}: Error finding container c540ca4082a2572416f5eb3c894e2b1f425a58fba6cce894b6c3ae0c172fefd0: Status 404 returned error can't find the container with id c540ca4082a2572416f5eb3c894e2b1f425a58fba6cce894b6c3ae0c172fefd0
Nov 04 05:27:55.932772 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.932745    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bwn4l"
Nov 04 05:27:55.936309 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.936285    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:27:55.942738 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:55.942717    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabfc6e5f_914e_4a19_8fd3_c8a844377da3.slice/crio-78cbf100285865845dce2bc76261d1e98147bebb3d4863fd1d14742d9e7c49af WatchSource:0}: Error finding container 78cbf100285865845dce2bc76261d1e98147bebb3d4863fd1d14742d9e7c49af: Status 404 returned error can't find the container with id 78cbf100285865845dce2bc76261d1e98147bebb3d4863fd1d14742d9e7c49af
Nov 04 05:27:55.945300 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:55.945280    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1f789ee_b574_48ba_abd5_cfac0b3d7f40.slice/crio-64fe8c0d1b759323fa1748f03e9aead6ff4208c092bfdf720361888671210bba WatchSource:0}: Error finding container 64fe8c0d1b759323fa1748f03e9aead6ff4208c092bfdf720361888671210bba: Status 404 returned error can't find the container with id 64fe8c0d1b759323fa1748f03e9aead6ff4208c092bfdf720361888671210bba
Nov 04 05:27:55.954521 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.954502    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s2tjx"
Nov 04 05:27:55.963084 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:55.963064    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02758cc7_baf6_44d1_baa6_87438b8376a2.slice/crio-e62e58a4402dca683180dd1df0167d14f964bd2ccc2f8863e81d0dc15c7c268d WatchSource:0}: Error finding container e62e58a4402dca683180dd1df0167d14f964bd2ccc2f8863e81d0dc15c7c268d: Status 404 returned error can't find the container with id e62e58a4402dca683180dd1df0167d14f964bd2ccc2f8863e81d0dc15c7c268d
Nov 04 05:27:55.979285 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.979266    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5gwpr"
Nov 04 05:27:55.983873 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.983849    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:27:55.988088 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:55.988068    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b670e74_95bd_4a10_9d6d_b7b6d95e91c7.slice/crio-0f7d24e6b682b270af4ba2e3048172e4e3ffbc8812d08556ef875a81d28f4e60 WatchSource:0}: Error finding container 0f7d24e6b682b270af4ba2e3048172e4e3ffbc8812d08556ef875a81d28f4e60: Status 404 returned error can't find the container with id 0f7d24e6b682b270af4ba2e3048172e4e3ffbc8812d08556ef875a81d28f4e60
Nov 04 05:27:55.992467 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:55.992448    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88680c4d_b306_483c_a5a7_3d559e078c01.slice/crio-85de20b1a11f645f193a95b894d4833ed9df92419c5929469c256341cd0a312f WatchSource:0}: Error finding container 85de20b1a11f645f193a95b894d4833ed9df92419c5929469c256341cd0a312f: Status 404 returned error can't find the container with id 85de20b1a11f645f193a95b894d4833ed9df92419c5929469c256341cd0a312f
Nov 04 05:27:55.997200 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:55.997185    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x7zft"
Nov 04 05:27:56.005769 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:27:56.005751    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5510018c_1e4d_4009_bc56_2152f7703f7a.slice/crio-49328b3d8b6f10a9d067b9332cb66b293020a0f07b58b0dce5402b0a8831a42f WatchSource:0}: Error finding container 49328b3d8b6f10a9d067b9332cb66b293020a0f07b58b0dce5402b0a8831a42f: Status 404 returned error can't find the container with id 49328b3d8b6f10a9d067b9332cb66b293020a0f07b58b0dce5402b0a8831a42f
Nov 04 05:27:56.007648 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:56.007627    2575 kuberuntime_manager.go:1707] "Unhandled Error" err="container dns-node-resolver start failed in pod node-resolver-x7zft_openshift-dns(5510018c-1e4d-4009-bc56-2152f7703f7a): ErrImagePull: pull QPS exceeded" logger="UnhandledError"
Nov 04 05:27:56.007715 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:56.007665    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dns-node-resolver\" with ErrImagePull: \"pull QPS exceeded\"" pod="openshift-dns/node-resolver-x7zft" podUID="5510018c-1e4d-4009-bc56-2152f7703f7a"
Nov 04 05:27:56.163358 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:56.163311    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b9aa45f3-1a47-489d-ba9d-76cbe630b283-original-pull-secret\") pod \"global-pull-secret-syncer-8fwjr\" (UID: \"b9aa45f3-1a47-489d-ba9d-76cbe630b283\") " pod="kube-system/global-pull-secret-syncer-8fwjr"
Nov 04 05:27:56.163358 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:56.163350    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a7a7beb-0136-46a3-84f6-e00b34c4a4a9-metrics-certs\") pod \"network-metrics-daemon-khrhn\" (UID: \"2a7a7beb-0136-46a3-84f6-e00b34c4a4a9\") " pod="openshift-multus/network-metrics-daemon-khrhn"
Nov 04 05:27:56.163468 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:56.163423    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 05:27:56.163468 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:56.163440    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 05:27:56.163468 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:56.163463    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a7a7beb-0136-46a3-84f6-e00b34c4a4a9-metrics-certs podName:2a7a7beb-0136-46a3-84f6-e00b34c4a4a9 nodeName:}" failed. No retries permitted until 2026-11-04 05:27:57.163449997 +0000 UTC m=+2.978773056 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a7a7beb-0136-46a3-84f6-e00b34c4a4a9-metrics-certs") pod "network-metrics-daemon-khrhn" (UID: "2a7a7beb-0136-46a3-84f6-e00b34c4a4a9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 05:27:56.163581 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:56.163485    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9aa45f3-1a47-489d-ba9d-76cbe630b283-original-pull-secret podName:b9aa45f3-1a47-489d-ba9d-76cbe630b283 nodeName:}" failed. No retries permitted until 2026-11-04 05:27:57.163472924 +0000 UTC m=+2.978795987 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b9aa45f3-1a47-489d-ba9d-76cbe630b283-original-pull-secret") pod "global-pull-secret-syncer-8fwjr" (UID: "b9aa45f3-1a47-489d-ba9d-76cbe630b283") : object "kube-system"/"original-pull-secret" not registered
Nov 04 05:27:56.364510 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:56.364480    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m8jk\" (UniqueName: \"kubernetes.io/projected/8a855aab-8901-4d7d-8f10-91a8896d4b71-kube-api-access-5m8jk\") pod \"network-check-target-k54vt\" (UID: \"8a855aab-8901-4d7d-8f10-91a8896d4b71\") " pod="openshift-network-diagnostics/network-check-target-k54vt"
Nov 04 05:27:56.364684 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:56.364658    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 05:27:56.375535 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:56.365008    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 05:27:56.375535 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:56.365030    2575 projected.go:196] Error preparing data for projected volume kube-api-access-5m8jk for pod openshift-network-diagnostics/network-check-target-k54vt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 05:27:56.375535 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:56.365109    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a855aab-8901-4d7d-8f10-91a8896d4b71-kube-api-access-5m8jk podName:8a855aab-8901-4d7d-8f10-91a8896d4b71 nodeName:}" failed. No retries permitted until 2026-11-04 05:27:57.365089176 +0000 UTC m=+3.180412255 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5m8jk" (UniqueName: "kubernetes.io/projected/8a855aab-8901-4d7d-8f10-91a8896d4b71-kube-api-access-5m8jk") pod "network-check-target-k54vt" (UID: "8a855aab-8901-4d7d-8f10-91a8896d4b71") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 05:27:56.432826 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:56.432713    2575 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 05:27:56.585169 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:56.585071    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 05:22:55 +0000 UTC" deadline="2028-06-23 10:26:38.512120871 +0000 UTC"
Nov 04 05:27:56.585169 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:56.585122    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14332h58m41.927002399s"
Nov 04 05:27:56.720042 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:56.720011    2575 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 05:27:56.761087 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:56.760483    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khrhn"
Nov 04 05:27:56.761087 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:56.760542    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k54vt"
Nov 04 05:27:56.761087 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:56.760690    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khrhn" podUID="2a7a7beb-0136-46a3-84f6-e00b34c4a4a9"
Nov 04 05:27:56.761087 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:56.760804    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k54vt" podUID="8a855aab-8901-4d7d-8f10-91a8896d4b71"
Nov 04 05:27:56.781763 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:56.781713    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s2tjx" event={"ID":"02758cc7-baf6-44d1-baa6-87438b8376a2","Type":"ContainerStarted","Data":"e62e58a4402dca683180dd1df0167d14f964bd2ccc2f8863e81d0dc15c7c268d"}
Nov 04 05:27:56.806245 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:56.806214    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7" event={"ID":"f1f789ee-b574-48ba-abd5-cfac0b3d7f40","Type":"ContainerStarted","Data":"64fe8c0d1b759323fa1748f03e9aead6ff4208c092bfdf720361888671210bba"}
Nov 04 05:27:56.827820 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:56.827788    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cxr2h" event={"ID":"16031827-bc25-4ecd-b902-0161403f7566","Type":"ContainerStarted","Data":"c540ca4082a2572416f5eb3c894e2b1f425a58fba6cce894b6c3ae0c172fefd0"}
Nov 04 05:27:56.837800 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:56.837775    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x5jbk" event={"ID":"1658b916-200e-432c-9ca8-a7814f38e485","Type":"ContainerStarted","Data":"ba5a651f7972fefaffd70ce2ab493ac67758f6a7dc6f2c49aaea67d2b59f6454"}
Nov 04 05:27:56.840030 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:56.839984    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-170.us-east-2.compute.internal" event={"ID":"49c578da98535d8878f600c872b7f09a","Type":"ContainerStarted","Data":"23db902d108e6ad7aa3e5f6405eed3de64a22e6b9bb89b97d764b3c812ab8288"}
Nov 04 05:27:56.843654 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:56.842855    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x7zft" event={"ID":"5510018c-1e4d-4009-bc56-2152f7703f7a","Type":"ContainerStarted","Data":"49328b3d8b6f10a9d067b9332cb66b293020a0f07b58b0dce5402b0a8831a42f"}
Nov 04 05:27:56.845693 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:56.845544    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dns-node-resolver\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2a8b58f028a9a4a0345ad1f809e47fb9913d7f77c731bfd785819e1c71be9472\\\": ErrImagePull: pull QPS exceeded\"" pod="openshift-dns/node-resolver-x7zft" podUID="5510018c-1e4d-4009-bc56-2152f7703f7a"
Nov 04 05:27:56.870738 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:56.870687    2575 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 05:27:56.884157 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:56.883926    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9tmdx" event={"ID":"88680c4d-b306-483c-a5a7-3d559e078c01","Type":"ContainerStarted","Data":"85de20b1a11f645f193a95b894d4833ed9df92419c5929469c256341cd0a312f"}
Nov 04 05:27:56.898540 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:56.898501    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5gwpr" event={"ID":"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7","Type":"ContainerStarted","Data":"0f7d24e6b682b270af4ba2e3048172e4e3ffbc8812d08556ef875a81d28f4e60"}
Nov 04 05:27:56.905878 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:56.905854    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bwn4l" event={"ID":"abfc6e5f-914e-4a19-8fd3-c8a844377da3","Type":"ContainerStarted","Data":"78cbf100285865845dce2bc76261d1e98147bebb3d4863fd1d14742d9e7c49af"}
Nov 04 05:27:56.928791 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:56.928731    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw" event={"ID":"d0adbb13-2521-4805-b5ba-86b9052b6123","Type":"ContainerStarted","Data":"9dbd08147bd975458dcd09f3f470eed4905c8ffd40ab7f10e2446a57560c5936"}
Nov 04 05:27:56.941245 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:56.941220    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-170.us-east-2.compute.internal" event={"ID":"b29a0db634b87915a8146a0a3af4e909","Type":"ContainerStarted","Data":"63d2c3ec19119f421c5939d5a79172820f2092b27c3c65986172f455daaf12c6"}
Nov 04 05:27:57.170672 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:57.169923    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b9aa45f3-1a47-489d-ba9d-76cbe630b283-original-pull-secret\") pod \"global-pull-secret-syncer-8fwjr\" (UID: \"b9aa45f3-1a47-489d-ba9d-76cbe630b283\") " pod="kube-system/global-pull-secret-syncer-8fwjr"
Nov 04 05:27:57.170672 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:57.169989    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a7a7beb-0136-46a3-84f6-e00b34c4a4a9-metrics-certs\") pod \"network-metrics-daemon-khrhn\" (UID: \"2a7a7beb-0136-46a3-84f6-e00b34c4a4a9\") " pod="openshift-multus/network-metrics-daemon-khrhn"
Nov 04 05:27:57.170672 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:57.170124    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 05:27:57.170672 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:57.170180    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a7a7beb-0136-46a3-84f6-e00b34c4a4a9-metrics-certs podName:2a7a7beb-0136-46a3-84f6-e00b34c4a4a9 nodeName:}" failed. No retries permitted until 2026-11-04 05:27:59.170163164 +0000 UTC m=+4.985486222 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a7a7beb-0136-46a3-84f6-e00b34c4a4a9-metrics-certs") pod "network-metrics-daemon-khrhn" (UID: "2a7a7beb-0136-46a3-84f6-e00b34c4a4a9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 05:27:57.170672 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:57.170554    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 05:27:57.170672 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:57.170599    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9aa45f3-1a47-489d-ba9d-76cbe630b283-original-pull-secret podName:b9aa45f3-1a47-489d-ba9d-76cbe630b283 nodeName:}" failed. No retries permitted until 2026-11-04 05:27:59.170584927 +0000 UTC m=+4.985907991 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b9aa45f3-1a47-489d-ba9d-76cbe630b283-original-pull-secret") pod "global-pull-secret-syncer-8fwjr" (UID: "b9aa45f3-1a47-489d-ba9d-76cbe630b283") : object "kube-system"/"original-pull-secret" not registered
Nov 04 05:27:57.371836 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:57.371802    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m8jk\" (UniqueName: \"kubernetes.io/projected/8a855aab-8901-4d7d-8f10-91a8896d4b71-kube-api-access-5m8jk\") pod \"network-check-target-k54vt\" (UID: \"8a855aab-8901-4d7d-8f10-91a8896d4b71\") " pod="openshift-network-diagnostics/network-check-target-k54vt"
Nov 04 05:27:57.372005 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:57.371971    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 05:27:57.372005 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:57.371988    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 05:27:57.372005 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:57.371999    2575 projected.go:196] Error preparing data for projected volume kube-api-access-5m8jk for pod openshift-network-diagnostics/network-check-target-k54vt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 05:27:57.372266 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:57.372052    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a855aab-8901-4d7d-8f10-91a8896d4b71-kube-api-access-5m8jk podName:8a855aab-8901-4d7d-8f10-91a8896d4b71 nodeName:}" failed. No retries permitted until 2026-11-04 05:27:59.372033404 +0000 UTC m=+5.187356467 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5m8jk" (UniqueName: "kubernetes.io/projected/8a855aab-8901-4d7d-8f10-91a8896d4b71-kube-api-access-5m8jk") pod "network-check-target-k54vt" (UID: "8a855aab-8901-4d7d-8f10-91a8896d4b71") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 05:27:57.586207 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:57.586134    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 05:22:55 +0000 UTC" deadline="2028-07-20 16:39:21.248159078 +0000 UTC"
Nov 04 05:27:57.586207 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:57.586172    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14987h11m23.661990846s"
Nov 04 05:27:57.759486 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:57.759448    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8fwjr"
Nov 04 05:27:57.759716 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:57.759602    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8fwjr" podUID="b9aa45f3-1a47-489d-ba9d-76cbe630b283"
Nov 04 05:27:58.760656 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:58.760622    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khrhn"
Nov 04 05:27:58.761113 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:58.760757    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khrhn" podUID="2a7a7beb-0136-46a3-84f6-e00b34c4a4a9"
Nov 04 05:27:58.761113 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:58.761091    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k54vt"
Nov 04 05:27:58.761206 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:58.761179    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k54vt" podUID="8a855aab-8901-4d7d-8f10-91a8896d4b71"
Nov 04 05:27:59.193218 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:59.193141    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b9aa45f3-1a47-489d-ba9d-76cbe630b283-original-pull-secret\") pod \"global-pull-secret-syncer-8fwjr\" (UID: \"b9aa45f3-1a47-489d-ba9d-76cbe630b283\") " pod="kube-system/global-pull-secret-syncer-8fwjr"
Nov 04 05:27:59.193376 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:59.193222    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a7a7beb-0136-46a3-84f6-e00b34c4a4a9-metrics-certs\") pod \"network-metrics-daemon-khrhn\" (UID: \"2a7a7beb-0136-46a3-84f6-e00b34c4a4a9\") " pod="openshift-multus/network-metrics-daemon-khrhn"
Nov 04 05:27:59.193437 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:59.193373    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 05:27:59.193437 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:59.193434    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a7a7beb-0136-46a3-84f6-e00b34c4a4a9-metrics-certs podName:2a7a7beb-0136-46a3-84f6-e00b34c4a4a9 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:03.193416797 +0000 UTC m=+9.008739859 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a7a7beb-0136-46a3-84f6-e00b34c4a4a9-metrics-certs") pod "network-metrics-daemon-khrhn" (UID: "2a7a7beb-0136-46a3-84f6-e00b34c4a4a9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 05:27:59.193901 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:59.193878    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 05:27:59.193999 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:59.193944    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9aa45f3-1a47-489d-ba9d-76cbe630b283-original-pull-secret podName:b9aa45f3-1a47-489d-ba9d-76cbe630b283 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:03.193927767 +0000 UTC m=+9.009250826 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b9aa45f3-1a47-489d-ba9d-76cbe630b283-original-pull-secret") pod "global-pull-secret-syncer-8fwjr" (UID: "b9aa45f3-1a47-489d-ba9d-76cbe630b283") : object "kube-system"/"original-pull-secret" not registered
Nov 04 05:27:59.395641 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:59.395610    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m8jk\" (UniqueName: \"kubernetes.io/projected/8a855aab-8901-4d7d-8f10-91a8896d4b71-kube-api-access-5m8jk\") pod \"network-check-target-k54vt\" (UID: \"8a855aab-8901-4d7d-8f10-91a8896d4b71\") " pod="openshift-network-diagnostics/network-check-target-k54vt"
Nov 04 05:27:59.395779 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:59.395763    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 05:27:59.395839 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:59.395781    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 05:27:59.395839 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:59.395796    2575 projected.go:196] Error preparing data for projected volume kube-api-access-5m8jk for pod openshift-network-diagnostics/network-check-target-k54vt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 05:27:59.395939 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:59.395852    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a855aab-8901-4d7d-8f10-91a8896d4b71-kube-api-access-5m8jk podName:8a855aab-8901-4d7d-8f10-91a8896d4b71 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:03.395835245 +0000 UTC m=+9.211158327 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5m8jk" (UniqueName: "kubernetes.io/projected/8a855aab-8901-4d7d-8f10-91a8896d4b71-kube-api-access-5m8jk") pod "network-check-target-k54vt" (UID: "8a855aab-8901-4d7d-8f10-91a8896d4b71") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 05:27:59.759927 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:59.759704    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8fwjr"
Nov 04 05:27:59.760062 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:27:59.760037    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8fwjr" podUID="b9aa45f3-1a47-489d-ba9d-76cbe630b283"
Nov 04 05:27:59.974370 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:59.974284    2575 generic.go:356] "Generic (PLEG): container finished" podID="b29a0db634b87915a8146a0a3af4e909" containerID="c4b920101af69aef65172486b56f54584f550a716500999215859e5c25fe7abc" exitCode=0
Nov 04 05:27:59.975039 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:59.974372    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-170.us-east-2.compute.internal" event={"ID":"b29a0db634b87915a8146a0a3af4e909","Type":"ContainerDied","Data":"c4b920101af69aef65172486b56f54584f550a716500999215859e5c25fe7abc"}
Nov 04 05:27:59.979372 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:59.979345    2575 generic.go:356] "Generic (PLEG): container finished" podID="1658b916-200e-432c-9ca8-a7814f38e485" containerID="76aac6199488ea21ea622869bdcebfdd385cd45ab504a46013234d861fd405c1" exitCode=0
Nov 04 05:27:59.979460 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:27:59.979385    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x5jbk" event={"ID":"1658b916-200e-432c-9ca8-a7814f38e485","Type":"ContainerDied","Data":"76aac6199488ea21ea622869bdcebfdd385cd45ab504a46013234d861fd405c1"}
Nov 04 05:28:00.763073 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:00.762385    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khrhn"
Nov 04 05:28:00.763073 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:00.762538    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khrhn" podUID="2a7a7beb-0136-46a3-84f6-e00b34c4a4a9"
Nov 04 05:28:00.763073 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:00.762907    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k54vt"
Nov 04 05:28:00.763073 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:00.763001    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k54vt" podUID="8a855aab-8901-4d7d-8f10-91a8896d4b71"
Nov 04 05:28:00.985727 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:00.985508    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-170.us-east-2.compute.internal" event={"ID":"49c578da98535d8878f600c872b7f09a","Type":"ContainerStarted","Data":"76fc854c22153ca3e5ee124e27a294d4e8b47762248c969a343593e8b0a2c697"}
Nov 04 05:28:00.989834 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:00.989806    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bwn4l" event={"ID":"abfc6e5f-914e-4a19-8fd3-c8a844377da3","Type":"ContainerStarted","Data":"26fa9d9243b7ab2972534d5169157d835570b9714ad3866f8655839f20dd79fd"}
Nov 04 05:28:00.991809 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:00.991792    2575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bwn4l"
Nov 04 05:28:00.992467 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:00.992447    2575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bwn4l"
Nov 04 05:28:00.995075 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:00.994419    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-170.us-east-2.compute.internal" event={"ID":"b29a0db634b87915a8146a0a3af4e909","Type":"ContainerStarted","Data":"df64b1ad2f46242b8586d2632974f98e2e8675140c978596a58ac4acb85c04cf"}
Nov 04 05:28:01.001060 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:01.001000    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-170.us-east-2.compute.internal" podStartSLOduration=7.000982989 podStartE2EDuration="7.000982989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:27:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:28:01.000198024 +0000 UTC m=+6.815521123" watchObservedRunningTime="2026-11-04 05:28:01.000982989 +0000 UTC m=+6.816306070"
Nov 04 05:28:01.034378 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:01.033737    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bwn4l" podStartSLOduration=2.926828854 podStartE2EDuration="7.033725529s" totalImagesPullingTime="4.106896675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:27:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:28:01.020240419 +0000 UTC m=+6.835563501" watchObservedRunningTime="2026-11-04 05:28:01.033725529 +0000 UTC m=+6.849048610"
Nov 04 05:28:01.034378 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:01.033958    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-170.us-east-2.compute.internal" podStartSLOduration=7.033954738 podStartE2EDuration="7.033954738s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:27:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:28:01.033616729 +0000 UTC m=+6.848939809" watchObservedRunningTime="2026-11-04 05:28:01.033954738 +0000 UTC m=+6.849277818"
Nov 04 05:28:01.760186 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:01.760098    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8fwjr"
Nov 04 05:28:01.760288 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:01.760196    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8fwjr" podUID="b9aa45f3-1a47-489d-ba9d-76cbe630b283"
Nov 04 05:28:02.000258 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:02.000222    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s2tjx" event={"ID":"02758cc7-baf6-44d1-baa6-87438b8376a2","Type":"ContainerStarted","Data":"03ac2ce2c0b177172c6808a0021c34d758667084b0e36701bf7eab2d82a1f8af"}
Nov 04 05:28:02.004086 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:02.004053    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw" event={"ID":"d0adbb13-2521-4805-b5ba-86b9052b6123","Type":"ContainerStarted","Data":"2a3753f3237e57f5dfb085188249f7bfd20d5e8d242e24ca43f622c5984a8b30"}
Nov 04 05:28:02.013912 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:02.013829    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-s2tjx" podStartSLOduration=3.046022649 podStartE2EDuration="8.013813612s" totalImagesPullingTime="4.967790963s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:27:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:28:02.013077797 +0000 UTC m=+7.828400877" watchObservedRunningTime="2026-11-04 05:28:02.013813612 +0000 UTC m=+7.829136695"
Nov 04 05:28:02.762274 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:02.762245    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k54vt"
Nov 04 05:28:02.762444 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:02.762363    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k54vt" podUID="8a855aab-8901-4d7d-8f10-91a8896d4b71"
Nov 04 05:28:02.762793 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:02.762754    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khrhn"
Nov 04 05:28:02.762918 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:02.762860    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khrhn" podUID="2a7a7beb-0136-46a3-84f6-e00b34c4a4a9"
Nov 04 05:28:03.006220 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:03.006189    2575 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 04 05:28:03.042555 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:03.042507    2575 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Nov 04 05:28:03.230194 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:03.230158    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a7a7beb-0136-46a3-84f6-e00b34c4a4a9-metrics-certs\") pod \"network-metrics-daemon-khrhn\" (UID: \"2a7a7beb-0136-46a3-84f6-e00b34c4a4a9\") " pod="openshift-multus/network-metrics-daemon-khrhn"
Nov 04 05:28:03.230364 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:03.230210    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b9aa45f3-1a47-489d-ba9d-76cbe630b283-original-pull-secret\") pod \"global-pull-secret-syncer-8fwjr\" (UID: \"b9aa45f3-1a47-489d-ba9d-76cbe630b283\") " pod="kube-system/global-pull-secret-syncer-8fwjr"
Nov 04 05:28:03.230364 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:03.230301    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 05:28:03.230364 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:03.230346    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9aa45f3-1a47-489d-ba9d-76cbe630b283-original-pull-secret podName:b9aa45f3-1a47-489d-ba9d-76cbe630b283 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:11.230334761 +0000 UTC m=+17.045657831 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b9aa45f3-1a47-489d-ba9d-76cbe630b283-original-pull-secret") pod "global-pull-secret-syncer-8fwjr" (UID: "b9aa45f3-1a47-489d-ba9d-76cbe630b283") : object "kube-system"/"original-pull-secret" not registered
Nov 04 05:28:03.230696 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:03.230677    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 05:28:03.230805 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:03.230738    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a7a7beb-0136-46a3-84f6-e00b34c4a4a9-metrics-certs podName:2a7a7beb-0136-46a3-84f6-e00b34c4a4a9 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:11.230720363 +0000 UTC m=+17.046043438 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a7a7beb-0136-46a3-84f6-e00b34c4a4a9-metrics-certs") pod "network-metrics-daemon-khrhn" (UID: "2a7a7beb-0136-46a3-84f6-e00b34c4a4a9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 05:28:03.433123 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:03.432531    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m8jk\" (UniqueName: \"kubernetes.io/projected/8a855aab-8901-4d7d-8f10-91a8896d4b71-kube-api-access-5m8jk\") pod \"network-check-target-k54vt\" (UID: \"8a855aab-8901-4d7d-8f10-91a8896d4b71\") " pod="openshift-network-diagnostics/network-check-target-k54vt"
Nov 04 05:28:03.433123 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:03.432697    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 05:28:03.433123 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:03.432718    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 05:28:03.433123 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:03.432732    2575 projected.go:196] Error preparing data for projected volume kube-api-access-5m8jk for pod openshift-network-diagnostics/network-check-target-k54vt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 05:28:03.433123 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:03.432789    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a855aab-8901-4d7d-8f10-91a8896d4b71-kube-api-access-5m8jk podName:8a855aab-8901-4d7d-8f10-91a8896d4b71 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:11.432770993 +0000 UTC m=+17.248094057 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5m8jk" (UniqueName: "kubernetes.io/projected/8a855aab-8901-4d7d-8f10-91a8896d4b71-kube-api-access-5m8jk") pod "network-check-target-k54vt" (UID: "8a855aab-8901-4d7d-8f10-91a8896d4b71") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 05:28:03.614009 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:03.613781    2575 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-04T05:28:03.042553068Z","UUID":"94bff843-9aa3-4bb8-a3ac-73e108316403","Handler":null,"Name":"","Endpoint":""}
Nov 04 05:28:03.620041 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:03.620017    2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Nov 04 05:28:03.620163 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:03.620055    2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Nov 04 05:28:03.759795 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:03.759733    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8fwjr"
Nov 04 05:28:03.759953 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:03.759835    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8fwjr" podUID="b9aa45f3-1a47-489d-ba9d-76cbe630b283"
Nov 04 05:28:04.014881 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:04.014844    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x5jbk" event={"ID":"1658b916-200e-432c-9ca8-a7814f38e485","Type":"ContainerStarted","Data":"9e6edc04440addb04eca6189b20ff1c55367f0bc5529fdaae5828ac52bb8cc30"}
Nov 04 05:28:04.017067 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:04.017043    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5gwpr" event={"ID":"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7","Type":"ContainerStarted","Data":"245715e93327bafacc97abd5daba9ffa4e82aef5b9d4cab177072ddb1b6847d9"}
Nov 04 05:28:04.020572 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:04.020544    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw" event={"ID":"d0adbb13-2521-4805-b5ba-86b9052b6123","Type":"ContainerStarted","Data":"08db2b61f5fe96c0fe602b3edfacde5342873d31d2c4347339743143d9ec1ee2"}
Nov 04 05:28:04.050750 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:04.050692    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-5gwpr" podStartSLOduration=2.690752929 podStartE2EDuration="10.050676389s" totalImagesPullingTime="7.35992346s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:27:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:28:04.050603528 +0000 UTC m=+9.865926633" watchObservedRunningTime="2026-11-04 05:28:04.050676389 +0000 UTC m=+9.865999470"
Nov 04 05:28:04.762186 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:04.762161    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k54vt"
Nov 04 05:28:04.762358 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:04.762277    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k54vt" podUID="8a855aab-8901-4d7d-8f10-91a8896d4b71"
Nov 04 05:28:04.762358 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:04.762346    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khrhn"
Nov 04 05:28:04.762452 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:04.762434    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khrhn" podUID="2a7a7beb-0136-46a3-84f6-e00b34c4a4a9"
Nov 04 05:28:05.028470 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:05.027919    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw" event={"ID":"d0adbb13-2521-4805-b5ba-86b9052b6123","Type":"ContainerStarted","Data":"fc2508d617ff6866fce1783c6a33c1b6e046d81e2492ccbee539ac5b3a4836d9"}
Nov 04 05:28:05.029778 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:05.029743    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cxr2h" event={"ID":"16031827-bc25-4ecd-b902-0161403f7566","Type":"ContainerStarted","Data":"fc2782d29013f89a6758b7f1210728243cd46707439002947213ef6c413e3e53"}
Nov 04 05:28:05.032039 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:05.032014    2575 generic.go:356] "Generic (PLEG): container finished" podID="1658b916-200e-432c-9ca8-a7814f38e485" containerID="9e6edc04440addb04eca6189b20ff1c55367f0bc5529fdaae5828ac52bb8cc30" exitCode=0
Nov 04 05:28:05.032501 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:05.032475    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x5jbk" event={"ID":"1658b916-200e-432c-9ca8-a7814f38e485","Type":"ContainerDied","Data":"9e6edc04440addb04eca6189b20ff1c55367f0bc5529fdaae5828ac52bb8cc30"}
Nov 04 05:28:05.062982 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:05.062937    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw" podStartSLOduration=3.242652521 podStartE2EDuration="11.062920095s" totalImagesPullingTime="7.820267574s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:27:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:28:05.049402588 +0000 UTC m=+10.864725667" watchObservedRunningTime="2026-11-04 05:28:05.062920095 +0000 UTC m=+10.878243176"
Nov 04 05:28:05.080871 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:05.080824    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cxr2h" podStartSLOduration=3.448881707 podStartE2EDuration="11.080807327s" totalImagesPullingTime="7.63192562s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:27:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:28:05.06233872 +0000 UTC m=+10.877661799" watchObservedRunningTime="2026-11-04 05:28:05.080807327 +0000 UTC m=+10.896130410"
Nov 04 05:28:05.759797 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:05.759722    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8fwjr"
Nov 04 05:28:05.759928 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:05.759833    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8fwjr" podUID="b9aa45f3-1a47-489d-ba9d-76cbe630b283"
Nov 04 05:28:06.035479 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:06.035083    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9tmdx" event={"ID":"88680c4d-b306-483c-a5a7-3d559e078c01","Type":"ContainerStarted","Data":"6520664a42943b30c0e648b3e2f370d30e813e4746fe91144a5c8abfa4325f9d"}
Nov 04 05:28:06.759677 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:06.759649    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k54vt"
Nov 04 05:28:06.759851 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:06.759688    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khrhn"
Nov 04 05:28:06.759851 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:06.759774    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k54vt" podUID="8a855aab-8901-4d7d-8f10-91a8896d4b71"
Nov 04 05:28:06.760014 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:06.759916    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khrhn" podUID="2a7a7beb-0136-46a3-84f6-e00b34c4a4a9"
Nov 04 05:28:07.039487 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:07.039414    2575 generic.go:356] "Generic (PLEG): container finished" podID="1658b916-200e-432c-9ca8-a7814f38e485" containerID="7fbf7b5dd1b42cf2a7df94b393c5f72374333c3c565c95c3fb5e145de0cde256" exitCode=0
Nov 04 05:28:07.039861 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:07.039495    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x5jbk" event={"ID":"1658b916-200e-432c-9ca8-a7814f38e485","Type":"ContainerDied","Data":"7fbf7b5dd1b42cf2a7df94b393c5f72374333c3c565c95c3fb5e145de0cde256"}
Nov 04 05:28:07.060440 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:07.060404    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9tmdx" podStartSLOduration=3.658873004 podStartE2EDuration="13.060392038s" totalImagesPullingTime="9.401519034s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:27:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:28:06.050172404 +0000 UTC m=+11.865495486" watchObservedRunningTime="2026-11-04 05:28:07.060392038 +0000 UTC m=+12.875715146"
Nov 04 05:28:07.760256 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:07.760222    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8fwjr"
Nov 04 05:28:07.760438 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:07.760336    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8fwjr" podUID="b9aa45f3-1a47-489d-ba9d-76cbe630b283"
Nov 04 05:28:08.666318 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:08.666287    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bwn4l"
Nov 04 05:28:08.667134 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:08.666428    2575 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 04 05:28:08.667134 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:08.666985    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bwn4l"
Nov 04 05:28:08.760204 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:08.760178    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k54vt"
Nov 04 05:28:08.760364 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:08.760322    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k54vt" podUID="8a855aab-8901-4d7d-8f10-91a8896d4b71"
Nov 04 05:28:08.760432 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:08.760369    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khrhn"
Nov 04 05:28:08.760480 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:08.760460    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khrhn" podUID="2a7a7beb-0136-46a3-84f6-e00b34c4a4a9"
Nov 04 05:28:09.047043 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:09.046965    2575 generic.go:356] "Generic (PLEG): container finished" podID="1658b916-200e-432c-9ca8-a7814f38e485" containerID="497175b7f3473c5f631a109eeba2b38aa1fac034e5ef36490af9e4bc4995e59c" exitCode=0
Nov 04 05:28:09.047841 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:09.047811    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x5jbk" event={"ID":"1658b916-200e-432c-9ca8-a7814f38e485","Type":"ContainerDied","Data":"497175b7f3473c5f631a109eeba2b38aa1fac034e5ef36490af9e4bc4995e59c"}
Nov 04 05:28:09.760472 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:09.760443    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8fwjr"
Nov 04 05:28:09.761084 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:09.760581    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8fwjr" podUID="b9aa45f3-1a47-489d-ba9d-76cbe630b283"
Nov 04 05:28:10.051589 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:10.051424    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dlb7_f1f789ee-b574-48ba-abd5-cfac0b3d7f40/ovn-acl-logging/0.log"
Nov 04 05:28:10.052188 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:10.052161    2575 generic.go:356] "Generic (PLEG): container finished" podID="f1f789ee-b574-48ba-abd5-cfac0b3d7f40" containerID="1c6514a09d07e21470de95348378f58513755ae042d0f7ce6b29f2d97c4db0cc" exitCode=1
Nov 04 05:28:10.052288 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:10.052228    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7" event={"ID":"f1f789ee-b574-48ba-abd5-cfac0b3d7f40","Type":"ContainerDied","Data":"1c6514a09d07e21470de95348378f58513755ae042d0f7ce6b29f2d97c4db0cc"}
Nov 04 05:28:10.052332 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:10.052310    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7" event={"ID":"f1f789ee-b574-48ba-abd5-cfac0b3d7f40","Type":"ContainerStarted","Data":"fd8b59c56bac5f91934935e60b3bf1e187fa9efe2b15fa8e663ae997cefa8801"}
Nov 04 05:28:10.759594 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:10.759561    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k54vt"
Nov 04 05:28:10.759769 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:10.759561    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khrhn"
Nov 04 05:28:10.759769 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:10.759680    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k54vt" podUID="8a855aab-8901-4d7d-8f10-91a8896d4b71"
Nov 04 05:28:10.759974 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:10.759950    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khrhn" podUID="2a7a7beb-0136-46a3-84f6-e00b34c4a4a9"
Nov 04 05:28:11.056168 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:11.056015    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x7zft" event={"ID":"5510018c-1e4d-4009-bc56-2152f7703f7a","Type":"ContainerStarted","Data":"6d33a9ed1d805cd6fd2bb6301bb67e4cba575c3df6cfa6d8bc2a8f06cbafba6e"}
Nov 04 05:28:11.058789 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:11.058771    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dlb7_f1f789ee-b574-48ba-abd5-cfac0b3d7f40/ovn-acl-logging/0.log"
Nov 04 05:28:11.059113 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:11.059089    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7" event={"ID":"f1f789ee-b574-48ba-abd5-cfac0b3d7f40","Type":"ContainerStarted","Data":"6bb6fc60afbcda02e72e022d73f7417179844f01bf4a89bc7af73c3c86cd27bc"}
Nov 04 05:28:11.059195 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:11.059150    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7" event={"ID":"f1f789ee-b574-48ba-abd5-cfac0b3d7f40","Type":"ContainerStarted","Data":"6a3aa112c4e9617a07e8065e355177a0701ac4ef27341508f0b0085f4dc4bf7b"}
Nov 04 05:28:11.059195 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:11.059181    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7" event={"ID":"f1f789ee-b574-48ba-abd5-cfac0b3d7f40","Type":"ContainerStarted","Data":"a6741f3650cdafc5a015d588c37f1fbd737399fee9efa5f300688201d8077717"}
Nov 04 05:28:11.059264 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:11.059207    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7" event={"ID":"f1f789ee-b574-48ba-abd5-cfac0b3d7f40","Type":"ContainerStarted","Data":"cfc616ca4626e9dd84bda24cebb123f974a6e14a7d863c7ee3d4f1a21d39574f"}
Nov 04 05:28:11.070093 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:11.070007    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-x7zft" podStartSLOduration=2.315528717 podStartE2EDuration="17.069998716s" totalImagesPullingTime="14.754469999s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:27:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:28:11.069881261 +0000 UTC m=+16.885204344" watchObservedRunningTime="2026-11-04 05:28:11.069998716 +0000 UTC m=+16.885321795"
Nov 04 05:28:11.299681 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:11.299627    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a7a7beb-0136-46a3-84f6-e00b34c4a4a9-metrics-certs\") pod \"network-metrics-daemon-khrhn\" (UID: \"2a7a7beb-0136-46a3-84f6-e00b34c4a4a9\") " pod="openshift-multus/network-metrics-daemon-khrhn"
Nov 04 05:28:11.299681 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:11.299676    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b9aa45f3-1a47-489d-ba9d-76cbe630b283-original-pull-secret\") pod \"global-pull-secret-syncer-8fwjr\" (UID: \"b9aa45f3-1a47-489d-ba9d-76cbe630b283\") " pod="kube-system/global-pull-secret-syncer-8fwjr"
Nov 04 05:28:11.299804 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:11.299775    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 05:28:11.299834 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:11.299826    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a7a7beb-0136-46a3-84f6-e00b34c4a4a9-metrics-certs podName:2a7a7beb-0136-46a3-84f6-e00b34c4a4a9 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:27.299814148 +0000 UTC m=+33.115137219 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a7a7beb-0136-46a3-84f6-e00b34c4a4a9-metrics-certs") pod "network-metrics-daemon-khrhn" (UID: "2a7a7beb-0136-46a3-84f6-e00b34c4a4a9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 05:28:11.299876 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:11.299775    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 05:28:11.299907 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:11.299892    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9aa45f3-1a47-489d-ba9d-76cbe630b283-original-pull-secret podName:b9aa45f3-1a47-489d-ba9d-76cbe630b283 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:27.299881353 +0000 UTC m=+33.115204428 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b9aa45f3-1a47-489d-ba9d-76cbe630b283-original-pull-secret") pod "global-pull-secret-syncer-8fwjr" (UID: "b9aa45f3-1a47-489d-ba9d-76cbe630b283") : object "kube-system"/"original-pull-secret" not registered
Nov 04 05:28:11.501107 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:11.501081    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m8jk\" (UniqueName: \"kubernetes.io/projected/8a855aab-8901-4d7d-8f10-91a8896d4b71-kube-api-access-5m8jk\") pod \"network-check-target-k54vt\" (UID: \"8a855aab-8901-4d7d-8f10-91a8896d4b71\") " pod="openshift-network-diagnostics/network-check-target-k54vt"
Nov 04 05:28:11.501223 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:11.501187    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 05:28:11.501223 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:11.501200    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 05:28:11.501223 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:11.501209    2575 projected.go:196] Error preparing data for projected volume kube-api-access-5m8jk for pod openshift-network-diagnostics/network-check-target-k54vt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 05:28:11.501315 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:11.501249    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a855aab-8901-4d7d-8f10-91a8896d4b71-kube-api-access-5m8jk podName:8a855aab-8901-4d7d-8f10-91a8896d4b71 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:27.501236817 +0000 UTC m=+33.316559875 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5m8jk" (UniqueName: "kubernetes.io/projected/8a855aab-8901-4d7d-8f10-91a8896d4b71-kube-api-access-5m8jk") pod "network-check-target-k54vt" (UID: "8a855aab-8901-4d7d-8f10-91a8896d4b71") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 05:28:11.759402 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:11.759380    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8fwjr"
Nov 04 05:28:11.759538 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:11.759486    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8fwjr" podUID="b9aa45f3-1a47-489d-ba9d-76cbe630b283"
Nov 04 05:28:12.063236 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:12.063176    2575 generic.go:356] "Generic (PLEG): container finished" podID="1658b916-200e-432c-9ca8-a7814f38e485" containerID="14485260a5308f0285d1b7920014dfa3b75cb5b60915553b691f4b6115e904bf" exitCode=0
Nov 04 05:28:12.063236 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:12.063222    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x5jbk" event={"ID":"1658b916-200e-432c-9ca8-a7814f38e485","Type":"ContainerDied","Data":"14485260a5308f0285d1b7920014dfa3b75cb5b60915553b691f4b6115e904bf"}
Nov 04 05:28:12.760363 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:12.760338    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k54vt"
Nov 04 05:28:12.760508 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:12.760347    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khrhn"
Nov 04 05:28:12.760508 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:12.760449    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k54vt" podUID="8a855aab-8901-4d7d-8f10-91a8896d4b71"
Nov 04 05:28:12.760658 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:12.760534    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khrhn" podUID="2a7a7beb-0136-46a3-84f6-e00b34c4a4a9"
Nov 04 05:28:13.067947 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:13.067893    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dlb7_f1f789ee-b574-48ba-abd5-cfac0b3d7f40/ovn-acl-logging/0.log"
Nov 04 05:28:13.068325 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:13.068270    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7" event={"ID":"f1f789ee-b574-48ba-abd5-cfac0b3d7f40","Type":"ContainerStarted","Data":"d51bc17df4d1294ad43619b4813380eb23e40bc2f7da9de096000cde15077682"}
Nov 04 05:28:13.071134 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:13.071114    2575 generic.go:356] "Generic (PLEG): container finished" podID="1658b916-200e-432c-9ca8-a7814f38e485" containerID="e3ca6e68478c325d04ffb09c0277bbd41e608945a696ac152f4168daa9ac3a45" exitCode=0
Nov 04 05:28:13.071239 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:13.071153    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x5jbk" event={"ID":"1658b916-200e-432c-9ca8-a7814f38e485","Type":"ContainerDied","Data":"e3ca6e68478c325d04ffb09c0277bbd41e608945a696ac152f4168daa9ac3a45"}
Nov 04 05:28:13.759656 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:13.759632    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8fwjr"
Nov 04 05:28:13.759784 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:13.759718    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8fwjr" podUID="b9aa45f3-1a47-489d-ba9d-76cbe630b283"
Nov 04 05:28:14.076414 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:14.076341    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x5jbk" event={"ID":"1658b916-200e-432c-9ca8-a7814f38e485","Type":"ContainerStarted","Data":"5fe460faac954e1e5e9e7ac817242474d2421a3935eb8c90b63a1004db0de48f"}
Nov 04 05:28:14.101075 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:14.101029    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-x5jbk" podStartSLOduration=9.422674032 podStartE2EDuration="20.101017311s" totalImagesPullingTime="10.678343279s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:27:54 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:28:14.099494138 +0000 UTC m=+19.914817229" watchObservedRunningTime="2026-11-04 05:28:14.101017311 +0000 UTC m=+19.916340391"
Nov 04 05:28:14.760123 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:14.760100    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khrhn"
Nov 04 05:28:14.760251 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:14.760191    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khrhn" podUID="2a7a7beb-0136-46a3-84f6-e00b34c4a4a9"
Nov 04 05:28:14.760293 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:14.760252    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k54vt"
Nov 04 05:28:14.760322 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:14.760304    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k54vt" podUID="8a855aab-8901-4d7d-8f10-91a8896d4b71"
Nov 04 05:28:15.081899 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:15.081829    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dlb7_f1f789ee-b574-48ba-abd5-cfac0b3d7f40/ovn-acl-logging/0.log"
Nov 04 05:28:15.082604 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:15.082203    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7" event={"ID":"f1f789ee-b574-48ba-abd5-cfac0b3d7f40","Type":"ContainerStarted","Data":"795e280072daacf9478ec410e847c1f0eaca72212ac7892c813f3e7011661a27"}
Nov 04 05:28:15.082791 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:15.082774    2575 scope.go:122] "RemoveContainer" containerID="1c6514a09d07e21470de95348378f58513755ae042d0f7ce6b29f2d97c4db0cc"
Nov 04 05:28:15.760352 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:15.760325    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8fwjr"
Nov 04 05:28:15.760488 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:15.760424    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8fwjr" podUID="b9aa45f3-1a47-489d-ba9d-76cbe630b283"
Nov 04 05:28:16.087746 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:16.087687    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dlb7_f1f789ee-b574-48ba-abd5-cfac0b3d7f40/ovn-acl-logging/0.log"
Nov 04 05:28:16.088152 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:16.088119    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7" event={"ID":"f1f789ee-b574-48ba-abd5-cfac0b3d7f40","Type":"ContainerStarted","Data":"2a819683f3a36e5e243d1d625887bbae4a6f19da29fa31f880264744a15742f4"}
Nov 04 05:28:16.088449 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:16.088429    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:16.088622 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:16.088601    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:16.088714 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:16.088682    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:16.105609 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:16.105585    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:16.105722 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:16.105698    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:16.114901 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:16.114879    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k54vt"]
Nov 04 05:28:16.115002 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:16.114971    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k54vt"
Nov 04 05:28:16.115068 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:16.115053    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k54vt" podUID="8a855aab-8901-4d7d-8f10-91a8896d4b71"
Nov 04 05:28:16.117420 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:16.117397    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8fwjr"]
Nov 04 05:28:16.117866 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:16.117483    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8fwjr"
Nov 04 05:28:16.117866 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:16.117592    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8fwjr" podUID="b9aa45f3-1a47-489d-ba9d-76cbe630b283"
Nov 04 05:28:16.118026 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:16.118003    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-khrhn"]
Nov 04 05:28:16.118229 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:16.118210    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khrhn"
Nov 04 05:28:16.118336 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:16.118318    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khrhn" podUID="2a7a7beb-0136-46a3-84f6-e00b34c4a4a9"
Nov 04 05:28:16.118388 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:16.118331    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7" podStartSLOduration=8.281681191 podStartE2EDuration="22.118319908s" totalImagesPullingTime="13.836638717s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:27:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:28:16.117222657 +0000 UTC m=+21.932545737" watchObservedRunningTime="2026-11-04 05:28:16.118319908 +0000 UTC m=+21.933642987"
Nov 04 05:28:17.760083 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:17.760055    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8fwjr"
Nov 04 05:28:17.760711 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:17.760157    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k54vt"
Nov 04 05:28:17.760711 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:17.760182    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khrhn"
Nov 04 05:28:17.760711 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:17.760170    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8fwjr" podUID="b9aa45f3-1a47-489d-ba9d-76cbe630b283"
Nov 04 05:28:17.760711 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:17.760252    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k54vt" podUID="8a855aab-8901-4d7d-8f10-91a8896d4b71"
Nov 04 05:28:17.760711 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:17.760318    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khrhn" podUID="2a7a7beb-0136-46a3-84f6-e00b34c4a4a9"
Nov 04 05:28:19.760141 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:19.760112    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8fwjr"
Nov 04 05:28:19.760141 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:19.760134    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k54vt"
Nov 04 05:28:19.760666 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:19.760113    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khrhn"
Nov 04 05:28:19.760666 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:19.760227    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8fwjr" podUID="b9aa45f3-1a47-489d-ba9d-76cbe630b283"
Nov 04 05:28:19.760666 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:19.760293    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khrhn" podUID="2a7a7beb-0136-46a3-84f6-e00b34c4a4a9"
Nov 04 05:28:19.760666 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:19.760343    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k54vt" podUID="8a855aab-8901-4d7d-8f10-91a8896d4b71"
Nov 04 05:28:21.760503 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:21.760479    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k54vt"
Nov 04 05:28:21.760800 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:21.760513    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khrhn"
Nov 04 05:28:21.760800 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:21.760588    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k54vt" podUID="8a855aab-8901-4d7d-8f10-91a8896d4b71"
Nov 04 05:28:21.760800 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:21.760639    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-khrhn" podUID="2a7a7beb-0136-46a3-84f6-e00b34c4a4a9"
Nov 04 05:28:21.760800 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:21.760677    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8fwjr"
Nov 04 05:28:21.760800 ip-10-0-133-170 kubenswrapper[2575]: E1104 05:28:21.760750    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8fwjr" podUID="b9aa45f3-1a47-489d-ba9d-76cbe630b283"
Nov 04 05:28:22.006375 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:22.006355    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-170.us-east-2.compute.internal" event="NodeReady"
Nov 04 05:28:22.006500 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:22.006438    2575 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Nov 04 05:28:23.760197 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:23.760171    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khrhn"
Nov 04 05:28:23.760578 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:23.760209    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k54vt"
Nov 04 05:28:23.760578 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:23.760293    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8fwjr"
Nov 04 05:28:23.765308 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:23.765282    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pqp2n\""
Nov 04 05:28:23.765430 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:23.765344    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Nov 04 05:28:23.765430 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:23.765349    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-kkpcg\""
Nov 04 05:28:23.765430 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:23.765359    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Nov 04 05:28:23.765430 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:23.765345    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 04 05:28:23.765430 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:23.765382    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-zs9xj\""
Nov 04 05:28:23.765430 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:23.765424    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 04 05:28:23.944985 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:23.944962    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x7zft_5510018c-1e4d-4009-bc56-2152f7703f7a/dns-node-resolver/0.log"
Nov 04 05:28:25.129779 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:25.129752    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s2tjx_02758cc7-baf6-44d1-baa6-87438b8376a2/node-ca/0.log"
Nov 04 05:28:25.134881 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:25.134835    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwn4l_abfc6e5f-914e-4a19-8fd3-c8a844377da3/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:25.515098 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:25.515073    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwn4l_abfc6e5f-914e-4a19-8fd3-c8a844377da3/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:27.313085 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:27.313055    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a7a7beb-0136-46a3-84f6-e00b34c4a4a9-metrics-certs\") pod \"network-metrics-daemon-khrhn\" (UID: \"2a7a7beb-0136-46a3-84f6-e00b34c4a4a9\") " pod="openshift-multus/network-metrics-daemon-khrhn"
Nov 04 05:28:27.313512 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:27.313129    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b9aa45f3-1a47-489d-ba9d-76cbe630b283-original-pull-secret\") pod \"global-pull-secret-syncer-8fwjr\" (UID: \"b9aa45f3-1a47-489d-ba9d-76cbe630b283\") " pod="kube-system/global-pull-secret-syncer-8fwjr"
Nov 04 05:28:27.316541 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:27.316505    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a7a7beb-0136-46a3-84f6-e00b34c4a4a9-metrics-certs\") pod \"network-metrics-daemon-khrhn\" (UID: \"2a7a7beb-0136-46a3-84f6-e00b34c4a4a9\") " pod="openshift-multus/network-metrics-daemon-khrhn"
Nov 04 05:28:27.316665 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:27.316610    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b9aa45f3-1a47-489d-ba9d-76cbe630b283-original-pull-secret\") pod \"global-pull-secret-syncer-8fwjr\" (UID: \"b9aa45f3-1a47-489d-ba9d-76cbe630b283\") " pod="kube-system/global-pull-secret-syncer-8fwjr"
Nov 04 05:28:27.374624 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:27.374605    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-khrhn"
Nov 04 05:28:27.377763 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:27.377733    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8fwjr"
Nov 04 05:28:27.515032 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:27.515004    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m8jk\" (UniqueName: \"kubernetes.io/projected/8a855aab-8901-4d7d-8f10-91a8896d4b71-kube-api-access-5m8jk\") pod \"network-check-target-k54vt\" (UID: \"8a855aab-8901-4d7d-8f10-91a8896d4b71\") " pod="openshift-network-diagnostics/network-check-target-k54vt"
Nov 04 05:28:27.518251 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:27.518225    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m8jk\" (UniqueName: \"kubernetes.io/projected/8a855aab-8901-4d7d-8f10-91a8896d4b71-kube-api-access-5m8jk\") pod \"network-check-target-k54vt\" (UID: \"8a855aab-8901-4d7d-8f10-91a8896d4b71\") " pod="openshift-network-diagnostics/network-check-target-k54vt"
Nov 04 05:28:27.682142 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:27.682081    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k54vt"
Nov 04 05:28:27.731104 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:27.731035    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8fwjr"]
Nov 04 05:28:27.733825 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:27.733804    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-khrhn"]
Nov 04 05:28:27.735847 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:28:27.735811    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9aa45f3_1a47_489d_ba9d_76cbe630b283.slice/crio-d040d5725ab3eec490524699c0edfe9798be8f355e2f087e8eef92afcec38c96 WatchSource:0}: Error finding container d040d5725ab3eec490524699c0edfe9798be8f355e2f087e8eef92afcec38c96: Status 404 returned error can't find the container with id d040d5725ab3eec490524699c0edfe9798be8f355e2f087e8eef92afcec38c96
Nov 04 05:28:27.736857 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:28:27.736831    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a7a7beb_0136_46a3_84f6_e00b34c4a4a9.slice/crio-a9e1958025ee8d8fb70e4de8f1d8752db6bc975b5ae2d4941b3093b8bb7473ae WatchSource:0}: Error finding container a9e1958025ee8d8fb70e4de8f1d8752db6bc975b5ae2d4941b3093b8bb7473ae: Status 404 returned error can't find the container with id a9e1958025ee8d8fb70e4de8f1d8752db6bc975b5ae2d4941b3093b8bb7473ae
Nov 04 05:28:27.984707 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:27.984636    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k54vt"]
Nov 04 05:28:27.987766 ip-10-0-133-170 kubenswrapper[2575]: W1104 05:28:27.987734    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a855aab_8901_4d7d_8f10_91a8896d4b71.slice/crio-c2c32e7d42fa40eb787b9c9f45da7b4f1f692904548f92f1dc8b4818ce4c5224 WatchSource:0}: Error finding container c2c32e7d42fa40eb787b9c9f45da7b4f1f692904548f92f1dc8b4818ce4c5224: Status 404 returned error can't find the container with id c2c32e7d42fa40eb787b9c9f45da7b4f1f692904548f92f1dc8b4818ce4c5224
Nov 04 05:28:28.117508 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:28.117479    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-khrhn" event={"ID":"2a7a7beb-0136-46a3-84f6-e00b34c4a4a9","Type":"ContainerStarted","Data":"a9e1958025ee8d8fb70e4de8f1d8752db6bc975b5ae2d4941b3093b8bb7473ae"}
Nov 04 05:28:28.118608 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:28.118579    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k54vt" event={"ID":"8a855aab-8901-4d7d-8f10-91a8896d4b71","Type":"ContainerStarted","Data":"c2c32e7d42fa40eb787b9c9f45da7b4f1f692904548f92f1dc8b4818ce4c5224"}
Nov 04 05:28:28.119592 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:28.119570    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8fwjr" event={"ID":"b9aa45f3-1a47-489d-ba9d-76cbe630b283","Type":"ContainerStarted","Data":"d040d5725ab3eec490524699c0edfe9798be8f355e2f087e8eef92afcec38c96"}
Nov 04 05:28:30.126436 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:30.126399    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-khrhn" event={"ID":"2a7a7beb-0136-46a3-84f6-e00b34c4a4a9","Type":"ContainerStarted","Data":"122b1f32496bf5c5a82c5027f22b1318e9e8a5e60829111f08aa025093029def"}
Nov 04 05:28:30.126953 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:30.126460    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-khrhn" event={"ID":"2a7a7beb-0136-46a3-84f6-e00b34c4a4a9","Type":"ContainerStarted","Data":"f03c1d2c615c0d53828921acb2efc6cbbe0b1baf15373082fa666179272d518a"}
Nov 04 05:28:30.142356 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:30.142305    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-khrhn" podStartSLOduration=34.625369565 podStartE2EDuration="36.142293442s" totalImagesPullingTime="1.516923877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:27:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:28:30.140695853 +0000 UTC m=+35.956018947" watchObservedRunningTime="2026-11-04 05:28:30.142293442 +0000 UTC m=+35.957616521"
Nov 04 05:28:32.132747 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:32.132708    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k54vt" event={"ID":"8a855aab-8901-4d7d-8f10-91a8896d4b71","Type":"ContainerStarted","Data":"45c99194a284fc9c73eb14b0d80c388e53308c887bec2647c75a58c87a4fa6a1"}
Nov 04 05:28:32.133198 ip-10-0-133-170 kubenswrapper[2575]: I1104 05:28:32.132843    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-k54vt"
Nov 04 05:28:33.077081 ip-10-0-133-170 systemd[1]: Stopping Kubernetes Kubelet...
Nov 04 05:28:33.091862 ip-10-0-133-170 systemd[1]: kubelet.service: Deactivated successfully.
Nov 04 05:28:33.092079 ip-10-0-133-170 systemd[1]: Stopped Kubernetes Kubelet.
Nov 04 05:28:33.092137 ip-10-0-133-170 systemd[1]: kubelet.service: Consumed 2.021s CPU time.
Nov 04 05:28:33.103109 ip-10-0-133-170 systemd[1]: Starting Kubernetes Kubelet...
Nov 04 05:28:33.191506 ip-10-0-133-170 kubenswrapper[4357]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 05:28:33.191506 ip-10-0-133-170 kubenswrapper[4357]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Nov 04 05:28:33.191506 ip-10-0-133-170 kubenswrapper[4357]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 05:28:33.191972 ip-10-0-133-170 kubenswrapper[4357]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 05:28:33.193548 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193468    4357 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:28:33.193548 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193548    4357 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:28:33.193614 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193551    4357 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:28:33.193614 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193555    4357 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:28:33.193614 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193558    4357 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:28:33.193614 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193562    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:28:33.193614 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193564    4357 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:28:33.193614 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193567    4357 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:28:33.193614 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193570    4357 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:28:33.193614 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193573    4357 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:28:33.193614 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193576    4357 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:28:33.193614 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193579    4357 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:28:33.193614 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193582    4357 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:28:33.193614 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193584    4357 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:28:33.193614 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193587    4357 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:28:33.193614 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193590    4357 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:28:33.193614 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193592    4357 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:28:33.193614 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193599    4357 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:28:33.193614 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193602    4357 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:28:33.193614 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193605    4357 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:28:33.193614 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193608    4357 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:28:33.193614 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193610    4357 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:28:33.194123 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193613    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:28:33.194123 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193616    4357 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:28:33.194123 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193619    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:28:33.194123 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193624    4357 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:28:33.194123 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193629    4357 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:28:33.194123 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193632    4357 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:28:33.194123 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193634    4357 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:28:33.194123 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193637    4357 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:28:33.194123 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193640    4357 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:28:33.194123 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193643    4357 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:28:33.194123 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193646    4357 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:28:33.194123 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193648    4357 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:28:33.194123 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193651    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:28:33.194123 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193654    4357 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:28:33.194123 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193656    4357 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:28:33.194123 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193659    4357 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:28:33.194123 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193662    4357 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:28:33.194123 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193664    4357 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:28:33.194123 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193667    4357 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:28:33.194611 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193670    4357 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:28:33.194611 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193672    4357 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:28:33.194611 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193675    4357 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:28:33.194611 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193677    4357 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:28:33.194611 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193680    4357 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:28:33.194611 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193683    4357 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:28:33.194611 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193686    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:28:33.194611 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193689    4357 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:28:33.194611 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193691    4357 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:28:33.194611 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193694    4357 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:28:33.194611 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193697    4357 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:28:33.194611 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193699    4357 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:28:33.194611 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193702    4357 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:28:33.194611 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193704    4357 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:28:33.194611 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193707    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:28:33.194611 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193710    4357 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:28:33.194611 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193713    4357 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:28:33.194611 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193715    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:28:33.194611 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193718    4357 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:28:33.195077 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193721    4357 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:28:33.195077 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193724    4357 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:28:33.195077 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193726    4357 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:28:33.195077 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193730    4357 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:28:33.195077 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193732    4357 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:28:33.195077 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193738    4357 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:28:33.195077 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193742    4357 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:28:33.195077 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193744    4357 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:28:33.195077 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193747    4357 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:28:33.195077 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193749    4357 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:28:33.195077 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193752    4357 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:28:33.195077 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193755    4357 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:28:33.195077 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193758    4357 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:28:33.195077 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193762    4357 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:28:33.195077 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193765    4357 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:28:33.195077 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193769    4357 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:28:33.195077 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193772    4357 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:28:33.195077 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193775    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:28:33.195077 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193777    4357 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:28:33.195543 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193780    4357 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:28:33.195543 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193782    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:28:33.195543 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193785    4357 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:28:33.195543 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193788    4357 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:28:33.195543 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193790    4357 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:28:33.195543 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193793    4357 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:28:33.195543 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193795    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:28:33.195543 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193798    4357 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:28:33.195543 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193801    4357 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:28:33.195543 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193804    4357 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:28:33.195543 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193807    4357 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:28:33.195543 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193810    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:28:33.195543 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193813    4357 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:28:33.195543 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193816    4357 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:28:33.195543 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193819    4357 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:28:33.195543 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193822    4357 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:28:33.195543 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193826    4357 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:28:33.195543 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193828    4357 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:28:33.195543 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193831    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:28:33.196142 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193834    4357 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:28:33.196142 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193837    4357 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:28:33.196142 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193840    4357 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:28:33.196142 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193842    4357 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:28:33.196142 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193845    4357 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:28:33.196142 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193848    4357 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:28:33.196142 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193850    4357 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:28:33.196142 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.193854    4357 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:28:33.196142 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194645    4357 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:28:33.196142 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194652    4357 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:28:33.196142 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194655    4357 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:28:33.196142 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194658    4357 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:28:33.196142 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194661    4357 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:28:33.196142 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194664    4357 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:28:33.196142 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194667    4357 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:28:33.196142 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194669    4357 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:28:33.196142 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194672    4357 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:28:33.196142 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194675    4357 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:28:33.196142 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194677    4357 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:28:33.196665 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194684    4357 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:28:33.196665 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194693    4357 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:28:33.196665 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194696    4357 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:28:33.196665 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194699    4357 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:28:33.196665 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194702    4357 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:28:33.196665 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194706    4357 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:28:33.196665 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194709    4357 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:28:33.196665 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194711    4357 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:28:33.196665 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194714    4357 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:28:33.196665 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194717    4357 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:28:33.196665 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194720    4357 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:28:33.196665 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194722    4357 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:28:33.196665 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194725    4357 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:28:33.196665 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194727    4357 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:28:33.196665 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194730    4357 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:28:33.196665 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194733    4357 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:28:33.196665 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194736    4357 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:28:33.196665 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194739    4357 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:28:33.196665 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194742    4357 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:28:33.196665 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194746    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:28:33.197164 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194748    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:28:33.197164 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194751    4357 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:28:33.197164 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194754    4357 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:28:33.197164 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194756    4357 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:28:33.197164 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194759    4357 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:28:33.197164 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194761    4357 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:28:33.197164 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194764    4357 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:28:33.197164 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194767    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:28:33.197164 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194769    4357 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:28:33.197164 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194772    4357 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:28:33.197164 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194776    4357 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:28:33.197164 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194780    4357 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:28:33.197164 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194785    4357 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:28:33.197164 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194788    4357 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:28:33.197164 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194791    4357 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:28:33.197164 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194794    4357 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:28:33.197164 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194797    4357 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:28:33.197164 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194800    4357 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:28:33.197164 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194803    4357 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:28:33.197677 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194805    4357 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:28:33.197677 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194808    4357 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:28:33.197677 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194811    4357 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:28:33.197677 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194815    4357 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:28:33.197677 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194818    4357 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:28:33.197677 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194821    4357 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:28:33.197677 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194824    4357 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:28:33.197677 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194826    4357 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:28:33.197677 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194830    4357 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:28:33.197677 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194832    4357 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:28:33.197677 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194835    4357 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:28:33.197677 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194838    4357 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:28:33.197677 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194841    4357 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:28:33.197677 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194843    4357 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:28:33.197677 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194846    4357 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:28:33.197677 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194849    4357 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:28:33.197677 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194852    4357 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:28:33.197677 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194854    4357 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:28:33.197677 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194857    4357 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:28:33.198149 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194861    4357 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:28:33.198149 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194865    4357 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:28:33.198149 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194868    4357 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:28:33.198149 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194871    4357 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:28:33.198149 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194874    4357 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:28:33.198149 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194877    4357 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:28:33.198149 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194881    4357 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:28:33.198149 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194884    4357 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:28:33.198149 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194887    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:28:33.198149 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194890    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:28:33.198149 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194893    4357 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:28:33.198149 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194895    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:28:33.198149 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194898    4357 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:28:33.198149 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194901    4357 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:28:33.198149 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194903    4357 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:28:33.198149 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194906    4357 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:28:33.198149 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194909    4357 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:28:33.198149 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194911    4357 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:28:33.198149 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194914    4357 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:28:33.198149 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194916    4357 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:28:33.198653 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194919    4357 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:28:33.198653 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194922    4357 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:28:33.198653 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194925    4357 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:28:33.198653 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194929    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:28:33.198653 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194931    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:28:33.198653 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194934    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:28:33.198653 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194936    4357 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:28:33.198653 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194939    4357 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:28:33.198653 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194942    4357 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:28:33.198653 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194944    4357 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:28:33.198653 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194947    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:28:33.198653 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194949    4357 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:28:33.198653 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194952    4357 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:28:33.198653 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194954    4357 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:28:33.198653 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194957    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:28:33.198653 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194960    4357 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:28:33.198653 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.194962    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:28:33.198653 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195444    4357 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:28:33.198653 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195453    4357 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:28:33.199163 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195458    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:28:33.199163 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195461    4357 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:28:33.199163 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195464    4357 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:28:33.199163 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195467    4357 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:28:33.199163 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195471    4357 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:28:33.199163 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195473    4357 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:28:33.199163 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195476    4357 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:28:33.199163 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195479    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:28:33.199163 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195482    4357 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:28:33.199163 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195485    4357 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:28:33.199163 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195487    4357 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:28:33.199163 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195490    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:28:33.199163 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195493    4357 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:28:33.199163 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195496    4357 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:28:33.199163 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195498    4357 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:28:33.199163 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195501    4357 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:28:33.199163 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195504    4357 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:28:33.199163 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195507    4357 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:28:33.199163 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195510    4357 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:28:33.199163 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195529    4357 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:28:33.199668 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195534    4357 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:28:33.199668 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195537    4357 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:28:33.199668 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195540    4357 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:28:33.199668 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195542    4357 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:28:33.199668 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195545    4357 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:28:33.199668 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195548    4357 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:28:33.199668 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195551    4357 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:28:33.199668 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195554    4357 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:28:33.199668 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195557    4357 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:28:33.199668 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195560    4357 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:28:33.199668 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195562    4357 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:28:33.199668 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195566    4357 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:28:33.199668 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195569    4357 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:28:33.199668 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195572    4357 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:28:33.199668 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195574    4357 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:28:33.199668 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195577    4357 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:28:33.199668 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195580    4357 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:28:33.199668 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195583    4357 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:28:33.199668 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195587    4357 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:28:33.199668 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195590    4357 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:28:33.200345 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195593    4357 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:28:33.200345 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195596    4357 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:28:33.200345 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195598    4357 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:28:33.200345 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195601    4357 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:28:33.200345 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195604    4357 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:28:33.200345 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195607    4357 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:28:33.200345 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195609    4357 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:28:33.200345 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195612    4357 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:28:33.200345 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195615    4357 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:28:33.200345 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195618    4357 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:28:33.200345 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195621    4357 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:28:33.200345 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195624    4357 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:28:33.200345 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195627    4357 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:28:33.200345 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195629    4357 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:28:33.200345 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195632    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:28:33.200345 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195634    4357 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:28:33.200345 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195637    4357 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:28:33.200345 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195640    4357 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:28:33.200345 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195642    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:28:33.201112 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195645    4357 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:28:33.201112 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195647    4357 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:28:33.201112 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195650    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:28:33.201112 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195653    4357 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:28:33.201112 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195657    4357 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:28:33.201112 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195660    4357 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:28:33.201112 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195663    4357 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:28:33.201112 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195665    4357 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:28:33.201112 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195668    4357 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:28:33.201112 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195671    4357 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:28:33.201112 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195674    4357 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:28:33.201112 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195676    4357 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:28:33.201112 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195679    4357 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:28:33.201112 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195682    4357 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:28:33.201112 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195684    4357 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:28:33.201112 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195687    4357 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:28:33.201112 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195690    4357 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:28:33.201112 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195692    4357 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:28:33.201112 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195695    4357 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:28:33.201112 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195698    4357 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:28:33.201968 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195700    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:28:33.201968 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195703    4357 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:28:33.201968 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195706    4357 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:28:33.201968 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195709    4357 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:28:33.201968 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195712    4357 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:28:33.201968 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195714    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:28:33.201968 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195717    4357 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:28:33.201968 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195720    4357 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:28:33.201968 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195722    4357 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:28:33.201968 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195725    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:28:33.201968 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195728    4357 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:28:33.201968 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195730    4357 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:28:33.201968 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195733    4357 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:28:33.201968 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195735    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:28:33.201968 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195738    4357 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:28:33.201968 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195742    4357 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:28:33.201968 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195746    4357 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:28:33.201968 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195749    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:28:33.201968 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195752    4357 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:28:33.202821 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195755    4357 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:28:33.202821 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195757    4357 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:28:33.202821 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195760    4357 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:28:33.202821 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195763    4357 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:28:33.202821 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195767    4357 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:28:33.202821 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.195772    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:28:33.202821 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.195871    4357 flags.go:64] FLAG: --address="0.0.0.0"
Nov 04 05:28:33.202821 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.195879    4357 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Nov 04 05:28:33.202821 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.195886    4357 flags.go:64] FLAG: --anonymous-auth="true"
Nov 04 05:28:33.202821 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.195890    4357 flags.go:64] FLAG: --application-metrics-count-limit="100"
Nov 04 05:28:33.202821 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.195895    4357 flags.go:64] FLAG: --authentication-token-webhook="false"
Nov 04 05:28:33.202821 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.195898    4357 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Nov 04 05:28:33.202821 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.195902    4357 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Nov 04 05:28:33.202821 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.195906    4357 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Nov 04 05:28:33.202821 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.195910    4357 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Nov 04 05:28:33.202821 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.195913    4357 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Nov 04 05:28:33.202821 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.195917    4357 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Nov 04 05:28:33.202821 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.195920    4357 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Nov 04 05:28:33.202821 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.195924    4357 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Nov 04 05:28:33.202821 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.195927    4357 flags.go:64] FLAG: --cgroup-root=""
Nov 04 05:28:33.202821 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.195930    4357 flags.go:64] FLAG: --cgroups-per-qos="true"
Nov 04 05:28:33.202821 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.195933    4357 flags.go:64] FLAG: --client-ca-file=""
Nov 04 05:28:33.203803 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.195936    4357 flags.go:64] FLAG: --cloud-provider="external"
Nov 04 05:28:33.203803 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.195939    4357 flags.go:64] FLAG: --cluster-dns="[]"
Nov 04 05:28:33.203803 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.195943    4357 flags.go:64] FLAG: --cluster-domain=""
Nov 04 05:28:33.203803 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.195946    4357 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Nov 04 05:28:33.203803 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.195949    4357 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Nov 04 05:28:33.203803 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.195953    4357 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Nov 04 05:28:33.203803 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.195958    4357 flags.go:64] FLAG: --container-log-max-files="5"
Nov 04 05:28:33.203803 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.195963    4357 flags.go:64] FLAG: --container-log-max-size="10Mi"
Nov 04 05:28:33.203803 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.195966    4357 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Nov 04 05:28:33.203803 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.195969    4357 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Nov 04 05:28:33.203803 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.195973    4357 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Nov 04 05:28:33.203803 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.195976    4357 flags.go:64] FLAG: --contention-profiling="false"
Nov 04 05:28:33.203803 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.195980    4357 flags.go:64] FLAG: --cpu-cfs-quota="true"
Nov 04 05:28:33.203803 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.195983    4357 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Nov 04 05:28:33.203803 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.195986    4357 flags.go:64] FLAG: --cpu-manager-policy="none"
Nov 04 05:28:33.203803 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.195989    4357 flags.go:64] FLAG: --cpu-manager-policy-options=""
Nov 04 05:28:33.203803 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.195993    4357 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Nov 04 05:28:33.203803 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.195996    4357 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Nov 04 05:28:33.203803 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.195999    4357 flags.go:64] FLAG: --enable-debugging-handlers="true"
Nov 04 05:28:33.203803 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196002    4357 flags.go:64] FLAG: --enable-load-reader="false"
Nov 04 05:28:33.203803 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196006    4357 flags.go:64] FLAG: --enable-server="true"
Nov 04 05:28:33.203803 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196009    4357 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Nov 04 05:28:33.203803 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196013    4357 flags.go:64] FLAG: --event-burst="100"
Nov 04 05:28:33.203803 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196016    4357 flags.go:64] FLAG: --event-qps="50"
Nov 04 05:28:33.203803 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196019    4357 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Nov 04 05:28:33.204967 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196023    4357 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Nov 04 05:28:33.204967 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196026    4357 flags.go:64] FLAG: --eviction-hard=""
Nov 04 05:28:33.204967 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196030    4357 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Nov 04 05:28:33.204967 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196033    4357 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Nov 04 05:28:33.204967 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196036    4357 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Nov 04 05:28:33.204967 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196040    4357 flags.go:64] FLAG: --eviction-soft=""
Nov 04 05:28:33.204967 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196043    4357 flags.go:64] FLAG: --eviction-soft-grace-period=""
Nov 04 05:28:33.204967 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196046    4357 flags.go:64] FLAG: --exit-on-lock-contention="false"
Nov 04 05:28:33.204967 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196048    4357 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Nov 04 05:28:33.204967 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196051    4357 flags.go:64] FLAG: --experimental-mounter-path=""
Nov 04 05:28:33.204967 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196054    4357 flags.go:64] FLAG: --fail-cgroupv1="true"
Nov 04 05:28:33.204967 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196057    4357 flags.go:64] FLAG: --fail-swap-on="true"
Nov 04 05:28:33.204967 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196060    4357 flags.go:64] FLAG: --feature-gates=""
Nov 04 05:28:33.204967 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196066    4357 flags.go:64] FLAG: --file-check-frequency="20s"
Nov 04 05:28:33.204967 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196071    4357 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Nov 04 05:28:33.204967 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196074    4357 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Nov 04 05:28:33.204967 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196077    4357 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Nov 04 05:28:33.204967 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196080    4357 flags.go:64] FLAG: --healthz-port="10248"
Nov 04 05:28:33.204967 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196083    4357 flags.go:64] FLAG: --help="false"
Nov 04 05:28:33.204967 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196086    4357 flags.go:64] FLAG: --hostname-override="ip-10-0-133-170.us-east-2.compute.internal"
Nov 04 05:28:33.204967 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196090    4357 flags.go:64] FLAG: --housekeeping-interval="10s"
Nov 04 05:28:33.204967 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196093    4357 flags.go:64] FLAG: --http-check-frequency="20s"
Nov 04 05:28:33.204967 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196096    4357 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Nov 04 05:28:33.206006 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196099    4357 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Nov 04 05:28:33.206006 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196103    4357 flags.go:64] FLAG: --image-gc-high-threshold="85"
Nov 04 05:28:33.206006 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196106    4357 flags.go:64] FLAG: --image-gc-low-threshold="80"
Nov 04 05:28:33.206006 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196109    4357 flags.go:64] FLAG: --image-service-endpoint=""
Nov 04 05:28:33.206006 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196112    4357 flags.go:64] FLAG: --kernel-memcg-notification="false"
Nov 04 05:28:33.206006 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196114    4357 flags.go:64] FLAG: --kube-api-burst="100"
Nov 04 05:28:33.206006 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196117    4357 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Nov 04 05:28:33.206006 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196120    4357 flags.go:64] FLAG: --kube-api-qps="50"
Nov 04 05:28:33.206006 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196124    4357 flags.go:64] FLAG: --kube-reserved=""
Nov 04 05:28:33.206006 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196127    4357 flags.go:64] FLAG: --kube-reserved-cgroup=""
Nov 04 05:28:33.206006 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196130    4357 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Nov 04 05:28:33.206006 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196133    4357 flags.go:64] FLAG: --kubelet-cgroups=""
Nov 04 05:28:33.206006 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196136    4357 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Nov 04 05:28:33.206006 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196139    4357 flags.go:64] FLAG: --lock-file=""
Nov 04 05:28:33.206006 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196142    4357 flags.go:64] FLAG: --log-cadvisor-usage="false"
Nov 04 05:28:33.206006 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196145    4357 flags.go:64] FLAG: --log-flush-frequency="5s"
Nov 04 05:28:33.206006 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196148    4357 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Nov 04 05:28:33.206006 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196154    4357 flags.go:64] FLAG: --log-json-split-stream="false"
Nov 04 05:28:33.206006 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196157    4357 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Nov 04 05:28:33.206006 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196161    4357 flags.go:64] FLAG: --log-text-split-stream="false"
Nov 04 05:28:33.206006 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196164    4357 flags.go:64] FLAG: --logging-format="text"
Nov 04 05:28:33.206006 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196167    4357 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Nov 04 05:28:33.206006 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196171    4357 flags.go:64] FLAG: --make-iptables-util-chains="true"
Nov 04 05:28:33.206006 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196175    4357 flags.go:64] FLAG: --manifest-url=""
Nov 04 05:28:33.207055 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196178    4357 flags.go:64] FLAG: --manifest-url-header=""
Nov 04 05:28:33.207055 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196182    4357 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Nov 04 05:28:33.207055 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196185    4357 flags.go:64] FLAG: --max-open-files="1000000"
Nov 04 05:28:33.207055 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196189    4357 flags.go:64] FLAG: --max-pods="110"
Nov 04 05:28:33.207055 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196192    4357 flags.go:64] FLAG: --maximum-dead-containers="-1"
Nov 04 05:28:33.207055 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196195    4357 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Nov 04 05:28:33.207055 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196199    4357 flags.go:64] FLAG: --memory-manager-policy="None"
Nov 04 05:28:33.207055 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196202    4357 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Nov 04 05:28:33.207055 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196205    4357 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Nov 04 05:28:33.207055 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196208    4357 flags.go:64] FLAG: --node-ip="0.0.0.0"
Nov 04 05:28:33.207055 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196211    4357 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Nov 04 05:28:33.207055 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196218    4357 flags.go:64] FLAG: --node-status-max-images="50"
Nov 04 05:28:33.207055 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196221    4357 flags.go:64] FLAG: --node-status-update-frequency="10s"
Nov 04 05:28:33.207055 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196224    4357 flags.go:64] FLAG: --oom-score-adj="-999"
Nov 04 05:28:33.207055 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196227    4357 flags.go:64] FLAG: --pod-cidr=""
Nov 04 05:28:33.207055 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196230    4357 flags.go:64] FLAG: --pod-manifest-path=""
Nov 04 05:28:33.207055 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196233    4357 flags.go:64] FLAG: --pod-max-pids="-1"
Nov 04 05:28:33.207055 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196236    4357 flags.go:64] FLAG: --pods-per-core="0"
Nov 04 05:28:33.207055 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196239    4357 flags.go:64] FLAG: --port="10250"
Nov 04 05:28:33.207055 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196242    4357 flags.go:64] FLAG: --protect-kernel-defaults="false"
Nov 04 05:28:33.207055 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196245    4357 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-07076f06eba7dd60c"
Nov 04 05:28:33.207055 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196249    4357 flags.go:64] FLAG: --qos-reserved=""
Nov 04 05:28:33.207055 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196252    4357 flags.go:64] FLAG: --read-only-port="10255"
Nov 04 05:28:33.207055 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196255    4357 flags.go:64] FLAG: --register-node="true"
Nov 04 05:28:33.207055 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196258    4357 flags.go:64] FLAG: --register-with-taints=""
Nov 04 05:28:33.207055 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196262    4357 flags.go:64] FLAG: --registry-burst="10"
Nov 04 05:28:33.208177 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196265    4357 flags.go:64] FLAG: --registry-qps="5"
Nov 04 05:28:33.208177 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196268    4357 flags.go:64] FLAG: --reserved-cpus=""
Nov 04 05:28:33.208177 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196271    4357 flags.go:64] FLAG: --reserved-memory=""
Nov 04 05:28:33.208177 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196275    4357 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Nov 04 05:28:33.208177 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196280    4357 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Nov 04 05:28:33.208177 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196283    4357 flags.go:64] FLAG: --rotate-certificates="false"
Nov 04 05:28:33.208177 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196286    4357 flags.go:64] FLAG: --rotate-server-certificates="false"
Nov 04 05:28:33.208177 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196289    4357 flags.go:64] FLAG: --runonce="false"
Nov 04 05:28:33.208177 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196292    4357 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Nov 04 05:28:33.208177 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196295    4357 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Nov 04 05:28:33.208177 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196298    4357 flags.go:64] FLAG: --seccomp-default="false"
Nov 04 05:28:33.208177 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196301    4357 flags.go:64] FLAG: --serialize-image-pulls="true"
Nov 04 05:28:33.208177 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196304    4357 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Nov 04 05:28:33.208177 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196307    4357 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Nov 04 05:28:33.208177 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196310    4357 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Nov 04 05:28:33.208177 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196313    4357 flags.go:64] FLAG: --storage-driver-password="root"
Nov 04 05:28:33.208177 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196317    4357 flags.go:64] FLAG: --storage-driver-secure="false"
Nov 04 05:28:33.208177 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196320    4357 flags.go:64] FLAG: --storage-driver-table="stats"
Nov 04 05:28:33.208177 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196323    4357 flags.go:64] FLAG: --storage-driver-user="root"
Nov 04 05:28:33.208177 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196326    4357 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Nov 04 05:28:33.208177 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196329    4357 flags.go:64] FLAG: --sync-frequency="1m0s"
Nov 04 05:28:33.208177 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196332    4357 flags.go:64] FLAG: --system-cgroups=""
Nov 04 05:28:33.208177 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196335    4357 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Nov 04 05:28:33.208177 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196340    4357 flags.go:64] FLAG: --system-reserved-cgroup=""
Nov 04 05:28:33.208177 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196344    4357 flags.go:64] FLAG: --tls-cert-file=""
Nov 04 05:28:33.209245 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196347    4357 flags.go:64] FLAG: --tls-cipher-suites="[]"
Nov 04 05:28:33.209245 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196350    4357 flags.go:64] FLAG: --tls-min-version=""
Nov 04 05:28:33.209245 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196353    4357 flags.go:64] FLAG: --tls-private-key-file=""
Nov 04 05:28:33.209245 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196357    4357 flags.go:64] FLAG: --topology-manager-policy="none"
Nov 04 05:28:33.209245 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196360    4357 flags.go:64] FLAG: --topology-manager-policy-options=""
Nov 04 05:28:33.209245 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196363    4357 flags.go:64] FLAG: --topology-manager-scope="container"
Nov 04 05:28:33.209245 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196366    4357 flags.go:64] FLAG: --v="2"
Nov 04 05:28:33.209245 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196370    4357 flags.go:64] FLAG: --version="false"
Nov 04 05:28:33.209245 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196375    4357 flags.go:64] FLAG: --vmodule=""
Nov 04 05:28:33.209245 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196378    4357 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Nov 04 05:28:33.209245 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196382    4357 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Nov 04 05:28:33.209245 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196541    4357 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:28:33.209245 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196545    4357 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:28:33.209245 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196549    4357 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:28:33.209245 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196552    4357 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:28:33.209245 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196555    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:28:33.209245 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196557    4357 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:28:33.209245 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196560    4357 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:28:33.209245 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196563    4357 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:28:33.209245 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196565    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:28:33.209245 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196568    4357 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:28:33.209245 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196571    4357 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:28:33.209939 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196573    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:28:33.209939 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196576    4357 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:28:33.209939 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196579    4357 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:28:33.209939 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196582    4357 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:28:33.209939 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196584    4357 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:28:33.209939 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196587    4357 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:28:33.209939 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196590    4357 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:28:33.209939 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196592    4357 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:28:33.209939 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196595    4357 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:28:33.209939 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196597    4357 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:28:33.209939 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196600    4357 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:28:33.209939 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196603    4357 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:28:33.209939 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196606    4357 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:28:33.209939 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196608    4357 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:28:33.209939 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196612    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:28:33.209939 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196614    4357 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:28:33.209939 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196617    4357 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:28:33.209939 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196620    4357 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:28:33.209939 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196623    4357 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:28:33.209939 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196625    4357 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:28:33.210579 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196628    4357 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:28:33.210579 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196632    4357 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:28:33.210579 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196635    4357 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:28:33.210579 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196638    4357 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:28:33.210579 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196640    4357 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:28:33.210579 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196643    4357 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:28:33.210579 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196645    4357 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:28:33.210579 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196648    4357 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:28:33.210579 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196651    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:28:33.210579 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196653    4357 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:28:33.210579 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196656    4357 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:28:33.210579 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196659    4357 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:28:33.210579 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196662    4357 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:28:33.210579 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196664    4357 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:28:33.210579 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196667    4357 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:28:33.210579 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196670    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:28:33.210579 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196672    4357 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:28:33.210579 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196675    4357 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:28:33.210579 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196678    4357 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:28:33.211180 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196682    4357 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:28:33.211180 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196687    4357 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:28:33.211180 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196691    4357 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:28:33.211180 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196694    4357 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:28:33.211180 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196698    4357 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:28:33.211180 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196701    4357 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:28:33.211180 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196704    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:28:33.211180 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196706    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:28:33.211180 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196710    4357 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:28:33.211180 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196713    4357 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:28:33.211180 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196717    4357 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:28:33.211180 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196720    4357 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:28:33.211180 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196722    4357 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:28:33.211180 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196725    4357 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:28:33.211180 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196729    4357 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:28:33.211180 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196732    4357 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:28:33.211180 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196734    4357 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:28:33.211180 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196737    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:28:33.211180 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196739    4357 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:28:33.211714 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196742    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:28:33.211714 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196745    4357 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:28:33.211714 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196748    4357 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:28:33.211714 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196751    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:28:33.211714 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196753    4357 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:28:33.211714 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196756    4357 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:28:33.211714 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196759    4357 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:28:33.211714 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196762    4357 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:28:33.211714 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196765    4357 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:28:33.211714 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196767    4357 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:28:33.211714 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196770    4357 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:28:33.211714 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196773    4357 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:28:33.211714 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196775    4357 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:28:33.211714 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196778    4357 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:28:33.211714 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196781    4357 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:28:33.211714 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196785    4357 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:28:33.211714 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196788    4357 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:28:33.211714 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196791    4357 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:28:33.211714 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196794    4357 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:28:33.212300 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196797    4357 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:28:33.212300 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196800    4357 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:28:33.212300 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196802    4357 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:28:33.212300 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196806    4357 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:28:33.212300 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196810    4357 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:28:33.212300 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196813    4357 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:28:33.212300 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196815    4357 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:28:33.212300 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196818    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:28:33.212300 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196821    4357 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:28:33.212300 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196823    4357 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:28:33.212300 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196826    4357 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:28:33.212300 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196829    4357 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:28:33.212300 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196832    4357 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:28:33.212300 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196834    4357 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:28:33.212300 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196837    4357 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:28:33.212300 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196840    4357 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:28:33.212300 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196842    4357 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:28:33.212300 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196845    4357 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:28:33.212942 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.196871    4357 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 05:28:33.212942 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196903    4357 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:28:33.212942 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196908    4357 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:28:33.212942 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196911    4357 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:28:33.212942 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196915    4357 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:28:33.212942 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196919    4357 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:28:33.212942 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196922    4357 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:28:33.212942 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196925    4357 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:28:33.212942 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196928    4357 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:28:33.212942 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196931    4357 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:28:33.212942 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196933    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:28:33.212942 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196936    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:28:33.212942 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196939    4357 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:28:33.212942 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196941    4357 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:28:33.212942 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196944    4357 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:28:33.213635 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196947    4357 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:28:33.213635 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196950    4357 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:28:33.213635 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196952    4357 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:28:33.213635 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196959    4357 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:28:33.213635 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196964    4357 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:28:33.213635 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196967    4357 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:28:33.213635 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196969    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:28:33.213635 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196972    4357 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:28:33.213635 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196975    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:28:33.213635 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196978    4357 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:28:33.213635 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196981    4357 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:28:33.213635 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196983    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:28:33.213635 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196986    4357 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:28:33.213635 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196988    4357 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:28:33.213635 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196992    4357 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:28:33.213635 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196994    4357 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:28:33.213635 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.196997    4357 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:28:33.213635 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197000    4357 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:28:33.213635 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197002    4357 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:28:33.213635 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197005    4357 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:28:33.214129 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197008    4357 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:28:33.214129 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197011    4357 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:28:33.214129 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197016    4357 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:28:33.214129 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197020    4357 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:28:33.214129 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197023    4357 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:28:33.214129 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197026    4357 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:28:33.214129 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197029    4357 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:28:33.214129 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197032    4357 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:28:33.214129 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197036    4357 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:28:33.214129 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197039    4357 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:28:33.214129 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197041    4357 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:28:33.214129 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197044    4357 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:28:33.214129 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197048    4357 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:28:33.214129 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197050    4357 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:28:33.214129 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197053    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:28:33.214129 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197055    4357 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:28:33.214129 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197060    4357 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:28:33.214129 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197063    4357 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:28:33.214129 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197066    4357 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:28:33.214611 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197068    4357 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:28:33.214611 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197071    4357 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:28:33.214611 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197073    4357 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:28:33.214611 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197076    4357 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:28:33.214611 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197079    4357 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:28:33.214611 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197081    4357 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:28:33.214611 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197084    4357 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:28:33.214611 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197087    4357 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:28:33.214611 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197090    4357 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:28:33.214611 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197093    4357 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:28:33.214611 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197095    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:28:33.214611 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197098    4357 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:28:33.214611 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197100    4357 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:28:33.214611 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197103    4357 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:28:33.214611 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197106    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:28:33.214611 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197109    4357 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:28:33.214611 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197111    4357 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:28:33.214611 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197114    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:28:33.214611 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197117    4357 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:28:33.214611 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197119    4357 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:28:33.215218 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197122    4357 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:28:33.215218 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197125    4357 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:28:33.215218 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197128    4357 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:28:33.215218 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197130    4357 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:28:33.215218 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197133    4357 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:28:33.215218 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197137    4357 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:28:33.215218 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197140    4357 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:28:33.215218 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197142    4357 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:28:33.215218 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197145    4357 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:28:33.215218 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197149    4357 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:28:33.215218 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197152    4357 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:28:33.215218 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197155    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:28:33.215218 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197158    4357 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:28:33.215218 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197161    4357 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:28:33.215218 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197163    4357 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:28:33.215218 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197166    4357 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:28:33.215218 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197169    4357 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:28:33.215218 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197172    4357 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:28:33.215218 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197175    4357 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:28:33.215218 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197178    4357 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:28:33.215884 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197180    4357 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:28:33.215884 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197183    4357 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:28:33.215884 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197186    4357 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:28:33.215884 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197188    4357 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:28:33.215884 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197191    4357 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:28:33.215884 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197193    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:28:33.215884 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197196    4357 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:28:33.215884 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197199    4357 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:28:33.215884 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197202    4357 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:28:33.215884 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197205    4357 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:28:33.215884 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197208    4357 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:28:33.215884 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197210    4357 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:28:33.215884 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.197213    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:28:33.215884 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.202606    4357 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Nov 04 05:28:33.215884 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.202627    4357 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Nov 04 05:28:33.215884 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.202651    4357 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Nov 04 05:28:33.215884 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.202659    4357 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Nov 04 05:28:33.215884 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202762    4357 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:28:33.215884 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202772    4357 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:28:33.216441 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202777    4357 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:28:33.216441 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202782    4357 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:28:33.216441 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202787    4357 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:28:33.216441 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202792    4357 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:28:33.216441 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202797    4357 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:28:33.216441 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202801    4357 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:28:33.216441 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202805    4357 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:28:33.216441 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202810    4357 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:28:33.216441 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202814    4357 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:28:33.216441 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202819    4357 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:28:33.216441 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202823    4357 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:28:33.216441 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202827    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:28:33.216441 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202831    4357 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:28:33.216441 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202835    4357 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:28:33.216441 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202839    4357 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:28:33.216441 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202843    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:28:33.216441 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202848    4357 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:28:33.216441 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202852    4357 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:28:33.216441 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202857    4357 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:28:33.216441 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202861    4357 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:28:33.216969 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202866    4357 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:28:33.216969 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202870    4357 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:28:33.216969 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202874    4357 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:28:33.216969 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202879    4357 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:28:33.216969 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202883    4357 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:28:33.216969 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202888    4357 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:28:33.216969 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202895    4357 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:28:33.216969 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202899    4357 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:28:33.216969 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202904    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:28:33.216969 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202909    4357 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:28:33.216969 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202914    4357 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:28:33.216969 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202919    4357 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:28:33.216969 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202923    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:28:33.216969 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202928    4357 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:28:33.216969 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202932    4357 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:28:33.216969 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202936    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:28:33.216969 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202940    4357 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:28:33.216969 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202944    4357 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:28:33.216969 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202949    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:28:33.216969 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202954    4357 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:28:33.217729 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202958    4357 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:28:33.217729 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202962    4357 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:28:33.217729 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202966    4357 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:28:33.217729 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202971    4357 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:28:33.217729 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202976    4357 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:28:33.217729 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202980    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:28:33.217729 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202985    4357 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:28:33.217729 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202989    4357 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:28:33.217729 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202993    4357 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:28:33.217729 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.202998    4357 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:28:33.217729 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203002    4357 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:28:33.217729 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203006    4357 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:28:33.217729 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203011    4357 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:28:33.217729 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203016    4357 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:28:33.217729 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203020    4357 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:28:33.217729 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203024    4357 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:28:33.217729 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203028    4357 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:28:33.217729 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203033    4357 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:28:33.217729 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203038    4357 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:28:33.218391 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203043    4357 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:28:33.218391 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203048    4357 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:28:33.218391 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203052    4357 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:28:33.218391 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203057    4357 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:28:33.218391 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203061    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:28:33.218391 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203066    4357 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:28:33.218391 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203070    4357 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:28:33.218391 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203075    4357 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:28:33.218391 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203081    4357 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:28:33.218391 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203088    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:28:33.218391 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203093    4357 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:28:33.218391 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203097    4357 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:28:33.218391 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203102    4357 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:28:33.218391 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203106    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:28:33.218391 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203110    4357 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:28:33.218391 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203114    4357 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:28:33.218391 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203119    4357 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:28:33.218391 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203123    4357 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:28:33.218391 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203129    4357 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:28:33.218918 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203133    4357 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:28:33.218918 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203137    4357 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:28:33.218918 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203142    4357 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:28:33.218918 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203146    4357 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:28:33.218918 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203150    4357 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:28:33.218918 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203155    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:28:33.218918 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203159    4357 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:28:33.218918 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203164    4357 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:28:33.218918 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203168    4357 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:28:33.218918 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203172    4357 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:28:33.218918 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203177    4357 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:28:33.218918 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203182    4357 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:28:33.218918 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203186    4357 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:28:33.218918 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203191    4357 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:28:33.218918 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203195    4357 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:28:33.218918 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203202    4357 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:28:33.218918 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203208    4357 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:28:33.218918 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203213    4357 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:28:33.218918 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203218    4357 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:28:33.219376 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203222    4357 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:28:33.219376 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203227    4357 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:28:33.219376 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203231    4357 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:28:33.219376 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203235    4357 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:28:33.219376 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203240    4357 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:28:33.219376 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203244    4357 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:28:33.219376 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203248    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:28:33.219376 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.203291    4357 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 05:28:33.219376 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203539    4357 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:28:33.219376 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203547    4357 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:28:33.219376 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203552    4357 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:28:33.219376 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203557    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:28:33.219376 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203561    4357 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:28:33.219376 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203567    4357 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:28:33.219376 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203572    4357 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:28:33.219376 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203576    4357 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:28:33.219773 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203580    4357 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:28:33.219773 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203585    4357 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:28:33.219773 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203589    4357 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:28:33.219773 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203593    4357 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:28:33.219773 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203598    4357 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:28:33.219773 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203602    4357 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:28:33.219773 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203607    4357 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:28:33.219773 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203611    4357 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:28:33.219773 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203615    4357 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:28:33.219773 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203620    4357 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:28:33.219773 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203625    4357 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:28:33.219773 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203629    4357 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:28:33.219773 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203633    4357 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:28:33.219773 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203638    4357 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:28:33.219773 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203643    4357 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:28:33.219773 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203647    4357 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:28:33.219773 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203651    4357 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:28:33.219773 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203656    4357 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:28:33.219773 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203661    4357 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:28:33.230578 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203665    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:28:33.230578 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203669    4357 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:28:33.230578 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203673    4357 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:28:33.230578 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203677    4357 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:28:33.230578 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203681    4357 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:28:33.230578 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203686    4357 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:28:33.230578 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203690    4357 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:28:33.230578 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203694    4357 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:28:33.230578 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203698    4357 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:28:33.230578 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203705    4357 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:28:33.230578 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203711    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:28:33.230578 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203717    4357 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:28:33.230578 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203722    4357 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:28:33.230578 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203727    4357 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:28:33.230578 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203731    4357 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:28:33.230578 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203736    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:28:33.230578 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203740    4357 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:28:33.230578 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203745    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:28:33.230578 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203749    4357 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:28:33.230563 ip-10-0-133-170 systemd[1]: Started Kubernetes Kubelet.
Nov 04 05:28:33.231323 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203753    4357 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:28:33.231323 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203758    4357 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:28:33.231323 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203763    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:28:33.231323 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203770    4357 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:28:33.231323 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203774    4357 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:28:33.231323 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203779    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:28:33.231323 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203783    4357 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:28:33.231323 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203788    4357 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:28:33.231323 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203792    4357 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:28:33.231323 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203796    4357 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:28:33.231323 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203801    4357 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:28:33.231323 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203805    4357 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:28:33.231323 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203809    4357 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:28:33.231323 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203813    4357 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:28:33.231323 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203817    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:28:33.231323 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203821    4357 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:28:33.231323 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203825    4357 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:28:33.231323 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203829    4357 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:28:33.231323 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203834    4357 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:28:33.232094 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203839    4357 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:28:33.232094 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203843    4357 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:28:33.232094 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203847    4357 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:28:33.232094 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203852    4357 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:28:33.232094 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203857    4357 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:28:33.232094 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203861    4357 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:28:33.232094 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203866    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:28:33.232094 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203871    4357 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:28:33.232094 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203874    4357 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:28:33.232094 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203880    4357 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:28:33.232094 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203884    4357 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:28:33.232094 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203888    4357 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:28:33.232094 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203893    4357 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:28:33.232094 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203897    4357 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:28:33.232094 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203901    4357 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:28:33.232094 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203906    4357 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:28:33.232094 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203912    4357 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:28:33.232094 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203919    4357 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:28:33.232094 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203924    4357 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:28:33.232094 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203930    4357 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:28:33.232706 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203934    4357 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:28:33.232706 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203939    4357 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:28:33.232706 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203943    4357 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:28:33.232706 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203950    4357 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:28:33.232706 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203957    4357 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:28:33.232706 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203964    4357 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:28:33.232706 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203968    4357 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:28:33.232706 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203972    4357 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:28:33.232706 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203977    4357 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:28:33.232706 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203982    4357 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:28:33.232706 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203986    4357 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:28:33.232706 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203991    4357 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:28:33.232706 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.203995    4357 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:28:33.232706 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204000    4357 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:28:33.232706 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204004    4357 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:28:33.232706 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204008    4357 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:28:33.232706 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204013    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:28:33.232706 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204017    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:28:33.232706 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204021    4357 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:28:33.233211 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204027    4357 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:28:33.233211 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204031    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:28:33.233211 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.204073    4357 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 05:28:33.233211 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204125    4357 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:28:33.233211 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204131    4357 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:28:33.233211 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204135    4357 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:28:33.233211 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204140    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:28:33.233211 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204145    4357 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:28:33.233211 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204150    4357 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:28:33.233211 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204154    4357 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:28:33.233211 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204161    4357 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:28:33.233211 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204166    4357 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:28:33.233211 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204170    4357 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:28:33.233211 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204175    4357 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:28:33.233211 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204179    4357 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:28:33.233638 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204185    4357 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:28:33.233638 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204192    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:28:33.233638 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204196    4357 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:28:33.233638 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204201    4357 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:28:33.233638 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204205    4357 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:28:33.233638 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204210    4357 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:28:33.233638 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204214    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:28:33.233638 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204218    4357 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:28:33.233638 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204223    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:28:33.233638 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204227    4357 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:28:33.233638 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204234    4357 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:28:33.233638 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204238    4357 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:28:33.233638 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204243    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:28:33.233638 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204248    4357 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:28:33.233638 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204252    4357 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:28:33.233638 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204256    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:28:33.233638 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204261    4357 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:28:33.233638 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204265    4357 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:28:33.233638 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204271    4357 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:28:33.234181 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204276    4357 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:28:33.234181 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204281    4357 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:28:33.234181 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204285    4357 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:28:33.234181 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204290    4357 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:28:33.234181 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204294    4357 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:28:33.234181 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204299    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:28:33.234181 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204303    4357 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:28:33.234181 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204307    4357 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:28:33.234181 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204313    4357 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:28:33.234181 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204318    4357 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:28:33.234181 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204323    4357 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:28:33.234181 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204327    4357 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:28:33.234181 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204332    4357 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:28:33.234181 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204336    4357 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:28:33.234181 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204341    4357 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:28:33.234181 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204345    4357 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:28:33.234181 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204349    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:28:33.234181 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204354    4357 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:28:33.234181 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204358    4357 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:28:33.234181 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204363    4357 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:28:33.234899 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204369    4357 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:28:33.234899 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204373    4357 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:28:33.234899 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204377    4357 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:28:33.234899 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204383    4357 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:28:33.234899 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204388    4357 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:28:33.234899 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204392    4357 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:28:33.234899 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204396    4357 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:28:33.234899 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204401    4357 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:28:33.234899 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204405    4357 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:28:33.234899 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204410    4357 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:28:33.234899 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204414    4357 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:28:33.234899 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204418    4357 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:28:33.234899 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204423    4357 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:28:33.234899 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204429    4357 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:28:33.234899 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204435    4357 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:28:33.234899 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204440    4357 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:28:33.234899 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204445    4357 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:28:33.234899 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204450    4357 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:28:33.234899 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204454    4357 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:28:33.234899 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204459    4357 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:28:33.235698 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204464    4357 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:28:33.235698 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204469    4357 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:28:33.235698 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204473    4357 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:28:33.235698 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204477    4357 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:28:33.235698 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204482    4357 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:28:33.235698 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204487    4357 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:28:33.235698 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204491    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:28:33.235698 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204495    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:28:33.235698 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204500    4357 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:28:33.235698 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204504    4357 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:28:33.235698 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204509    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:28:33.235698 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204528    4357 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:28:33.235698 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204533    4357 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:28:33.235698 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204538    4357 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:28:33.235698 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204543    4357 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:28:33.235698 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204549    4357 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:28:33.235698 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204554    4357 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:28:33.235698 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204558    4357 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:28:33.235698 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204562    4357 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:28:33.235698 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204567    4357 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:28:33.236252 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204571    4357 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:28:33.236252 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204576    4357 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:28:33.236252 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204580    4357 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:28:33.236252 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204584    4357 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:28:33.236252 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204589    4357 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:28:33.236252 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204594    4357 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:28:33.236252 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204598    4357 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:28:33.236252 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204603    4357 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:28:33.236252 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204607    4357 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:28:33.236252 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204612    4357 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:28:33.236252 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204617    4357 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:28:33.236252 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204621    4357 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:28:33.236252 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204628    4357 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:28:33.236252 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204635    4357 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:28:33.236252 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:33.204639    4357 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:28:33.236252 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.204718    4357 server.go:957] "Client rotation is on, will bootstrap in background"
Nov 04 05:28:33.236252 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.206206    4357 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Nov 04 05:28:33.236252 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.206277    4357 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Nov 04 05:28:33.236252 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.206552    4357 server.go:1014] "Starting client certificate rotation"
Nov 04 05:28:33.236852 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.206693    4357 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 04 05:28:33.236852 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.206743    4357 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-03 05:22:54 +0000 UTC" deadline="2028-05-13 03:12:33.066509637 +0000 UTC"
Nov 04 05:28:33.236852 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.206777    4357 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13341h43m59.8597343s"
Nov 04 05:28:33.236852 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.207266    4357 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 04 05:28:33.236852 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.208886    4357 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 04 05:28:33.236852 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.210442    4357 log.go:25] "Validated CRI v1 runtime API"
Nov 04 05:28:33.236852 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.212063    4357 log.go:25] "Validated CRI v1 image API"
Nov 04 05:28:33.236852 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.212802    4357 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Nov 04 05:28:33.236852 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.214208    4357 fs.go:135] Filesystem UUIDs: map[018d316d-ce84-4e15-baef-952a0b26637b:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c03728e6-6362-4a82-af6e-bf04c8d171f9:/dev/nvme0n1p3]
Nov 04 05:28:33.237115 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.214229    4357 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0f7d24e6b682b270af4ba2e3048172e4e3ffbc8812d08556ef875a81d28f4e60/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0f7d24e6b682b270af4ba2e3048172e4e3ffbc8812d08556ef875a81d28f4e60/userdata/shm major:0 minor:92 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/23db902d108e6ad7aa3e5f6405eed3de64a22e6b9bb89b97d764b3c812ab8288/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/23db902d108e6ad7aa3e5f6405eed3de64a22e6b9bb89b97d764b3c812ab8288/userdata/shm major:0 minor:53 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/49328b3d8b6f10a9d067b9332cb66b293020a0f07b58b0dce5402b0a8831a42f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/49328b3d8b6f10a9d067b9332cb66b293020a0f07b58b0dce5402b0a8831a42f/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/63d2c3ec19119f421c5939d5a79172820f2092b27c3c65986172f455daaf12c6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/63d2c3ec19119f421c5939d5a79172820f2092b27c3c65986172f455daaf12c6/userdata/shm major:0 minor:54 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/64fe8c0d1b759323fa1748f03e9aead6ff4208c092bfdf720361888671210bba/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/64fe8c0d1b759323fa1748f03e9aead6ff4208c092bfdf720361888671210bba/userdata/shm major:0 minor:84 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/78cbf100285865845dce2bc76261d1e98147bebb3d4863fd1d14742d9e7c49af/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/78cbf100285865845dce2bc76261d1e98147bebb3d4863fd1d14742d9e7c49af/userdata/shm major:0 minor:80 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9dbd08147bd975458dcd09f3f470eed4905c8ffd40ab7f10e2446a57560c5936/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9dbd08147bd975458dcd09f3f470eed4905c8ffd40ab7f10e2446a57560c5936/userdata/shm major:0 minor:63 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a9e1958025ee8d8fb70e4de8f1d8752db6bc975b5ae2d4941b3093b8bb7473ae/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a9e1958025ee8d8fb70e4de8f1d8752db6bc975b5ae2d4941b3093b8bb7473ae/userdata/shm major:0 minor:201 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ba5a651f7972fefaffd70ce2ab493ac67758f6a7dc6f2c49aaea67d2b59f6454/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ba5a651f7972fefaffd70ce2ab493ac67758f6a7dc6f2c49aaea67d2b59f6454/userdata/shm major:0 minor:62 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c2c32e7d42fa40eb787b9c9f45da7b4f1f692904548f92f1dc8b4818ce4c5224/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c2c32e7d42fa40eb787b9c9f45da7b4f1f692904548f92f1dc8b4818ce4c5224/userdata/shm major:0 minor:206 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c540ca4082a2572416f5eb3c894e2b1f425a58fba6cce894b6c3ae0c172fefd0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c540ca4082a2572416f5eb3c894e2b1f425a58fba6cce894b6c3ae0c172fefd0/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d040d5725ab3eec490524699c0edfe9798be8f355e2f087e8eef92afcec38c96/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d040d5725ab3eec490524699c0edfe9798be8f355e2f087e8eef92afcec38c96/userdata/shm major:0 minor:203 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e62e58a4402dca683180dd1df0167d14f964bd2ccc2f8863e81d0dc15c7c268d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e62e58a4402dca683180dd1df0167d14f964bd2ccc2f8863e81d0dc15c7c268d/userdata/shm major:0 minor:88 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/02758cc7-baf6-44d1-baa6-87438b8376a2/volumes/kubernetes.io~projected/kube-api-access-n2hgd:{mountpoint:/var/lib/kubelet/pods/02758cc7-baf6-44d1-baa6-87438b8376a2/volumes/kubernetes.io~projected/kube-api-access-n2hgd major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/16031827-bc25-4ecd-b902-0161403f7566/volumes/kubernetes.io~projected/kube-api-access-8jqnp:{mountpoint:/var/lib/kubelet/pods/16031827-bc25-4ecd-b902-0161403f7566/volumes/kubernetes.io~projected/kube-api-access-8jqnp major:0 minor:48 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1658b916-200e-432c-9ca8-a7814f38e485/volumes/kubernetes.io~projected/kube-api-access-z4vgq:{mountpoint:/var/lib/kubelet/pods/1658b916-200e-432c-9ca8-a7814f38e485/volumes/kubernetes.io~projected/kube-api-access-z4vgq major:0 minor:52 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2a7a7beb-0136-46a3-84f6-e00b34c4a4a9/volumes/kubernetes.io~projected/kube-api-access-t88mv:{mountpoint:/var/lib/kubelet/pods/2a7a7beb-0136-46a3-84f6-e00b34c4a4a9/volumes/kubernetes.io~projected/kube-api-access-t88mv major:0 minor:51 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2a7a7beb-0136-46a3-84f6-e00b34c4a4a9/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/2a7a7beb-0136-46a3-84f6-e00b34c4a4a9/volumes/kubernetes.io~secret/metrics-certs major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5510018c-1e4d-4009-bc56-2152f7703f7a/volumes/kubernetes.io~projected/kube-api-access-vlb7q:{mountpoint:/var/lib/kubelet/pods/5510018c-1e4d-4009-bc56-2152f7703f7a/volumes/kubernetes.io~projected/kube-api-access-vlb7q major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7/volumes/kubernetes.io~projected/kube-api-access-55vhs:{mountpoint:/var/lib/kubelet/pods/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7/volumes/kubernetes.io~projected/kube-api-access-55vhs major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/88680c4d-b306-483c-a5a7-3d559e078c01/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/88680c4d-b306-483c-a5a7-3d559e078c01/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/88680c4d-b306-483c-a5a7-3d559e078c01/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/88680c4d-b306-483c-a5a7-3d559e078c01/volumes/kubernetes.io~empty-dir/tmp major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/88680c4d-b306-483c-a5a7-3d559e078c01/volumes/kubernetes.io~projected/kube-api-access-pjmnx:{mountpoint:/var/lib/kubelet/pods/88680c4d-b306-483c-a5a7-3d559e078c01/volumes/kubernetes.io~projected/kube-api-access-pjmnx major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8a855aab-8901-4d7d-8f10-91a8896d4b71/volumes/kubernetes.io~projected/kube-api-access-5m8jk:{mountpoint:/var/lib/kubelet/pods/8a855aab-8901-4d7d-8f10-91a8896d4b71/volumes/kubernetes.io~projected/kube-api-access-5m8jk major:0 minor:205 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/abfc6e5f-914e-4a19-8fd3-c8a844377da3/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/abfc6e5f-914e-4a19-8fd3-c8a844377da3/volumes/kubernetes.io~secret/agent-certs major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b9aa45f3-1a47-489d-ba9d-76cbe630b283/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/b9aa45f3-1a47-489d-ba9d-76cbe630b283/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d0adbb13-2521-4805-b5ba-86b9052b6123/volumes/kubernetes.io~projected/kube-api-access-bx7g8:{mountpoint:/var/lib/kubelet/pods/d0adbb13-2521-4805-b5ba-86b9052b6123/volumes/kubernetes.io~projected/kube-api-access-bx7g8 major:0 minor:50 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f1f789ee-b574-48ba-abd5-cfac0b3d7f40/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/f1f789ee-b574-48ba-abd5-cfac0b3d7f40/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f1f789ee-b574-48ba-abd5-cfac0b3d7f40/volumes/kubernetes.io~projected/kube-api-access-qx72x:{mountpoint:/var/lib/kubelet/pods/f1f789ee-b574-48ba-abd5-cfac0b3d7f40/volumes/kubernetes.io~projected/kube-api-access-qx72x major:0 minor:49 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f1f789ee-b574-48ba-abd5-cfac0b3d7f40/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/f1f789ee-b574-48ba-abd5-cfac0b3d7f40/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:47 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/71da4b96ad064c81096a195883ff83852f25b6a18ac40eaaa9c9623907c62b4c/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/05f284e47b7b827868a8f829b03d81d1b3dded90309116408f3ac4f733ccf89a/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/b2626e6328c8a6efae1d7c54cb8a3b06b9a9498a5556a2bd33608a7b79c7fc6e/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-108:{mountpoint:/var/lib/containers/storage/overlay/d831535fdec38cef9c5645509f27afbe47c1bb4e3af6546e96c09621d3bbcb35/merged major:0 minor:108 fsType:overlay blockSize:0} overlay_0-111:{mountpoint:/var/lib/containers/storage/overlay/d245ac13ffceafdcbb08d15f1cb0cfdf7e8c366bd2d32d901b6f8e2d7eecc8df/merged major:0 minor:111 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/49bed898918094d7ce7d8f8f450138bb80c43ba378d2eedb60254136476a432a/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/edf117ffcc6ca89b048896426504531fada04833873ef132b28f5ca3e5ce8df6/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/c85e5c83272f4fbea2af3b56717283ada3df90bcc3c8bb01610c8447345390a7/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/387d8c89d6545d197f673f41c14e8b25226f10eccb0b2c8a3269a112e86eb847/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-137:{mountpoint:/var/lib/containers/storage/overlay/05e20e18a479b45e44f0e7975120ee068802accb0da24242ef3f634283d3ac77/merged major:0 minor:137 fsType:overlay blockSize:0} overlay_0-139:{mountpoint:/var/lib/containers/storage/overlay/5d4e037eec37d2cb2db0dada6c00eff54b932662a730cf7cfb6131d26b9ab25f/merged major:0 minor:139 fsType:overlay blockSize:0} overlay_0-147:{mountpoint:/var/lib/containers/storage/overlay/22819f9c78f08ba7bee6d338ede3b8e56be5a3e00bb3330da3eebed35844d68b/merged major:0 minor:147 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/905b58772c0f97dd3844d137fdb22b305a23c8b36a5f76c9dbb703012eac426b/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/a9111da3abb849365fdc2b3f23b512a214657ee7761170d23d9547e13f98d729/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/dd3214a1e4a902281e42a536e77cb95b0e9c7bf7a643b10321430d6198ca60a5/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/ef778ccf9dfe41f765c888172df96346efa871e4a7046fa17336a8f441e1a2c5/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/fbc4e61fd3c07faaa77d03ceeec5caa5e379ef2ca1b30d23674b4472eeca3c50/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/7d85b76c546a9ba7a23880f4717a33130a5f611ce01b58a5df1859cca21176d8/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/e89182ae8e7c461ef43610d675691087b35894bac4a816e38e75c35059fd5b99/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/1399d8a17800a051c6db051542045e62e72725a01eb8088d529b73d0f965728d/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/cbf1dd633128078a26828789b6fffe4951604bd34c6b863336674d4e370777dd/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-208:{mountpoint:/var/lib/containers/storage/overlay/c27182c6890b4488c581b416dbcf63d00817969922789e0a42e704a9620ecd42/merged major:0 minor:208 fsType:overlay blockSize:0} overlay_0-210:{mountpoint:/var/lib/containers/storage/overlay/c828b11e249fd7326a65e815fa0b478ea2ae6fe46e7be8dceb6ac53a339538f5/merged major:0 minor:210 fsType:overlay blockSize:0} overlay_0-212:{mountpoint:/var/lib/containers/storage/overlay/6aa9964d8029a8ba18837b381c74c1e26ad6cf6ae0ad75467d8ac37441a87d1c/merged major:0 minor:212 fsType:overlay blockSize:0} overlay_0-214:{mountpoint:/var/lib/containers/storage/overlay/9840c72cae1e0965833cf2667036d8419ef3d9ffda2f08a7869edee771531f34/merged major:0 minor:214 fsType:overlay blockSize:0} overlay_0-216:{mountpoint:/var/lib/containers/storage/overlay/87eaba814d264d49fd9c97a4aa6b39f6188553626cf405dc90abaff6d139ad97/merged major:0 minor:216 fsType:overlay blockSize:0} overlay_0-222:{mountpoint:/var/lib/containers/storage/overlay/c815ecdd34e5679c6cc6c12190dc4f532e8fa6a88fbc48e845956798337caae4/merged major:0 minor:222 fsType:overlay blockSize:0} overlay_0-227:{mountpoint:/var/lib/containers/storage/overlay/4fe633d1975c6412c17108fcd51f477d95a879faea37bbe14eb2121b333f1250/merged major:0 minor:227 fsType:overlay blockSize:0} overlay_0-68:{mountpoint:/var/lib/containers/storage/overlay/a8fd061fd102e456cdd54970132451f33cf1535dfe514bb3af8cc44f89fe082f/merged major:0 minor:68 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/8625192c37000affea6df055e15f834fb0109e6d624556440fc9917da703c53d/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-72:{mountpoint:/var/lib/containers/storage/overlay/bca590b2d3554a148a5a0d1093fef2cc0da1b8ce747098f1148e5db6bc5bc17e/merged major:0 minor:72 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/12aefee5c83ad35f0c445964911bb94069eac8cec641700209f6c9147832f17b/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/916f56f870112a611b348d640f597c2dccb67ddf5d116389a95e9d1ba060d54e/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-82:{mountpoint:/var/lib/containers/storage/overlay/316b80fff4e933b14e503ba0d6ab01bc03e86825231e869446fc014cd5fa0d42/merged major:0 minor:82 fsType:overlay blockSize:0} overlay_0-86:{mountpoint:/var/lib/containers/storage/overlay/acdf3e95924bff0045e79890d7bc0a32936f05ca7699a0e93979d39c57aecbc3/merged major:0 minor:86 fsType:overlay blockSize:0} overlay_0-90:{mountpoint:/var/lib/containers/storage/overlay/ae2d02000e5fd8f27ea61f0b9bac2258836b3d3cba939b974e0d885b48c71e01/merged major:0 minor:90 fsType:overlay blockSize:0} overlay_0-94:{mountpoint:/var/lib/containers/storage/overlay/85995b471fd2dce03344b1e7bf8ae46dea9780d8779bc626d06375b23127ae8f/merged major:0 minor:94 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/12ac77b0f90f2d1689c3d4bc94cae8c0c902c9832e98e9b404e52cba4616050a/merged major:0 minor:96 fsType:overlay blockSize:0}]
Nov 04 05:28:33.237115 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.221043    4357 manager.go:217] Machine: {Timestamp:2026-11-04 05:28:33.220596215 +0000 UTC m=+0.089259780 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099917 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec232d82ed9a7e4d7327c1dfa3110cea SystemUUID:ec232d82-ed9a-7e4d-7327-c1dfa3110cea BootID:e86eadbd-3636-4921-83e6-4ae215b66d61 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/1658b916-200e-432c-9ca8-a7814f38e485/volumes/kubernetes.io~projected/kube-api-access-z4vgq DeviceMajor:0 DeviceMinor:52 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/49328b3d8b6f10a9d067b9332cb66b293020a0f07b58b0dce5402b0a8831a42f/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/02758cc7-baf6-44d1-baa6-87438b8376a2/volumes/kubernetes.io~projected/kube-api-access-n2hgd DeviceMajor:0 DeviceMinor:59 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f1f789ee-b574-48ba-abd5-cfac0b3d7f40/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5510018c-1e4d-4009-bc56-2152f7703f7a/volumes/kubernetes.io~projected/kube-api-access-vlb7q DeviceMajor:0 DeviceMinor:60 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-68 DeviceMajor:0 DeviceMinor:68 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e62e58a4402dca683180dd1df0167d14f964bd2ccc2f8863e81d0dc15c7c268d/userdata/shm DeviceMajor:0 DeviceMinor:88 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-108 DeviceMajor:0 DeviceMinor:108 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/var/lib/kubelet/pods/88680c4d-b306-483c-a5a7-3d559e078c01/volumes/kubernetes.io~projected/kube-api-access-pjmnx DeviceMajor:0 DeviceMinor:58 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/23db902d108e6ad7aa3e5f6405eed3de64a22e6b9bb89b97d764b3c812ab8288/userdata/shm DeviceMajor:0 DeviceMinor:53 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-210 DeviceMajor:0 DeviceMinor:210 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/var/lib/kubelet/pods/88680c4d-b306-483c-a5a7-3d559e078c01/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:57 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/63d2c3ec19119f421c5939d5a79172820f2092b27c3c65986172f455daaf12c6/userdata/shm DeviceMajor:0 DeviceMinor:54 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-212 DeviceMajor:0 DeviceMinor:212 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a9e1958025ee8d8fb70e4de8f1d8752db6bc975b5ae2d4941b3093b8bb7473ae/userdata/shm DeviceMajor:0 DeviceMinor:201 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/78cbf100285865845dce2bc76261d1e98147bebb3d4863fd1d14742d9e7c49af/userdata/shm DeviceMajor:0 DeviceMinor:80 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-137 DeviceMajor:0 DeviceMinor:137 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-147 DeviceMajor:0 DeviceMinor:147 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-222 DeviceMajor:0 DeviceMinor:222 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9dbd08147bd975458dcd09f3f470eed4905c8ffd40ab7f10e2446a57560c5936/userdata/shm DeviceMajor:0 DeviceMinor:63 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/2a7a7beb-0136-46a3-84f6-e00b34c4a4a9/volumes/kubernetes.io~projected/kube-api-access-t88mv DeviceMajor:0 DeviceMinor:51 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7/volumes/kubernetes.io~projected/kube-api-access-55vhs DeviceMajor:0 DeviceMinor:61 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b9aa45f3-1a47-489d-ba9d-76cbe630b283/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:45 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-90 DeviceMajor:0 DeviceMinor:90 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-139 DeviceMajor:0 DeviceMinor:139 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/88680c4d-b306-483c-a5a7-3d559e078c01/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:56 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8a855aab-8901-4d7d-8f10-91a8896d4b71/volumes/kubernetes.io~projected/kube-api-access-5m8jk DeviceMajor:0 DeviceMinor:205 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:overlay_0-82 DeviceMajor:0 DeviceMinor:82 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-214 DeviceMajor:0 DeviceMinor:214 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f1f789ee-b574-48ba-abd5-cfac0b3d7f40/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:47 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ba5a651f7972fefaffd70ce2ab493ac67758f6a7dc6f2c49aaea67d2b59f6454/userdata/shm DeviceMajor:0 DeviceMinor:62 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-111 DeviceMajor:0 DeviceMinor:111 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-208 DeviceMajor:0 DeviceMinor:208 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-227 DeviceMajor:0 DeviceMinor:227 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-72 DeviceMajor:0 DeviceMinor:72 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/64fe8c0d1b759323fa1748f03e9aead6ff4208c092bfdf720361888671210bba/userdata/shm DeviceMajor:0 DeviceMinor:84 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d040d5725ab3eec490524699c0edfe9798be8f355e2f087e8eef92afcec38c96/userdata/shm DeviceMajor:0 DeviceMinor:203 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c2c32e7d42fa40eb787b9c9f45da7b4f1f692904548f92f1dc8b4818ce4c5224/userdata/shm DeviceMajor:0 DeviceMinor:206 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-216 DeviceMajor:0 DeviceMinor:216 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-86 DeviceMajor:0 DeviceMinor:86 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-94 DeviceMajor:0 DeviceMinor:94 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/16031827-bc25-4ecd-b902-0161403f7566/volumes/kubernetes.io~projected/kube-api-access-8jqnp DeviceMajor:0 DeviceMinor:48 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/d0adbb13-2521-4805-b5ba-86b9052b6123/volumes/kubernetes.io~projected/kube-api-access-bx7g8 DeviceMajor:0 DeviceMinor:50 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/abfc6e5f-914e-4a19-8fd3-c8a844377da3/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:55 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c540ca4082a2572416f5eb3c894e2b1f425a58fba6cce894b6c3ae0c172fefd0/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0f7d24e6b682b270af4ba2e3048172e4e3ffbc8812d08556ef875a81d28f4e60/userdata/shm DeviceMajor:0 DeviceMinor:92 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f1f789ee-b574-48ba-abd5-cfac0b3d7f40/volumes/kubernetes.io~projected/kube-api-access-qx72x DeviceMajor:0 DeviceMinor:49 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2a7a7beb-0136-46a3-84f6-e00b34c4a4a9/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:197 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:a9e1958025ee8d8 MacAddress:62:fe:a0:b8:81:8d Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:fe:01:6c:85 Speed:0 Mtu:9001} {Name:br-int MacAddress:86:fc:40:a4:ec:0c Speed:0 Mtu:8901} {Name:c2c32e7d42fa40e MacAddress:3e:fb:7f:e4:11:56 Speed:10000 Mtu:8901} {Name:d040d5725ab3eec MacAddress:16:22:3b:bb:01:45 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:fe:01:6c:85 Speed:0 Mtu:9001} {Name:genev_sys_6081 MacAddress:56:33:53:45:65:5d Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:85:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:4e:b7:e8:fa:5a:55 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Nov 04 05:28:33.237115 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.221281    4357 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Nov 04 05:28:33.237115 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.221320    4357 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Nov 04 05:28:33.237115 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.221618    4357 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.221635    4357 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-170.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.221745    4357 topology_manager.go:143] "Creating topology manager with none policy"
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.221752    4357 container_manager_linux.go:311] "Creating device plugin manager"
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.221765    4357 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.221777    4357 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.221851    4357 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.222027    4357 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.222127    4357 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.222159    4357 kubelet.go:493] "Attempting to sync node with API server"
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.222168    4357 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.222177    4357 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.222186    4357 kubelet.go:405] "Adding apiserver pod source"
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.222193    4357 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.222672    4357 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.222681    4357 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.223127    4357 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.225823    4357 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.225835    4357 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.225964    4357 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.226216    4357 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.226256    4357 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.226364    4357 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.226376    4357 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.226383    4357 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.226388    4357 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.226394    4357 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.226402    4357 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.226411    4357 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.226419    4357 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.226425    4357 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.226442    4357 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.226457    4357 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.226465    4357 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.226492    4357 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.226501    4357 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.230015    4357 server.go:1263] "Started kubelet"
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.230098    4357 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.230130    4357 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.230185    4357 server_v1.go:49] "podresources" method="list" useActivePods=true
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.230640    4357 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.234157    4357 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.234496    4357 volume_manager.go:309] "The desired_state_of_world populator starts"
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.234512    4357 volume_manager.go:311] "Starting Kubelet Volume Manager"
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.234674    4357 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:28:33.234890    4357 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-133-170.us-east-2.compute.internal\" not found"
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.235349    4357 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.235432    4357 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 05:22:55 +0000 UTC" deadline="2028-08-10 17:39:06.413657576 +0000 UTC"
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.235463    4357 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15492h10m33.178197716s"
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.236825    4357 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="abfc6e5f-914e-4a19-8fd3-c8a844377da3" volumeName="kubernetes.io/secret/abfc6e5f-914e-4a19-8fd3-c8a844377da3-agent-certs" seLinuxMountContext=""
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.236863    4357 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f1f789ee-b574-48ba-abd5-cfac0b3d7f40" volumeName="kubernetes.io/configmap/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-ovnkube-config" seLinuxMountContext=""
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.236892    4357 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="16031827-bc25-4ecd-b902-0161403f7566" volumeName="kubernetes.io/configmap/16031827-bc25-4ecd-b902-0161403f7566-iptables-alerter-script" seLinuxMountContext=""
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.236907    4357 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1658b916-200e-432c-9ca8-a7814f38e485" volumeName="kubernetes.io/projected/1658b916-200e-432c-9ca8-a7814f38e485-kube-api-access-z4vgq" seLinuxMountContext=""
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.236927    4357 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5b670e74-95bd-4a10-9d6d-b7b6d95e91c7" volumeName="kubernetes.io/configmap/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-cni-binary-copy" seLinuxMountContext=""
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.236942    4357 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f1f789ee-b574-48ba-abd5-cfac0b3d7f40" volumeName="kubernetes.io/projected/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-kube-api-access-qx72x" seLinuxMountContext=""
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.236963    4357 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f1f789ee-b574-48ba-abd5-cfac0b3d7f40" volumeName="kubernetes.io/secret/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-ovn-node-metrics-cert" seLinuxMountContext=""
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.236977    4357 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1658b916-200e-432c-9ca8-a7814f38e485" volumeName="kubernetes.io/configmap/1658b916-200e-432c-9ca8-a7814f38e485-cni-binary-copy" seLinuxMountContext=""
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.237000    4357 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1658b916-200e-432c-9ca8-a7814f38e485" volumeName="kubernetes.io/configmap/1658b916-200e-432c-9ca8-a7814f38e485-cni-sysctl-allowlist" seLinuxMountContext=""
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.237014    4357 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2a7a7beb-0136-46a3-84f6-e00b34c4a4a9" volumeName="kubernetes.io/secret/2a7a7beb-0136-46a3-84f6-e00b34c4a4a9-metrics-certs" seLinuxMountContext=""
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.237028    4357 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5510018c-1e4d-4009-bc56-2152f7703f7a" volumeName="kubernetes.io/empty-dir/5510018c-1e4d-4009-bc56-2152f7703f7a-tmp-dir" seLinuxMountContext=""
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.237063    4357 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="88680c4d-b306-483c-a5a7-3d559e078c01" volumeName="kubernetes.io/empty-dir/88680c4d-b306-483c-a5a7-3d559e078c01-tmp" seLinuxMountContext=""
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.237078    4357 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b9aa45f3-1a47-489d-ba9d-76cbe630b283" volumeName="kubernetes.io/secret/b9aa45f3-1a47-489d-ba9d-76cbe630b283-original-pull-secret" seLinuxMountContext=""
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.237096    4357 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d0adbb13-2521-4805-b5ba-86b9052b6123" volumeName="kubernetes.io/projected/d0adbb13-2521-4805-b5ba-86b9052b6123-kube-api-access-bx7g8" seLinuxMountContext=""
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.237115    4357 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f1f789ee-b574-48ba-abd5-cfac0b3d7f40" volumeName="kubernetes.io/configmap/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-ovnkube-script-lib" seLinuxMountContext=""
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.237137    4357 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="02758cc7-baf6-44d1-baa6-87438b8376a2" volumeName="kubernetes.io/configmap/02758cc7-baf6-44d1-baa6-87438b8376a2-serviceca" seLinuxMountContext=""
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.237152    4357 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="02758cc7-baf6-44d1-baa6-87438b8376a2" volumeName="kubernetes.io/projected/02758cc7-baf6-44d1-baa6-87438b8376a2-kube-api-access-n2hgd" seLinuxMountContext=""
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.237167    4357 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="16031827-bc25-4ecd-b902-0161403f7566" volumeName="kubernetes.io/projected/16031827-bc25-4ecd-b902-0161403f7566-kube-api-access-8jqnp" seLinuxMountContext=""
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.237186    4357 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5b670e74-95bd-4a10-9d6d-b7b6d95e91c7" volumeName="kubernetes.io/configmap/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-multus-daemon-config" seLinuxMountContext=""
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.237201    4357 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="88680c4d-b306-483c-a5a7-3d559e078c01" volumeName="kubernetes.io/empty-dir/88680c4d-b306-483c-a5a7-3d559e078c01-etc-tuned" seLinuxMountContext=""
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.237227    4357 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8a855aab-8901-4d7d-8f10-91a8896d4b71" volumeName="kubernetes.io/projected/8a855aab-8901-4d7d-8f10-91a8896d4b71-kube-api-access-5m8jk" seLinuxMountContext=""
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.237240    4357 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="abfc6e5f-914e-4a19-8fd3-c8a844377da3" volumeName="kubernetes.io/configmap/abfc6e5f-914e-4a19-8fd3-c8a844377da3-konnectivity-ca" seLinuxMountContext=""
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.237259    4357 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f1f789ee-b574-48ba-abd5-cfac0b3d7f40" volumeName="kubernetes.io/configmap/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-env-overrides" seLinuxMountContext=""
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.237277    4357 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1658b916-200e-432c-9ca8-a7814f38e485" volumeName="kubernetes.io/configmap/1658b916-200e-432c-9ca8-a7814f38e485-whereabouts-flatfile-configmap" seLinuxMountContext=""
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.237291    4357 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2a7a7beb-0136-46a3-84f6-e00b34c4a4a9" volumeName="kubernetes.io/projected/2a7a7beb-0136-46a3-84f6-e00b34c4a4a9-kube-api-access-t88mv" seLinuxMountContext=""
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.237309    4357 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5510018c-1e4d-4009-bc56-2152f7703f7a" volumeName="kubernetes.io/projected/5510018c-1e4d-4009-bc56-2152f7703f7a-kube-api-access-vlb7q" seLinuxMountContext=""
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.237322    4357 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5b670e74-95bd-4a10-9d6d-b7b6d95e91c7" volumeName="kubernetes.io/projected/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-kube-api-access-55vhs" seLinuxMountContext=""
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.237337    4357 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="88680c4d-b306-483c-a5a7-3d559e078c01" volumeName="kubernetes.io/projected/88680c4d-b306-483c-a5a7-3d559e078c01-kube-api-access-pjmnx" seLinuxMountContext=""
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.237355    4357 reconstruct.go:97] "Volume reconstruction finished"
Nov 04 05:28:33.237456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.237364    4357 reconciler.go:29] "Reconciler: start to sync state"
Nov 04 05:28:33.240891 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.237705    4357 server.go:317] "Adding debug handlers to kubelet server"
Nov 04 05:28:33.240891 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.238441    4357 factory.go:55] Registering systemd factory
Nov 04 05:28:33.240891 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.238457    4357 factory.go:223] Registration of the systemd container factory successfully
Nov 04 05:28:33.240891 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.238851    4357 factory.go:153] Registering CRI-O factory
Nov 04 05:28:33.240891 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.238884    4357 factory.go:223] Registration of the crio container factory successfully
Nov 04 05:28:33.240891 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.238956    4357 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Nov 04 05:28:33.240891 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.238978    4357 factory.go:103] Registering Raw factory
Nov 04 05:28:33.240891 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.239000    4357 manager.go:1199] Started watching for new ooms in manager
Nov 04 05:28:33.240891 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.239411    4357 manager.go:319] Starting recovery of all containers
Nov 04 05:28:33.240891 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.240363    4357 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 05:28:33.240891 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.240572    4357 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 05:28:33.243288 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.243267    4357 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 05:28:33.243459 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.243445    4357 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Nov 04 05:28:33.247583 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.247564    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dlb7_f1f789ee-b574-48ba-abd5-cfac0b3d7f40/ovn-acl-logging/0.log"
Nov 04 05:28:33.249240 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.249221    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dlb7_f1f789ee-b574-48ba-abd5-cfac0b3d7f40/ovn-acl-logging/0.log"
Nov 04 05:28:33.265489 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.265454    4357 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Nov 04 05:28:33.266661 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.266643    4357 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Nov 04 05:28:33.266750 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.266667    4357 status_manager.go:249] "Starting to sync pod status with apiserver"
Nov 04 05:28:33.266750 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.266686    4357 kubelet.go:2521] "Starting kubelet main sync loop"
Nov 04 05:28:33.266750 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:28:33.266728    4357 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Nov 04 05:28:33.270462 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.270439    4357 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 05:28:33.282486 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.282424    4357 generic.go:356] "Generic (PLEG): container finished" podID="b29a0db634b87915a8146a0a3af4e909" containerID="c4b920101af69aef65172486b56f54584f550a716500999215859e5c25fe7abc" exitCode=0
Nov 04 05:28:33.292624 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.292603    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dlb7_f1f789ee-b574-48ba-abd5-cfac0b3d7f40/ovn-acl-logging/0.log"
Nov 04 05:28:33.293328 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.293301    4357 generic.go:356] "Generic (PLEG): container finished" podID="f1f789ee-b574-48ba-abd5-cfac0b3d7f40" containerID="1c6514a09d07e21470de95348378f58513755ae042d0f7ce6b29f2d97c4db0cc" exitCode=1
Nov 04 05:28:33.301652 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.301635    4357 manager.go:324] Recovery completed
Nov 04 05:28:33.302541 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.302499    4357 generic.go:356] "Generic (PLEG): container finished" podID="1658b916-200e-432c-9ca8-a7814f38e485" containerID="e3ca6e68478c325d04ffb09c0277bbd41e608945a696ac152f4168daa9ac3a45" exitCode=0
Nov 04 05:28:33.302599 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.302543    4357 generic.go:356] "Generic (PLEG): container finished" podID="1658b916-200e-432c-9ca8-a7814f38e485" containerID="14485260a5308f0285d1b7920014dfa3b75cb5b60915553b691f4b6115e904bf" exitCode=0
Nov 04 05:28:33.302599 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.302555    4357 generic.go:356] "Generic (PLEG): container finished" podID="1658b916-200e-432c-9ca8-a7814f38e485" containerID="497175b7f3473c5f631a109eeba2b38aa1fac034e5ef36490af9e4bc4995e59c" exitCode=0
Nov 04 05:28:33.302599 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.302563    4357 generic.go:356] "Generic (PLEG): container finished" podID="1658b916-200e-432c-9ca8-a7814f38e485" containerID="7fbf7b5dd1b42cf2a7df94b393c5f72374333c3c565c95c3fb5e145de0cde256" exitCode=0
Nov 04 05:28:33.302599 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.302571    4357 generic.go:356] "Generic (PLEG): container finished" podID="1658b916-200e-432c-9ca8-a7814f38e485" containerID="9e6edc04440addb04eca6189b20ff1c55367f0bc5529fdaae5828ac52bb8cc30" exitCode=0
Nov 04 05:28:33.302599 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.302579    4357 generic.go:356] "Generic (PLEG): container finished" podID="1658b916-200e-432c-9ca8-a7814f38e485" containerID="76aac6199488ea21ea622869bdcebfdd385cd45ab504a46013234d861fd405c1" exitCode=0
Nov 04 05:28:33.314371 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.314354    4357 cpu_manager.go:226] "Starting" policy="none"
Nov 04 05:28:33.314371 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.314366    4357 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Nov 04 05:28:33.314466 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.314381    4357 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Nov 04 05:28:33.314495 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.314479    4357 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Nov 04 05:28:33.314540 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.314489    4357 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Nov 04 05:28:33.314540 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.314504    4357 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Nov 04 05:28:33.314540 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.314509    4357 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Nov 04 05:28:33.314623 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.314556    4357 policy_none.go:50] "Start"
Nov 04 05:28:33.314623 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.314566    4357 memory_manager.go:187] "Starting memorymanager" policy="None"
Nov 04 05:28:33.314623 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.314576    4357 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Nov 04 05:28:33.314721 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.314711    4357 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Nov 04 05:28:33.314751 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.314721    4357 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Nov 04 05:28:33.314751 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.314726    4357 policy_none.go:44] "Start"
Nov 04 05:28:33.318355 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.318329    4357 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Nov 04 05:28:33.320781 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.320770    4357 manager.go:341] "Starting Device Plugin manager"
Nov 04 05:28:33.321210 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:28:33.320791    4357 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Nov 04 05:28:33.321259 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.321211    4357 server.go:87] "Starting device plugin registration server"
Nov 04 05:28:33.321449 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.321438    4357 eviction_manager.go:194] "Eviction manager: starting control loop"
Nov 04 05:28:33.321490 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.321449    4357 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Nov 04 05:28:33.321603 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.321573    4357 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Nov 04 05:28:33.321703 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.321661    4357 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Nov 04 05:28:33.321779 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.321720    4357 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Nov 04 05:28:33.321779 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.321726    4357 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Nov 04 05:28:33.321929 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.321817    4357 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-04T05:28:33.321701236Z","UUID":"559d920d-256c-410d-a415-6f3baf0cf738","Handler":null,"Name":"","Endpoint":""}
Nov 04 05:28:33.322836 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:28:33.322816    4357 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Nov 04 05:28:33.323203 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.323188    4357 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Nov 04 05:28:33.323298 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.323210    4357 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Nov 04 05:28:33.367784 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.367715    4357 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-170.us-east-2.compute.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-170.us-east-2.compute.internal"]
Nov 04 05:28:33.368195 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.368154    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-170.us-east-2.compute.internal" event={"ID":"49c578da98535d8878f600c872b7f09a","Type":"ContainerStarted","Data":"76fc854c22153ca3e5ee124e27a294d4e8b47762248c969a343593e8b0a2c697"}
Nov 04 05:28:33.368280 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.368194    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-170.us-east-2.compute.internal" event={"ID":"49c578da98535d8878f600c872b7f09a","Type":"ContainerStarted","Data":"23db902d108e6ad7aa3e5f6405eed3de64a22e6b9bb89b97d764b3c812ab8288"}
Nov 04 05:28:33.368280 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.368217    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-170.us-east-2.compute.internal" event={"ID":"b29a0db634b87915a8146a0a3af4e909","Type":"ContainerStarted","Data":"df64b1ad2f46242b8586d2632974f98e2e8675140c978596a58ac4acb85c04cf"}
Nov 04 05:28:33.368280 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.368229    4357 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-170.us-east-2.compute.internal"
Nov 04 05:28:33.368280 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.368234    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-170.us-east-2.compute.internal" event={"ID":"b29a0db634b87915a8146a0a3af4e909","Type":"ContainerDied","Data":"c4b920101af69aef65172486b56f54584f550a716500999215859e5c25fe7abc"}
Nov 04 05:28:33.368280 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.368254    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-170.us-east-2.compute.internal" event={"ID":"b29a0db634b87915a8146a0a3af4e909","Type":"ContainerStarted","Data":"63d2c3ec19119f421c5939d5a79172820f2092b27c3c65986172f455daaf12c6"}
Nov 04 05:28:33.368460 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.368371    4357 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-170.us-east-2.compute.internal"
Nov 04 05:28:33.379026 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.379007    4357 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 05:28:33.379099 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:28:33.379050    4357 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-133-170.us-east-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-170.us-east-2.compute.internal"
Nov 04 05:28:33.379557 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.379534    4357 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 05:28:33.379606 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:28:33.379565    4357 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-133-170.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-170.us-east-2.compute.internal"
Nov 04 05:28:33.422666 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.422648    4357 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 05:28:33.423781 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.423764    4357 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-170.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 05:28:33.423836 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.423796    4357 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-170.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 05:28:33.423836 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.423808    4357 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-170.us-east-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 05:28:33.423836 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.423832    4357 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-133-170.us-east-2.compute.internal"
Nov 04 05:28:33.437152 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.437135    4357 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-133-170.us-east-2.compute.internal"
Nov 04 05:28:33.437198 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.437178    4357 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-133-170.us-east-2.compute.internal"
Nov 04 05:28:33.444558 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.444541    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/49c578da98535d8878f600c872b7f09a-config\") pod \"kube-apiserver-proxy-ip-10-0-133-170.us-east-2.compute.internal\" (UID: \"49c578da98535d8878f600c872b7f09a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-170.us-east-2.compute.internal"
Nov 04 05:28:33.444636 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.444565    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b29a0db634b87915a8146a0a3af4e909-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-170.us-east-2.compute.internal\" (UID: \"b29a0db634b87915a8146a0a3af4e909\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-170.us-east-2.compute.internal"
Nov 04 05:28:33.444636 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.444581    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b29a0db634b87915a8146a0a3af4e909-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-170.us-east-2.compute.internal\" (UID: \"b29a0db634b87915a8146a0a3af4e909\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-170.us-east-2.compute.internal"
Nov 04 05:28:33.545305 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.545281    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/49c578da98535d8878f600c872b7f09a-config\") pod \"kube-apiserver-proxy-ip-10-0-133-170.us-east-2.compute.internal\" (UID: \"49c578da98535d8878f600c872b7f09a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-170.us-east-2.compute.internal"
Nov 04 05:28:33.545387 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.545305    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/49c578da98535d8878f600c872b7f09a-config\") pod \"kube-apiserver-proxy-ip-10-0-133-170.us-east-2.compute.internal\" (UID: \"49c578da98535d8878f600c872b7f09a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-170.us-east-2.compute.internal"
Nov 04 05:28:33.545387 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.545331    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b29a0db634b87915a8146a0a3af4e909-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-170.us-east-2.compute.internal\" (UID: \"b29a0db634b87915a8146a0a3af4e909\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-170.us-east-2.compute.internal"
Nov 04 05:28:33.545387 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.545358    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b29a0db634b87915a8146a0a3af4e909-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-170.us-east-2.compute.internal\" (UID: \"b29a0db634b87915a8146a0a3af4e909\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-170.us-east-2.compute.internal"
Nov 04 05:28:33.545505 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.545405    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b29a0db634b87915a8146a0a3af4e909-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-170.us-east-2.compute.internal\" (UID: \"b29a0db634b87915a8146a0a3af4e909\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-170.us-east-2.compute.internal"
Nov 04 05:28:33.545505 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:33.545422    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b29a0db634b87915a8146a0a3af4e909-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-170.us-east-2.compute.internal\" (UID: \"b29a0db634b87915a8146a0a3af4e909\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-170.us-east-2.compute.internal"
Nov 04 05:28:34.222788 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.222760    4357 apiserver.go:52] "Watching apiserver"
Nov 04 05:28:34.230479 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.230436    4357 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Nov 04 05:28:34.230886 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.230864    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-8fwjr","kube-system/konnectivity-agent-bwn4l","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw","openshift-cluster-node-tuning-operator/tuned-9tmdx","openshift-image-registry/node-ca-s2tjx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-170.us-east-2.compute.internal","openshift-multus/multus-5gwpr","openshift-multus/network-metrics-daemon-khrhn","openshift-network-operator/iptables-alerter-cxr2h","openshift-ovn-kubernetes/ovnkube-node-2dlb7","kube-system/kube-apiserver-proxy-ip-10-0-133-170.us-east-2.compute.internal","openshift-dns/node-resolver-x7zft","openshift-multus/multus-additional-cni-plugins-x5jbk","openshift-network-diagnostics/network-check-target-k54vt"]
Nov 04 05:28:34.236531 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.236487    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Nov 04 05:28:34.236652 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.236599    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Nov 04 05:28:34.236742 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.236718    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Nov 04 05:28:34.236915 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.236859    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Nov 04 05:28:34.237188 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.237168    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Nov 04 05:28:34.237315 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.237294    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Nov 04 05:28:34.237894 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.237876    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Nov 04 05:28:34.237998 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.237981    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-kkpcg\""
Nov 04 05:28:34.238057 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.237985    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pqp2n\""
Nov 04 05:28:34.238057 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.238049    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Nov 04 05:28:34.238144 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.238091    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Nov 04 05:28:34.238144 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.238097    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Nov 04 05:28:34.238144 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.238122    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-67qcf\""
Nov 04 05:28:34.238415 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.238394    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7x6ks\""
Nov 04 05:28:34.238472 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.238419    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-m8rqh\""
Nov 04 05:28:34.238472 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.238440    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xrb2c\""
Nov 04 05:28:34.238472 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.238444    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Nov 04 05:28:34.238620 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.238480    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 04 05:28:34.238620 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.238500    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Nov 04 05:28:34.238736 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.238719    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Nov 04 05:28:34.239386 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.239369    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 04 05:28:34.239466 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.239373    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-4fjpb\""
Nov 04 05:28:34.239509 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.239461    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-chnwp\""
Nov 04 05:28:34.239679 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.239664    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Nov 04 05:28:34.239752 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.239699    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Nov 04 05:28:34.239752 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.239723    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Nov 04 05:28:34.239867 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.239782    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Nov 04 05:28:34.239867 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.239814    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rpj2j\""
Nov 04 05:28:34.239958 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.239941    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Nov 04 05:28:34.240036 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.240024    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Nov 04 05:28:34.240169 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.240159    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Nov 04 05:28:34.240539 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.240512    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Nov 04 05:28:34.241070 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.241058    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qlwsz\""
Nov 04 05:28:34.241106 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.241069    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Nov 04 05:28:34.241135 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.241109    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Nov 04 05:28:34.241170 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.241146    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-zs9xj\""
Nov 04 05:28:34.241433 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.241422    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Nov 04 05:28:34.241550 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.241538    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fwwlp\""
Nov 04 05:28:34.241581 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.241550    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Nov 04 05:28:34.241901 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.241889    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Nov 04 05:28:34.241947 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.241893    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Nov 04 05:28:34.241947 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.241904    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Nov 04 05:28:34.242672 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.242660    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Nov 04 05:28:34.246806 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.246791    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-host-run-netns\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.246860 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.246815    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-system-cni-dir\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:28:34.246860 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.246842    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55vhs\" (UniqueName: \"kubernetes.io/projected/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-kube-api-access-55vhs\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:28:34.246860 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.246856    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-etc-openvswitch\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.246938 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.246898    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-host-cni-netd\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.246938 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.246923    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-ovnkube-config\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.246994 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.246983    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1658b916-200e-432c-9ca8-a7814f38e485-cnibin\") pod \"multus-additional-cni-plugins-x5jbk\" (UID: \"1658b916-200e-432c-9ca8-a7814f38e485\") " pod="openshift-multus/multus-additional-cni-plugins-x5jbk"
Nov 04 05:28:34.247046 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.247030    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1658b916-200e-432c-9ca8-a7814f38e485-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x5jbk\" (UID: \"1658b916-200e-432c-9ca8-a7814f38e485\") " pod="openshift-multus/multus-additional-cni-plugins-x5jbk"
Nov 04 05:28:34.247078 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.247064    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a7a7beb-0136-46a3-84f6-e00b34c4a4a9-metrics-certs\") pod \"network-metrics-daemon-khrhn\" (UID: \"2a7a7beb-0136-46a3-84f6-e00b34c4a4a9\") " pod="openshift-multus/network-metrics-daemon-khrhn"
Nov 04 05:28:34.247165 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.247149    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-etc-modprobe-d\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:28:34.247204 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.247153    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-ovnkube-config\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.247245 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.247214    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjmnx\" (UniqueName: \"kubernetes.io/projected/88680c4d-b306-483c-a5a7-3d559e078c01-kube-api-access-pjmnx\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:28:34.247279 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.247261    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a7a7beb-0136-46a3-84f6-e00b34c4a4a9-metrics-certs\") pod \"network-metrics-daemon-khrhn\" (UID: \"2a7a7beb-0136-46a3-84f6-e00b34c4a4a9\") " pod="openshift-multus/network-metrics-daemon-khrhn"
Nov 04 05:28:34.247279 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.247258    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-multus-cni-dir\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:28:34.247331 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.247289    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-host-run-netns\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:28:34.247331 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.247306    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-etc-kubernetes\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:28:34.247386 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.247359    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-host-kubelet\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.247386 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.247377    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-log-socket\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.247453 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.247391    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d0adbb13-2521-4805-b5ba-86b9052b6123-socket-dir\") pod \"aws-ebs-csi-driver-node-t8sjw\" (UID: \"d0adbb13-2521-4805-b5ba-86b9052b6123\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw"
Nov 04 05:28:34.247453 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.247427    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1658b916-200e-432c-9ca8-a7814f38e485-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x5jbk\" (UID: \"1658b916-200e-432c-9ca8-a7814f38e485\") " pod="openshift-multus/multus-additional-cni-plugins-x5jbk"
Nov 04 05:28:34.247577 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.247444    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx7g8\" (UniqueName: \"kubernetes.io/projected/d0adbb13-2521-4805-b5ba-86b9052b6123-kube-api-access-bx7g8\") pod \"aws-ebs-csi-driver-node-t8sjw\" (UID: \"d0adbb13-2521-4805-b5ba-86b9052b6123\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw"
Nov 04 05:28:34.247577 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.247485    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/abfc6e5f-914e-4a19-8fd3-c8a844377da3-agent-certs\") pod \"konnectivity-agent-bwn4l\" (UID: \"abfc6e5f-914e-4a19-8fd3-c8a844377da3\") " pod="kube-system/konnectivity-agent-bwn4l"
Nov 04 05:28:34.247577 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.247531    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/abfc6e5f-914e-4a19-8fd3-c8a844377da3-konnectivity-ca\") pod \"konnectivity-agent-bwn4l\" (UID: \"abfc6e5f-914e-4a19-8fd3-c8a844377da3\") " pod="kube-system/konnectivity-agent-bwn4l"
Nov 04 05:28:34.247577 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.247560    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-sys\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:28:34.247722 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.247586    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-hostroot\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:28:34.247722 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.247611    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-run-systemd\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.247722 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.247697    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b9aa45f3-1a47-489d-ba9d-76cbe630b283-original-pull-secret\") pod \"global-pull-secret-syncer-8fwjr\" (UID: \"b9aa45f3-1a47-489d-ba9d-76cbe630b283\") " pod="kube-system/global-pull-secret-syncer-8fwjr"
Nov 04 05:28:34.247847 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.247740    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-etc-sysconfig\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:28:34.247847 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.247785    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-ovn-node-metrics-cert\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.247948 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.247846    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/abfc6e5f-914e-4a19-8fd3-c8a844377da3-agent-certs\") pod \"konnectivity-agent-bwn4l\" (UID: \"abfc6e5f-914e-4a19-8fd3-c8a844377da3\") " pod="kube-system/konnectivity-agent-bwn4l"
Nov 04 05:28:34.247948 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.247855    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/abfc6e5f-914e-4a19-8fd3-c8a844377da3-konnectivity-ca\") pod \"konnectivity-agent-bwn4l\" (UID: \"abfc6e5f-914e-4a19-8fd3-c8a844377da3\") " pod="kube-system/konnectivity-agent-bwn4l"
Nov 04 05:28:34.247948 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.247883    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m8jk\" (UniqueName: \"kubernetes.io/projected/8a855aab-8901-4d7d-8f10-91a8896d4b71-kube-api-access-5m8jk\") pod \"network-check-target-k54vt\" (UID: \"8a855aab-8901-4d7d-8f10-91a8896d4b71\") " pod="openshift-network-diagnostics/network-check-target-k54vt"
Nov 04 05:28:34.247948 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.247907    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t88mv\" (UniqueName: \"kubernetes.io/projected/2a7a7beb-0136-46a3-84f6-e00b34c4a4a9-kube-api-access-t88mv\") pod \"network-metrics-daemon-khrhn\" (UID: \"2a7a7beb-0136-46a3-84f6-e00b34c4a4a9\") " pod="openshift-multus/network-metrics-daemon-khrhn"
Nov 04 05:28:34.247948 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.247923    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-etc-sysctl-d\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:28:34.247948 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.247938    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/88680c4d-b306-483c-a5a7-3d559e078c01-etc-tuned\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:28:34.248216 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.247960    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-host-run-k8s-cni-cncf-io\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:28:34.248216 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.247976    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-host-var-lib-cni-bin\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:28:34.248216 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.247991    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-host-slash\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.248216 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.248001    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b9aa45f3-1a47-489d-ba9d-76cbe630b283-original-pull-secret\") pod \"global-pull-secret-syncer-8fwjr\" (UID: \"b9aa45f3-1a47-489d-ba9d-76cbe630b283\") " pod="kube-system/global-pull-secret-syncer-8fwjr"
Nov 04 05:28:34.248216 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.248008    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1658b916-200e-432c-9ca8-a7814f38e485-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x5jbk\" (UID: \"1658b916-200e-432c-9ca8-a7814f38e485\") " pod="openshift-multus/multus-additional-cni-plugins-x5jbk"
Nov 04 05:28:34.248216 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.248024    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/88680c4d-b306-483c-a5a7-3d559e078c01-etc-tuned\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:28:34.248216 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.248033    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d0adbb13-2521-4805-b5ba-86b9052b6123-device-dir\") pod \"aws-ebs-csi-driver-node-t8sjw\" (UID: \"d0adbb13-2521-4805-b5ba-86b9052b6123\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw"
Nov 04 05:28:34.248216 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.248063    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-multus-socket-dir-parent\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:28:34.248216 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.248108    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1658b916-200e-432c-9ca8-a7814f38e485-cni-binary-copy\") pod \"multus-additional-cni-plugins-x5jbk\" (UID: \"1658b916-200e-432c-9ca8-a7814f38e485\") " pod="openshift-multus/multus-additional-cni-plugins-x5jbk"
Nov 04 05:28:34.248216 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.248140    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-etc-kubernetes\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:28:34.248216 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.248202    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d0adbb13-2521-4805-b5ba-86b9052b6123-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t8sjw\" (UID: \"d0adbb13-2521-4805-b5ba-86b9052b6123\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw"
Nov 04 05:28:34.248216 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.248209    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-ovn-node-metrics-cert\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.248687 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.248251    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d0adbb13-2521-4805-b5ba-86b9052b6123-registration-dir\") pod \"aws-ebs-csi-driver-node-t8sjw\" (UID: \"d0adbb13-2521-4805-b5ba-86b9052b6123\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw"
Nov 04 05:28:34.248687 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.248259    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1658b916-200e-432c-9ca8-a7814f38e485-cni-binary-copy\") pod \"multus-additional-cni-plugins-x5jbk\" (UID: \"1658b916-200e-432c-9ca8-a7814f38e485\") " pod="openshift-multus/multus-additional-cni-plugins-x5jbk"
Nov 04 05:28:34.248687 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.248282    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/02758cc7-baf6-44d1-baa6-87438b8376a2-serviceca\") pod \"node-ca-s2tjx\" (UID: \"02758cc7-baf6-44d1-baa6-87438b8376a2\") " pod="openshift-image-registry/node-ca-s2tjx"
Nov 04 05:28:34.248687 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.248315    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2hgd\" (UniqueName: \"kubernetes.io/projected/02758cc7-baf6-44d1-baa6-87438b8376a2-kube-api-access-n2hgd\") pod \"node-ca-s2tjx\" (UID: \"02758cc7-baf6-44d1-baa6-87438b8376a2\") " pod="openshift-image-registry/node-ca-s2tjx"
Nov 04 05:28:34.248687 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.248343    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1658b916-200e-432c-9ca8-a7814f38e485-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x5jbk\" (UID: \"1658b916-200e-432c-9ca8-a7814f38e485\") " pod="openshift-multus/multus-additional-cni-plugins-x5jbk"
Nov 04 05:28:34.248687 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.248410    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-run\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:28:34.248687 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.248436    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-host\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:28:34.248687 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.248462    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-multus-conf-dir\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:28:34.248687 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.248498    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d0adbb13-2521-4805-b5ba-86b9052b6123-etc-selinux\") pod \"aws-ebs-csi-driver-node-t8sjw\" (UID: \"d0adbb13-2521-4805-b5ba-86b9052b6123\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw"
Nov 04 05:28:34.248687 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.248554    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/88680c4d-b306-483c-a5a7-3d559e078c01-tmp\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:28:34.248687 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.248569    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1658b916-200e-432c-9ca8-a7814f38e485-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x5jbk\" (UID: \"1658b916-200e-432c-9ca8-a7814f38e485\") " pod="openshift-multus/multus-additional-cni-plugins-x5jbk"
Nov 04 05:28:34.248687 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.248583    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-host-run-multus-certs\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:28:34.248687 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.248602    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/88680c4d-b306-483c-a5a7-3d559e078c01-tmp\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:28:34.248687 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.248631    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/16031827-bc25-4ecd-b902-0161403f7566-iptables-alerter-script\") pod \"iptables-alerter-cxr2h\" (UID: \"16031827-bc25-4ecd-b902-0161403f7566\") " pod="openshift-network-operator/iptables-alerter-cxr2h"
Nov 04 05:28:34.248687 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.248658    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx72x\" (UniqueName: \"kubernetes.io/projected/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-kube-api-access-qx72x\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.248687 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.248683    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlb7q\" (UniqueName: \"kubernetes.io/projected/5510018c-1e4d-4009-bc56-2152f7703f7a-kube-api-access-vlb7q\") pod \"node-resolver-x7zft\" (UID: \"5510018c-1e4d-4009-bc56-2152f7703f7a\") " pod="openshift-dns/node-resolver-x7zft"
Nov 04 05:28:34.249374 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.248709    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-etc-systemd\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:28:34.249374 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.248733    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b9aa45f3-1a47-489d-ba9d-76cbe630b283-kubelet-config\") pod \"global-pull-secret-syncer-8fwjr\" (UID: \"b9aa45f3-1a47-489d-ba9d-76cbe630b283\") " pod="kube-system/global-pull-secret-syncer-8fwjr"
Nov 04 05:28:34.249374 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.248756    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b9aa45f3-1a47-489d-ba9d-76cbe630b283-dbus\") pod \"global-pull-secret-syncer-8fwjr\" (UID: \"b9aa45f3-1a47-489d-ba9d-76cbe630b283\") " pod="kube-system/global-pull-secret-syncer-8fwjr"
Nov 04 05:28:34.249374 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.248791    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-host-var-lib-cni-multus\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:28:34.249374 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.248844    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/16031827-bc25-4ecd-b902-0161403f7566-iptables-alerter-script\") pod \"iptables-alerter-cxr2h\" (UID: \"16031827-bc25-4ecd-b902-0161403f7566\") " pod="openshift-network-operator/iptables-alerter-cxr2h"
Nov 04 05:28:34.249374 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.248899    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-run-ovn\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.249374 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.248933    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-ovnkube-script-lib\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.249374 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.248960    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-multus-daemon-config\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:28:34.249374 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.248985    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-node-log\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.249374 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.249009    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-host-cni-bin\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.249374 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.249018    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/02758cc7-baf6-44d1-baa6-87438b8376a2-serviceca\") pod \"node-ca-s2tjx\" (UID: \"02758cc7-baf6-44d1-baa6-87438b8376a2\") " pod="openshift-image-registry/node-ca-s2tjx"
Nov 04 05:28:34.249374 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.249037    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jqnp\" (UniqueName: \"kubernetes.io/projected/16031827-bc25-4ecd-b902-0161403f7566-kube-api-access-8jqnp\") pod \"iptables-alerter-cxr2h\" (UID: \"16031827-bc25-4ecd-b902-0161403f7566\") " pod="openshift-network-operator/iptables-alerter-cxr2h"
Nov 04 05:28:34.249374 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.249086    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/02758cc7-baf6-44d1-baa6-87438b8376a2-host\") pod \"node-ca-s2tjx\" (UID: \"02758cc7-baf6-44d1-baa6-87438b8376a2\") " pod="openshift-image-registry/node-ca-s2tjx"
Nov 04 05:28:34.249374 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.249111    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-etc-sysctl-conf\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:28:34.249374 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.249117    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-ovnkube-script-lib\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.249374 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.249134    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-cnibin\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:28:34.249374 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.249159    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-systemd-units\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.249374 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.249207    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-var-lib-openvswitch\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.249374 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.249241    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-run-openvswitch\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.249374 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.249234    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-multus-daemon-config\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:28:34.249374 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.249271    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1658b916-200e-432c-9ca8-a7814f38e485-system-cni-dir\") pod \"multus-additional-cni-plugins-x5jbk\" (UID: \"1658b916-200e-432c-9ca8-a7814f38e485\") " pod="openshift-multus/multus-additional-cni-plugins-x5jbk"
Nov 04 05:28:34.249374 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.249335    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5510018c-1e4d-4009-bc56-2152f7703f7a-tmp-dir\") pod \"node-resolver-x7zft\" (UID: \"5510018c-1e4d-4009-bc56-2152f7703f7a\") " pod="openshift-dns/node-resolver-x7zft"
Nov 04 05:28:34.249374 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.249365    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-host-run-ovn-kubernetes\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.250094 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.249403    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-var-lib-kubelet\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:28:34.250094 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.249461    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-cni-binary-copy\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:28:34.250094 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.249463    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5510018c-1e4d-4009-bc56-2152f7703f7a-tmp-dir\") pod \"node-resolver-x7zft\" (UID: \"5510018c-1e4d-4009-bc56-2152f7703f7a\") " pod="openshift-dns/node-resolver-x7zft"
Nov 04 05:28:34.250094 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.249493    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/16031827-bc25-4ecd-b902-0161403f7566-host-slash\") pod \"iptables-alerter-cxr2h\" (UID: \"16031827-bc25-4ecd-b902-0161403f7566\") " pod="openshift-network-operator/iptables-alerter-cxr2h"
Nov 04 05:28:34.250094 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.249509    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.250094 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.249542    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-env-overrides\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.250094 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.249577    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4vgq\" (UniqueName: \"kubernetes.io/projected/1658b916-200e-432c-9ca8-a7814f38e485-kube-api-access-z4vgq\") pod \"multus-additional-cni-plugins-x5jbk\" (UID: \"1658b916-200e-432c-9ca8-a7814f38e485\") " pod="openshift-multus/multus-additional-cni-plugins-x5jbk"
Nov 04 05:28:34.250094 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.249610    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d0adbb13-2521-4805-b5ba-86b9052b6123-sys-fs\") pod \"aws-ebs-csi-driver-node-t8sjw\" (UID: \"d0adbb13-2521-4805-b5ba-86b9052b6123\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw"
Nov 04 05:28:34.250094 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.249635    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-cni-binary-copy\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:28:34.250094 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.249634    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5510018c-1e4d-4009-bc56-2152f7703f7a-hosts-file\") pod \"node-resolver-x7zft\" (UID: \"5510018c-1e4d-4009-bc56-2152f7703f7a\") " pod="openshift-dns/node-resolver-x7zft"
Nov 04 05:28:34.250094 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.249650    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-env-overrides\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.250094 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.249679    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-lib-modules\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:28:34.250094 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.249715    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-host-var-lib-kubelet\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:28:34.253714 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.253677    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjmnx\" (UniqueName: \"kubernetes.io/projected/88680c4d-b306-483c-a5a7-3d559e078c01-kube-api-access-pjmnx\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:28:34.253790 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.253761    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55vhs\" (UniqueName: \"kubernetes.io/projected/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-kube-api-access-55vhs\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:28:34.253826 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.253765    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx7g8\" (UniqueName: \"kubernetes.io/projected/d0adbb13-2521-4805-b5ba-86b9052b6123-kube-api-access-bx7g8\") pod \"aws-ebs-csi-driver-node-t8sjw\" (UID: \"d0adbb13-2521-4805-b5ba-86b9052b6123\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw"
Nov 04 05:28:34.254807 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.254788    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jqnp\" (UniqueName: \"kubernetes.io/projected/16031827-bc25-4ecd-b902-0161403f7566-kube-api-access-8jqnp\") pod \"iptables-alerter-cxr2h\" (UID: \"16031827-bc25-4ecd-b902-0161403f7566\") " pod="openshift-network-operator/iptables-alerter-cxr2h"
Nov 04 05:28:34.254888 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.254870    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m8jk\" (UniqueName: \"kubernetes.io/projected/8a855aab-8901-4d7d-8f10-91a8896d4b71-kube-api-access-5m8jk\") pod \"network-check-target-k54vt\" (UID: \"8a855aab-8901-4d7d-8f10-91a8896d4b71\") " pod="openshift-network-diagnostics/network-check-target-k54vt"
Nov 04 05:28:34.254976 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.254959    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2hgd\" (UniqueName: \"kubernetes.io/projected/02758cc7-baf6-44d1-baa6-87438b8376a2-kube-api-access-n2hgd\") pod \"node-ca-s2tjx\" (UID: \"02758cc7-baf6-44d1-baa6-87438b8376a2\") " pod="openshift-image-registry/node-ca-s2tjx"
Nov 04 05:28:34.255074 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.255059    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t88mv\" (UniqueName: \"kubernetes.io/projected/2a7a7beb-0136-46a3-84f6-e00b34c4a4a9-kube-api-access-t88mv\") pod \"network-metrics-daemon-khrhn\" (UID: \"2a7a7beb-0136-46a3-84f6-e00b34c4a4a9\") " pod="openshift-multus/network-metrics-daemon-khrhn"
Nov 04 05:28:34.255731 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.255713    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlb7q\" (UniqueName: \"kubernetes.io/projected/5510018c-1e4d-4009-bc56-2152f7703f7a-kube-api-access-vlb7q\") pod \"node-resolver-x7zft\" (UID: \"5510018c-1e4d-4009-bc56-2152f7703f7a\") " pod="openshift-dns/node-resolver-x7zft"
Nov 04 05:28:34.255889 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.255870    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx72x\" (UniqueName: \"kubernetes.io/projected/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-kube-api-access-qx72x\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.255923 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.255889    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4vgq\" (UniqueName: \"kubernetes.io/projected/1658b916-200e-432c-9ca8-a7814f38e485-kube-api-access-z4vgq\") pod \"multus-additional-cni-plugins-x5jbk\" (UID: \"1658b916-200e-432c-9ca8-a7814f38e485\") " pod="openshift-multus/multus-additional-cni-plugins-x5jbk"
Nov 04 05:28:34.305178 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.305156    4357 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-170.us-east-2.compute.internal"
Nov 04 05:28:34.305308 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.305294    4357 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-170.us-east-2.compute.internal"
Nov 04 05:28:34.316507 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.316489    4357 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 05:28:34.316601 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:28:34.316536    4357 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-133-170.us-east-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-170.us-east-2.compute.internal"
Nov 04 05:28:34.323396 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.323379    4357 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 05:28:34.323492 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:28:34.323428    4357 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-133-170.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-170.us-east-2.compute.internal"
Nov 04 05:28:34.335667 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.335650    4357 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Nov 04 05:28:34.350454 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.350433    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-etc-sysctl-d\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:28:34.350596 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.350462    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-host-run-k8s-cni-cncf-io\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:28:34.350596 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.350478    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-host-var-lib-cni-bin\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:28:34.350596 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.350491    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-host-slash\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.350596 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.350506    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1658b916-200e-432c-9ca8-a7814f38e485-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x5jbk\" (UID: \"1658b916-200e-432c-9ca8-a7814f38e485\") " pod="openshift-multus/multus-additional-cni-plugins-x5jbk"
Nov 04 05:28:34.350596 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.350544    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-host-run-k8s-cni-cncf-io\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:28:34.350596 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.350564    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d0adbb13-2521-4805-b5ba-86b9052b6123-device-dir\") pod \"aws-ebs-csi-driver-node-t8sjw\" (UID: \"d0adbb13-2521-4805-b5ba-86b9052b6123\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw"
Nov 04 05:28:34.350596 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.350574    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-host-slash\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.350596 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.350589    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-multus-socket-dir-parent\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:28:34.350596 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.350561    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-host-var-lib-cni-bin\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:28:34.350989 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.350611    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-etc-kubernetes\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:28:34.350989 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.350614    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d0adbb13-2521-4805-b5ba-86b9052b6123-device-dir\") pod \"aws-ebs-csi-driver-node-t8sjw\" (UID: \"d0adbb13-2521-4805-b5ba-86b9052b6123\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw"
Nov 04 05:28:34.350989 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.350616    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1658b916-200e-432c-9ca8-a7814f38e485-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x5jbk\" (UID: \"1658b916-200e-432c-9ca8-a7814f38e485\") " pod="openshift-multus/multus-additional-cni-plugins-x5jbk"
Nov 04 05:28:34.350989 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.350635    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d0adbb13-2521-4805-b5ba-86b9052b6123-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t8sjw\" (UID: \"d0adbb13-2521-4805-b5ba-86b9052b6123\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw"
Nov 04 05:28:34.350989 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.350647    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-multus-socket-dir-parent\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:28:34.350989 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.350658    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-etc-sysctl-d\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:28:34.350989 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.350665    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d0adbb13-2521-4805-b5ba-86b9052b6123-registration-dir\") pod \"aws-ebs-csi-driver-node-t8sjw\" (UID: \"d0adbb13-2521-4805-b5ba-86b9052b6123\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw"
Nov 04 05:28:34.350989 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.350677    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d0adbb13-2521-4805-b5ba-86b9052b6123-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t8sjw\" (UID: \"d0adbb13-2521-4805-b5ba-86b9052b6123\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw"
Nov 04 05:28:34.350989 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.350706    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d0adbb13-2521-4805-b5ba-86b9052b6123-registration-dir\") pod \"aws-ebs-csi-driver-node-t8sjw\" (UID: \"d0adbb13-2521-4805-b5ba-86b9052b6123\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw"
Nov 04 05:28:34.350989 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.350710    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-run\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:28:34.350989 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.350703    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-etc-kubernetes\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:28:34.350989 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.350728    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-host\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:28:34.350989 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.350743    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-multus-conf-dir\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:28:34.350989 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.350761    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d0adbb13-2521-4805-b5ba-86b9052b6123-etc-selinux\") pod \"aws-ebs-csi-driver-node-t8sjw\" (UID: \"d0adbb13-2521-4805-b5ba-86b9052b6123\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw"
Nov 04 05:28:34.350989 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.350762    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-run\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:28:34.350989 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.350787    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-host-run-multus-certs\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:28:34.350989 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.350793    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-multus-conf-dir\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:28:34.350989 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.350779    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-host\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:28:34.350989 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.350811    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d0adbb13-2521-4805-b5ba-86b9052b6123-etc-selinux\") pod \"aws-ebs-csi-driver-node-t8sjw\" (UID: \"d0adbb13-2521-4805-b5ba-86b9052b6123\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw"
Nov 04 05:28:34.350989 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.350821    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-host-run-multus-certs\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:28:34.350989 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.350854    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-etc-systemd\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:28:34.350989 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.350883    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b9aa45f3-1a47-489d-ba9d-76cbe630b283-kubelet-config\") pod \"global-pull-secret-syncer-8fwjr\" (UID: \"b9aa45f3-1a47-489d-ba9d-76cbe630b283\") " pod="kube-system/global-pull-secret-syncer-8fwjr"
Nov 04 05:28:34.350989 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.350906    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b9aa45f3-1a47-489d-ba9d-76cbe630b283-dbus\") pod \"global-pull-secret-syncer-8fwjr\" (UID: \"b9aa45f3-1a47-489d-ba9d-76cbe630b283\") " pod="kube-system/global-pull-secret-syncer-8fwjr"
Nov 04 05:28:34.350989 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.350929    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-host-var-lib-cni-multus\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:28:34.350989 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.350937    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-etc-systemd\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:28:34.350989 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.350965    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-run-ovn\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.350989 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.350976    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-host-var-lib-cni-multus\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:28:34.350989 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.350990    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-node-log\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.350989 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351000    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b9aa45f3-1a47-489d-ba9d-76cbe630b283-dbus\") pod \"global-pull-secret-syncer-8fwjr\" (UID: \"b9aa45f3-1a47-489d-ba9d-76cbe630b283\") " pod="kube-system/global-pull-secret-syncer-8fwjr"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351014    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-host-cni-bin\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351023    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b9aa45f3-1a47-489d-ba9d-76cbe630b283-kubelet-config\") pod \"global-pull-secret-syncer-8fwjr\" (UID: \"b9aa45f3-1a47-489d-ba9d-76cbe630b283\") " pod="kube-system/global-pull-secret-syncer-8fwjr"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351033    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/02758cc7-baf6-44d1-baa6-87438b8376a2-host\") pod \"node-ca-s2tjx\" (UID: \"02758cc7-baf6-44d1-baa6-87438b8376a2\") " pod="openshift-image-registry/node-ca-s2tjx"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351048    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-etc-sysctl-conf\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351052    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-node-log\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351060    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-host-cni-bin\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351034    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-run-ovn\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351068    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-cnibin\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351068    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/02758cc7-baf6-44d1-baa6-87438b8376a2-host\") pod \"node-ca-s2tjx\" (UID: \"02758cc7-baf6-44d1-baa6-87438b8376a2\") " pod="openshift-image-registry/node-ca-s2tjx"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351102    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-cnibin\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351097    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-systemd-units\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351137    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-systemd-units\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351139    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-var-lib-openvswitch\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351168    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-var-lib-openvswitch\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351172    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-run-openvswitch\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351196    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1658b916-200e-432c-9ca8-a7814f38e485-system-cni-dir\") pod \"multus-additional-cni-plugins-x5jbk\" (UID: \"1658b916-200e-432c-9ca8-a7814f38e485\") " pod="openshift-multus/multus-additional-cni-plugins-x5jbk"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351168    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-etc-sysctl-conf\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351203    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-run-openvswitch\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351212    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-host-run-ovn-kubernetes\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351222    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1658b916-200e-432c-9ca8-a7814f38e485-system-cni-dir\") pod \"multus-additional-cni-plugins-x5jbk\" (UID: \"1658b916-200e-432c-9ca8-a7814f38e485\") " pod="openshift-multus/multus-additional-cni-plugins-x5jbk"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351226    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-var-lib-kubelet\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351249    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-var-lib-kubelet\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351254    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/16031827-bc25-4ecd-b902-0161403f7566-host-slash\") pod \"iptables-alerter-cxr2h\" (UID: \"16031827-bc25-4ecd-b902-0161403f7566\") " pod="openshift-network-operator/iptables-alerter-cxr2h"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351253    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-host-run-ovn-kubernetes\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351271    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/16031827-bc25-4ecd-b902-0161403f7566-host-slash\") pod \"iptables-alerter-cxr2h\" (UID: \"16031827-bc25-4ecd-b902-0161403f7566\") " pod="openshift-network-operator/iptables-alerter-cxr2h"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351270    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351288    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351293    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d0adbb13-2521-4805-b5ba-86b9052b6123-sys-fs\") pod \"aws-ebs-csi-driver-node-t8sjw\" (UID: \"d0adbb13-2521-4805-b5ba-86b9052b6123\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351307    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5510018c-1e4d-4009-bc56-2152f7703f7a-hosts-file\") pod \"node-resolver-x7zft\" (UID: \"5510018c-1e4d-4009-bc56-2152f7703f7a\") " pod="openshift-dns/node-resolver-x7zft"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351320    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-lib-modules\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351333    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-host-var-lib-kubelet\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351348    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-host-run-netns\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351363    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-system-cni-dir\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351364    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d0adbb13-2521-4805-b5ba-86b9052b6123-sys-fs\") pod \"aws-ebs-csi-driver-node-t8sjw\" (UID: \"d0adbb13-2521-4805-b5ba-86b9052b6123\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351376    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5510018c-1e4d-4009-bc56-2152f7703f7a-hosts-file\") pod \"node-resolver-x7zft\" (UID: \"5510018c-1e4d-4009-bc56-2152f7703f7a\") " pod="openshift-dns/node-resolver-x7zft"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351377    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-etc-openvswitch\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351398    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-host-run-netns\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351399    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-host-var-lib-kubelet\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351415    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-host-cni-netd\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351429    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-system-cni-dir\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351440    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1658b916-200e-432c-9ca8-a7814f38e485-cnibin\") pod \"multus-additional-cni-plugins-x5jbk\" (UID: \"1658b916-200e-432c-9ca8-a7814f38e485\") " pod="openshift-multus/multus-additional-cni-plugins-x5jbk"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351419    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-etc-openvswitch\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351445    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-host-cni-netd\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351449    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-lib-modules\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351457    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-etc-modprobe-d\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351479    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1658b916-200e-432c-9ca8-a7814f38e485-cnibin\") pod \"multus-additional-cni-plugins-x5jbk\" (UID: \"1658b916-200e-432c-9ca8-a7814f38e485\") " pod="openshift-multus/multus-additional-cni-plugins-x5jbk"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351485    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-multus-cni-dir\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351525    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-host-run-netns\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351540    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-etc-kubernetes\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351548    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-etc-modprobe-d\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351555    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-multus-cni-dir\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351561    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-host-kubelet\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351590    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-host-run-netns\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351624    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-log-socket\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351642    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-etc-kubernetes\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351650    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d0adbb13-2521-4805-b5ba-86b9052b6123-socket-dir\") pod \"aws-ebs-csi-driver-node-t8sjw\" (UID: \"d0adbb13-2521-4805-b5ba-86b9052b6123\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351672    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-host-kubelet\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351679    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-sys\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351701    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-log-socket\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351725    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-hostroot\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351732    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-sys\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351739    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-run-systemd\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351760    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5b670e74-95bd-4a10-9d6d-b7b6d95e91c7-hostroot\") pod \"multus-5gwpr\" (UID: \"5b670e74-95bd-4a10-9d6d-b7b6d95e91c7\") " pod="openshift-multus/multus-5gwpr"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351760    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f1f789ee-b574-48ba-abd5-cfac0b3d7f40-run-systemd\") pod \"ovnkube-node-2dlb7\" (UID: \"f1f789ee-b574-48ba-abd5-cfac0b3d7f40\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351782    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-etc-sysconfig\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351794    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d0adbb13-2521-4805-b5ba-86b9052b6123-socket-dir\") pod \"aws-ebs-csi-driver-node-t8sjw\" (UID: \"d0adbb13-2521-4805-b5ba-86b9052b6123\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t8sjw"
Nov 04 05:28:34.352029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.351828    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/88680c4d-b306-483c-a5a7-3d559e078c01-etc-sysconfig\") pod \"tuned-9tmdx\" (UID: \"88680c4d-b306-483c-a5a7-3d559e078c01\") " pod="openshift-cluster-node-tuning-operator/tuned-9tmdx"
Nov 04 05:28:34.775749 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:34.775720    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:37.454026 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:37.453990    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:37.454473 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:37.454267    4357 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 04 05:28:40.606487 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.606454    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-npgcv"]
Nov 04 05:28:40.609857 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.609822    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-npgcv"
Nov 04 05:28:40.611682 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.611656    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6dd789c8b7-twk8j"]
Nov 04 05:28:40.613353 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.613331    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-twk8j"
Nov 04 05:28:40.618529 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.618497    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c4dff5bcb-m9qgc"]
Nov 04 05:28:40.619990 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.619970    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-kwfv6"]
Nov 04 05:28:40.620134 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.620116    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c4dff5bcb-m9qgc"
Nov 04 05:28:40.621452 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.621436    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-kwfv6"
Nov 04 05:28:40.624706 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.624686    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Nov 04 05:28:40.624812 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.624765    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Nov 04 05:28:40.624935 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.624922    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Nov 04 05:28:40.625697 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.625683    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Nov 04 05:28:40.625760 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.625704    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Nov 04 05:28:40.626944 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.626926    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Nov 04 05:28:40.627120 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.627048    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ghvrd\""
Nov 04 05:28:40.627753 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.627150    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"downloads-dockercfg-9srfn\""
Nov 04 05:28:40.628604 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.628584    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-npgcv"]
Nov 04 05:28:40.637554 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.637534    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-bgxrs\""
Nov 04 05:28:40.637554 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.637538    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Nov 04 05:28:40.638092 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.637727    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Nov 04 05:28:40.639180 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.639017    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-twk8j"]
Nov 04 05:28:40.639575 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.639479    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Nov 04 05:28:40.639575 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.639755    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Nov 04 05:28:40.639575 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.640650    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Nov 04 05:28:40.639575 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.641147    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-kwfv6"]
Nov 04 05:28:40.641618 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.641602    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pwfdh"]
Nov 04 05:28:40.643575 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.643554    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pwfdh"
Nov 04 05:28:40.652549 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.652534    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Nov 04 05:28:40.656620 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.656600    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pwfdh"]
Nov 04 05:28:40.657024 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.657000    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c4dff5bcb-m9qgc"]
Nov 04 05:28:40.666569 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.666551    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-p27dv"]
Nov 04 05:28:40.668308 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.668295    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-p27dv"
Nov 04 05:28:40.679656 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.679635    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-p27dv"]
Nov 04 05:28:40.682086 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.682068    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Nov 04 05:28:40.682346 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.682328    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Nov 04 05:28:40.683554 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.683537    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8180f8f9-e202-413f-a5f0-bc3146ab4613-service-ca\") pod \"console-5c4dff5bcb-m9qgc\" (UID: \"8180f8f9-e202-413f-a5f0-bc3146ab4613\") " pod="openshift-console/console-5c4dff5bcb-m9qgc"
Nov 04 05:28:40.683639 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.683569    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnrtg\" (UniqueName: \"kubernetes.io/projected/8180f8f9-e202-413f-a5f0-bc3146ab4613-kube-api-access-dnrtg\") pod \"console-5c4dff5bcb-m9qgc\" (UID: \"8180f8f9-e202-413f-a5f0-bc3146ab4613\") " pod="openshift-console/console-5c4dff5bcb-m9qgc"
Nov 04 05:28:40.683639 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.683602    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c610835f-ae53-45a1-868d-573b7e07524c-crio-socket\") pod \"insights-runtime-extractor-npgcv\" (UID: \"c610835f-ae53-45a1-868d-573b7e07524c\") " pod="openshift-insights/insights-runtime-extractor-npgcv"
Nov 04 05:28:40.683712 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.683670    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8180f8f9-e202-413f-a5f0-bc3146ab4613-console-serving-cert\") pod \"console-5c4dff5bcb-m9qgc\" (UID: \"8180f8f9-e202-413f-a5f0-bc3146ab4613\") " pod="openshift-console/console-5c4dff5bcb-m9qgc"
Nov 04 05:28:40.683712 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.683700    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpxbb\" (UniqueName: \"kubernetes.io/projected/141ed76b-593a-4efb-a0b2-0e9c95258451-kube-api-access-hpxbb\") pod \"dns-default-pwfdh\" (UID: \"141ed76b-593a-4efb-a0b2-0e9c95258451\") " pod="openshift-dns/dns-default-pwfdh"
Nov 04 05:28:40.683777 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.683717    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/fd7c3d1d-397d-4280-bc90-40bf34af6424-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-kwfv6\" (UID: \"fd7c3d1d-397d-4280-bc90-40bf34af6424\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-kwfv6"
Nov 04 05:28:40.683777 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.683742    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2mbm\" (UniqueName: \"kubernetes.io/projected/c610835f-ae53-45a1-868d-573b7e07524c-kube-api-access-t2mbm\") pod \"insights-runtime-extractor-npgcv\" (UID: \"c610835f-ae53-45a1-868d-573b7e07524c\") " pod="openshift-insights/insights-runtime-extractor-npgcv"
Nov 04 05:28:40.683875 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.683775    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8180f8f9-e202-413f-a5f0-bc3146ab4613-tmp\") pod \"console-5c4dff5bcb-m9qgc\" (UID: \"8180f8f9-e202-413f-a5f0-bc3146ab4613\") " pod="openshift-console/console-5c4dff5bcb-m9qgc"
Nov 04 05:28:40.683875 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.683821    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f85457d7-1779-477b-8f2d-e9d4b7ac6c3c-tmp\") pod \"downloads-6dd789c8b7-twk8j\" (UID: \"f85457d7-1779-477b-8f2d-e9d4b7ac6c3c\") " pod="openshift-console/downloads-6dd789c8b7-twk8j"
Nov 04 05:28:40.683949 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.683873    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmt7d\" (UniqueName: \"kubernetes.io/projected/f85457d7-1779-477b-8f2d-e9d4b7ac6c3c-kube-api-access-hmt7d\") pod \"downloads-6dd789c8b7-twk8j\" (UID: \"f85457d7-1779-477b-8f2d-e9d4b7ac6c3c\") " pod="openshift-console/downloads-6dd789c8b7-twk8j"
Nov 04 05:28:40.683949 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.683937    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/141ed76b-593a-4efb-a0b2-0e9c95258451-metrics-tls\") pod \"dns-default-pwfdh\" (UID: \"141ed76b-593a-4efb-a0b2-0e9c95258451\") " pod="openshift-dns/dns-default-pwfdh"
Nov 04 05:28:40.684026 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.683956    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8180f8f9-e202-413f-a5f0-bc3146ab4613-console-config\") pod \"console-5c4dff5bcb-m9qgc\" (UID: \"8180f8f9-e202-413f-a5f0-bc3146ab4613\") " pod="openshift-console/console-5c4dff5bcb-m9qgc"
Nov 04 05:28:40.684026 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.683972    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8180f8f9-e202-413f-a5f0-bc3146ab4613-oauth-serving-cert\") pod \"console-5c4dff5bcb-m9qgc\" (UID: \"8180f8f9-e202-413f-a5f0-bc3146ab4613\") " pod="openshift-console/console-5c4dff5bcb-m9qgc"
Nov 04 05:28:40.684026 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.683987    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/141ed76b-593a-4efb-a0b2-0e9c95258451-config-volume\") pod \"dns-default-pwfdh\" (UID: \"141ed76b-593a-4efb-a0b2-0e9c95258451\") " pod="openshift-dns/dns-default-pwfdh"
Nov 04 05:28:40.684026 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.684006    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c610835f-ae53-45a1-868d-573b7e07524c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-npgcv\" (UID: \"c610835f-ae53-45a1-868d-573b7e07524c\") " pod="openshift-insights/insights-runtime-extractor-npgcv"
Nov 04 05:28:40.684187 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.684052    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c610835f-ae53-45a1-868d-573b7e07524c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-npgcv\" (UID: \"c610835f-ae53-45a1-868d-573b7e07524c\") " pod="openshift-insights/insights-runtime-extractor-npgcv"
Nov 04 05:28:40.684187 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.684092    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8180f8f9-e202-413f-a5f0-bc3146ab4613-console-oauth-config\") pod \"console-5c4dff5bcb-m9qgc\" (UID: \"8180f8f9-e202-413f-a5f0-bc3146ab4613\") " pod="openshift-console/console-5c4dff5bcb-m9qgc"
Nov 04 05:28:40.684187 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.684120    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/141ed76b-593a-4efb-a0b2-0e9c95258451-tmp-dir\") pod \"dns-default-pwfdh\" (UID: \"141ed76b-593a-4efb-a0b2-0e9c95258451\") " pod="openshift-dns/dns-default-pwfdh"
Nov 04 05:28:40.684279 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.684192    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c610835f-ae53-45a1-868d-573b7e07524c-data-volume\") pod \"insights-runtime-extractor-npgcv\" (UID: \"c610835f-ae53-45a1-868d-573b7e07524c\") " pod="openshift-insights/insights-runtime-extractor-npgcv"
Nov 04 05:28:40.705785 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.705761    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d6d44dc4-bfpvx"]
Nov 04 05:28:40.707223 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.707209    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d6d44dc4-bfpvx"
Nov 04 05:28:40.723346 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.723327    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Nov 04 05:28:40.724863 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.724844    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d6d44dc4-bfpvx"]
Nov 04 05:28:40.725645 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.725611    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Nov 04 05:28:40.725645 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.725630    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-wgnzz\""
Nov 04 05:28:40.725791 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.725673    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Nov 04 05:28:40.725791 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.725754    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Nov 04 05:28:40.726554 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.726537    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qm9rq\""
Nov 04 05:28:40.727130 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.727074    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Nov 04 05:28:40.727130 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.727086    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-gqfxb\""
Nov 04 05:28:40.727130 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.727100    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xhrfz\""
Nov 04 05:28:40.727130 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.727110    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Nov 04 05:28:40.730255 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.727439    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Nov 04 05:28:40.785119 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.785096    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmt7d\" (UniqueName: \"kubernetes.io/projected/f85457d7-1779-477b-8f2d-e9d4b7ac6c3c-kube-api-access-hmt7d\") pod \"downloads-6dd789c8b7-twk8j\" (UID: \"f85457d7-1779-477b-8f2d-e9d4b7ac6c3c\") " pod="openshift-console/downloads-6dd789c8b7-twk8j"
Nov 04 05:28:40.785199 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.785124    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7fa6dfd0-336b-4bf6-a288-08eebb4b8897-trusted-ca\") pod \"image-registry-5d6d44dc4-bfpvx\" (UID: \"7fa6dfd0-336b-4bf6-a288-08eebb4b8897\") " pod="openshift-image-registry/image-registry-5d6d44dc4-bfpvx"
Nov 04 05:28:40.785199 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.785143    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/141ed76b-593a-4efb-a0b2-0e9c95258451-metrics-tls\") pod \"dns-default-pwfdh\" (UID: \"141ed76b-593a-4efb-a0b2-0e9c95258451\") " pod="openshift-dns/dns-default-pwfdh"
Nov 04 05:28:40.785199 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.785159    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7fa6dfd0-336b-4bf6-a288-08eebb4b8897-installation-pull-secrets\") pod \"image-registry-5d6d44dc4-bfpvx\" (UID: \"7fa6dfd0-336b-4bf6-a288-08eebb4b8897\") " pod="openshift-image-registry/image-registry-5d6d44dc4-bfpvx"
Nov 04 05:28:40.785294 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.785260    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8180f8f9-e202-413f-a5f0-bc3146ab4613-oauth-serving-cert\") pod \"console-5c4dff5bcb-m9qgc\" (UID: \"8180f8f9-e202-413f-a5f0-bc3146ab4613\") " pod="openshift-console/console-5c4dff5bcb-m9qgc"
Nov 04 05:28:40.785374 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.785359    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8180f8f9-e202-413f-a5f0-bc3146ab4613-console-oauth-config\") pod \"console-5c4dff5bcb-m9qgc\" (UID: \"8180f8f9-e202-413f-a5f0-bc3146ab4613\") " pod="openshift-console/console-5c4dff5bcb-m9qgc"
Nov 04 05:28:40.785413 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.785388    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/141ed76b-593a-4efb-a0b2-0e9c95258451-tmp-dir\") pod \"dns-default-pwfdh\" (UID: \"141ed76b-593a-4efb-a0b2-0e9c95258451\") " pod="openshift-dns/dns-default-pwfdh"
Nov 04 05:28:40.785462 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.785420    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7fa6dfd0-336b-4bf6-a288-08eebb4b8897-ca-trust-extracted\") pod \"image-registry-5d6d44dc4-bfpvx\" (UID: \"7fa6dfd0-336b-4bf6-a288-08eebb4b8897\") " pod="openshift-image-registry/image-registry-5d6d44dc4-bfpvx"
Nov 04 05:28:40.785532 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.785475    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2mbm\" (UniqueName: \"kubernetes.io/projected/c610835f-ae53-45a1-868d-573b7e07524c-kube-api-access-t2mbm\") pod \"insights-runtime-extractor-npgcv\" (UID: \"c610835f-ae53-45a1-868d-573b7e07524c\") " pod="openshift-insights/insights-runtime-extractor-npgcv"
Nov 04 05:28:40.785532 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.785500    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c610835f-ae53-45a1-868d-573b7e07524c-data-volume\") pod \"insights-runtime-extractor-npgcv\" (UID: \"c610835f-ae53-45a1-868d-573b7e07524c\") " pod="openshift-insights/insights-runtime-extractor-npgcv"
Nov 04 05:28:40.785638 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.785548    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c610835f-ae53-45a1-868d-573b7e07524c-crio-socket\") pod \"insights-runtime-extractor-npgcv\" (UID: \"c610835f-ae53-45a1-868d-573b7e07524c\") " pod="openshift-insights/insights-runtime-extractor-npgcv"
Nov 04 05:28:40.785638 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.785609    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c610835f-ae53-45a1-868d-573b7e07524c-crio-socket\") pod \"insights-runtime-extractor-npgcv\" (UID: \"c610835f-ae53-45a1-868d-573b7e07524c\") " pod="openshift-insights/insights-runtime-extractor-npgcv"
Nov 04 05:28:40.785743 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.785670    4357 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Nov 04 05:28:40.785743 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.785708    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8180f8f9-e202-413f-a5f0-bc3146ab4613-console-serving-cert\") pod \"console-5c4dff5bcb-m9qgc\" (UID: \"8180f8f9-e202-413f-a5f0-bc3146ab4613\") " pod="openshift-console/console-5c4dff5bcb-m9qgc"
Nov 04 05:28:40.785743 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.785737    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/fd7c3d1d-397d-4280-bc90-40bf34af6424-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-kwfv6\" (UID: \"fd7c3d1d-397d-4280-bc90-40bf34af6424\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-kwfv6"
Nov 04 05:28:40.785881 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.785764    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/141ed76b-593a-4efb-a0b2-0e9c95258451-tmp-dir\") pod \"dns-default-pwfdh\" (UID: \"141ed76b-593a-4efb-a0b2-0e9c95258451\") " pod="openshift-dns/dns-default-pwfdh"
Nov 04 05:28:40.785881 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.785789    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf58m\" (UniqueName: \"kubernetes.io/projected/7fa6dfd0-336b-4bf6-a288-08eebb4b8897-kube-api-access-tf58m\") pod \"image-registry-5d6d44dc4-bfpvx\" (UID: \"7fa6dfd0-336b-4bf6-a288-08eebb4b8897\") " pod="openshift-image-registry/image-registry-5d6d44dc4-bfpvx"
Nov 04 05:28:40.785956 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.785896    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c610835f-ae53-45a1-868d-573b7e07524c-data-volume\") pod \"insights-runtime-extractor-npgcv\" (UID: \"c610835f-ae53-45a1-868d-573b7e07524c\") " pod="openshift-insights/insights-runtime-extractor-npgcv"
Nov 04 05:28:40.786032 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.786006    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8180f8f9-e202-413f-a5f0-bc3146ab4613-console-config\") pod \"console-5c4dff5bcb-m9qgc\" (UID: \"8180f8f9-e202-413f-a5f0-bc3146ab4613\") " pod="openshift-console/console-5c4dff5bcb-m9qgc"
Nov 04 05:28:40.786156 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.786029    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8180f8f9-e202-413f-a5f0-bc3146ab4613-oauth-serving-cert\") pod \"console-5c4dff5bcb-m9qgc\" (UID: \"8180f8f9-e202-413f-a5f0-bc3146ab4613\") " pod="openshift-console/console-5c4dff5bcb-m9qgc"
Nov 04 05:28:40.786156 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.786055    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/141ed76b-593a-4efb-a0b2-0e9c95258451-config-volume\") pod \"dns-default-pwfdh\" (UID: \"141ed76b-593a-4efb-a0b2-0e9c95258451\") " pod="openshift-dns/dns-default-pwfdh"
Nov 04 05:28:40.786156 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.786093    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c610835f-ae53-45a1-868d-573b7e07524c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-npgcv\" (UID: \"c610835f-ae53-45a1-868d-573b7e07524c\") " pod="openshift-insights/insights-runtime-extractor-npgcv"
Nov 04 05:28:40.786156 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.786118    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c610835f-ae53-45a1-868d-573b7e07524c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-npgcv\" (UID: \"c610835f-ae53-45a1-868d-573b7e07524c\") " pod="openshift-insights/insights-runtime-extractor-npgcv"
Nov 04 05:28:40.786156 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.786147    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhksv\" (UniqueName: \"kubernetes.io/projected/0b1d0f07-5908-48f3-90ab-6f569e452b04-kube-api-access-jhksv\") pod \"ingress-canary-p27dv\" (UID: \"0b1d0f07-5908-48f3-90ab-6f569e452b04\") " pod="openshift-ingress-canary/ingress-canary-p27dv"
Nov 04 05:28:40.786412 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.786173    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7fa6dfd0-336b-4bf6-a288-08eebb4b8897-image-registry-private-configuration\") pod \"image-registry-5d6d44dc4-bfpvx\" (UID: \"7fa6dfd0-336b-4bf6-a288-08eebb4b8897\") " pod="openshift-image-registry/image-registry-5d6d44dc4-bfpvx"
Nov 04 05:28:40.786412 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.786204    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7fa6dfd0-336b-4bf6-a288-08eebb4b8897-registry-tls\") pod \"image-registry-5d6d44dc4-bfpvx\" (UID: \"7fa6dfd0-336b-4bf6-a288-08eebb4b8897\") " pod="openshift-image-registry/image-registry-5d6d44dc4-bfpvx"
Nov 04 05:28:40.786412 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.786233    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnrtg\" (UniqueName: \"kubernetes.io/projected/8180f8f9-e202-413f-a5f0-bc3146ab4613-kube-api-access-dnrtg\") pod \"console-5c4dff5bcb-m9qgc\" (UID: \"8180f8f9-e202-413f-a5f0-bc3146ab4613\") " pod="openshift-console/console-5c4dff5bcb-m9qgc"
Nov 04 05:28:40.786412 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.786260    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8180f8f9-e202-413f-a5f0-bc3146ab4613-service-ca\") pod \"console-5c4dff5bcb-m9qgc\" (UID: \"8180f8f9-e202-413f-a5f0-bc3146ab4613\") " pod="openshift-console/console-5c4dff5bcb-m9qgc"
Nov 04 05:28:40.786412 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.786286    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7fa6dfd0-336b-4bf6-a288-08eebb4b8897-bound-sa-token\") pod \"image-registry-5d6d44dc4-bfpvx\" (UID: \"7fa6dfd0-336b-4bf6-a288-08eebb4b8897\") " pod="openshift-image-registry/image-registry-5d6d44dc4-bfpvx"
Nov 04 05:28:40.786412 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.786310    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b1d0f07-5908-48f3-90ab-6f569e452b04-cert\") pod \"ingress-canary-p27dv\" (UID: \"0b1d0f07-5908-48f3-90ab-6f569e452b04\") " pod="openshift-ingress-canary/ingress-canary-p27dv"
Nov 04 05:28:40.786412 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.786336    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpxbb\" (UniqueName: \"kubernetes.io/projected/141ed76b-593a-4efb-a0b2-0e9c95258451-kube-api-access-hpxbb\") pod \"dns-default-pwfdh\" (UID: \"141ed76b-593a-4efb-a0b2-0e9c95258451\") " pod="openshift-dns/dns-default-pwfdh"
Nov 04 05:28:40.786412 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.786363    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8180f8f9-e202-413f-a5f0-bc3146ab4613-tmp\") pod \"console-5c4dff5bcb-m9qgc\" (UID: \"8180f8f9-e202-413f-a5f0-bc3146ab4613\") " pod="openshift-console/console-5c4dff5bcb-m9qgc"
Nov 04 05:28:40.786412 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.786384    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f85457d7-1779-477b-8f2d-e9d4b7ac6c3c-tmp\") pod \"downloads-6dd789c8b7-twk8j\" (UID: \"f85457d7-1779-477b-8f2d-e9d4b7ac6c3c\") " pod="openshift-console/downloads-6dd789c8b7-twk8j"
Nov 04 05:28:40.786412 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.786406    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7fa6dfd0-336b-4bf6-a288-08eebb4b8897-registry-certificates\") pod \"image-registry-5d6d44dc4-bfpvx\" (UID: \"7fa6dfd0-336b-4bf6-a288-08eebb4b8897\") " pod="openshift-image-registry/image-registry-5d6d44dc4-bfpvx"
Nov 04 05:28:40.786932 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.786737    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8180f8f9-e202-413f-a5f0-bc3146ab4613-console-config\") pod \"console-5c4dff5bcb-m9qgc\" (UID: \"8180f8f9-e202-413f-a5f0-bc3146ab4613\") " pod="openshift-console/console-5c4dff5bcb-m9qgc"
Nov 04 05:28:40.786932 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.786806    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/141ed76b-593a-4efb-a0b2-0e9c95258451-config-volume\") pod \"dns-default-pwfdh\" (UID: \"141ed76b-593a-4efb-a0b2-0e9c95258451\") " pod="openshift-dns/dns-default-pwfdh"
Nov 04 05:28:40.787194 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.787093    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8180f8f9-e202-413f-a5f0-bc3146ab4613-tmp\") pod \"console-5c4dff5bcb-m9qgc\" (UID: \"8180f8f9-e202-413f-a5f0-bc3146ab4613\") " pod="openshift-console/console-5c4dff5bcb-m9qgc"
Nov 04 05:28:40.787194 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.787131    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8180f8f9-e202-413f-a5f0-bc3146ab4613-service-ca\") pod \"console-5c4dff5bcb-m9qgc\" (UID: \"8180f8f9-e202-413f-a5f0-bc3146ab4613\") " pod="openshift-console/console-5c4dff5bcb-m9qgc"
Nov 04 05:28:40.787194 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.787131    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c610835f-ae53-45a1-868d-573b7e07524c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-npgcv\" (UID: \"c610835f-ae53-45a1-868d-573b7e07524c\") " pod="openshift-insights/insights-runtime-extractor-npgcv"
Nov 04 05:28:40.787391 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.787324    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f85457d7-1779-477b-8f2d-e9d4b7ac6c3c-tmp\") pod \"downloads-6dd789c8b7-twk8j\" (UID: \"f85457d7-1779-477b-8f2d-e9d4b7ac6c3c\") " pod="openshift-console/downloads-6dd789c8b7-twk8j"
Nov 04 05:28:40.788396 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.788370    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/141ed76b-593a-4efb-a0b2-0e9c95258451-metrics-tls\") pod \"dns-default-pwfdh\" (UID: \"141ed76b-593a-4efb-a0b2-0e9c95258451\") " pod="openshift-dns/dns-default-pwfdh"
Nov 04 05:28:40.788534 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.788485    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/fd7c3d1d-397d-4280-bc90-40bf34af6424-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-kwfv6\" (UID: \"fd7c3d1d-397d-4280-bc90-40bf34af6424\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-kwfv6"
Nov 04 05:28:40.788816 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.788799    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8180f8f9-e202-413f-a5f0-bc3146ab4613-console-oauth-config\") pod \"console-5c4dff5bcb-m9qgc\" (UID: \"8180f8f9-e202-413f-a5f0-bc3146ab4613\") " pod="openshift-console/console-5c4dff5bcb-m9qgc"
Nov 04 05:28:40.788975 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.788954    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8180f8f9-e202-413f-a5f0-bc3146ab4613-console-serving-cert\") pod \"console-5c4dff5bcb-m9qgc\" (UID: \"8180f8f9-e202-413f-a5f0-bc3146ab4613\") " pod="openshift-console/console-5c4dff5bcb-m9qgc"
Nov 04 05:28:40.789195 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.789180    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c610835f-ae53-45a1-868d-573b7e07524c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-npgcv\" (UID: \"c610835f-ae53-45a1-868d-573b7e07524c\") " pod="openshift-insights/insights-runtime-extractor-npgcv"
Nov 04 05:28:40.794809 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.794786    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpxbb\" (UniqueName: \"kubernetes.io/projected/141ed76b-593a-4efb-a0b2-0e9c95258451-kube-api-access-hpxbb\") pod \"dns-default-pwfdh\" (UID: \"141ed76b-593a-4efb-a0b2-0e9c95258451\") " pod="openshift-dns/dns-default-pwfdh"
Nov 04 05:28:40.794901 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.794822    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnrtg\" (UniqueName: \"kubernetes.io/projected/8180f8f9-e202-413f-a5f0-bc3146ab4613-kube-api-access-dnrtg\") pod \"console-5c4dff5bcb-m9qgc\" (UID: \"8180f8f9-e202-413f-a5f0-bc3146ab4613\") " pod="openshift-console/console-5c4dff5bcb-m9qgc"
Nov 04 05:28:40.795449 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.795409    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmt7d\" (UniqueName: \"kubernetes.io/projected/f85457d7-1779-477b-8f2d-e9d4b7ac6c3c-kube-api-access-hmt7d\") pod \"downloads-6dd789c8b7-twk8j\" (UID: \"f85457d7-1779-477b-8f2d-e9d4b7ac6c3c\") " pod="openshift-console/downloads-6dd789c8b7-twk8j"
Nov 04 05:28:40.795579 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.795563    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2mbm\" (UniqueName: \"kubernetes.io/projected/c610835f-ae53-45a1-868d-573b7e07524c-kube-api-access-t2mbm\") pod \"insights-runtime-extractor-npgcv\" (UID: \"c610835f-ae53-45a1-868d-573b7e07524c\") " pod="openshift-insights/insights-runtime-extractor-npgcv"
Nov 04 05:28:40.887222 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.887176    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7fa6dfd0-336b-4bf6-a288-08eebb4b8897-bound-sa-token\") pod \"image-registry-5d6d44dc4-bfpvx\" (UID: \"7fa6dfd0-336b-4bf6-a288-08eebb4b8897\") " pod="openshift-image-registry/image-registry-5d6d44dc4-bfpvx"
Nov 04 05:28:40.887222 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.887200    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b1d0f07-5908-48f3-90ab-6f569e452b04-cert\") pod \"ingress-canary-p27dv\" (UID: \"0b1d0f07-5908-48f3-90ab-6f569e452b04\") " pod="openshift-ingress-canary/ingress-canary-p27dv"
Nov 04 05:28:40.887222 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.887218    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7fa6dfd0-336b-4bf6-a288-08eebb4b8897-registry-certificates\") pod \"image-registry-5d6d44dc4-bfpvx\" (UID: \"7fa6dfd0-336b-4bf6-a288-08eebb4b8897\") " pod="openshift-image-registry/image-registry-5d6d44dc4-bfpvx"
Nov 04 05:28:40.887409 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.887236    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7fa6dfd0-336b-4bf6-a288-08eebb4b8897-trusted-ca\") pod \"image-registry-5d6d44dc4-bfpvx\" (UID: \"7fa6dfd0-336b-4bf6-a288-08eebb4b8897\") " pod="openshift-image-registry/image-registry-5d6d44dc4-bfpvx"
Nov 04 05:28:40.887409 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.887253    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7fa6dfd0-336b-4bf6-a288-08eebb4b8897-installation-pull-secrets\") pod \"image-registry-5d6d44dc4-bfpvx\" (UID: \"7fa6dfd0-336b-4bf6-a288-08eebb4b8897\") " pod="openshift-image-registry/image-registry-5d6d44dc4-bfpvx"
Nov 04 05:28:40.887409 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.887281    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7fa6dfd0-336b-4bf6-a288-08eebb4b8897-ca-trust-extracted\") pod \"image-registry-5d6d44dc4-bfpvx\" (UID: \"7fa6dfd0-336b-4bf6-a288-08eebb4b8897\") " pod="openshift-image-registry/image-registry-5d6d44dc4-bfpvx"
Nov 04 05:28:40.887409 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.887317    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tf58m\" (UniqueName: \"kubernetes.io/projected/7fa6dfd0-336b-4bf6-a288-08eebb4b8897-kube-api-access-tf58m\") pod \"image-registry-5d6d44dc4-bfpvx\" (UID: \"7fa6dfd0-336b-4bf6-a288-08eebb4b8897\") " pod="openshift-image-registry/image-registry-5d6d44dc4-bfpvx"
Nov 04 05:28:40.887409 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.887355    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhksv\" (UniqueName: \"kubernetes.io/projected/0b1d0f07-5908-48f3-90ab-6f569e452b04-kube-api-access-jhksv\") pod \"ingress-canary-p27dv\" (UID: \"0b1d0f07-5908-48f3-90ab-6f569e452b04\") " pod="openshift-ingress-canary/ingress-canary-p27dv"
Nov 04 05:28:40.887409 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.887378    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7fa6dfd0-336b-4bf6-a288-08eebb4b8897-image-registry-private-configuration\") pod \"image-registry-5d6d44dc4-bfpvx\" (UID: \"7fa6dfd0-336b-4bf6-a288-08eebb4b8897\") " pod="openshift-image-registry/image-registry-5d6d44dc4-bfpvx"
Nov 04 05:28:40.887409 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.887405    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7fa6dfd0-336b-4bf6-a288-08eebb4b8897-registry-tls\") pod \"image-registry-5d6d44dc4-bfpvx\" (UID: \"7fa6dfd0-336b-4bf6-a288-08eebb4b8897\") " pod="openshift-image-registry/image-registry-5d6d44dc4-bfpvx"
Nov 04 05:28:40.887946 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.887913    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7fa6dfd0-336b-4bf6-a288-08eebb4b8897-ca-trust-extracted\") pod \"image-registry-5d6d44dc4-bfpvx\" (UID: \"7fa6dfd0-336b-4bf6-a288-08eebb4b8897\") " pod="openshift-image-registry/image-registry-5d6d44dc4-bfpvx"
Nov 04 05:28:40.888181 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.888135    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7fa6dfd0-336b-4bf6-a288-08eebb4b8897-registry-certificates\") pod \"image-registry-5d6d44dc4-bfpvx\" (UID: \"7fa6dfd0-336b-4bf6-a288-08eebb4b8897\") " pod="openshift-image-registry/image-registry-5d6d44dc4-bfpvx"
Nov 04 05:28:40.888323 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.888303    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7fa6dfd0-336b-4bf6-a288-08eebb4b8897-trusted-ca\") pod \"image-registry-5d6d44dc4-bfpvx\" (UID: \"7fa6dfd0-336b-4bf6-a288-08eebb4b8897\") " pod="openshift-image-registry/image-registry-5d6d44dc4-bfpvx"
Nov 04 05:28:40.889616 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.889595    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7fa6dfd0-336b-4bf6-a288-08eebb4b8897-image-registry-private-configuration\") pod \"image-registry-5d6d44dc4-bfpvx\" (UID: \"7fa6dfd0-336b-4bf6-a288-08eebb4b8897\") " pod="openshift-image-registry/image-registry-5d6d44dc4-bfpvx"
Nov 04 05:28:40.889847 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.889819    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7fa6dfd0-336b-4bf6-a288-08eebb4b8897-registry-tls\") pod \"image-registry-5d6d44dc4-bfpvx\" (UID: \"7fa6dfd0-336b-4bf6-a288-08eebb4b8897\") " pod="openshift-image-registry/image-registry-5d6d44dc4-bfpvx"
Nov 04 05:28:40.890036 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.890020    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b1d0f07-5908-48f3-90ab-6f569e452b04-cert\") pod \"ingress-canary-p27dv\" (UID: \"0b1d0f07-5908-48f3-90ab-6f569e452b04\") " pod="openshift-ingress-canary/ingress-canary-p27dv"
Nov 04 05:28:40.890099 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.890035    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7fa6dfd0-336b-4bf6-a288-08eebb4b8897-installation-pull-secrets\") pod \"image-registry-5d6d44dc4-bfpvx\" (UID: \"7fa6dfd0-336b-4bf6-a288-08eebb4b8897\") " pod="openshift-image-registry/image-registry-5d6d44dc4-bfpvx"
Nov 04 05:28:40.894318 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.894299    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7fa6dfd0-336b-4bf6-a288-08eebb4b8897-bound-sa-token\") pod \"image-registry-5d6d44dc4-bfpvx\" (UID: \"7fa6dfd0-336b-4bf6-a288-08eebb4b8897\") " pod="openshift-image-registry/image-registry-5d6d44dc4-bfpvx"
Nov 04 05:28:40.897987 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.897964    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhksv\" (UniqueName: \"kubernetes.io/projected/0b1d0f07-5908-48f3-90ab-6f569e452b04-kube-api-access-jhksv\") pod \"ingress-canary-p27dv\" (UID: \"0b1d0f07-5908-48f3-90ab-6f569e452b04\") " pod="openshift-ingress-canary/ingress-canary-p27dv"
Nov 04 05:28:40.898081 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.898058    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf58m\" (UniqueName: \"kubernetes.io/projected/7fa6dfd0-336b-4bf6-a288-08eebb4b8897-kube-api-access-tf58m\") pod \"image-registry-5d6d44dc4-bfpvx\" (UID: \"7fa6dfd0-336b-4bf6-a288-08eebb4b8897\") " pod="openshift-image-registry/image-registry-5d6d44dc4-bfpvx"
Nov 04 05:28:40.923709 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.923691    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-npgcv"
Nov 04 05:28:40.929322 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.929302    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-twk8j"
Nov 04 05:28:40.936211 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.936195    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c4dff5bcb-m9qgc"
Nov 04 05:28:40.946008 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.945987    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-kwfv6"
Nov 04 05:28:40.954144 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.954130    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pwfdh"
Nov 04 05:28:40.978883 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:40.978651    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-p27dv"
Nov 04 05:28:41.016262 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:41.016013    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d6d44dc4-bfpvx"
Nov 04 05:28:41.202260 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:41.202049    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-npgcv"]
Nov 04 05:28:41.204728 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:41.204702    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc610835f_ae53_45a1_868d_573b7e07524c.slice/crio-1db0eec8f4e58ae0c2980c31c18c174e2e8de24f7493221aa67d4450d85ecabd WatchSource:0}: Error finding container 1db0eec8f4e58ae0c2980c31c18c174e2e8de24f7493221aa67d4450d85ecabd: Status 404 returned error can't find the container with id 1db0eec8f4e58ae0c2980c31c18c174e2e8de24f7493221aa67d4450d85ecabd
Nov 04 05:28:41.210542 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:41.210507    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c4dff5bcb-m9qgc"]
Nov 04 05:28:41.213752 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:41.213726    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-twk8j"]
Nov 04 05:28:41.213893 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:41.213875    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8180f8f9_e202_413f_a5f0_bc3146ab4613.slice/crio-6a32c1db933c6f1a2dc95a77ba5443d482869f5e28b55014014e1c558dfb8120 WatchSource:0}: Error finding container 6a32c1db933c6f1a2dc95a77ba5443d482869f5e28b55014014e1c558dfb8120: Status 404 returned error can't find the container with id 6a32c1db933c6f1a2dc95a77ba5443d482869f5e28b55014014e1c558dfb8120
Nov 04 05:28:41.215964 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:41.215950    4357 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 05:28:41.217445 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:41.217423    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf85457d7_1779_477b_8f2d_e9d4b7ac6c3c.slice/crio-70557c9b60c62f0dd3da15d0217455a3dc35514ed417fecf06542e90d658e6eb WatchSource:0}: Error finding container 70557c9b60c62f0dd3da15d0217455a3dc35514ed417fecf06542e90d658e6eb: Status 404 returned error can't find the container with id 70557c9b60c62f0dd3da15d0217455a3dc35514ed417fecf06542e90d658e6eb
Nov 04 05:28:41.266067 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:41.266043    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-kwfv6"]
Nov 04 05:28:41.269490 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:41.269467    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd7c3d1d_397d_4280_bc90_40bf34af6424.slice/crio-21b6926ff9bcf04707f0bf80ff52d243b01d5d147641b3d08ce3370cd0eca574 WatchSource:0}: Error finding container 21b6926ff9bcf04707f0bf80ff52d243b01d5d147641b3d08ce3370cd0eca574: Status 404 returned error can't find the container with id 21b6926ff9bcf04707f0bf80ff52d243b01d5d147641b3d08ce3370cd0eca574
Nov 04 05:28:41.278982 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:41.278962    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pwfdh"]
Nov 04 05:28:41.282824 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:41.282797    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod141ed76b_593a_4efb_a0b2_0e9c95258451.slice/crio-55877f934f13363d26066262dde36a2742382cdb48f0313f18206847c9f39b4e WatchSource:0}: Error finding container 55877f934f13363d26066262dde36a2742382cdb48f0313f18206847c9f39b4e: Status 404 returned error can't find the container with id 55877f934f13363d26066262dde36a2742382cdb48f0313f18206847c9f39b4e
Nov 04 05:28:41.321619 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:41.321592    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c4dff5bcb-m9qgc" event={"ID":"8180f8f9-e202-413f-a5f0-bc3146ab4613","Type":"ContainerStarted","Data":"6a32c1db933c6f1a2dc95a77ba5443d482869f5e28b55014014e1c558dfb8120"}
Nov 04 05:28:41.322746 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:41.322722    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-kwfv6" event={"ID":"fd7c3d1d-397d-4280-bc90-40bf34af6424","Type":"ContainerStarted","Data":"21b6926ff9bcf04707f0bf80ff52d243b01d5d147641b3d08ce3370cd0eca574"}
Nov 04 05:28:41.324623 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:41.324602    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-p27dv"]
Nov 04 05:28:41.324949 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:41.324923    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-npgcv" event={"ID":"c610835f-ae53-45a1-868d-573b7e07524c","Type":"ContainerStarted","Data":"b522b24ebcda910253453372d734031e677cb6bfe9d3fc1099165fb02cbe9055"}
Nov 04 05:28:41.325061 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:41.324986    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-npgcv" event={"ID":"c610835f-ae53-45a1-868d-573b7e07524c","Type":"ContainerStarted","Data":"1db0eec8f4e58ae0c2980c31c18c174e2e8de24f7493221aa67d4450d85ecabd"}
Nov 04 05:28:41.326598 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:41.326239    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pwfdh" event={"ID":"141ed76b-593a-4efb-a0b2-0e9c95258451","Type":"ContainerStarted","Data":"55877f934f13363d26066262dde36a2742382cdb48f0313f18206847c9f39b4e"}
Nov 04 05:28:41.327085 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:41.327065    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d6d44dc4-bfpvx"]
Nov 04 05:28:41.328096 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:41.328062    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-twk8j" event={"ID":"f85457d7-1779-477b-8f2d-e9d4b7ac6c3c","Type":"ContainerStarted","Data":"70557c9b60c62f0dd3da15d0217455a3dc35514ed417fecf06542e90d658e6eb"}
Nov 04 05:28:41.328304 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:41.328277    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b1d0f07_5908_48f3_90ab_6f569e452b04.slice/crio-5aafe8331a764563fa80a6c9ad7e701ab857f6e630599ed4b03cf7809d557748 WatchSource:0}: Error finding container 5aafe8331a764563fa80a6c9ad7e701ab857f6e630599ed4b03cf7809d557748: Status 404 returned error can't find the container with id 5aafe8331a764563fa80a6c9ad7e701ab857f6e630599ed4b03cf7809d557748
Nov 04 05:28:41.330045 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:41.330024    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fa6dfd0_336b_4bf6_a288_08eebb4b8897.slice/crio-c9c65d7eed79498837e5eae302d6de3c4f6beb165e775590b729603b52e52e28 WatchSource:0}: Error finding container c9c65d7eed79498837e5eae302d6de3c4f6beb165e775590b729603b52e52e28: Status 404 returned error can't find the container with id c9c65d7eed79498837e5eae302d6de3c4f6beb165e775590b729603b52e52e28
Nov 04 05:28:42.337123 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:42.336499    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d6d44dc4-bfpvx" event={"ID":"7fa6dfd0-336b-4bf6-a288-08eebb4b8897","Type":"ContainerStarted","Data":"78437ad8ff5b5105ed9d2ea4387bae5cd4fcde95364ac653fb038721b8bff1b0"}
Nov 04 05:28:42.337123 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:42.336612    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d6d44dc4-bfpvx" event={"ID":"7fa6dfd0-336b-4bf6-a288-08eebb4b8897","Type":"ContainerStarted","Data":"c9c65d7eed79498837e5eae302d6de3c4f6beb165e775590b729603b52e52e28"}
Nov 04 05:28:42.340683 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:42.340496    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-p27dv" event={"ID":"0b1d0f07-5908-48f3-90ab-6f569e452b04","Type":"ContainerStarted","Data":"5aafe8331a764563fa80a6c9ad7e701ab857f6e630599ed4b03cf7809d557748"}
Nov 04 05:28:42.358124 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:42.357902    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5d6d44dc4-bfpvx" podStartSLOduration=2.357887326 podStartE2EDuration="2.357887326s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:28:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:28:42.355936099 +0000 UTC m=+9.224599664" watchObservedRunningTime="2026-11-04 05:28:42.357887326 +0000 UTC m=+9.226550897"
Nov 04 05:28:43.348496 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:43.346409    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-kwfv6" event={"ID":"fd7c3d1d-397d-4280-bc90-40bf34af6424","Type":"ContainerStarted","Data":"8c2bea716a53a02fef2a3959c19ecb62f1027503cb5b4a779b7f692ec7c2e304"}
Nov 04 05:28:43.353600 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:43.350006    4357 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 04 05:28:43.353600 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:43.350433    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-npgcv" event={"ID":"c610835f-ae53-45a1-868d-573b7e07524c","Type":"ContainerStarted","Data":"828e3a271f33394126a34ffd627a139da71f0b8a4afd7a3b4b45dbc524ae944d"}
Nov 04 05:28:43.363751 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:43.363703    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-kwfv6" podStartSLOduration=1.814196516 podStartE2EDuration="3.363689472s" totalImagesPullingTime="1.549492956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:28:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:28:43.361787363 +0000 UTC m=+10.230450937" watchObservedRunningTime="2026-11-04 05:28:43.363689472 +0000 UTC m=+10.232353046"
Nov 04 05:28:44.107942 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:44.107167    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-k54vt"
Nov 04 05:28:44.357837 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:44.357808    4357 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 04 05:28:44.358599 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:44.358573    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pwfdh" event={"ID":"141ed76b-593a-4efb-a0b2-0e9c95258451","Type":"ContainerStarted","Data":"9373e3619362d9ba1bc344da14f1c7bfeae8ee387ce0f8babaafcefbf3804251"}
Nov 04 05:28:44.358674 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:44.358629    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pwfdh" event={"ID":"141ed76b-593a-4efb-a0b2-0e9c95258451","Type":"ContainerStarted","Data":"d3e8d496c325dbc4960d1d1f7bcdd32332d236389a135bac04a466cf3bf57653"}
Nov 04 05:28:44.358721 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:44.358682    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pwfdh"
Nov 04 05:28:44.378065 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:44.378024    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-pwfdh" podStartSLOduration=1.648652991 podStartE2EDuration="4.378013036s" totalImagesPullingTime="2.729360045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:28:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:28:44.377766049 +0000 UTC m=+11.246429621" watchObservedRunningTime="2026-11-04 05:28:44.378013036 +0000 UTC m=+11.246676608"
Nov 04 05:28:45.365321 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:45.365287    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-npgcv" event={"ID":"c610835f-ae53-45a1-868d-573b7e07524c","Type":"ContainerStarted","Data":"7edb190c43632f987ad2d5742123f3c1624f3cb46a4d282d0a10641b9d0927ac"}
Nov 04 05:28:45.381551 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:45.381477    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-npgcv" podStartSLOduration=2.087256206 podStartE2EDuration="5.381460692s" totalImagesPullingTime="3.294204486s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:28:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:28:45.381332186 +0000 UTC m=+12.249995781" watchObservedRunningTime="2026-11-04 05:28:45.381460692 +0000 UTC m=+12.250124261"
Nov 04 05:28:45.486961 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:45.486931    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-kwfv6"
Nov 04 05:28:45.487097 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:45.487060    4357 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 04 05:28:45.494710 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:45.494677    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-kwfv6"
Nov 04 05:28:45.781789 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:45.781749    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-vqhd7"]
Nov 04 05:28:45.786616 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:45.786594    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-vqhd7"
Nov 04 05:28:45.797202 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:45.797016    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-vqhd7"]
Nov 04 05:28:45.797746 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:45.797454    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Nov 04 05:28:45.797746 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:45.797497    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Nov 04 05:28:45.797746 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:45.797530    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Nov 04 05:28:45.797746 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:45.797575    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Nov 04 05:28:45.797746 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:45.797709    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-l4nb2\""
Nov 04 05:28:45.797746 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:45.797591    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Nov 04 05:28:45.825360 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:45.825335    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5603583-e3d5-4988-82be-318b4ea43904-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-vqhd7\" (UID: \"a5603583-e3d5-4988-82be-318b4ea43904\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-vqhd7"
Nov 04 05:28:45.825464 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:45.825378    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a5603583-e3d5-4988-82be-318b4ea43904-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-vqhd7\" (UID: \"a5603583-e3d5-4988-82be-318b4ea43904\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-vqhd7"
Nov 04 05:28:45.825529 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:45.825484    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kx6vl\" (UniqueName: \"kubernetes.io/projected/a5603583-e3d5-4988-82be-318b4ea43904-kube-api-access-kx6vl\") pod \"prometheus-operator-9cd89b74c-vqhd7\" (UID: \"a5603583-e3d5-4988-82be-318b4ea43904\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-vqhd7"
Nov 04 05:28:45.825593 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:45.825555    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a5603583-e3d5-4988-82be-318b4ea43904-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-vqhd7\" (UID: \"a5603583-e3d5-4988-82be-318b4ea43904\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-vqhd7"
Nov 04 05:28:45.925883 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:45.925861    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kx6vl\" (UniqueName: \"kubernetes.io/projected/a5603583-e3d5-4988-82be-318b4ea43904-kube-api-access-kx6vl\") pod \"prometheus-operator-9cd89b74c-vqhd7\" (UID: \"a5603583-e3d5-4988-82be-318b4ea43904\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-vqhd7"
Nov 04 05:28:45.926002 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:45.925897    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a5603583-e3d5-4988-82be-318b4ea43904-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-vqhd7\" (UID: \"a5603583-e3d5-4988-82be-318b4ea43904\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-vqhd7"
Nov 04 05:28:45.926002 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:45.925923    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5603583-e3d5-4988-82be-318b4ea43904-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-vqhd7\" (UID: \"a5603583-e3d5-4988-82be-318b4ea43904\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-vqhd7"
Nov 04 05:28:45.926205 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:45.926181    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a5603583-e3d5-4988-82be-318b4ea43904-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-vqhd7\" (UID: \"a5603583-e3d5-4988-82be-318b4ea43904\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-vqhd7"
Nov 04 05:28:45.926708 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:45.926678    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5603583-e3d5-4988-82be-318b4ea43904-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-vqhd7\" (UID: \"a5603583-e3d5-4988-82be-318b4ea43904\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-vqhd7"
Nov 04 05:28:45.928655 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:45.928631    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a5603583-e3d5-4988-82be-318b4ea43904-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-vqhd7\" (UID: \"a5603583-e3d5-4988-82be-318b4ea43904\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-vqhd7"
Nov 04 05:28:45.928755 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:45.928695    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a5603583-e3d5-4988-82be-318b4ea43904-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-vqhd7\" (UID: \"a5603583-e3d5-4988-82be-318b4ea43904\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-vqhd7"
Nov 04 05:28:45.934437 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:45.934396    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx6vl\" (UniqueName: \"kubernetes.io/projected/a5603583-e3d5-4988-82be-318b4ea43904-kube-api-access-kx6vl\") pod \"prometheus-operator-9cd89b74c-vqhd7\" (UID: \"a5603583-e3d5-4988-82be-318b4ea43904\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-vqhd7"
Nov 04 05:28:46.104303 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:46.104224    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-vqhd7"
Nov 04 05:28:46.371737 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:46.371652    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-p27dv" event={"ID":"0b1d0f07-5908-48f3-90ab-6f569e452b04","Type":"ContainerStarted","Data":"3a7c21d95bf79e5221511a30ead507c0494aead1209b40ceba652800b1e733d9"}
Nov 04 05:28:46.375495 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:46.375466    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c4dff5bcb-m9qgc" event={"ID":"8180f8f9-e202-413f-a5f0-bc3146ab4613","Type":"ContainerStarted","Data":"7dc6482ec4d42547ad93a85c8e72873a17d10bf3a0b3d24f03affb393939cee5"}
Nov 04 05:28:46.375659 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:46.375543    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-vqhd7"]
Nov 04 05:28:46.388768 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:46.388720    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-p27dv" podStartSLOduration=2.328479366 podStartE2EDuration="6.388703446s" totalImagesPullingTime="4.06022408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:28:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:28:46.388148595 +0000 UTC m=+13.256812168" watchObservedRunningTime="2026-11-04 05:28:46.388703446 +0000 UTC m=+13.257367014"
Nov 04 05:28:46.408240 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:46.408194    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-5c4dff5bcb-m9qgc" podStartSLOduration=1.755864083 podStartE2EDuration="6.408178578s" totalImagesPullingTime="4.652314495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:28:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:28:46.40754936 +0000 UTC m=+13.276212930" watchObservedRunningTime="2026-11-04 05:28:46.408178578 +0000 UTC m=+13.276842149"
Nov 04 05:28:47.278510 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:28:47.278478    4357 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-npgcv" containerName="extractor"
Nov 04 05:28:47.379529 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:47.379487    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-vqhd7" event={"ID":"a5603583-e3d5-4988-82be-318b4ea43904","Type":"ContainerStarted","Data":"823dbb6bf0d73896d1a7dc54d2872d8c24733949cd456f3cd1055481fec5750d"}
Nov 04 05:28:48.385002 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:48.384962    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-vqhd7" event={"ID":"a5603583-e3d5-4988-82be-318b4ea43904","Type":"ContainerStarted","Data":"a7ec5653946ae86434cd9a90137b93e7715a571f0f17937aa0625dc78428c67f"}
Nov 04 05:28:48.385398 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:48.385018    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-vqhd7" event={"ID":"a5603583-e3d5-4988-82be-318b4ea43904","Type":"ContainerStarted","Data":"ab8a3d63e5ac3ddd23078eb8ae8cf22ea92985dfa339a18a752386faae2fea03"}
Nov 04 05:28:48.400579 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:48.400511    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-9cd89b74c-vqhd7" podStartSLOduration=1.995697529 podStartE2EDuration="3.400498227s" totalImagesPullingTime="1.404800698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:28:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:28:48.399408651 +0000 UTC m=+15.268072224" watchObservedRunningTime="2026-11-04 05:28:48.400498227 +0000 UTC m=+15.269161796"
Nov 04 05:28:48.986777 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:48.986750    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2dlb7"
Nov 04 05:28:50.180331 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:50.180294    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mzslf"]
Nov 04 05:28:50.184696 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:50.184671    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mzslf"
Nov 04 05:28:50.226661 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:50.226637    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d6d44dc4-bfpvx"
Nov 04 05:28:50.244778 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:50.244755    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pwkwp\""
Nov 04 05:28:50.244892 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:50.244803    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Nov 04 05:28:50.244892 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:50.244848    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Nov 04 05:28:50.261916 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:50.261895    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Nov 04 05:28:50.268331 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:50.268307    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/45a62b3f-7826-4234-8bc4-8f3aaeaac2da-root\") pod \"node-exporter-mzslf\" (UID: \"45a62b3f-7826-4234-8bc4-8f3aaeaac2da\") " pod="openshift-monitoring/node-exporter-mzslf"
Nov 04 05:28:50.268452 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:50.268364    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/45a62b3f-7826-4234-8bc4-8f3aaeaac2da-node-exporter-textfile\") pod \"node-exporter-mzslf\" (UID: \"45a62b3f-7826-4234-8bc4-8f3aaeaac2da\") " pod="openshift-monitoring/node-exporter-mzslf"
Nov 04 05:28:50.268510 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:50.268483    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mcfq\" (UniqueName: \"kubernetes.io/projected/45a62b3f-7826-4234-8bc4-8f3aaeaac2da-kube-api-access-2mcfq\") pod \"node-exporter-mzslf\" (UID: \"45a62b3f-7826-4234-8bc4-8f3aaeaac2da\") " pod="openshift-monitoring/node-exporter-mzslf"
Nov 04 05:28:50.268711 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:50.268693    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/45a62b3f-7826-4234-8bc4-8f3aaeaac2da-node-exporter-wtmp\") pod \"node-exporter-mzslf\" (UID: \"45a62b3f-7826-4234-8bc4-8f3aaeaac2da\") " pod="openshift-monitoring/node-exporter-mzslf"
Nov 04 05:28:50.268754 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:50.268742    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/45a62b3f-7826-4234-8bc4-8f3aaeaac2da-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mzslf\" (UID: \"45a62b3f-7826-4234-8bc4-8f3aaeaac2da\") " pod="openshift-monitoring/node-exporter-mzslf"
Nov 04 05:28:50.268802 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:50.268788    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45a62b3f-7826-4234-8bc4-8f3aaeaac2da-metrics-client-ca\") pod \"node-exporter-mzslf\" (UID: \"45a62b3f-7826-4234-8bc4-8f3aaeaac2da\") " pod="openshift-monitoring/node-exporter-mzslf"
Nov 04 05:28:50.268838 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:50.268809    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/45a62b3f-7826-4234-8bc4-8f3aaeaac2da-node-exporter-tls\") pod \"node-exporter-mzslf\" (UID: \"45a62b3f-7826-4234-8bc4-8f3aaeaac2da\") " pod="openshift-monitoring/node-exporter-mzslf"
Nov 04 05:28:50.268838 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:50.268827    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/45a62b3f-7826-4234-8bc4-8f3aaeaac2da-node-exporter-accelerators-collector-config\") pod \"node-exporter-mzslf\" (UID: \"45a62b3f-7826-4234-8bc4-8f3aaeaac2da\") " pod="openshift-monitoring/node-exporter-mzslf"
Nov 04 05:28:50.268904 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:50.268846    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/45a62b3f-7826-4234-8bc4-8f3aaeaac2da-sys\") pod \"node-exporter-mzslf\" (UID: \"45a62b3f-7826-4234-8bc4-8f3aaeaac2da\") " pod="openshift-monitoring/node-exporter-mzslf"
Nov 04 05:28:50.369813 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:50.369782    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/45a62b3f-7826-4234-8bc4-8f3aaeaac2da-node-exporter-wtmp\") pod \"node-exporter-mzslf\" (UID: \"45a62b3f-7826-4234-8bc4-8f3aaeaac2da\") " pod="openshift-monitoring/node-exporter-mzslf"
Nov 04 05:28:50.369973 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:50.369832    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/45a62b3f-7826-4234-8bc4-8f3aaeaac2da-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mzslf\" (UID: \"45a62b3f-7826-4234-8bc4-8f3aaeaac2da\") " pod="openshift-monitoring/node-exporter-mzslf"
Nov 04 05:28:50.369973 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:50.369865    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45a62b3f-7826-4234-8bc4-8f3aaeaac2da-metrics-client-ca\") pod \"node-exporter-mzslf\" (UID: \"45a62b3f-7826-4234-8bc4-8f3aaeaac2da\") " pod="openshift-monitoring/node-exporter-mzslf"
Nov 04 05:28:50.369973 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:50.369890    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/45a62b3f-7826-4234-8bc4-8f3aaeaac2da-node-exporter-tls\") pod \"node-exporter-mzslf\" (UID: \"45a62b3f-7826-4234-8bc4-8f3aaeaac2da\") " pod="openshift-monitoring/node-exporter-mzslf"
Nov 04 05:28:50.369973 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:50.369915    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/45a62b3f-7826-4234-8bc4-8f3aaeaac2da-node-exporter-accelerators-collector-config\") pod \"node-exporter-mzslf\" (UID: \"45a62b3f-7826-4234-8bc4-8f3aaeaac2da\") " pod="openshift-monitoring/node-exporter-mzslf"
Nov 04 05:28:50.370170 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:50.369966    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/45a62b3f-7826-4234-8bc4-8f3aaeaac2da-node-exporter-wtmp\") pod \"node-exporter-mzslf\" (UID: \"45a62b3f-7826-4234-8bc4-8f3aaeaac2da\") " pod="openshift-monitoring/node-exporter-mzslf"
Nov 04 05:28:50.370170 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:50.369971    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/45a62b3f-7826-4234-8bc4-8f3aaeaac2da-sys\") pod \"node-exporter-mzslf\" (UID: \"45a62b3f-7826-4234-8bc4-8f3aaeaac2da\") " pod="openshift-monitoring/node-exporter-mzslf"
Nov 04 05:28:50.370170 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:50.370012    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/45a62b3f-7826-4234-8bc4-8f3aaeaac2da-sys\") pod \"node-exporter-mzslf\" (UID: \"45a62b3f-7826-4234-8bc4-8f3aaeaac2da\") " pod="openshift-monitoring/node-exporter-mzslf"
Nov 04 05:28:50.370170 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:50.370056    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/45a62b3f-7826-4234-8bc4-8f3aaeaac2da-root\") pod \"node-exporter-mzslf\" (UID: \"45a62b3f-7826-4234-8bc4-8f3aaeaac2da\") " pod="openshift-monitoring/node-exporter-mzslf"
Nov 04 05:28:50.370170 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:50.370090    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/45a62b3f-7826-4234-8bc4-8f3aaeaac2da-node-exporter-textfile\") pod \"node-exporter-mzslf\" (UID: \"45a62b3f-7826-4234-8bc4-8f3aaeaac2da\") " pod="openshift-monitoring/node-exporter-mzslf"
Nov 04 05:28:50.370170 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:50.370122    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mcfq\" (UniqueName: \"kubernetes.io/projected/45a62b3f-7826-4234-8bc4-8f3aaeaac2da-kube-api-access-2mcfq\") pod \"node-exporter-mzslf\" (UID: \"45a62b3f-7826-4234-8bc4-8f3aaeaac2da\") " pod="openshift-monitoring/node-exporter-mzslf"
Nov 04 05:28:50.370462 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:50.370347    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/45a62b3f-7826-4234-8bc4-8f3aaeaac2da-root\") pod \"node-exporter-mzslf\" (UID: \"45a62b3f-7826-4234-8bc4-8f3aaeaac2da\") " pod="openshift-monitoring/node-exporter-mzslf"
Nov 04 05:28:50.370462 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:50.370376    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/45a62b3f-7826-4234-8bc4-8f3aaeaac2da-node-exporter-accelerators-collector-config\") pod \"node-exporter-mzslf\" (UID: \"45a62b3f-7826-4234-8bc4-8f3aaeaac2da\") " pod="openshift-monitoring/node-exporter-mzslf"
Nov 04 05:28:50.370721 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:50.370691    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/45a62b3f-7826-4234-8bc4-8f3aaeaac2da-node-exporter-textfile\") pod \"node-exporter-mzslf\" (UID: \"45a62b3f-7826-4234-8bc4-8f3aaeaac2da\") " pod="openshift-monitoring/node-exporter-mzslf"
Nov 04 05:28:50.370938 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:50.370919    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45a62b3f-7826-4234-8bc4-8f3aaeaac2da-metrics-client-ca\") pod \"node-exporter-mzslf\" (UID: \"45a62b3f-7826-4234-8bc4-8f3aaeaac2da\") " pod="openshift-monitoring/node-exporter-mzslf"
Nov 04 05:28:50.372381 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:50.372357    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/45a62b3f-7826-4234-8bc4-8f3aaeaac2da-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mzslf\" (UID: \"45a62b3f-7826-4234-8bc4-8f3aaeaac2da\") " pod="openshift-monitoring/node-exporter-mzslf"
Nov 04 05:28:50.372709 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:50.372693    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/45a62b3f-7826-4234-8bc4-8f3aaeaac2da-node-exporter-tls\") pod \"node-exporter-mzslf\" (UID: \"45a62b3f-7826-4234-8bc4-8f3aaeaac2da\") " pod="openshift-monitoring/node-exporter-mzslf"
Nov 04 05:28:50.381905 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:50.381864    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mcfq\" (UniqueName: \"kubernetes.io/projected/45a62b3f-7826-4234-8bc4-8f3aaeaac2da-kube-api-access-2mcfq\") pod \"node-exporter-mzslf\" (UID: \"45a62b3f-7826-4234-8bc4-8f3aaeaac2da\") " pod="openshift-monitoring/node-exporter-mzslf"
Nov 04 05:28:50.501819 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:50.501790    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mzslf"
Nov 04 05:28:50.514100 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:50.514069    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45a62b3f_7826_4234_8bc4_8f3aaeaac2da.slice/crio-b5a6e480f1721cad3b9d4b6e39e530591f8b2943b299e88776acd0bd1801a373 WatchSource:0}: Error finding container b5a6e480f1721cad3b9d4b6e39e530591f8b2943b299e88776acd0bd1801a373: Status 404 returned error can't find the container with id b5a6e480f1721cad3b9d4b6e39e530591f8b2943b299e88776acd0bd1801a373
Nov 04 05:28:50.856147 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:50.856069    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c4dff5bcb-m9qgc"
Nov 04 05:28:50.861594 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:50.861571    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c4dff5bcb-m9qgc"
Nov 04 05:28:51.312364 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:51.312331    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c4dff5bcb-m9qgc"
Nov 04 05:28:51.317205 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:51.317181    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c4dff5bcb-m9qgc"
Nov 04 05:28:51.397579 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:51.397546    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mzslf" event={"ID":"45a62b3f-7826-4234-8bc4-8f3aaeaac2da","Type":"ContainerStarted","Data":"b5a6e480f1721cad3b9d4b6e39e530591f8b2943b299e88776acd0bd1801a373"}
Nov 04 05:28:52.402526 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:52.402475    4357 generic.go:356] "Generic (PLEG): container finished" podID="45a62b3f-7826-4234-8bc4-8f3aaeaac2da" containerID="1ef28bcdbfc67a1a231f9346ad6f33db7bc26e5f627453c4a2f0d84d69173a2e" exitCode=0
Nov 04 05:28:52.402946 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:52.402556    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mzslf" event={"ID":"45a62b3f-7826-4234-8bc4-8f3aaeaac2da","Type":"ContainerDied","Data":"1ef28bcdbfc67a1a231f9346ad6f33db7bc26e5f627453c4a2f0d84d69173a2e"}
Nov 04 05:28:53.408081 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:53.408042    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mzslf" event={"ID":"45a62b3f-7826-4234-8bc4-8f3aaeaac2da","Type":"ContainerStarted","Data":"52c1699790090e2d91988a4adbf2b3a2992c5b3d6d9a93eecdba5bfd75309fc3"}
Nov 04 05:28:53.408477 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:53.408104    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mzslf" event={"ID":"45a62b3f-7826-4234-8bc4-8f3aaeaac2da","Type":"ContainerStarted","Data":"f4d455daab412440c1625812341ccc9837a36a04d40dd798b1ea1cf637d26581"}
Nov 04 05:28:53.431168 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:53.431125    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mzslf" podStartSLOduration=2.213542473 podStartE2EDuration="3.431112227s" totalImagesPullingTime="1.144267541s" totalInitContainerRuntime="73.302213ms" isStatefulPod=true podCreationTimestamp="2026-11-04 05:28:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:28:53.429259046 +0000 UTC m=+20.297922645" watchObservedRunningTime="2026-11-04 05:28:53.431112227 +0000 UTC m=+20.299775800"
Nov 04 05:28:54.367597 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:54.367569    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pwfdh"
Nov 04 05:28:55.352313 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:55.352275    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6667f598b5-jzm79"]
Nov 04 05:28:55.356142 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:55.356116    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6667f598b5-jzm79"
Nov 04 05:28:55.362362 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:55.361396    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Nov 04 05:28:55.362362 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:55.361718    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-rwxf4\""
Nov 04 05:28:55.362362 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:55.361773    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Nov 04 05:28:55.362362 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:55.361885    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Nov 04 05:28:55.362362 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:55.361936    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Nov 04 05:28:55.362362 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:55.362039    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Nov 04 05:28:55.365760 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:55.365295    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-28r105lbnph2c\""
Nov 04 05:28:55.370383 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:55.370354    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6667f598b5-jzm79"]
Nov 04 05:28:55.406266 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:55.406239    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6d7b8054-8d1a-4180-ac57-cf95873f8a58-secret-telemeter-client\") pod \"telemeter-client-6667f598b5-jzm79\" (UID: \"6d7b8054-8d1a-4180-ac57-cf95873f8a58\") " pod="openshift-monitoring/telemeter-client-6667f598b5-jzm79"
Nov 04 05:28:55.406378 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:55.406278    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d7b8054-8d1a-4180-ac57-cf95873f8a58-serving-certs-ca-bundle\") pod \"telemeter-client-6667f598b5-jzm79\" (UID: \"6d7b8054-8d1a-4180-ac57-cf95873f8a58\") " pod="openshift-monitoring/telemeter-client-6667f598b5-jzm79"
Nov 04 05:28:55.406378 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:55.406304    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d7b8054-8d1a-4180-ac57-cf95873f8a58-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6667f598b5-jzm79\" (UID: \"6d7b8054-8d1a-4180-ac57-cf95873f8a58\") " pod="openshift-monitoring/telemeter-client-6667f598b5-jzm79"
Nov 04 05:28:55.406458 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:55.406428    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6d7b8054-8d1a-4180-ac57-cf95873f8a58-federate-client-tls\") pod \"telemeter-client-6667f598b5-jzm79\" (UID: \"6d7b8054-8d1a-4180-ac57-cf95873f8a58\") " pod="openshift-monitoring/telemeter-client-6667f598b5-jzm79"
Nov 04 05:28:55.406458 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:55.406451    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d7b8054-8d1a-4180-ac57-cf95873f8a58-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6667f598b5-jzm79\" (UID: \"6d7b8054-8d1a-4180-ac57-cf95873f8a58\") " pod="openshift-monitoring/telemeter-client-6667f598b5-jzm79"
Nov 04 05:28:55.406580 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:55.406476    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54656\" (UniqueName: \"kubernetes.io/projected/6d7b8054-8d1a-4180-ac57-cf95873f8a58-kube-api-access-54656\") pod \"telemeter-client-6667f598b5-jzm79\" (UID: \"6d7b8054-8d1a-4180-ac57-cf95873f8a58\") " pod="openshift-monitoring/telemeter-client-6667f598b5-jzm79"
Nov 04 05:28:55.406647 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:55.406625    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6d7b8054-8d1a-4180-ac57-cf95873f8a58-telemeter-client-tls\") pod \"telemeter-client-6667f598b5-jzm79\" (UID: \"6d7b8054-8d1a-4180-ac57-cf95873f8a58\") " pod="openshift-monitoring/telemeter-client-6667f598b5-jzm79"
Nov 04 05:28:55.406696 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:55.406660    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d7b8054-8d1a-4180-ac57-cf95873f8a58-metrics-client-ca\") pod \"telemeter-client-6667f598b5-jzm79\" (UID: \"6d7b8054-8d1a-4180-ac57-cf95873f8a58\") " pod="openshift-monitoring/telemeter-client-6667f598b5-jzm79"
Nov 04 05:28:55.507895 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:55.507866    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6d7b8054-8d1a-4180-ac57-cf95873f8a58-secret-telemeter-client\") pod \"telemeter-client-6667f598b5-jzm79\" (UID: \"6d7b8054-8d1a-4180-ac57-cf95873f8a58\") " pod="openshift-monitoring/telemeter-client-6667f598b5-jzm79"
Nov 04 05:28:55.508023 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:55.507902    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d7b8054-8d1a-4180-ac57-cf95873f8a58-serving-certs-ca-bundle\") pod \"telemeter-client-6667f598b5-jzm79\" (UID: \"6d7b8054-8d1a-4180-ac57-cf95873f8a58\") " pod="openshift-monitoring/telemeter-client-6667f598b5-jzm79"
Nov 04 05:28:55.508023 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:55.507924    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d7b8054-8d1a-4180-ac57-cf95873f8a58-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6667f598b5-jzm79\" (UID: \"6d7b8054-8d1a-4180-ac57-cf95873f8a58\") " pod="openshift-monitoring/telemeter-client-6667f598b5-jzm79"
Nov 04 05:28:55.508023 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:55.507967    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6d7b8054-8d1a-4180-ac57-cf95873f8a58-federate-client-tls\") pod \"telemeter-client-6667f598b5-jzm79\" (UID: \"6d7b8054-8d1a-4180-ac57-cf95873f8a58\") " pod="openshift-monitoring/telemeter-client-6667f598b5-jzm79"
Nov 04 05:28:55.508023 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:55.507993    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d7b8054-8d1a-4180-ac57-cf95873f8a58-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6667f598b5-jzm79\" (UID: \"6d7b8054-8d1a-4180-ac57-cf95873f8a58\") " pod="openshift-monitoring/telemeter-client-6667f598b5-jzm79"
Nov 04 05:28:55.508023 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:55.508010    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54656\" (UniqueName: \"kubernetes.io/projected/6d7b8054-8d1a-4180-ac57-cf95873f8a58-kube-api-access-54656\") pod \"telemeter-client-6667f598b5-jzm79\" (UID: \"6d7b8054-8d1a-4180-ac57-cf95873f8a58\") " pod="openshift-monitoring/telemeter-client-6667f598b5-jzm79"
Nov 04 05:28:55.508240 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:55.508036    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6d7b8054-8d1a-4180-ac57-cf95873f8a58-telemeter-client-tls\") pod \"telemeter-client-6667f598b5-jzm79\" (UID: \"6d7b8054-8d1a-4180-ac57-cf95873f8a58\") " pod="openshift-monitoring/telemeter-client-6667f598b5-jzm79"
Nov 04 05:28:55.508240 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:55.508053    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d7b8054-8d1a-4180-ac57-cf95873f8a58-metrics-client-ca\") pod \"telemeter-client-6667f598b5-jzm79\" (UID: \"6d7b8054-8d1a-4180-ac57-cf95873f8a58\") " pod="openshift-monitoring/telemeter-client-6667f598b5-jzm79"
Nov 04 05:28:55.508815 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:55.508791    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d7b8054-8d1a-4180-ac57-cf95873f8a58-metrics-client-ca\") pod \"telemeter-client-6667f598b5-jzm79\" (UID: \"6d7b8054-8d1a-4180-ac57-cf95873f8a58\") " pod="openshift-monitoring/telemeter-client-6667f598b5-jzm79"
Nov 04 05:28:55.508940 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:55.508797    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d7b8054-8d1a-4180-ac57-cf95873f8a58-serving-certs-ca-bundle\") pod \"telemeter-client-6667f598b5-jzm79\" (UID: \"6d7b8054-8d1a-4180-ac57-cf95873f8a58\") " pod="openshift-monitoring/telemeter-client-6667f598b5-jzm79"
Nov 04 05:28:55.509480 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:55.509454    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d7b8054-8d1a-4180-ac57-cf95873f8a58-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6667f598b5-jzm79\" (UID: \"6d7b8054-8d1a-4180-ac57-cf95873f8a58\") " pod="openshift-monitoring/telemeter-client-6667f598b5-jzm79"
Nov 04 05:28:55.510932 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:55.510911    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6d7b8054-8d1a-4180-ac57-cf95873f8a58-secret-telemeter-client\") pod \"telemeter-client-6667f598b5-jzm79\" (UID: \"6d7b8054-8d1a-4180-ac57-cf95873f8a58\") " pod="openshift-monitoring/telemeter-client-6667f598b5-jzm79"
Nov 04 05:28:55.511262 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:55.511239    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d7b8054-8d1a-4180-ac57-cf95873f8a58-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6667f598b5-jzm79\" (UID: \"6d7b8054-8d1a-4180-ac57-cf95873f8a58\") " pod="openshift-monitoring/telemeter-client-6667f598b5-jzm79"
Nov 04 05:28:55.511320 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:55.511251    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6d7b8054-8d1a-4180-ac57-cf95873f8a58-telemeter-client-tls\") pod \"telemeter-client-6667f598b5-jzm79\" (UID: \"6d7b8054-8d1a-4180-ac57-cf95873f8a58\") " pod="openshift-monitoring/telemeter-client-6667f598b5-jzm79"
Nov 04 05:28:55.511465 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:55.511446    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6d7b8054-8d1a-4180-ac57-cf95873f8a58-federate-client-tls\") pod \"telemeter-client-6667f598b5-jzm79\" (UID: \"6d7b8054-8d1a-4180-ac57-cf95873f8a58\") " pod="openshift-monitoring/telemeter-client-6667f598b5-jzm79"
Nov 04 05:28:55.516346 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:55.516323    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54656\" (UniqueName: \"kubernetes.io/projected/6d7b8054-8d1a-4180-ac57-cf95873f8a58-kube-api-access-54656\") pod \"telemeter-client-6667f598b5-jzm79\" (UID: \"6d7b8054-8d1a-4180-ac57-cf95873f8a58\") " pod="openshift-monitoring/telemeter-client-6667f598b5-jzm79"
Nov 04 05:28:55.675298 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:55.675230    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6667f598b5-jzm79"
Nov 04 05:28:55.956547 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:55.956403    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6667f598b5-jzm79"]
Nov 04 05:28:55.960236 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:28:55.960206    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d7b8054_8d1a_4180_ac57_cf95873f8a58.slice/crio-1555a411937667153b8d4fb2993fe186d0e22d6cd85708840f7290bdff59a431 WatchSource:0}: Error finding container 1555a411937667153b8d4fb2993fe186d0e22d6cd85708840f7290bdff59a431: Status 404 returned error can't find the container with id 1555a411937667153b8d4fb2993fe186d0e22d6cd85708840f7290bdff59a431
Nov 04 05:28:56.421413 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:56.421369    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6667f598b5-jzm79" event={"ID":"6d7b8054-8d1a-4180-ac57-cf95873f8a58","Type":"ContainerStarted","Data":"1555a411937667153b8d4fb2993fe186d0e22d6cd85708840f7290bdff59a431"}
Nov 04 05:28:58.430450 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:58.430372    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6667f598b5-jzm79" event={"ID":"6d7b8054-8d1a-4180-ac57-cf95873f8a58","Type":"ContainerStarted","Data":"7193aa8ebbce07ea7dd4d27a2e6f0a1c2246dc463903b7ed09d31c54e18dddc3"}
Nov 04 05:28:59.952749 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:28:59.952711    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bwn4l"
Nov 04 05:29:00.232273 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:00.232245    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d6d44dc4-bfpvx"
Nov 04 05:29:00.439418 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:00.439327    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-twk8j" event={"ID":"f85457d7-1779-477b-8f2d-e9d4b7ac6c3c","Type":"ContainerStarted","Data":"6d10668e995e3a37b1c2886fe64d0929a744f31748f7c6edcfa879984a610dbb"}
Nov 04 05:29:00.439418 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:00.439400    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6dd789c8b7-twk8j"
Nov 04 05:29:00.442909 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:00.442873    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6667f598b5-jzm79" event={"ID":"6d7b8054-8d1a-4180-ac57-cf95873f8a58","Type":"ContainerStarted","Data":"7770517d28dd525dfba74bb5a288769a2124098446b32a056c0d8d5a88c57650"}
Nov 04 05:29:00.443019 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:00.442929    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6667f598b5-jzm79" event={"ID":"6d7b8054-8d1a-4180-ac57-cf95873f8a58","Type":"ContainerStarted","Data":"0a49b1806d1a91b779e42274f1ebf626a380419439fdd3ef0aeda02f8447523f"}
Nov 04 05:29:00.455569 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:00.455508    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/downloads-6dd789c8b7-twk8j" podStartSLOduration=2.190099139 podStartE2EDuration="20.455496265s" totalImagesPullingTime="18.265397126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:28:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:29:00.455199856 +0000 UTC m=+27.323863449" watchObservedRunningTime="2026-11-04 05:29:00.455496265 +0000 UTC m=+27.324159837"
Nov 04 05:29:00.462261 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:00.462241    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6dd789c8b7-twk8j"
Nov 04 05:29:00.476706 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:00.476667    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6667f598b5-jzm79" podStartSLOduration=1.832190566 podStartE2EDuration="5.476652798s" totalImagesPullingTime="3.644462232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:28:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:29:00.475244628 +0000 UTC m=+27.343908211" watchObservedRunningTime="2026-11-04 05:29:00.476652798 +0000 UTC m=+27.345316371"
Nov 04 05:29:00.903173 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:00.903140    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-865c655659-tgvjt"]
Nov 04 05:29:00.920110 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:00.920085    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-865c655659-tgvjt"]
Nov 04 05:29:00.920268 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:00.920192    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-865c655659-tgvjt"
Nov 04 05:29:00.927578 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:00.927551    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Nov 04 05:29:01.059182 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:01.059147    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78689178-b5be-4157-bea8-d6c02ac25f6c-oauth-serving-cert\") pod \"console-865c655659-tgvjt\" (UID: \"78689178-b5be-4157-bea8-d6c02ac25f6c\") " pod="openshift-console/console-865c655659-tgvjt"
Nov 04 05:29:01.059182 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:01.059187    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78689178-b5be-4157-bea8-d6c02ac25f6c-service-ca\") pod \"console-865c655659-tgvjt\" (UID: \"78689178-b5be-4157-bea8-d6c02ac25f6c\") " pod="openshift-console/console-865c655659-tgvjt"
Nov 04 05:29:01.059737 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:01.059217    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78689178-b5be-4157-bea8-d6c02ac25f6c-console-config\") pod \"console-865c655659-tgvjt\" (UID: \"78689178-b5be-4157-bea8-d6c02ac25f6c\") " pod="openshift-console/console-865c655659-tgvjt"
Nov 04 05:29:01.059737 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:01.059389    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78689178-b5be-4157-bea8-d6c02ac25f6c-console-oauth-config\") pod \"console-865c655659-tgvjt\" (UID: \"78689178-b5be-4157-bea8-d6c02ac25f6c\") " pod="openshift-console/console-865c655659-tgvjt"
Nov 04 05:29:01.059737 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:01.059421    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78689178-b5be-4157-bea8-d6c02ac25f6c-tmp\") pod \"console-865c655659-tgvjt\" (UID: \"78689178-b5be-4157-bea8-d6c02ac25f6c\") " pod="openshift-console/console-865c655659-tgvjt"
Nov 04 05:29:01.059737 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:01.059447    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78689178-b5be-4157-bea8-d6c02ac25f6c-trusted-ca-bundle\") pod \"console-865c655659-tgvjt\" (UID: \"78689178-b5be-4157-bea8-d6c02ac25f6c\") " pod="openshift-console/console-865c655659-tgvjt"
Nov 04 05:29:01.059737 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:01.059536    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78689178-b5be-4157-bea8-d6c02ac25f6c-console-serving-cert\") pod \"console-865c655659-tgvjt\" (UID: \"78689178-b5be-4157-bea8-d6c02ac25f6c\") " pod="openshift-console/console-865c655659-tgvjt"
Nov 04 05:29:01.059737 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:01.059586    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9rt5\" (UniqueName: \"kubernetes.io/projected/78689178-b5be-4157-bea8-d6c02ac25f6c-kube-api-access-q9rt5\") pod \"console-865c655659-tgvjt\" (UID: \"78689178-b5be-4157-bea8-d6c02ac25f6c\") " pod="openshift-console/console-865c655659-tgvjt"
Nov 04 05:29:01.160604 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:01.160279    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78689178-b5be-4157-bea8-d6c02ac25f6c-console-oauth-config\") pod \"console-865c655659-tgvjt\" (UID: \"78689178-b5be-4157-bea8-d6c02ac25f6c\") " pod="openshift-console/console-865c655659-tgvjt"
Nov 04 05:29:01.160604 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:01.160329    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78689178-b5be-4157-bea8-d6c02ac25f6c-tmp\") pod \"console-865c655659-tgvjt\" (UID: \"78689178-b5be-4157-bea8-d6c02ac25f6c\") " pod="openshift-console/console-865c655659-tgvjt"
Nov 04 05:29:01.160604 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:01.160364    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78689178-b5be-4157-bea8-d6c02ac25f6c-trusted-ca-bundle\") pod \"console-865c655659-tgvjt\" (UID: \"78689178-b5be-4157-bea8-d6c02ac25f6c\") " pod="openshift-console/console-865c655659-tgvjt"
Nov 04 05:29:01.160604 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:01.160389    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78689178-b5be-4157-bea8-d6c02ac25f6c-console-serving-cert\") pod \"console-865c655659-tgvjt\" (UID: \"78689178-b5be-4157-bea8-d6c02ac25f6c\") " pod="openshift-console/console-865c655659-tgvjt"
Nov 04 05:29:01.160604 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:01.160413    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9rt5\" (UniqueName: \"kubernetes.io/projected/78689178-b5be-4157-bea8-d6c02ac25f6c-kube-api-access-q9rt5\") pod \"console-865c655659-tgvjt\" (UID: \"78689178-b5be-4157-bea8-d6c02ac25f6c\") " pod="openshift-console/console-865c655659-tgvjt"
Nov 04 05:29:01.160604 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:01.160461    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78689178-b5be-4157-bea8-d6c02ac25f6c-oauth-serving-cert\") pod \"console-865c655659-tgvjt\" (UID: \"78689178-b5be-4157-bea8-d6c02ac25f6c\") " pod="openshift-console/console-865c655659-tgvjt"
Nov 04 05:29:01.160604 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:01.160486    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78689178-b5be-4157-bea8-d6c02ac25f6c-service-ca\") pod \"console-865c655659-tgvjt\" (UID: \"78689178-b5be-4157-bea8-d6c02ac25f6c\") " pod="openshift-console/console-865c655659-tgvjt"
Nov 04 05:29:01.160604 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:01.160537    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78689178-b5be-4157-bea8-d6c02ac25f6c-console-config\") pod \"console-865c655659-tgvjt\" (UID: \"78689178-b5be-4157-bea8-d6c02ac25f6c\") " pod="openshift-console/console-865c655659-tgvjt"
Nov 04 05:29:01.161620 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:01.161563    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78689178-b5be-4157-bea8-d6c02ac25f6c-tmp\") pod \"console-865c655659-tgvjt\" (UID: \"78689178-b5be-4157-bea8-d6c02ac25f6c\") " pod="openshift-console/console-865c655659-tgvjt"
Nov 04 05:29:01.163159 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:01.162998    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78689178-b5be-4157-bea8-d6c02ac25f6c-service-ca\") pod \"console-865c655659-tgvjt\" (UID: \"78689178-b5be-4157-bea8-d6c02ac25f6c\") " pod="openshift-console/console-865c655659-tgvjt"
Nov 04 05:29:01.163159 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:01.163015    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78689178-b5be-4157-bea8-d6c02ac25f6c-console-config\") pod \"console-865c655659-tgvjt\" (UID: \"78689178-b5be-4157-bea8-d6c02ac25f6c\") " pod="openshift-console/console-865c655659-tgvjt"
Nov 04 05:29:01.163159 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:01.163127    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78689178-b5be-4157-bea8-d6c02ac25f6c-oauth-serving-cert\") pod \"console-865c655659-tgvjt\" (UID: \"78689178-b5be-4157-bea8-d6c02ac25f6c\") " pod="openshift-console/console-865c655659-tgvjt"
Nov 04 05:29:01.165061 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:01.164207    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78689178-b5be-4157-bea8-d6c02ac25f6c-console-oauth-config\") pod \"console-865c655659-tgvjt\" (UID: \"78689178-b5be-4157-bea8-d6c02ac25f6c\") " pod="openshift-console/console-865c655659-tgvjt"
Nov 04 05:29:01.165061 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:01.164439    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78689178-b5be-4157-bea8-d6c02ac25f6c-console-serving-cert\") pod \"console-865c655659-tgvjt\" (UID: \"78689178-b5be-4157-bea8-d6c02ac25f6c\") " pod="openshift-console/console-865c655659-tgvjt"
Nov 04 05:29:01.165964 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:01.165452    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78689178-b5be-4157-bea8-d6c02ac25f6c-trusted-ca-bundle\") pod \"console-865c655659-tgvjt\" (UID: \"78689178-b5be-4157-bea8-d6c02ac25f6c\") " pod="openshift-console/console-865c655659-tgvjt"
Nov 04 05:29:01.171736 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:01.171712    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9rt5\" (UniqueName: \"kubernetes.io/projected/78689178-b5be-4157-bea8-d6c02ac25f6c-kube-api-access-q9rt5\") pod \"console-865c655659-tgvjt\" (UID: \"78689178-b5be-4157-bea8-d6c02ac25f6c\") " pod="openshift-console/console-865c655659-tgvjt"
Nov 04 05:29:01.251422 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:01.251376    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-865c655659-tgvjt"
Nov 04 05:29:01.557274 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:01.557236    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-865c655659-tgvjt"]
Nov 04 05:29:01.564370 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:29:01.564330    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78689178_b5be_4157_bea8_d6c02ac25f6c.slice/crio-83c9c9b8fdb62ae760319143dcc2a42608fd23aa3be9cbdb9354d8093b025942 WatchSource:0}: Error finding container 83c9c9b8fdb62ae760319143dcc2a42608fd23aa3be9cbdb9354d8093b025942: Status 404 returned error can't find the container with id 83c9c9b8fdb62ae760319143dcc2a42608fd23aa3be9cbdb9354d8093b025942
Nov 04 05:29:02.453099 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:02.453049    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-865c655659-tgvjt" event={"ID":"78689178-b5be-4157-bea8-d6c02ac25f6c","Type":"ContainerStarted","Data":"f81918a5485990280ea6b7261671f3156740de742125988f2e56f6fb462f2df5"}
Nov 04 05:29:02.453641 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:02.453116    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-865c655659-tgvjt" event={"ID":"78689178-b5be-4157-bea8-d6c02ac25f6c","Type":"ContainerStarted","Data":"83c9c9b8fdb62ae760319143dcc2a42608fd23aa3be9cbdb9354d8093b025942"}
Nov 04 05:29:02.469114 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:02.469059    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-865c655659-tgvjt" podStartSLOduration=2.469041452 podStartE2EDuration="2.469041452s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:29:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:29:02.468395551 +0000 UTC m=+29.337059124" watchObservedRunningTime="2026-11-04 05:29:02.469041452 +0000 UTC m=+29.337705023"
Nov 04 05:29:04.110642 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:04.110613    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-k54vt"
Nov 04 05:29:11.251565 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:11.251504    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-865c655659-tgvjt"
Nov 04 05:29:11.252100 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:11.251621    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-865c655659-tgvjt"
Nov 04 05:29:11.256045 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:11.256025    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-865c655659-tgvjt"
Nov 04 05:29:11.493582 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:11.493560    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-865c655659-tgvjt"
Nov 04 05:29:11.535900 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:11.535835    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c4dff5bcb-m9qgc"]
Nov 04 05:29:17.275456 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:29:17.275376    4357 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-npgcv" containerName="extractor"
Nov 04 05:29:27.443236 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:27.443203    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-6cdb876fbd-vmgnf"]
Nov 04 05:29:27.466220 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:27.466181    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cdb876fbd-vmgnf"]
Nov 04 05:29:27.466380 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:27.466304    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cdb876fbd-vmgnf"
Nov 04 05:29:27.541053 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:27.541031    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2a27f89d-eef9-472c-a84e-ae1f0ee30827-service-ca\") pod \"console-6cdb876fbd-vmgnf\" (UID: \"2a27f89d-eef9-472c-a84e-ae1f0ee30827\") " pod="openshift-console/console-6cdb876fbd-vmgnf"
Nov 04 05:29:27.541190 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:27.541074    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2a27f89d-eef9-472c-a84e-ae1f0ee30827-console-oauth-config\") pod \"console-6cdb876fbd-vmgnf\" (UID: \"2a27f89d-eef9-472c-a84e-ae1f0ee30827\") " pod="openshift-console/console-6cdb876fbd-vmgnf"
Nov 04 05:29:27.541190 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:27.541177    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a27f89d-eef9-472c-a84e-ae1f0ee30827-tmp\") pod \"console-6cdb876fbd-vmgnf\" (UID: \"2a27f89d-eef9-472c-a84e-ae1f0ee30827\") " pod="openshift-console/console-6cdb876fbd-vmgnf"
Nov 04 05:29:27.541278 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:27.541215    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mtsr\" (UniqueName: \"kubernetes.io/projected/2a27f89d-eef9-472c-a84e-ae1f0ee30827-kube-api-access-5mtsr\") pod \"console-6cdb876fbd-vmgnf\" (UID: \"2a27f89d-eef9-472c-a84e-ae1f0ee30827\") " pod="openshift-console/console-6cdb876fbd-vmgnf"
Nov 04 05:29:27.541327 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:27.541305    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2a27f89d-eef9-472c-a84e-ae1f0ee30827-console-config\") pod \"console-6cdb876fbd-vmgnf\" (UID: \"2a27f89d-eef9-472c-a84e-ae1f0ee30827\") " pod="openshift-console/console-6cdb876fbd-vmgnf"
Nov 04 05:29:27.541425 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:27.541341    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a27f89d-eef9-472c-a84e-ae1f0ee30827-trusted-ca-bundle\") pod \"console-6cdb876fbd-vmgnf\" (UID: \"2a27f89d-eef9-472c-a84e-ae1f0ee30827\") " pod="openshift-console/console-6cdb876fbd-vmgnf"
Nov 04 05:29:27.541478 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:27.541449    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a27f89d-eef9-472c-a84e-ae1f0ee30827-console-serving-cert\") pod \"console-6cdb876fbd-vmgnf\" (UID: \"2a27f89d-eef9-472c-a84e-ae1f0ee30827\") " pod="openshift-console/console-6cdb876fbd-vmgnf"
Nov 04 05:29:27.541478 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:27.541474    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2a27f89d-eef9-472c-a84e-ae1f0ee30827-oauth-serving-cert\") pod \"console-6cdb876fbd-vmgnf\" (UID: \"2a27f89d-eef9-472c-a84e-ae1f0ee30827\") " pod="openshift-console/console-6cdb876fbd-vmgnf"
Nov 04 05:29:27.642474 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:27.642447    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a27f89d-eef9-472c-a84e-ae1f0ee30827-trusted-ca-bundle\") pod \"console-6cdb876fbd-vmgnf\" (UID: \"2a27f89d-eef9-472c-a84e-ae1f0ee30827\") " pod="openshift-console/console-6cdb876fbd-vmgnf"
Nov 04 05:29:27.642618 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:27.642495    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a27f89d-eef9-472c-a84e-ae1f0ee30827-console-serving-cert\") pod \"console-6cdb876fbd-vmgnf\" (UID: \"2a27f89d-eef9-472c-a84e-ae1f0ee30827\") " pod="openshift-console/console-6cdb876fbd-vmgnf"
Nov 04 05:29:27.642618 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:27.642542    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2a27f89d-eef9-472c-a84e-ae1f0ee30827-oauth-serving-cert\") pod \"console-6cdb876fbd-vmgnf\" (UID: \"2a27f89d-eef9-472c-a84e-ae1f0ee30827\") " pod="openshift-console/console-6cdb876fbd-vmgnf"
Nov 04 05:29:27.642618 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:27.642574    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2a27f89d-eef9-472c-a84e-ae1f0ee30827-service-ca\") pod \"console-6cdb876fbd-vmgnf\" (UID: \"2a27f89d-eef9-472c-a84e-ae1f0ee30827\") " pod="openshift-console/console-6cdb876fbd-vmgnf"
Nov 04 05:29:27.642618 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:27.642607    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2a27f89d-eef9-472c-a84e-ae1f0ee30827-console-oauth-config\") pod \"console-6cdb876fbd-vmgnf\" (UID: \"2a27f89d-eef9-472c-a84e-ae1f0ee30827\") " pod="openshift-console/console-6cdb876fbd-vmgnf"
Nov 04 05:29:27.642816 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:27.642644    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a27f89d-eef9-472c-a84e-ae1f0ee30827-tmp\") pod \"console-6cdb876fbd-vmgnf\" (UID: \"2a27f89d-eef9-472c-a84e-ae1f0ee30827\") " pod="openshift-console/console-6cdb876fbd-vmgnf"
Nov 04 05:29:27.642816 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:27.642669    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mtsr\" (UniqueName: \"kubernetes.io/projected/2a27f89d-eef9-472c-a84e-ae1f0ee30827-kube-api-access-5mtsr\") pod \"console-6cdb876fbd-vmgnf\" (UID: \"2a27f89d-eef9-472c-a84e-ae1f0ee30827\") " pod="openshift-console/console-6cdb876fbd-vmgnf"
Nov 04 05:29:27.643078 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:27.643048    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2a27f89d-eef9-472c-a84e-ae1f0ee30827-console-config\") pod \"console-6cdb876fbd-vmgnf\" (UID: \"2a27f89d-eef9-472c-a84e-ae1f0ee30827\") " pod="openshift-console/console-6cdb876fbd-vmgnf"
Nov 04 05:29:27.643078 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:27.643068    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a27f89d-eef9-472c-a84e-ae1f0ee30827-tmp\") pod \"console-6cdb876fbd-vmgnf\" (UID: \"2a27f89d-eef9-472c-a84e-ae1f0ee30827\") " pod="openshift-console/console-6cdb876fbd-vmgnf"
Nov 04 05:29:27.643315 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:27.643297    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2a27f89d-eef9-472c-a84e-ae1f0ee30827-oauth-serving-cert\") pod \"console-6cdb876fbd-vmgnf\" (UID: \"2a27f89d-eef9-472c-a84e-ae1f0ee30827\") " pod="openshift-console/console-6cdb876fbd-vmgnf"
Nov 04 05:29:27.643430 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:27.643346    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2a27f89d-eef9-472c-a84e-ae1f0ee30827-service-ca\") pod \"console-6cdb876fbd-vmgnf\" (UID: \"2a27f89d-eef9-472c-a84e-ae1f0ee30827\") " pod="openshift-console/console-6cdb876fbd-vmgnf"
Nov 04 05:29:27.643430 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:27.643378    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a27f89d-eef9-472c-a84e-ae1f0ee30827-trusted-ca-bundle\") pod \"console-6cdb876fbd-vmgnf\" (UID: \"2a27f89d-eef9-472c-a84e-ae1f0ee30827\") " pod="openshift-console/console-6cdb876fbd-vmgnf"
Nov 04 05:29:27.643795 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:27.643774    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2a27f89d-eef9-472c-a84e-ae1f0ee30827-console-config\") pod \"console-6cdb876fbd-vmgnf\" (UID: \"2a27f89d-eef9-472c-a84e-ae1f0ee30827\") " pod="openshift-console/console-6cdb876fbd-vmgnf"
Nov 04 05:29:27.644949 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:27.644930    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2a27f89d-eef9-472c-a84e-ae1f0ee30827-console-oauth-config\") pod \"console-6cdb876fbd-vmgnf\" (UID: \"2a27f89d-eef9-472c-a84e-ae1f0ee30827\") " pod="openshift-console/console-6cdb876fbd-vmgnf"
Nov 04 05:29:27.645168 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:27.645149    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a27f89d-eef9-472c-a84e-ae1f0ee30827-console-serving-cert\") pod \"console-6cdb876fbd-vmgnf\" (UID: \"2a27f89d-eef9-472c-a84e-ae1f0ee30827\") " pod="openshift-console/console-6cdb876fbd-vmgnf"
Nov 04 05:29:27.649750 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:27.649729    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mtsr\" (UniqueName: \"kubernetes.io/projected/2a27f89d-eef9-472c-a84e-ae1f0ee30827-kube-api-access-5mtsr\") pod \"console-6cdb876fbd-vmgnf\" (UID: \"2a27f89d-eef9-472c-a84e-ae1f0ee30827\") " pod="openshift-console/console-6cdb876fbd-vmgnf"
Nov 04 05:29:27.788783 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:27.788761    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cdb876fbd-vmgnf"
Nov 04 05:29:28.085158 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:28.085092    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cdb876fbd-vmgnf"]
Nov 04 05:29:28.088453 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:29:28.088421    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a27f89d_eef9_472c_a84e_ae1f0ee30827.slice/crio-4317e9650316156ee2662de0758a90791368a6a743a75c6f93e8596b0f0fb870 WatchSource:0}: Error finding container 4317e9650316156ee2662de0758a90791368a6a743a75c6f93e8596b0f0fb870: Status 404 returned error can't find the container with id 4317e9650316156ee2662de0758a90791368a6a743a75c6f93e8596b0f0fb870
Nov 04 05:29:28.551463 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:28.551433    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cdb876fbd-vmgnf" event={"ID":"2a27f89d-eef9-472c-a84e-ae1f0ee30827","Type":"ContainerStarted","Data":"9507ca94097355a8d267a54f5ad093bf220adc4411e77495ad8059de53a75ac6"}
Nov 04 05:29:28.551832 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:28.551492    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cdb876fbd-vmgnf" event={"ID":"2a27f89d-eef9-472c-a84e-ae1f0ee30827","Type":"ContainerStarted","Data":"4317e9650316156ee2662de0758a90791368a6a743a75c6f93e8596b0f0fb870"}
Nov 04 05:29:28.567046 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:28.567007    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-6cdb876fbd-vmgnf" podStartSLOduration=1.566994444 podStartE2EDuration="1.566994444s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:29:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:29:28.566331423 +0000 UTC m=+55.434995034" watchObservedRunningTime="2026-11-04 05:29:28.566994444 +0000 UTC m=+55.435658016"
Nov 04 05:29:36.555398 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:36.555336    4357 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-5c4dff5bcb-m9qgc" podUID="8180f8f9-e202-413f-a5f0-bc3146ab4613" containerName="console" containerID="cri-o://7dc6482ec4d42547ad93a85c8e72873a17d10bf3a0b3d24f03affb393939cee5" gracePeriod=15
Nov 04 05:29:36.809292 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:36.809245    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c4dff5bcb-m9qgc"
Nov 04 05:29:36.909326 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:36.909304    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8180f8f9-e202-413f-a5f0-bc3146ab4613-service-ca\" (UniqueName: \"kubernetes.io/configmap/8180f8f9-e202-413f-a5f0-bc3146ab4613-service-ca\") pod \"8180f8f9-e202-413f-a5f0-bc3146ab4613\" (UID: \"8180f8f9-e202-413f-a5f0-bc3146ab4613\") "
Nov 04 05:29:36.909435 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:36.909340    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8180f8f9-e202-413f-a5f0-bc3146ab4613-tmp\" (UniqueName: \"kubernetes.io/empty-dir/8180f8f9-e202-413f-a5f0-bc3146ab4613-tmp\") pod \"8180f8f9-e202-413f-a5f0-bc3146ab4613\" (UID: \"8180f8f9-e202-413f-a5f0-bc3146ab4613\") "
Nov 04 05:29:36.909435 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:36.909374    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8180f8f9-e202-413f-a5f0-bc3146ab4613-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8180f8f9-e202-413f-a5f0-bc3146ab4613-oauth-serving-cert\") pod \"8180f8f9-e202-413f-a5f0-bc3146ab4613\" (UID: \"8180f8f9-e202-413f-a5f0-bc3146ab4613\") "
Nov 04 05:29:36.909539 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:36.909481    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8180f8f9-e202-413f-a5f0-bc3146ab4613-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8180f8f9-e202-413f-a5f0-bc3146ab4613-console-oauth-config\") pod \"8180f8f9-e202-413f-a5f0-bc3146ab4613\" (UID: \"8180f8f9-e202-413f-a5f0-bc3146ab4613\") "
Nov 04 05:29:36.909596 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:36.909538    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8180f8f9-e202-413f-a5f0-bc3146ab4613-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8180f8f9-e202-413f-a5f0-bc3146ab4613-console-serving-cert\") pod \"8180f8f9-e202-413f-a5f0-bc3146ab4613\" (UID: \"8180f8f9-e202-413f-a5f0-bc3146ab4613\") "
Nov 04 05:29:36.909596 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:36.909581    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8180f8f9-e202-413f-a5f0-bc3146ab4613-console-config\" (UniqueName: \"kubernetes.io/configmap/8180f8f9-e202-413f-a5f0-bc3146ab4613-console-config\") pod \"8180f8f9-e202-413f-a5f0-bc3146ab4613\" (UID: \"8180f8f9-e202-413f-a5f0-bc3146ab4613\") "
Nov 04 05:29:36.909694 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:36.909577    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8180f8f9-e202-413f-a5f0-bc3146ab4613-tmp" pod "8180f8f9-e202-413f-a5f0-bc3146ab4613" (UID: "8180f8f9-e202-413f-a5f0-bc3146ab4613"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:29:36.909694 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:36.909608    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8180f8f9-e202-413f-a5f0-bc3146ab4613-kube-api-access-dnrtg\" (UniqueName: \"kubernetes.io/projected/8180f8f9-e202-413f-a5f0-bc3146ab4613-kube-api-access-dnrtg\") pod \"8180f8f9-e202-413f-a5f0-bc3146ab4613\" (UID: \"8180f8f9-e202-413f-a5f0-bc3146ab4613\") "
Nov 04 05:29:36.909797 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:36.909738    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8180f8f9-e202-413f-a5f0-bc3146ab4613-service-ca" pod "8180f8f9-e202-413f-a5f0-bc3146ab4613" (UID: "8180f8f9-e202-413f-a5f0-bc3146ab4613"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:29:36.909914 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:36.909889    4357 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8180f8f9-e202-413f-a5f0-bc3146ab4613-service-ca\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:29:36.910002 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:36.909922    4357 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8180f8f9-e202-413f-a5f0-bc3146ab4613-tmp\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:29:36.910002 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:36.909892    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8180f8f9-e202-413f-a5f0-bc3146ab4613-oauth-serving-cert" pod "8180f8f9-e202-413f-a5f0-bc3146ab4613" (UID: "8180f8f9-e202-413f-a5f0-bc3146ab4613"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:29:36.910002 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:36.909943    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8180f8f9-e202-413f-a5f0-bc3146ab4613-console-config" pod "8180f8f9-e202-413f-a5f0-bc3146ab4613" (UID: "8180f8f9-e202-413f-a5f0-bc3146ab4613"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:29:36.911650 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:36.911623    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8180f8f9-e202-413f-a5f0-bc3146ab4613-console-oauth-config" pod "8180f8f9-e202-413f-a5f0-bc3146ab4613" (UID: "8180f8f9-e202-413f-a5f0-bc3146ab4613"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:29:36.911744 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:36.911663    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8180f8f9-e202-413f-a5f0-bc3146ab4613-kube-api-access-dnrtg" pod "8180f8f9-e202-413f-a5f0-bc3146ab4613" (UID: "8180f8f9-e202-413f-a5f0-bc3146ab4613"). InnerVolumeSpecName "kube-api-access-dnrtg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:29:36.911744 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:36.911672    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8180f8f9-e202-413f-a5f0-bc3146ab4613-console-serving-cert" pod "8180f8f9-e202-413f-a5f0-bc3146ab4613" (UID: "8180f8f9-e202-413f-a5f0-bc3146ab4613"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:29:37.010379 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:37.010356    4357 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8180f8f9-e202-413f-a5f0-bc3146ab4613-oauth-serving-cert\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:29:37.010379 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:37.010377    4357 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8180f8f9-e202-413f-a5f0-bc3146ab4613-console-oauth-config\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:29:37.010496 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:37.010388    4357 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8180f8f9-e202-413f-a5f0-bc3146ab4613-console-serving-cert\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:29:37.010496 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:37.010397    4357 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8180f8f9-e202-413f-a5f0-bc3146ab4613-console-config\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:29:37.010496 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:37.010406    4357 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnrtg\" (UniqueName: \"kubernetes.io/projected/8180f8f9-e202-413f-a5f0-bc3146ab4613-kube-api-access-dnrtg\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:29:37.579428 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:37.579371    4357 generic.go:356] "Generic (PLEG): container finished" podID="8180f8f9-e202-413f-a5f0-bc3146ab4613" containerID="7dc6482ec4d42547ad93a85c8e72873a17d10bf3a0b3d24f03affb393939cee5" exitCode=0
Nov 04 05:29:37.579428 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:37.579414    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c4dff5bcb-m9qgc"
Nov 04 05:29:37.579831 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:37.579455    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c4dff5bcb-m9qgc" event={"ID":"8180f8f9-e202-413f-a5f0-bc3146ab4613","Type":"ContainerDied","Data":"7dc6482ec4d42547ad93a85c8e72873a17d10bf3a0b3d24f03affb393939cee5"}
Nov 04 05:29:37.579831 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:37.579503    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c4dff5bcb-m9qgc" event={"ID":"8180f8f9-e202-413f-a5f0-bc3146ab4613","Type":"ContainerDied","Data":"6a32c1db933c6f1a2dc95a77ba5443d482869f5e28b55014014e1c558dfb8120"}
Nov 04 05:29:37.579831 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:37.579537    4357 scope.go:122] "RemoveContainer" containerID="7dc6482ec4d42547ad93a85c8e72873a17d10bf3a0b3d24f03affb393939cee5"
Nov 04 05:29:37.586939 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:37.586917    4357 scope.go:122] "RemoveContainer" containerID="7dc6482ec4d42547ad93a85c8e72873a17d10bf3a0b3d24f03affb393939cee5"
Nov 04 05:29:37.587211 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:29:37.587192    4357 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7dc6482ec4d42547ad93a85c8e72873a17d10bf3a0b3d24f03affb393939cee5\": container with ID starting with 7dc6482ec4d42547ad93a85c8e72873a17d10bf3a0b3d24f03affb393939cee5 not found: ID does not exist" containerID="7dc6482ec4d42547ad93a85c8e72873a17d10bf3a0b3d24f03affb393939cee5"
Nov 04 05:29:37.587275 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:37.587219    4357 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dc6482ec4d42547ad93a85c8e72873a17d10bf3a0b3d24f03affb393939cee5"} err="failed to get container status \"7dc6482ec4d42547ad93a85c8e72873a17d10bf3a0b3d24f03affb393939cee5\": rpc error: code = NotFound desc = could not find container \"7dc6482ec4d42547ad93a85c8e72873a17d10bf3a0b3d24f03affb393939cee5\": container with ID starting with 7dc6482ec4d42547ad93a85c8e72873a17d10bf3a0b3d24f03affb393939cee5 not found: ID does not exist"
Nov 04 05:29:37.595035 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:37.595016    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c4dff5bcb-m9qgc"]
Nov 04 05:29:37.598945 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:37.598925    4357 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c4dff5bcb-m9qgc"]
Nov 04 05:29:37.788872 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:37.788852    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6cdb876fbd-vmgnf"
Nov 04 05:29:37.788983 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:37.788890    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6cdb876fbd-vmgnf"
Nov 04 05:29:37.793334 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:37.793315    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6cdb876fbd-vmgnf"
Nov 04 05:29:38.591041 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:38.591016    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6cdb876fbd-vmgnf"
Nov 04 05:29:38.633994 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:38.633963    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-865c655659-tgvjt"]
Nov 04 05:29:39.274004 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:29:39.273971    4357 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8180f8f9-e202-413f-a5f0-bc3146ab4613" path="/var/lib/kubelet/pods/8180f8f9-e202-413f-a5f0-bc3146ab4613/volumes"
Nov 04 05:29:47.275671 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:29:47.275630    4357 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-npgcv" containerName="extractor"
Nov 04 05:30:03.652602 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:30:03.652552    4357 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-865c655659-tgvjt" podUID="78689178-b5be-4157-bea8-d6c02ac25f6c" containerName="console" containerID="cri-o://f81918a5485990280ea6b7261671f3156740de742125988f2e56f6fb462f2df5" gracePeriod=15
Nov 04 05:30:03.890127 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:30:03.890106    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-865c655659-tgvjt"
Nov 04 05:30:04.086395 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:30:04.086371    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/78689178-b5be-4157-bea8-d6c02ac25f6c-console-config\" (UniqueName: \"kubernetes.io/configmap/78689178-b5be-4157-bea8-d6c02ac25f6c-console-config\") pod \"78689178-b5be-4157-bea8-d6c02ac25f6c\" (UID: \"78689178-b5be-4157-bea8-d6c02ac25f6c\") "
Nov 04 05:30:04.086505 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:30:04.086407    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/78689178-b5be-4157-bea8-d6c02ac25f6c-tmp\" (UniqueName: \"kubernetes.io/empty-dir/78689178-b5be-4157-bea8-d6c02ac25f6c-tmp\") pod \"78689178-b5be-4157-bea8-d6c02ac25f6c\" (UID: \"78689178-b5be-4157-bea8-d6c02ac25f6c\") "
Nov 04 05:30:04.086505 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:30:04.086446    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/78689178-b5be-4157-bea8-d6c02ac25f6c-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78689178-b5be-4157-bea8-d6c02ac25f6c-oauth-serving-cert\") pod \"78689178-b5be-4157-bea8-d6c02ac25f6c\" (UID: \"78689178-b5be-4157-bea8-d6c02ac25f6c\") "
Nov 04 05:30:04.086505 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:30:04.086472    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/78689178-b5be-4157-bea8-d6c02ac25f6c-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78689178-b5be-4157-bea8-d6c02ac25f6c-trusted-ca-bundle\") pod \"78689178-b5be-4157-bea8-d6c02ac25f6c\" (UID: \"78689178-b5be-4157-bea8-d6c02ac25f6c\") "
Nov 04 05:30:04.086505 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:30:04.086497    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/78689178-b5be-4157-bea8-d6c02ac25f6c-service-ca\" (UniqueName: \"kubernetes.io/configmap/78689178-b5be-4157-bea8-d6c02ac25f6c-service-ca\") pod \"78689178-b5be-4157-bea8-d6c02ac25f6c\" (UID: \"78689178-b5be-4157-bea8-d6c02ac25f6c\") "
Nov 04 05:30:04.086723 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:30:04.086533    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/78689178-b5be-4157-bea8-d6c02ac25f6c-kube-api-access-q9rt5\" (UniqueName: \"kubernetes.io/projected/78689178-b5be-4157-bea8-d6c02ac25f6c-kube-api-access-q9rt5\") pod \"78689178-b5be-4157-bea8-d6c02ac25f6c\" (UID: \"78689178-b5be-4157-bea8-d6c02ac25f6c\") "
Nov 04 05:30:04.086723 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:30:04.086565    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/78689178-b5be-4157-bea8-d6c02ac25f6c-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78689178-b5be-4157-bea8-d6c02ac25f6c-console-oauth-config\") pod \"78689178-b5be-4157-bea8-d6c02ac25f6c\" (UID: \"78689178-b5be-4157-bea8-d6c02ac25f6c\") "
Nov 04 05:30:04.086723 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:30:04.086591    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/78689178-b5be-4157-bea8-d6c02ac25f6c-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78689178-b5be-4157-bea8-d6c02ac25f6c-console-serving-cert\") pod \"78689178-b5be-4157-bea8-d6c02ac25f6c\" (UID: \"78689178-b5be-4157-bea8-d6c02ac25f6c\") "
Nov 04 05:30:04.086723 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:30:04.086653    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78689178-b5be-4157-bea8-d6c02ac25f6c-tmp" pod "78689178-b5be-4157-bea8-d6c02ac25f6c" (UID: "78689178-b5be-4157-bea8-d6c02ac25f6c"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:30:04.086931 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:30:04.086779    4357 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78689178-b5be-4157-bea8-d6c02ac25f6c-tmp\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:30:04.086931 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:30:04.086830    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78689178-b5be-4157-bea8-d6c02ac25f6c-console-config" pod "78689178-b5be-4157-bea8-d6c02ac25f6c" (UID: "78689178-b5be-4157-bea8-d6c02ac25f6c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:30:04.087033 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:30:04.086971    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78689178-b5be-4157-bea8-d6c02ac25f6c-service-ca" pod "78689178-b5be-4157-bea8-d6c02ac25f6c" (UID: "78689178-b5be-4157-bea8-d6c02ac25f6c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:30:04.087033 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:30:04.087000    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78689178-b5be-4157-bea8-d6c02ac25f6c-oauth-serving-cert" pod "78689178-b5be-4157-bea8-d6c02ac25f6c" (UID: "78689178-b5be-4157-bea8-d6c02ac25f6c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:30:04.087138 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:30:04.087118    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78689178-b5be-4157-bea8-d6c02ac25f6c-trusted-ca-bundle" pod "78689178-b5be-4157-bea8-d6c02ac25f6c" (UID: "78689178-b5be-4157-bea8-d6c02ac25f6c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:30:04.088730 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:30:04.088702    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78689178-b5be-4157-bea8-d6c02ac25f6c-console-oauth-config" pod "78689178-b5be-4157-bea8-d6c02ac25f6c" (UID: "78689178-b5be-4157-bea8-d6c02ac25f6c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:30:04.088835 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:30:04.088757    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78689178-b5be-4157-bea8-d6c02ac25f6c-kube-api-access-q9rt5" pod "78689178-b5be-4157-bea8-d6c02ac25f6c" (UID: "78689178-b5be-4157-bea8-d6c02ac25f6c"). InnerVolumeSpecName "kube-api-access-q9rt5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:30:04.088835 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:30:04.088809    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78689178-b5be-4157-bea8-d6c02ac25f6c-console-serving-cert" pod "78689178-b5be-4157-bea8-d6c02ac25f6c" (UID: "78689178-b5be-4157-bea8-d6c02ac25f6c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:30:04.187742 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:30:04.187709    4357 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9rt5\" (UniqueName: \"kubernetes.io/projected/78689178-b5be-4157-bea8-d6c02ac25f6c-kube-api-access-q9rt5\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:30:04.187742 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:30:04.187740    4357 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78689178-b5be-4157-bea8-d6c02ac25f6c-console-oauth-config\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:30:04.187742 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:30:04.187750    4357 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78689178-b5be-4157-bea8-d6c02ac25f6c-console-serving-cert\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:30:04.187895 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:30:04.187760    4357 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78689178-b5be-4157-bea8-d6c02ac25f6c-console-config\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:30:04.187895 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:30:04.187768    4357 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78689178-b5be-4157-bea8-d6c02ac25f6c-oauth-serving-cert\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:30:04.187895 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:30:04.187776    4357 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78689178-b5be-4157-bea8-d6c02ac25f6c-trusted-ca-bundle\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:30:04.187895 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:30:04.187785    4357 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78689178-b5be-4157-bea8-d6c02ac25f6c-service-ca\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:30:04.672236 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:30:04.672207    4357 generic.go:356] "Generic (PLEG): container finished" podID="78689178-b5be-4157-bea8-d6c02ac25f6c" containerID="f81918a5485990280ea6b7261671f3156740de742125988f2e56f6fb462f2df5" exitCode=0
Nov 04 05:30:04.672617 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:30:04.672258    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-865c655659-tgvjt"
Nov 04 05:30:04.672617 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:30:04.672277    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-865c655659-tgvjt" event={"ID":"78689178-b5be-4157-bea8-d6c02ac25f6c","Type":"ContainerDied","Data":"f81918a5485990280ea6b7261671f3156740de742125988f2e56f6fb462f2df5"}
Nov 04 05:30:04.672617 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:30:04.672322    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-865c655659-tgvjt" event={"ID":"78689178-b5be-4157-bea8-d6c02ac25f6c","Type":"ContainerDied","Data":"83c9c9b8fdb62ae760319143dcc2a42608fd23aa3be9cbdb9354d8093b025942"}
Nov 04 05:30:04.672617 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:30:04.672349    4357 scope.go:122] "RemoveContainer" containerID="f81918a5485990280ea6b7261671f3156740de742125988f2e56f6fb462f2df5"
Nov 04 05:30:04.680136 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:30:04.680122    4357 scope.go:122] "RemoveContainer" containerID="f81918a5485990280ea6b7261671f3156740de742125988f2e56f6fb462f2df5"
Nov 04 05:30:04.680366 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:30:04.680347    4357 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f81918a5485990280ea6b7261671f3156740de742125988f2e56f6fb462f2df5\": container with ID starting with f81918a5485990280ea6b7261671f3156740de742125988f2e56f6fb462f2df5 not found: ID does not exist" containerID="f81918a5485990280ea6b7261671f3156740de742125988f2e56f6fb462f2df5"
Nov 04 05:30:04.680415 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:30:04.680374    4357 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f81918a5485990280ea6b7261671f3156740de742125988f2e56f6fb462f2df5"} err="failed to get container status \"f81918a5485990280ea6b7261671f3156740de742125988f2e56f6fb462f2df5\": rpc error: code = NotFound desc = could not find container \"f81918a5485990280ea6b7261671f3156740de742125988f2e56f6fb462f2df5\": container with ID starting with f81918a5485990280ea6b7261671f3156740de742125988f2e56f6fb462f2df5 not found: ID does not exist"
Nov 04 05:30:04.692393 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:30:04.692371    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-865c655659-tgvjt"]
Nov 04 05:30:04.695954 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:30:04.695934    4357 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-865c655659-tgvjt"]
Nov 04 05:30:05.271252 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:30:05.271221    4357 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="78689178-b5be-4157-bea8-d6c02ac25f6c" path="/var/lib/kubelet/pods/78689178-b5be-4157-bea8-d6c02ac25f6c/volumes"
Nov 04 05:30:17.275887 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:30:17.275843    4357 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-npgcv" containerName="extractor"
Nov 04 05:30:47.275934 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:30:47.275849    4357 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-npgcv" containerName="extractor"
Nov 04 05:31:17.275654 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:31:17.275615    4357 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-npgcv" containerName="extractor"
Nov 04 05:31:47.275193 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:31:47.275152    4357 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-npgcv" containerName="extractor"
Nov 04 05:32:17.274825 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:32:17.274746    4357 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-npgcv" containerName="extractor"
Nov 04 05:32:47.275533 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:32:47.275483    4357 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-npgcv" containerName="extractor"
Nov 04 05:33:17.277502 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:33:17.277457    4357 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-npgcv" containerName="extractor"
Nov 04 05:33:33.276631 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:33:33.276599    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dlb7_f1f789ee-b574-48ba-abd5-cfac0b3d7f40/ovn-acl-logging/0.log"
Nov 04 05:33:33.278439 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:33:33.278416    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dlb7_f1f789ee-b574-48ba-abd5-cfac0b3d7f40/ovn-acl-logging/0.log"
Nov 04 05:33:47.275331 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:33:47.275247    4357 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-npgcv" containerName="extractor"
Nov 04 05:34:17.274458 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:34:17.274424    4357 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-npgcv" containerName="extractor"
Nov 04 05:34:47.274864 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:34:47.274828    4357 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-npgcv" containerName="extractor"
Nov 04 05:35:17.275616 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:35:17.275541    4357 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-npgcv" containerName="extractor"
Nov 04 05:35:47.275921 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:35:47.275884    4357 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-npgcv" containerName="extractor"
Nov 04 05:36:03.665347 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:03.665316    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-t6vr6"]
Nov 04 05:36:03.665800 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:03.665553    4357 cpu_manager.go:414] "containerMap: removing container" podUID="8180f8f9-e202-413f-a5f0-bc3146ab4613" containerName="console"
Nov 04 05:36:03.665800 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:03.665563    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8180f8f9-e202-413f-a5f0-bc3146ab4613" containerName="console"
Nov 04 05:36:03.665800 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:03.665583    4357 cpu_manager.go:414] "containerMap: removing container" podUID="78689178-b5be-4157-bea8-d6c02ac25f6c" containerName="console"
Nov 04 05:36:03.665800 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:03.665588    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="78689178-b5be-4157-bea8-d6c02ac25f6c" containerName="console"
Nov 04 05:36:03.665800 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:03.665645    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="78689178-b5be-4157-bea8-d6c02ac25f6c" containerName="console"
Nov 04 05:36:03.665800 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:03.665655    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="8180f8f9-e202-413f-a5f0-bc3146ab4613" containerName="console"
Nov 04 05:36:03.667103 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:03.667088    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-t6vr6"
Nov 04 05:36:03.672824 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:03.672798    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-qrh98\""
Nov 04 05:36:03.675302 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:03.675279    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Nov 04 05:36:03.675302 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:03.675287    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Nov 04 05:36:03.675453 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:03.675339    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Nov 04 05:36:03.690679 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:03.690651    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-t6vr6"]
Nov 04 05:36:03.763288 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:03.763265    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/39b582f2-0f7f-42da-85ff-6cc7c256f922-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-t6vr6\" (UID: \"39b582f2-0f7f-42da-85ff-6cc7c256f922\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-t6vr6"
Nov 04 05:36:03.763394 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:03.763295    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/39b582f2-0f7f-42da-85ff-6cc7c256f922-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-t6vr6\" (UID: \"39b582f2-0f7f-42da-85ff-6cc7c256f922\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-t6vr6"
Nov 04 05:36:03.763394 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:03.763314    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/39b582f2-0f7f-42da-85ff-6cc7c256f922-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-t6vr6\" (UID: \"39b582f2-0f7f-42da-85ff-6cc7c256f922\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-t6vr6"
Nov 04 05:36:03.763394 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:03.763330    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dq5n\" (UniqueName: \"kubernetes.io/projected/39b582f2-0f7f-42da-85ff-6cc7c256f922-kube-api-access-2dq5n\") pod \"istiod-openshift-gateway-7876bfcb74-t6vr6\" (UID: \"39b582f2-0f7f-42da-85ff-6cc7c256f922\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-t6vr6"
Nov 04 05:36:03.763394 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:03.763386    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/39b582f2-0f7f-42da-85ff-6cc7c256f922-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-t6vr6\" (UID: \"39b582f2-0f7f-42da-85ff-6cc7c256f922\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-t6vr6"
Nov 04 05:36:03.763547 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:03.763510    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39b582f2-0f7f-42da-85ff-6cc7c256f922-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-t6vr6\" (UID: \"39b582f2-0f7f-42da-85ff-6cc7c256f922\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-t6vr6"
Nov 04 05:36:03.763587 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:03.763550    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/39b582f2-0f7f-42da-85ff-6cc7c256f922-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-t6vr6\" (UID: \"39b582f2-0f7f-42da-85ff-6cc7c256f922\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-t6vr6"
Nov 04 05:36:03.772615 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:03.772593    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Nov 04 05:36:03.772715 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:03.772662    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Nov 04 05:36:03.772770 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:03.772717    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Nov 04 05:36:03.864773 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:03.864749    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/39b582f2-0f7f-42da-85ff-6cc7c256f922-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-t6vr6\" (UID: \"39b582f2-0f7f-42da-85ff-6cc7c256f922\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-t6vr6"
Nov 04 05:36:03.864884 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:03.864780    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/39b582f2-0f7f-42da-85ff-6cc7c256f922-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-t6vr6\" (UID: \"39b582f2-0f7f-42da-85ff-6cc7c256f922\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-t6vr6"
Nov 04 05:36:03.864884 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:03.864799    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/39b582f2-0f7f-42da-85ff-6cc7c256f922-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-t6vr6\" (UID: \"39b582f2-0f7f-42da-85ff-6cc7c256f922\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-t6vr6"
Nov 04 05:36:03.864884 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:03.864816    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dq5n\" (UniqueName: \"kubernetes.io/projected/39b582f2-0f7f-42da-85ff-6cc7c256f922-kube-api-access-2dq5n\") pod \"istiod-openshift-gateway-7876bfcb74-t6vr6\" (UID: \"39b582f2-0f7f-42da-85ff-6cc7c256f922\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-t6vr6"
Nov 04 05:36:03.864884 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:03.864832    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/39b582f2-0f7f-42da-85ff-6cc7c256f922-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-t6vr6\" (UID: \"39b582f2-0f7f-42da-85ff-6cc7c256f922\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-t6vr6"
Nov 04 05:36:03.864884 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:03.864861    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39b582f2-0f7f-42da-85ff-6cc7c256f922-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-t6vr6\" (UID: \"39b582f2-0f7f-42da-85ff-6cc7c256f922\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-t6vr6"
Nov 04 05:36:03.865173 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:03.864887    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/39b582f2-0f7f-42da-85ff-6cc7c256f922-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-t6vr6\" (UID: \"39b582f2-0f7f-42da-85ff-6cc7c256f922\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-t6vr6"
Nov 04 05:36:03.865566 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:03.865541    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/39b582f2-0f7f-42da-85ff-6cc7c256f922-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-t6vr6\" (UID: \"39b582f2-0f7f-42da-85ff-6cc7c256f922\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-t6vr6"
Nov 04 05:36:03.867257 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:03.867231    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/39b582f2-0f7f-42da-85ff-6cc7c256f922-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-t6vr6\" (UID: \"39b582f2-0f7f-42da-85ff-6cc7c256f922\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-t6vr6"
Nov 04 05:36:03.867257 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:03.867248    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/39b582f2-0f7f-42da-85ff-6cc7c256f922-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-t6vr6\" (UID: \"39b582f2-0f7f-42da-85ff-6cc7c256f922\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-t6vr6"
Nov 04 05:36:03.867461 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:03.867447    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/39b582f2-0f7f-42da-85ff-6cc7c256f922-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-t6vr6\" (UID: \"39b582f2-0f7f-42da-85ff-6cc7c256f922\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-t6vr6"
Nov 04 05:36:03.867638 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:03.867621    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/39b582f2-0f7f-42da-85ff-6cc7c256f922-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-t6vr6\" (UID: \"39b582f2-0f7f-42da-85ff-6cc7c256f922\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-t6vr6"
Nov 04 05:36:03.873740 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:03.873713    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dq5n\" (UniqueName: \"kubernetes.io/projected/39b582f2-0f7f-42da-85ff-6cc7c256f922-kube-api-access-2dq5n\") pod \"istiod-openshift-gateway-7876bfcb74-t6vr6\" (UID: \"39b582f2-0f7f-42da-85ff-6cc7c256f922\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-t6vr6"
Nov 04 05:36:03.874111 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:03.874085    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39b582f2-0f7f-42da-85ff-6cc7c256f922-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-t6vr6\" (UID: \"39b582f2-0f7f-42da-85ff-6cc7c256f922\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-t6vr6"
Nov 04 05:36:03.976767 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:03.976726    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-t6vr6"
Nov 04 05:36:04.247473 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:04.247402    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-t6vr6"]
Nov 04 05:36:04.250532 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:36:04.250484    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39b582f2_0f7f_42da_85ff_6cc7c256f922.slice/crio-d00b57037488266def61e517309abbfb44d08bdce29509e1c5995fe082fe2a64 WatchSource:0}: Error finding container d00b57037488266def61e517309abbfb44d08bdce29509e1c5995fe082fe2a64: Status 404 returned error can't find the container with id d00b57037488266def61e517309abbfb44d08bdce29509e1c5995fe082fe2a64
Nov 04 05:36:04.252374 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:04.252359    4357 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 05:36:04.776354 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:04.776321    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-t6vr6" event={"ID":"39b582f2-0f7f-42da-85ff-6cc7c256f922","Type":"ContainerStarted","Data":"d00b57037488266def61e517309abbfb44d08bdce29509e1c5995fe082fe2a64"}
Nov 04 05:36:07.085625 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:07.085593    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:36:07.086022 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:07.085668    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:36:07.788797 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:07.788763    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-t6vr6" event={"ID":"39b582f2-0f7f-42da-85ff-6cc7c256f922","Type":"ContainerStarted","Data":"e5632aeed9bc56478f60d971331af42b4ba1b88f74ca5e32213667690be4b032"}
Nov 04 05:36:07.788958 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:07.788837    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-t6vr6"
Nov 04 05:36:07.808579 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:07.808533    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-t6vr6" podStartSLOduration=1.97620667 podStartE2EDuration="4.808502444s" totalImagesPullingTime="2.832295774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:36:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:36:07.807580787 +0000 UTC m=+454.676244359" watchObservedRunningTime="2026-11-04 05:36:07.808502444 +0000 UTC m=+454.677166013"
Nov 04 05:36:08.793303 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:08.793268    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-t6vr6"
Nov 04 05:36:17.275629 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:36:17.275594    4357 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-npgcv" containerName="extractor"
Nov 04 05:36:43.615775 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:43.615740    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-s4ckx"]
Nov 04 05:36:43.625779 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:43.625756    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-s4ckx"
Nov 04 05:36:43.645127 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:43.645102    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-s4ckx"]
Nov 04 05:36:43.690594 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:43.690563    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Nov 04 05:36:43.690908 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:43.690891    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Nov 04 05:36:43.692160 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:43.692131    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Nov 04 05:36:43.696831 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:43.696800    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Nov 04 05:36:43.697034 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:43.697022    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Nov 04 05:36:43.697088 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:43.697042    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-vkh6g\""
Nov 04 05:36:43.736681 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:43.736654    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pfsc\" (UniqueName: \"kubernetes.io/projected/12872dd6-2073-44d4-9b3a-df0195f4a33d-kube-api-access-4pfsc\") pod \"opendatahub-operator-controller-manager-56cd9ffd8-s4ckx\" (UID: \"12872dd6-2073-44d4-9b3a-df0195f4a33d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-s4ckx"
Nov 04 05:36:43.736777 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:43.736710    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/12872dd6-2073-44d4-9b3a-df0195f4a33d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56cd9ffd8-s4ckx\" (UID: \"12872dd6-2073-44d4-9b3a-df0195f4a33d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-s4ckx"
Nov 04 05:36:43.736840 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:43.736807    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/12872dd6-2073-44d4-9b3a-df0195f4a33d-manifests\") pod \"opendatahub-operator-controller-manager-56cd9ffd8-s4ckx\" (UID: \"12872dd6-2073-44d4-9b3a-df0195f4a33d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-s4ckx"
Nov 04 05:36:43.736897 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:43.736841    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/12872dd6-2073-44d4-9b3a-df0195f4a33d-metrics-cert\") pod \"opendatahub-operator-controller-manager-56cd9ffd8-s4ckx\" (UID: \"12872dd6-2073-44d4-9b3a-df0195f4a33d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-s4ckx"
Nov 04 05:36:43.736946 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:43.736909    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12872dd6-2073-44d4-9b3a-df0195f4a33d-tmp\") pod \"opendatahub-operator-controller-manager-56cd9ffd8-s4ckx\" (UID: \"12872dd6-2073-44d4-9b3a-df0195f4a33d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-s4ckx"
Nov 04 05:36:43.737029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:43.736954    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/12872dd6-2073-44d4-9b3a-df0195f4a33d-webhook-cert\") pod \"opendatahub-operator-controller-manager-56cd9ffd8-s4ckx\" (UID: \"12872dd6-2073-44d4-9b3a-df0195f4a33d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-s4ckx"
Nov 04 05:36:43.837905 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:43.837880    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/12872dd6-2073-44d4-9b3a-df0195f4a33d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56cd9ffd8-s4ckx\" (UID: \"12872dd6-2073-44d4-9b3a-df0195f4a33d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-s4ckx"
Nov 04 05:36:43.838001 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:43.837917    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/12872dd6-2073-44d4-9b3a-df0195f4a33d-manifests\") pod \"opendatahub-operator-controller-manager-56cd9ffd8-s4ckx\" (UID: \"12872dd6-2073-44d4-9b3a-df0195f4a33d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-s4ckx"
Nov 04 05:36:43.838001 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:43.837946    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/12872dd6-2073-44d4-9b3a-df0195f4a33d-metrics-cert\") pod \"opendatahub-operator-controller-manager-56cd9ffd8-s4ckx\" (UID: \"12872dd6-2073-44d4-9b3a-df0195f4a33d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-s4ckx"
Nov 04 05:36:43.838001 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:43.837977    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12872dd6-2073-44d4-9b3a-df0195f4a33d-tmp\") pod \"opendatahub-operator-controller-manager-56cd9ffd8-s4ckx\" (UID: \"12872dd6-2073-44d4-9b3a-df0195f4a33d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-s4ckx"
Nov 04 05:36:43.838152 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:43.838004    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/12872dd6-2073-44d4-9b3a-df0195f4a33d-webhook-cert\") pod \"opendatahub-operator-controller-manager-56cd9ffd8-s4ckx\" (UID: \"12872dd6-2073-44d4-9b3a-df0195f4a33d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-s4ckx"
Nov 04 05:36:43.838152 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:43.838058    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pfsc\" (UniqueName: \"kubernetes.io/projected/12872dd6-2073-44d4-9b3a-df0195f4a33d-kube-api-access-4pfsc\") pod \"opendatahub-operator-controller-manager-56cd9ffd8-s4ckx\" (UID: \"12872dd6-2073-44d4-9b3a-df0195f4a33d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-s4ckx"
Nov 04 05:36:43.838384 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:43.838344    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/12872dd6-2073-44d4-9b3a-df0195f4a33d-manifests\") pod \"opendatahub-operator-controller-manager-56cd9ffd8-s4ckx\" (UID: \"12872dd6-2073-44d4-9b3a-df0195f4a33d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-s4ckx"
Nov 04 05:36:43.840394 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:43.840374    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12872dd6-2073-44d4-9b3a-df0195f4a33d-tmp\") pod \"opendatahub-operator-controller-manager-56cd9ffd8-s4ckx\" (UID: \"12872dd6-2073-44d4-9b3a-df0195f4a33d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-s4ckx"
Nov 04 05:36:43.840480 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:43.840424    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/12872dd6-2073-44d4-9b3a-df0195f4a33d-webhook-cert\") pod \"opendatahub-operator-controller-manager-56cd9ffd8-s4ckx\" (UID: \"12872dd6-2073-44d4-9b3a-df0195f4a33d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-s4ckx"
Nov 04 05:36:43.840559 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:43.840541    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/12872dd6-2073-44d4-9b3a-df0195f4a33d-metrics-cert\") pod \"opendatahub-operator-controller-manager-56cd9ffd8-s4ckx\" (UID: \"12872dd6-2073-44d4-9b3a-df0195f4a33d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-s4ckx"
Nov 04 05:36:43.840723 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:43.840704    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/12872dd6-2073-44d4-9b3a-df0195f4a33d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56cd9ffd8-s4ckx\" (UID: \"12872dd6-2073-44d4-9b3a-df0195f4a33d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-s4ckx"
Nov 04 05:36:43.845685 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:43.845661    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pfsc\" (UniqueName: \"kubernetes.io/projected/12872dd6-2073-44d4-9b3a-df0195f4a33d-kube-api-access-4pfsc\") pod \"opendatahub-operator-controller-manager-56cd9ffd8-s4ckx\" (UID: \"12872dd6-2073-44d4-9b3a-df0195f4a33d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-s4ckx"
Nov 04 05:36:43.941382 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:43.941336    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-s4ckx"
Nov 04 05:36:44.297563 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:44.297531    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-s4ckx"]
Nov 04 05:36:44.300999 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:36:44.300964    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12872dd6_2073_44d4_9b3a_df0195f4a33d.slice/crio-3b42ee1e662b14a8071ea8a0894b82db850f20ece2f6524f0f5239ff45b8154d WatchSource:0}: Error finding container 3b42ee1e662b14a8071ea8a0894b82db850f20ece2f6524f0f5239ff45b8154d: Status 404 returned error can't find the container with id 3b42ee1e662b14a8071ea8a0894b82db850f20ece2f6524f0f5239ff45b8154d
Nov 04 05:36:44.914855 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:44.914826    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-s4ckx" event={"ID":"12872dd6-2073-44d4-9b3a-df0195f4a33d","Type":"ContainerStarted","Data":"3b42ee1e662b14a8071ea8a0894b82db850f20ece2f6524f0f5239ff45b8154d"}
Nov 04 05:36:47.279806 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:36:47.279714    4357 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-npgcv" containerName="extractor"
Nov 04 05:36:48.931225 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:48.931199    4357 generic.go:356] "Generic (PLEG): container finished" podID="12872dd6-2073-44d4-9b3a-df0195f4a33d" containerID="d610ea99ac67f8f63b5cb93ad193981b9c2cc1ab4d4001ce3d802a445b97c863" exitCode=0
Nov 04 05:36:48.931561 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:48.931259    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-s4ckx" event={"ID":"12872dd6-2073-44d4-9b3a-df0195f4a33d","Type":"ContainerDied","Data":"d610ea99ac67f8f63b5cb93ad193981b9c2cc1ab4d4001ce3d802a445b97c863"}
Nov 04 05:36:49.938949 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:49.938918    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-s4ckx" event={"ID":"12872dd6-2073-44d4-9b3a-df0195f4a33d","Type":"ContainerStarted","Data":"f5c09d20aae87cf7d50d54ddc0eddf411eb577ecf0f004d0aabf406e2ef4eef1"}
Nov 04 05:36:49.939361 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:49.939050    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-s4ckx"
Nov 04 05:36:49.979946 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:36:49.979881    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-s4ckx" podStartSLOduration=2.113762904 podStartE2EDuration="6.979864471s" totalImagesPullingTime="4.397301772s" totalInitContainerRuntime="468.799795ms" isStatefulPod=false podCreationTimestamp="2026-11-04 05:36:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:36:49.978406128 +0000 UTC m=+496.847069734" watchObservedRunningTime="2026-11-04 05:36:49.979864471 +0000 UTC m=+496.848528096"
Nov 04 05:37:00.944476 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:00.944443    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-s4ckx"
Nov 04 05:37:15.086312 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:15.086264    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5488c58ff5-924cz"]
Nov 04 05:37:15.092697 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:15.092678    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5488c58ff5-924cz"
Nov 04 05:37:15.103128 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:15.103100    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5488c58ff5-924cz"]
Nov 04 05:37:15.128937 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:15.128913    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Nov 04 05:37:15.129050 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:15.128940    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Nov 04 05:37:15.129050 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:15.129025    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-fm4tq\""
Nov 04 05:37:15.259014 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:15.258984    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca5cdd56-1893-43c5-a34f-5662919b23a8-tmp\") pod \"kube-auth-proxy-5488c58ff5-924cz\" (UID: \"ca5cdd56-1893-43c5-a34f-5662919b23a8\") " pod="openshift-ingress/kube-auth-proxy-5488c58ff5-924cz"
Nov 04 05:37:15.259158 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:15.259027    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca5cdd56-1893-43c5-a34f-5662919b23a8-tls-certs\") pod \"kube-auth-proxy-5488c58ff5-924cz\" (UID: \"ca5cdd56-1893-43c5-a34f-5662919b23a8\") " pod="openshift-ingress/kube-auth-proxy-5488c58ff5-924cz"
Nov 04 05:37:15.259158 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:15.259056    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8qv4\" (UniqueName: \"kubernetes.io/projected/ca5cdd56-1893-43c5-a34f-5662919b23a8-kube-api-access-z8qv4\") pod \"kube-auth-proxy-5488c58ff5-924cz\" (UID: \"ca5cdd56-1893-43c5-a34f-5662919b23a8\") " pod="openshift-ingress/kube-auth-proxy-5488c58ff5-924cz"
Nov 04 05:37:15.359888 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:15.359828    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca5cdd56-1893-43c5-a34f-5662919b23a8-tmp\") pod \"kube-auth-proxy-5488c58ff5-924cz\" (UID: \"ca5cdd56-1893-43c5-a34f-5662919b23a8\") " pod="openshift-ingress/kube-auth-proxy-5488c58ff5-924cz"
Nov 04 05:37:15.359888 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:15.359865    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca5cdd56-1893-43c5-a34f-5662919b23a8-tls-certs\") pod \"kube-auth-proxy-5488c58ff5-924cz\" (UID: \"ca5cdd56-1893-43c5-a34f-5662919b23a8\") " pod="openshift-ingress/kube-auth-proxy-5488c58ff5-924cz"
Nov 04 05:37:15.360031 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:15.359885    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8qv4\" (UniqueName: \"kubernetes.io/projected/ca5cdd56-1893-43c5-a34f-5662919b23a8-kube-api-access-z8qv4\") pod \"kube-auth-proxy-5488c58ff5-924cz\" (UID: \"ca5cdd56-1893-43c5-a34f-5662919b23a8\") " pod="openshift-ingress/kube-auth-proxy-5488c58ff5-924cz"
Nov 04 05:37:15.362016 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:15.361989    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca5cdd56-1893-43c5-a34f-5662919b23a8-tmp\") pod \"kube-auth-proxy-5488c58ff5-924cz\" (UID: \"ca5cdd56-1893-43c5-a34f-5662919b23a8\") " pod="openshift-ingress/kube-auth-proxy-5488c58ff5-924cz"
Nov 04 05:37:15.362212 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:15.362195    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca5cdd56-1893-43c5-a34f-5662919b23a8-tls-certs\") pod \"kube-auth-proxy-5488c58ff5-924cz\" (UID: \"ca5cdd56-1893-43c5-a34f-5662919b23a8\") " pod="openshift-ingress/kube-auth-proxy-5488c58ff5-924cz"
Nov 04 05:37:15.367895 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:15.367869    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8qv4\" (UniqueName: \"kubernetes.io/projected/ca5cdd56-1893-43c5-a34f-5662919b23a8-kube-api-access-z8qv4\") pod \"kube-auth-proxy-5488c58ff5-924cz\" (UID: \"ca5cdd56-1893-43c5-a34f-5662919b23a8\") " pod="openshift-ingress/kube-auth-proxy-5488c58ff5-924cz"
Nov 04 05:37:15.406616 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:15.406588    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5488c58ff5-924cz"
Nov 04 05:37:15.678961 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:15.678934    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5488c58ff5-924cz"]
Nov 04 05:37:15.681365 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:37:15.681326    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca5cdd56_1893_43c5_a34f_5662919b23a8.slice/crio-9af56e63fbfa21aa71c4589be57707be91526a3fb4a194b1b71caf3f2e961a6f WatchSource:0}: Error finding container 9af56e63fbfa21aa71c4589be57707be91526a3fb4a194b1b71caf3f2e961a6f: Status 404 returned error can't find the container with id 9af56e63fbfa21aa71c4589be57707be91526a3fb4a194b1b71caf3f2e961a6f
Nov 04 05:37:16.021061 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:16.021028    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5488c58ff5-924cz" event={"ID":"ca5cdd56-1893-43c5-a34f-5662919b23a8","Type":"ContainerStarted","Data":"9af56e63fbfa21aa71c4589be57707be91526a3fb4a194b1b71caf3f2e961a6f"}
Nov 04 05:37:16.881110 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:16.881076    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57f7f8659f-c5w9q"]
Nov 04 05:37:16.884455 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:16.884431    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-c5w9q"
Nov 04 05:37:16.892106 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:16.892079    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-c5w9q"]
Nov 04 05:37:16.892293 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:16.892268    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-mp9cq\""
Nov 04 05:37:16.910711 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:16.910691    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Nov 04 05:37:16.910819 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:16.910751    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Nov 04 05:37:17.073886 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:17.073850    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5686\" (UniqueName: \"kubernetes.io/projected/7ecf80c5-3611-492d-b3f5-136d5a9e4a74-kube-api-access-h5686\") pod \"authorino-57f7f8659f-c5w9q\" (UID: \"7ecf80c5-3611-492d-b3f5-136d5a9e4a74\") " pod="kuadrant-system/authorino-57f7f8659f-c5w9q"
Nov 04 05:37:17.175205 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:17.175121    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5686\" (UniqueName: \"kubernetes.io/projected/7ecf80c5-3611-492d-b3f5-136d5a9e4a74-kube-api-access-h5686\") pod \"authorino-57f7f8659f-c5w9q\" (UID: \"7ecf80c5-3611-492d-b3f5-136d5a9e4a74\") " pod="kuadrant-system/authorino-57f7f8659f-c5w9q"
Nov 04 05:37:17.195808 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:17.194580    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5686\" (UniqueName: \"kubernetes.io/projected/7ecf80c5-3611-492d-b3f5-136d5a9e4a74-kube-api-access-h5686\") pod \"authorino-57f7f8659f-c5w9q\" (UID: \"7ecf80c5-3611-492d-b3f5-136d5a9e4a74\") " pod="kuadrant-system/authorino-57f7f8659f-c5w9q"
Nov 04 05:37:17.195940 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:17.195831    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-5897477d49-fj2zh"]
Nov 04 05:37:17.203539 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:17.203504    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-5897477d49-fj2zh"
Nov 04 05:37:17.208388 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:17.208366    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-5897477d49-fj2zh"]
Nov 04 05:37:17.208548 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:17.208531    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-c5w9q"
Nov 04 05:37:17.269614 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:17.267196    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"jobset-manager-config\""
Nov 04 05:37:17.269614 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:17.267324    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\""
Nov 04 05:37:17.269815 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:17.269784    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\""
Nov 04 05:37:17.285538 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:37:17.283068    4357 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-npgcv" containerName="extractor"
Nov 04 05:37:17.292755 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:17.292733    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-controller-manager-dockercfg-gsvjg\""
Nov 04 05:37:17.292903 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:17.292793    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"metrics-server-cert\""
Nov 04 05:37:17.292903 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:17.292823    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"webhook-server-cert\""
Nov 04 05:37:17.376848 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:17.376819    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f6de1b43-d06d-44b4-bd63-e31f73436c1c-manager-config\") pod \"jobset-controller-manager-5897477d49-fj2zh\" (UID: \"f6de1b43-d06d-44b4-bd63-e31f73436c1c\") " pod="openshift-jobset-operator/jobset-controller-manager-5897477d49-fj2zh"
Nov 04 05:37:17.376988 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:17.376863    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f6de1b43-d06d-44b4-bd63-e31f73436c1c-cert\") pod \"jobset-controller-manager-5897477d49-fj2zh\" (UID: \"f6de1b43-d06d-44b4-bd63-e31f73436c1c\") " pod="openshift-jobset-operator/jobset-controller-manager-5897477d49-fj2zh"
Nov 04 05:37:17.377051 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:17.376986    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6de1b43-d06d-44b4-bd63-e31f73436c1c-metrics-certs\") pod \"jobset-controller-manager-5897477d49-fj2zh\" (UID: \"f6de1b43-d06d-44b4-bd63-e31f73436c1c\") " pod="openshift-jobset-operator/jobset-controller-manager-5897477d49-fj2zh"
Nov 04 05:37:17.377051 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:17.377022    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-684wc\" (UniqueName: \"kubernetes.io/projected/f6de1b43-d06d-44b4-bd63-e31f73436c1c-kube-api-access-684wc\") pod \"jobset-controller-manager-5897477d49-fj2zh\" (UID: \"f6de1b43-d06d-44b4-bd63-e31f73436c1c\") " pod="openshift-jobset-operator/jobset-controller-manager-5897477d49-fj2zh"
Nov 04 05:37:17.478363 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:17.478305    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f6de1b43-d06d-44b4-bd63-e31f73436c1c-manager-config\") pod \"jobset-controller-manager-5897477d49-fj2zh\" (UID: \"f6de1b43-d06d-44b4-bd63-e31f73436c1c\") " pod="openshift-jobset-operator/jobset-controller-manager-5897477d49-fj2zh"
Nov 04 05:37:17.478363 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:17.478340    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f6de1b43-d06d-44b4-bd63-e31f73436c1c-cert\") pod \"jobset-controller-manager-5897477d49-fj2zh\" (UID: \"f6de1b43-d06d-44b4-bd63-e31f73436c1c\") " pod="openshift-jobset-operator/jobset-controller-manager-5897477d49-fj2zh"
Nov 04 05:37:17.478528 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:17.478397    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6de1b43-d06d-44b4-bd63-e31f73436c1c-metrics-certs\") pod \"jobset-controller-manager-5897477d49-fj2zh\" (UID: \"f6de1b43-d06d-44b4-bd63-e31f73436c1c\") " pod="openshift-jobset-operator/jobset-controller-manager-5897477d49-fj2zh"
Nov 04 05:37:17.478528 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:17.478423    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-684wc\" (UniqueName: \"kubernetes.io/projected/f6de1b43-d06d-44b4-bd63-e31f73436c1c-kube-api-access-684wc\") pod \"jobset-controller-manager-5897477d49-fj2zh\" (UID: \"f6de1b43-d06d-44b4-bd63-e31f73436c1c\") " pod="openshift-jobset-operator/jobset-controller-manager-5897477d49-fj2zh"
Nov 04 05:37:17.479280 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:17.479260    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f6de1b43-d06d-44b4-bd63-e31f73436c1c-manager-config\") pod \"jobset-controller-manager-5897477d49-fj2zh\" (UID: \"f6de1b43-d06d-44b4-bd63-e31f73436c1c\") " pod="openshift-jobset-operator/jobset-controller-manager-5897477d49-fj2zh"
Nov 04 05:37:17.481006 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:17.480984    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6de1b43-d06d-44b4-bd63-e31f73436c1c-metrics-certs\") pod \"jobset-controller-manager-5897477d49-fj2zh\" (UID: \"f6de1b43-d06d-44b4-bd63-e31f73436c1c\") " pod="openshift-jobset-operator/jobset-controller-manager-5897477d49-fj2zh"
Nov 04 05:37:17.481164 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:17.481142    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f6de1b43-d06d-44b4-bd63-e31f73436c1c-cert\") pod \"jobset-controller-manager-5897477d49-fj2zh\" (UID: \"f6de1b43-d06d-44b4-bd63-e31f73436c1c\") " pod="openshift-jobset-operator/jobset-controller-manager-5897477d49-fj2zh"
Nov 04 05:37:17.489267 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:17.489244    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-c5w9q"]
Nov 04 05:37:17.490868 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:17.490849    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-684wc\" (UniqueName: \"kubernetes.io/projected/f6de1b43-d06d-44b4-bd63-e31f73436c1c-kube-api-access-684wc\") pod \"jobset-controller-manager-5897477d49-fj2zh\" (UID: \"f6de1b43-d06d-44b4-bd63-e31f73436c1c\") " pod="openshift-jobset-operator/jobset-controller-manager-5897477d49-fj2zh"
Nov 04 05:37:17.499458 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:37:17.499433    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ecf80c5_3611_492d_b3f5_136d5a9e4a74.slice/crio-9342637242cc8c13e3dc40b1c36854f10cf5008107eab1757d2ed9501361776e WatchSource:0}: Error finding container 9342637242cc8c13e3dc40b1c36854f10cf5008107eab1757d2ed9501361776e: Status 404 returned error can't find the container with id 9342637242cc8c13e3dc40b1c36854f10cf5008107eab1757d2ed9501361776e
Nov 04 05:37:17.520897 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:17.520880    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-5897477d49-fj2zh"
Nov 04 05:37:17.796190 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:17.796161    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-5897477d49-fj2zh"]
Nov 04 05:37:17.799209 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:37:17.799183    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6de1b43_d06d_44b4_bd63_e31f73436c1c.slice/crio-078e753728de7acbf5cec5044995239a22fc3a1535aac36f72047a6962a3a106 WatchSource:0}: Error finding container 078e753728de7acbf5cec5044995239a22fc3a1535aac36f72047a6962a3a106: Status 404 returned error can't find the container with id 078e753728de7acbf5cec5044995239a22fc3a1535aac36f72047a6962a3a106
Nov 04 05:37:18.030879 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:18.030842    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-c5w9q" event={"ID":"7ecf80c5-3611-492d-b3f5-136d5a9e4a74","Type":"ContainerStarted","Data":"9342637242cc8c13e3dc40b1c36854f10cf5008107eab1757d2ed9501361776e"}
Nov 04 05:37:18.032370 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:18.032333    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-5897477d49-fj2zh" event={"ID":"f6de1b43-d06d-44b4-bd63-e31f73436c1c","Type":"ContainerStarted","Data":"078e753728de7acbf5cec5044995239a22fc3a1535aac36f72047a6962a3a106"}
Nov 04 05:37:19.038846 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:19.038800    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5488c58ff5-924cz" event={"ID":"ca5cdd56-1893-43c5-a34f-5662919b23a8","Type":"ContainerStarted","Data":"c314cf75c33664c72625641ae628f1debd0ad58bf28da5972573cead4d81d695"}
Nov 04 05:37:19.054600 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:19.054551    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5488c58ff5-924cz" podStartSLOduration=1.617367417 podStartE2EDuration="4.054538342s" totalImagesPullingTime="2.437170925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:37:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:37:19.053371665 +0000 UTC m=+525.922035239" watchObservedRunningTime="2026-11-04 05:37:19.054538342 +0000 UTC m=+525.923201913"
Nov 04 05:37:20.738225 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:20.738150    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-c5w9q"]
Nov 04 05:37:21.047726 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:21.047693    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-c5w9q" event={"ID":"7ecf80c5-3611-492d-b3f5-136d5a9e4a74","Type":"ContainerStarted","Data":"d35b18dfe0cf60b4c1a4feb2d26a1d45dd49df11bb638961cb90ea7b6d9c0e6d"}
Nov 04 05:37:21.062646 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:21.062601    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-57f7f8659f-c5w9q" podStartSLOduration=2.260107053 podStartE2EDuration="5.062588315s" totalImagesPullingTime="2.802481262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:37:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:37:21.061262842 +0000 UTC m=+527.929926415" watchObservedRunningTime="2026-11-04 05:37:21.062588315 +0000 UTC m=+527.931251886"
Nov 04 05:37:22.051594 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:22.051558    4357 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-57f7f8659f-c5w9q" podUID="7ecf80c5-3611-492d-b3f5-136d5a9e4a74" containerName="authorino" containerID="cri-o://d35b18dfe0cf60b4c1a4feb2d26a1d45dd49df11bb638961cb90ea7b6d9c0e6d" gracePeriod=30
Nov 04 05:37:22.282471 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:22.282450    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-c5w9q"
Nov 04 05:37:22.316627 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:22.316563    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7ecf80c5-3611-492d-b3f5-136d5a9e4a74-kube-api-access-h5686\" (UniqueName: \"kubernetes.io/projected/7ecf80c5-3611-492d-b3f5-136d5a9e4a74-kube-api-access-h5686\") pod \"7ecf80c5-3611-492d-b3f5-136d5a9e4a74\" (UID: \"7ecf80c5-3611-492d-b3f5-136d5a9e4a74\") "
Nov 04 05:37:22.318557 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:22.318531    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ecf80c5-3611-492d-b3f5-136d5a9e4a74-kube-api-access-h5686" pod "7ecf80c5-3611-492d-b3f5-136d5a9e4a74" (UID: "7ecf80c5-3611-492d-b3f5-136d5a9e4a74"). InnerVolumeSpecName "kube-api-access-h5686". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:37:22.417901 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:22.417872    4357 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5686\" (UniqueName: \"kubernetes.io/projected/7ecf80c5-3611-492d-b3f5-136d5a9e4a74-kube-api-access-h5686\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:37:23.056526 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:23.056487    4357 generic.go:356] "Generic (PLEG): container finished" podID="7ecf80c5-3611-492d-b3f5-136d5a9e4a74" containerID="d35b18dfe0cf60b4c1a4feb2d26a1d45dd49df11bb638961cb90ea7b6d9c0e6d" exitCode=0
Nov 04 05:37:23.056960 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:23.056540    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-c5w9q" event={"ID":"7ecf80c5-3611-492d-b3f5-136d5a9e4a74","Type":"ContainerDied","Data":"d35b18dfe0cf60b4c1a4feb2d26a1d45dd49df11bb638961cb90ea7b6d9c0e6d"}
Nov 04 05:37:23.056960 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:23.056578    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-c5w9q" event={"ID":"7ecf80c5-3611-492d-b3f5-136d5a9e4a74","Type":"ContainerDied","Data":"9342637242cc8c13e3dc40b1c36854f10cf5008107eab1757d2ed9501361776e"}
Nov 04 05:37:23.056960 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:23.056595    4357 scope.go:122] "RemoveContainer" containerID="d35b18dfe0cf60b4c1a4feb2d26a1d45dd49df11bb638961cb90ea7b6d9c0e6d"
Nov 04 05:37:23.056960 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:23.056547    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-c5w9q"
Nov 04 05:37:23.064478 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:23.064460    4357 scope.go:122] "RemoveContainer" containerID="d35b18dfe0cf60b4c1a4feb2d26a1d45dd49df11bb638961cb90ea7b6d9c0e6d"
Nov 04 05:37:23.064750 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:37:23.064730    4357 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d35b18dfe0cf60b4c1a4feb2d26a1d45dd49df11bb638961cb90ea7b6d9c0e6d\": container with ID starting with d35b18dfe0cf60b4c1a4feb2d26a1d45dd49df11bb638961cb90ea7b6d9c0e6d not found: ID does not exist" containerID="d35b18dfe0cf60b4c1a4feb2d26a1d45dd49df11bb638961cb90ea7b6d9c0e6d"
Nov 04 05:37:23.064812 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:23.064759    4357 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d35b18dfe0cf60b4c1a4feb2d26a1d45dd49df11bb638961cb90ea7b6d9c0e6d"} err="failed to get container status \"d35b18dfe0cf60b4c1a4feb2d26a1d45dd49df11bb638961cb90ea7b6d9c0e6d\": rpc error: code = NotFound desc = could not find container \"d35b18dfe0cf60b4c1a4feb2d26a1d45dd49df11bb638961cb90ea7b6d9c0e6d\": container with ID starting with d35b18dfe0cf60b4c1a4feb2d26a1d45dd49df11bb638961cb90ea7b6d9c0e6d not found: ID does not exist"
Nov 04 05:37:23.076456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:23.076436    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-c5w9q"]
Nov 04 05:37:23.082876 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:23.079087    4357 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-c5w9q"]
Nov 04 05:37:23.271387 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:23.271360    4357 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7ecf80c5-3611-492d-b3f5-136d5a9e4a74" path="/var/lib/kubelet/pods/7ecf80c5-3611-492d-b3f5-136d5a9e4a74/volumes"
Nov 04 05:37:29.080116 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:29.080083    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-5897477d49-fj2zh" event={"ID":"f6de1b43-d06d-44b4-bd63-e31f73436c1c","Type":"ContainerStarted","Data":"1f6184b6e6352e67806fddd64b506ea5d56a4c19cd764d26558a892f9d6505a9"}
Nov 04 05:37:29.080604 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:29.080211    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-jobset-operator/jobset-controller-manager-5897477d49-fj2zh"
Nov 04 05:37:29.096044 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:29.095995    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-controller-manager-5897477d49-fj2zh" podStartSLOduration=0.916484384 podStartE2EDuration="12.095981385s" totalImagesPullingTime="11.179497001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:37:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:37:29.095750835 +0000 UTC m=+535.964414419" watchObservedRunningTime="2026-11-04 05:37:29.095981385 +0000 UTC m=+535.964645010"
Nov 04 05:37:40.088637 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:37:40.088602    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-jobset-operator/jobset-controller-manager-5897477d49-fj2zh"
Nov 04 05:37:47.274932 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:37:47.274895    4357 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-npgcv" containerName="extractor"
Nov 04 05:38:12.132827 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:12.132797    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-64lvc"]
Nov 04 05:38:12.133282 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:12.133101    4357 cpu_manager.go:414] "containerMap: removing container" podUID="7ecf80c5-3611-492d-b3f5-136d5a9e4a74" containerName="authorino"
Nov 04 05:38:12.133282 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:12.133112    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7ecf80c5-3611-492d-b3f5-136d5a9e4a74" containerName="authorino"
Nov 04 05:38:12.133282 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:12.133163    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="7ecf80c5-3611-492d-b3f5-136d5a9e4a74" containerName="authorino"
Nov 04 05:38:12.143397 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:12.143374    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-64lvc"
Nov 04 05:38:12.147511 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:12.147483    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-64lvc"]
Nov 04 05:38:12.257557 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:12.257509    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbda0ee3-ad65-4d05-bc9e-6006bcf7f084-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-64lvc\" (UID: \"bbda0ee3-ad65-4d05-bc9e-6006bcf7f084\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-64lvc"
Nov 04 05:38:12.257705 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:12.257637    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bbda0ee3-ad65-4d05-bc9e-6006bcf7f084-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-64lvc\" (UID: \"bbda0ee3-ad65-4d05-bc9e-6006bcf7f084\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-64lvc"
Nov 04 05:38:12.257705 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:12.257696    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bbda0ee3-ad65-4d05-bc9e-6006bcf7f084-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-64lvc\" (UID: \"bbda0ee3-ad65-4d05-bc9e-6006bcf7f084\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-64lvc"
Nov 04 05:38:12.257783 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:12.257737    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bbda0ee3-ad65-4d05-bc9e-6006bcf7f084-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-64lvc\" (UID: \"bbda0ee3-ad65-4d05-bc9e-6006bcf7f084\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-64lvc"
Nov 04 05:38:12.257783 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:12.257768    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bbda0ee3-ad65-4d05-bc9e-6006bcf7f084-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-64lvc\" (UID: \"bbda0ee3-ad65-4d05-bc9e-6006bcf7f084\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-64lvc"
Nov 04 05:38:12.257844 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:12.257827    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2w75\" (UniqueName: \"kubernetes.io/projected/bbda0ee3-ad65-4d05-bc9e-6006bcf7f084-kube-api-access-g2w75\") pod \"istiod-openshift-gateway-7ddd9cfdc8-64lvc\" (UID: \"bbda0ee3-ad65-4d05-bc9e-6006bcf7f084\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-64lvc"
Nov 04 05:38:12.257876 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:12.257858    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbda0ee3-ad65-4d05-bc9e-6006bcf7f084-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-64lvc\" (UID: \"bbda0ee3-ad65-4d05-bc9e-6006bcf7f084\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-64lvc"
Nov 04 05:38:12.358352 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:12.358327    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbda0ee3-ad65-4d05-bc9e-6006bcf7f084-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-64lvc\" (UID: \"bbda0ee3-ad65-4d05-bc9e-6006bcf7f084\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-64lvc"
Nov 04 05:38:12.358492 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:12.358367    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbda0ee3-ad65-4d05-bc9e-6006bcf7f084-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-64lvc\" (UID: \"bbda0ee3-ad65-4d05-bc9e-6006bcf7f084\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-64lvc"
Nov 04 05:38:12.358492 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:12.358400    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bbda0ee3-ad65-4d05-bc9e-6006bcf7f084-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-64lvc\" (UID: \"bbda0ee3-ad65-4d05-bc9e-6006bcf7f084\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-64lvc"
Nov 04 05:38:12.358593 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:12.358561    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bbda0ee3-ad65-4d05-bc9e-6006bcf7f084-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-64lvc\" (UID: \"bbda0ee3-ad65-4d05-bc9e-6006bcf7f084\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-64lvc"
Nov 04 05:38:12.358635 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:12.358620    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bbda0ee3-ad65-4d05-bc9e-6006bcf7f084-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-64lvc\" (UID: \"bbda0ee3-ad65-4d05-bc9e-6006bcf7f084\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-64lvc"
Nov 04 05:38:12.358682 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:12.358656    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bbda0ee3-ad65-4d05-bc9e-6006bcf7f084-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-64lvc\" (UID: \"bbda0ee3-ad65-4d05-bc9e-6006bcf7f084\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-64lvc"
Nov 04 05:38:12.358720 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:12.358682    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2w75\" (UniqueName: \"kubernetes.io/projected/bbda0ee3-ad65-4d05-bc9e-6006bcf7f084-kube-api-access-g2w75\") pod \"istiod-openshift-gateway-7ddd9cfdc8-64lvc\" (UID: \"bbda0ee3-ad65-4d05-bc9e-6006bcf7f084\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-64lvc"
Nov 04 05:38:12.359365 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:12.359335    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bbda0ee3-ad65-4d05-bc9e-6006bcf7f084-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-64lvc\" (UID: \"bbda0ee3-ad65-4d05-bc9e-6006bcf7f084\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-64lvc"
Nov 04 05:38:12.360832 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:12.360803    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbda0ee3-ad65-4d05-bc9e-6006bcf7f084-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-64lvc\" (UID: \"bbda0ee3-ad65-4d05-bc9e-6006bcf7f084\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-64lvc"
Nov 04 05:38:12.360930 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:12.360844    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bbda0ee3-ad65-4d05-bc9e-6006bcf7f084-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-64lvc\" (UID: \"bbda0ee3-ad65-4d05-bc9e-6006bcf7f084\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-64lvc"
Nov 04 05:38:12.360930 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:12.360856    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bbda0ee3-ad65-4d05-bc9e-6006bcf7f084-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-64lvc\" (UID: \"bbda0ee3-ad65-4d05-bc9e-6006bcf7f084\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-64lvc"
Nov 04 05:38:12.361016 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:12.360994    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bbda0ee3-ad65-4d05-bc9e-6006bcf7f084-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-64lvc\" (UID: \"bbda0ee3-ad65-4d05-bc9e-6006bcf7f084\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-64lvc"
Nov 04 05:38:12.366275 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:12.366253    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbda0ee3-ad65-4d05-bc9e-6006bcf7f084-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-64lvc\" (UID: \"bbda0ee3-ad65-4d05-bc9e-6006bcf7f084\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-64lvc"
Nov 04 05:38:12.366757 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:12.366737    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2w75\" (UniqueName: \"kubernetes.io/projected/bbda0ee3-ad65-4d05-bc9e-6006bcf7f084-kube-api-access-g2w75\") pod \"istiod-openshift-gateway-7ddd9cfdc8-64lvc\" (UID: \"bbda0ee3-ad65-4d05-bc9e-6006bcf7f084\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-64lvc"
Nov 04 05:38:12.459584 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:12.459495    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-64lvc"
Nov 04 05:38:12.733876 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:12.733806    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-64lvc"]
Nov 04 05:38:12.737915 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:38:12.737887    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbda0ee3_ad65_4d05_bc9e_6006bcf7f084.slice/crio-86f49012345770d99d88548334ea4dc251dc8e98b23279095161745c988c07b8 WatchSource:0}: Error finding container 86f49012345770d99d88548334ea4dc251dc8e98b23279095161745c988c07b8: Status 404 returned error can't find the container with id 86f49012345770d99d88548334ea4dc251dc8e98b23279095161745c988c07b8
Nov 04 05:38:12.740099 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:12.740069    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:38:12.740179 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:12.740133    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:38:13.234984 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:13.234939    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-64lvc" event={"ID":"bbda0ee3-ad65-4d05-bc9e-6006bcf7f084","Type":"ContainerStarted","Data":"88dadcc7a9fd314c967ff17f13fddb1e5c2a061dff0238883077fccfa5b8ecac"}
Nov 04 05:38:13.235382 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:13.235000    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-64lvc" event={"ID":"bbda0ee3-ad65-4d05-bc9e-6006bcf7f084","Type":"ContainerStarted","Data":"86f49012345770d99d88548334ea4dc251dc8e98b23279095161745c988c07b8"}
Nov 04 05:38:13.235382 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:13.235149    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-64lvc"
Nov 04 05:38:13.236696 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:13.236665    4357 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-64lvc container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 04 05:38:13.236814 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:13.236717    4357 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-64lvc" podUID="bbda0ee3-ad65-4d05-bc9e-6006bcf7f084" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 04 05:38:13.256232 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:13.256187    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-64lvc" podStartSLOduration=1.256174876 podStartE2EDuration="1.256174876s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:38:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:38:13.254280132 +0000 UTC m=+580.122943708" watchObservedRunningTime="2026-11-04 05:38:13.256174876 +0000 UTC m=+580.124838448"
Nov 04 05:38:14.238711 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:14.238683    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-64lvc"
Nov 04 05:38:14.290779 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:14.290745    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-t6vr6"]
Nov 04 05:38:14.290946 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:14.290927    4357 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-t6vr6" podUID="39b582f2-0f7f-42da-85ff-6cc7c256f922" containerName="discovery" containerID="cri-o://e5632aeed9bc56478f60d971331af42b4ba1b88f74ca5e32213667690be4b032" gracePeriod=30
Nov 04 05:38:14.529836 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:14.529813    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-t6vr6"
Nov 04 05:38:14.676338 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:14.676310    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/39b582f2-0f7f-42da-85ff-6cc7c256f922-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/39b582f2-0f7f-42da-85ff-6cc7c256f922-local-certs\") pod \"39b582f2-0f7f-42da-85ff-6cc7c256f922\" (UID: \"39b582f2-0f7f-42da-85ff-6cc7c256f922\") "
Nov 04 05:38:14.676461 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:14.676345    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/39b582f2-0f7f-42da-85ff-6cc7c256f922-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/39b582f2-0f7f-42da-85ff-6cc7c256f922-istio-kubeconfig\") pod \"39b582f2-0f7f-42da-85ff-6cc7c256f922\" (UID: \"39b582f2-0f7f-42da-85ff-6cc7c256f922\") "
Nov 04 05:38:14.676461 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:14.676366    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/39b582f2-0f7f-42da-85ff-6cc7c256f922-cacerts\" (UniqueName: \"kubernetes.io/secret/39b582f2-0f7f-42da-85ff-6cc7c256f922-cacerts\") pod \"39b582f2-0f7f-42da-85ff-6cc7c256f922\" (UID: \"39b582f2-0f7f-42da-85ff-6cc7c256f922\") "
Nov 04 05:38:14.676461 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:14.676394    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/39b582f2-0f7f-42da-85ff-6cc7c256f922-kube-api-access-2dq5n\" (UniqueName: \"kubernetes.io/projected/39b582f2-0f7f-42da-85ff-6cc7c256f922-kube-api-access-2dq5n\") pod \"39b582f2-0f7f-42da-85ff-6cc7c256f922\" (UID: \"39b582f2-0f7f-42da-85ff-6cc7c256f922\") "
Nov 04 05:38:14.676461 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:14.676428    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/39b582f2-0f7f-42da-85ff-6cc7c256f922-istio-token\" (UniqueName: \"kubernetes.io/projected/39b582f2-0f7f-42da-85ff-6cc7c256f922-istio-token\") pod \"39b582f2-0f7f-42da-85ff-6cc7c256f922\" (UID: \"39b582f2-0f7f-42da-85ff-6cc7c256f922\") "
Nov 04 05:38:14.677350 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:14.677120    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39b582f2-0f7f-42da-85ff-6cc7c256f922-istio-csr-ca-configmap" pod "39b582f2-0f7f-42da-85ff-6cc7c256f922" (UID: "39b582f2-0f7f-42da-85ff-6cc7c256f922"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:38:14.677477 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:14.676450    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/39b582f2-0f7f-42da-85ff-6cc7c256f922-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/39b582f2-0f7f-42da-85ff-6cc7c256f922-istio-csr-ca-configmap\") pod \"39b582f2-0f7f-42da-85ff-6cc7c256f922\" (UID: \"39b582f2-0f7f-42da-85ff-6cc7c256f922\") "
Nov 04 05:38:14.677561 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:14.677485    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/39b582f2-0f7f-42da-85ff-6cc7c256f922-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/39b582f2-0f7f-42da-85ff-6cc7c256f922-istio-csr-dns-cert\") pod \"39b582f2-0f7f-42da-85ff-6cc7c256f922\" (UID: \"39b582f2-0f7f-42da-85ff-6cc7c256f922\") "
Nov 04 05:38:14.679044 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:14.678987    4357 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/39b582f2-0f7f-42da-85ff-6cc7c256f922-istio-csr-ca-configmap\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:38:14.683468 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:14.679977    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39b582f2-0f7f-42da-85ff-6cc7c256f922-istio-token" pod "39b582f2-0f7f-42da-85ff-6cc7c256f922" (UID: "39b582f2-0f7f-42da-85ff-6cc7c256f922"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:38:14.683808 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:14.683564    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39b582f2-0f7f-42da-85ff-6cc7c256f922-local-certs" pod "39b582f2-0f7f-42da-85ff-6cc7c256f922" (UID: "39b582f2-0f7f-42da-85ff-6cc7c256f922"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:38:14.683808 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:14.683666    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39b582f2-0f7f-42da-85ff-6cc7c256f922-cacerts" pod "39b582f2-0f7f-42da-85ff-6cc7c256f922" (UID: "39b582f2-0f7f-42da-85ff-6cc7c256f922"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:38:14.683962 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:14.683871    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39b582f2-0f7f-42da-85ff-6cc7c256f922-istio-kubeconfig" pod "39b582f2-0f7f-42da-85ff-6cc7c256f922" (UID: "39b582f2-0f7f-42da-85ff-6cc7c256f922"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:38:14.684020 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:14.683992    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39b582f2-0f7f-42da-85ff-6cc7c256f922-kube-api-access-2dq5n" pod "39b582f2-0f7f-42da-85ff-6cc7c256f922" (UID: "39b582f2-0f7f-42da-85ff-6cc7c256f922"). InnerVolumeSpecName "kube-api-access-2dq5n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:38:14.684890 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:14.684868    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39b582f2-0f7f-42da-85ff-6cc7c256f922-istio-csr-dns-cert" pod "39b582f2-0f7f-42da-85ff-6cc7c256f922" (UID: "39b582f2-0f7f-42da-85ff-6cc7c256f922"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:38:14.779965 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:14.779908    4357 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/39b582f2-0f7f-42da-85ff-6cc7c256f922-istio-csr-dns-cert\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:38:14.779965 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:14.779933    4357 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/39b582f2-0f7f-42da-85ff-6cc7c256f922-local-certs\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:38:14.779965 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:14.779942    4357 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/39b582f2-0f7f-42da-85ff-6cc7c256f922-istio-kubeconfig\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:38:14.779965 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:14.779951    4357 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/39b582f2-0f7f-42da-85ff-6cc7c256f922-cacerts\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:38:14.779965 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:14.779961    4357 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2dq5n\" (UniqueName: \"kubernetes.io/projected/39b582f2-0f7f-42da-85ff-6cc7c256f922-kube-api-access-2dq5n\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:38:14.780188 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:14.779970    4357 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39b582f2-0f7f-42da-85ff-6cc7c256f922-istio-token\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:38:15.243009 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:15.242933    4357 generic.go:356] "Generic (PLEG): container finished" podID="39b582f2-0f7f-42da-85ff-6cc7c256f922" containerID="e5632aeed9bc56478f60d971331af42b4ba1b88f74ca5e32213667690be4b032" exitCode=0
Nov 04 05:38:15.243009 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:15.242995    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-t6vr6"
Nov 04 05:38:15.243436 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:15.243017    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-t6vr6" event={"ID":"39b582f2-0f7f-42da-85ff-6cc7c256f922","Type":"ContainerDied","Data":"e5632aeed9bc56478f60d971331af42b4ba1b88f74ca5e32213667690be4b032"}
Nov 04 05:38:15.243436 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:15.243089    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-t6vr6" event={"ID":"39b582f2-0f7f-42da-85ff-6cc7c256f922","Type":"ContainerDied","Data":"d00b57037488266def61e517309abbfb44d08bdce29509e1c5995fe082fe2a64"}
Nov 04 05:38:15.243436 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:15.243110    4357 scope.go:122] "RemoveContainer" containerID="e5632aeed9bc56478f60d971331af42b4ba1b88f74ca5e32213667690be4b032"
Nov 04 05:38:15.251316 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:15.251296    4357 scope.go:122] "RemoveContainer" containerID="e5632aeed9bc56478f60d971331af42b4ba1b88f74ca5e32213667690be4b032"
Nov 04 05:38:15.251601 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:38:15.251579    4357 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5632aeed9bc56478f60d971331af42b4ba1b88f74ca5e32213667690be4b032\": container with ID starting with e5632aeed9bc56478f60d971331af42b4ba1b88f74ca5e32213667690be4b032 not found: ID does not exist" containerID="e5632aeed9bc56478f60d971331af42b4ba1b88f74ca5e32213667690be4b032"
Nov 04 05:38:15.251680 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:15.251609    4357 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5632aeed9bc56478f60d971331af42b4ba1b88f74ca5e32213667690be4b032"} err="failed to get container status \"e5632aeed9bc56478f60d971331af42b4ba1b88f74ca5e32213667690be4b032\": rpc error: code = NotFound desc = could not find container \"e5632aeed9bc56478f60d971331af42b4ba1b88f74ca5e32213667690be4b032\": container with ID starting with e5632aeed9bc56478f60d971331af42b4ba1b88f74ca5e32213667690be4b032 not found: ID does not exist"
Nov 04 05:38:15.263217 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:15.263197    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-t6vr6"]
Nov 04 05:38:15.266672 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:15.266653    4357 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-t6vr6"]
Nov 04 05:38:15.271682 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:15.271662    4357 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="39b582f2-0f7f-42da-85ff-6cc7c256f922" path="/var/lib/kubelet/pods/39b582f2-0f7f-42da-85ff-6cc7c256f922/volumes"
Nov 04 05:38:17.274578 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:38:17.274498    4357 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-npgcv" containerName="extractor"
Nov 04 05:38:33.296498 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:33.296471    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dlb7_f1f789ee-b574-48ba-abd5-cfac0b3d7f40/ovn-acl-logging/0.log"
Nov 04 05:38:33.298084 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:33.298059    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dlb7_f1f789ee-b574-48ba-abd5-cfac0b3d7f40/ovn-acl-logging/0.log"
Nov 04 05:38:42.343176 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:42.343148    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-l7tns"]
Nov 04 05:38:42.343611 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:42.343428    4357 cpu_manager.go:414] "containerMap: removing container" podUID="39b582f2-0f7f-42da-85ff-6cc7c256f922" containerName="discovery"
Nov 04 05:38:42.343611 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:42.343439    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="39b582f2-0f7f-42da-85ff-6cc7c256f922" containerName="discovery"
Nov 04 05:38:42.343611 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:42.343486    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="39b582f2-0f7f-42da-85ff-6cc7c256f922" containerName="discovery"
Nov 04 05:38:42.347417 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:42.347398    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-l7tns"
Nov 04 05:38:42.352898 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:42.352872    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-l7tns"]
Nov 04 05:38:42.354558 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:42.354536    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Nov 04 05:38:42.354654 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:42.354616    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Nov 04 05:38:42.381240 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:42.381219    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Nov 04 05:38:42.381348 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:42.381300    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-mp9cq\""
Nov 04 05:38:42.465295 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:42.465266    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/64594980-aa36-4c9d-8cec-1c7beaf9b32a-tls-cert\") pod \"authorino-6889cbd8c4-l7tns\" (UID: \"64594980-aa36-4c9d-8cec-1c7beaf9b32a\") " pod="kuadrant-system/authorino-6889cbd8c4-l7tns"
Nov 04 05:38:42.465409 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:42.465301    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpzq5\" (UniqueName: \"kubernetes.io/projected/64594980-aa36-4c9d-8cec-1c7beaf9b32a-kube-api-access-xpzq5\") pod \"authorino-6889cbd8c4-l7tns\" (UID: \"64594980-aa36-4c9d-8cec-1c7beaf9b32a\") " pod="kuadrant-system/authorino-6889cbd8c4-l7tns"
Nov 04 05:38:42.566634 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:42.566598    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/64594980-aa36-4c9d-8cec-1c7beaf9b32a-tls-cert\") pod \"authorino-6889cbd8c4-l7tns\" (UID: \"64594980-aa36-4c9d-8cec-1c7beaf9b32a\") " pod="kuadrant-system/authorino-6889cbd8c4-l7tns"
Nov 04 05:38:42.566781 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:42.566647    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpzq5\" (UniqueName: \"kubernetes.io/projected/64594980-aa36-4c9d-8cec-1c7beaf9b32a-kube-api-access-xpzq5\") pod \"authorino-6889cbd8c4-l7tns\" (UID: \"64594980-aa36-4c9d-8cec-1c7beaf9b32a\") " pod="kuadrant-system/authorino-6889cbd8c4-l7tns"
Nov 04 05:38:42.568979 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:42.568958    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/64594980-aa36-4c9d-8cec-1c7beaf9b32a-tls-cert\") pod \"authorino-6889cbd8c4-l7tns\" (UID: \"64594980-aa36-4c9d-8cec-1c7beaf9b32a\") " pod="kuadrant-system/authorino-6889cbd8c4-l7tns"
Nov 04 05:38:42.574582 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:42.574563    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpzq5\" (UniqueName: \"kubernetes.io/projected/64594980-aa36-4c9d-8cec-1c7beaf9b32a-kube-api-access-xpzq5\") pod \"authorino-6889cbd8c4-l7tns\" (UID: \"64594980-aa36-4c9d-8cec-1c7beaf9b32a\") " pod="kuadrant-system/authorino-6889cbd8c4-l7tns"
Nov 04 05:38:42.657102 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:42.657046    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-l7tns"]
Nov 04 05:38:42.657267 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:42.657254    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-l7tns"
Nov 04 05:38:42.923144 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:42.923121    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-l7tns"]
Nov 04 05:38:42.925592 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:38:42.925559    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod64594980_aa36_4c9d_8cec_1c7beaf9b32a.slice/crio-aac5422f4d25e60bcd15b0462377e2e1492387fa1c2f05ba8ad03678dd4d5016 WatchSource:0}: Error finding container aac5422f4d25e60bcd15b0462377e2e1492387fa1c2f05ba8ad03678dd4d5016: Status 404 returned error can't find the container with id aac5422f4d25e60bcd15b0462377e2e1492387fa1c2f05ba8ad03678dd4d5016
Nov 04 05:38:43.338348 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:43.338315    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6889cbd8c4-l7tns" event={"ID":"64594980-aa36-4c9d-8cec-1c7beaf9b32a","Type":"ContainerStarted","Data":"aac5422f4d25e60bcd15b0462377e2e1492387fa1c2f05ba8ad03678dd4d5016"}
Nov 04 05:38:44.343799 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:44.343763    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6889cbd8c4-l7tns" event={"ID":"64594980-aa36-4c9d-8cec-1c7beaf9b32a","Type":"ContainerStarted","Data":"b85ce524069e36fc408841ad2e6d24d6ea0d3dfcaf97ec0cd512d6e2355c4f1b"}
Nov 04 05:38:44.344318 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:44.343865    4357 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-6889cbd8c4-l7tns" podUID="64594980-aa36-4c9d-8cec-1c7beaf9b32a" containerName="authorino" containerID="cri-o://b85ce524069e36fc408841ad2e6d24d6ea0d3dfcaf97ec0cd512d6e2355c4f1b" gracePeriod=30
Nov 04 05:38:44.358302 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:44.358252    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-6889cbd8c4-l7tns" podStartSLOduration=1.550086648 podStartE2EDuration="2.358235583s" totalImagesPullingTime="808.148935ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:38:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:38:44.35718507 +0000 UTC m=+611.225848639" watchObservedRunningTime="2026-11-04 05:38:44.358235583 +0000 UTC m=+611.226899156"
Nov 04 05:38:44.570003 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:44.569981    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-l7tns"
Nov 04 05:38:44.684116 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:44.684062    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/64594980-aa36-4c9d-8cec-1c7beaf9b32a-kube-api-access-xpzq5\" (UniqueName: \"kubernetes.io/projected/64594980-aa36-4c9d-8cec-1c7beaf9b32a-kube-api-access-xpzq5\") pod \"64594980-aa36-4c9d-8cec-1c7beaf9b32a\" (UID: \"64594980-aa36-4c9d-8cec-1c7beaf9b32a\") "
Nov 04 05:38:44.684232 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:44.684118    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/64594980-aa36-4c9d-8cec-1c7beaf9b32a-tls-cert\" (UniqueName: \"kubernetes.io/secret/64594980-aa36-4c9d-8cec-1c7beaf9b32a-tls-cert\") pod \"64594980-aa36-4c9d-8cec-1c7beaf9b32a\" (UID: \"64594980-aa36-4c9d-8cec-1c7beaf9b32a\") "
Nov 04 05:38:44.686132 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:44.686111    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64594980-aa36-4c9d-8cec-1c7beaf9b32a-kube-api-access-xpzq5" pod "64594980-aa36-4c9d-8cec-1c7beaf9b32a" (UID: "64594980-aa36-4c9d-8cec-1c7beaf9b32a"). InnerVolumeSpecName "kube-api-access-xpzq5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:38:44.693396 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:44.693373    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64594980-aa36-4c9d-8cec-1c7beaf9b32a-tls-cert" pod "64594980-aa36-4c9d-8cec-1c7beaf9b32a" (UID: "64594980-aa36-4c9d-8cec-1c7beaf9b32a"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:38:44.785315 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:44.785289    4357 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpzq5\" (UniqueName: \"kubernetes.io/projected/64594980-aa36-4c9d-8cec-1c7beaf9b32a-kube-api-access-xpzq5\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:38:44.785403 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:44.785316    4357 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/64594980-aa36-4c9d-8cec-1c7beaf9b32a-tls-cert\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:38:45.348984 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:45.348958    4357 generic.go:356] "Generic (PLEG): container finished" podID="64594980-aa36-4c9d-8cec-1c7beaf9b32a" containerID="b85ce524069e36fc408841ad2e6d24d6ea0d3dfcaf97ec0cd512d6e2355c4f1b" exitCode=0
Nov 04 05:38:45.349360 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:45.349004    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-l7tns"
Nov 04 05:38:45.349360 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:45.349012    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6889cbd8c4-l7tns" event={"ID":"64594980-aa36-4c9d-8cec-1c7beaf9b32a","Type":"ContainerDied","Data":"b85ce524069e36fc408841ad2e6d24d6ea0d3dfcaf97ec0cd512d6e2355c4f1b"}
Nov 04 05:38:45.349360 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:45.349040    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6889cbd8c4-l7tns" event={"ID":"64594980-aa36-4c9d-8cec-1c7beaf9b32a","Type":"ContainerDied","Data":"aac5422f4d25e60bcd15b0462377e2e1492387fa1c2f05ba8ad03678dd4d5016"}
Nov 04 05:38:45.349360 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:45.349057    4357 scope.go:122] "RemoveContainer" containerID="b85ce524069e36fc408841ad2e6d24d6ea0d3dfcaf97ec0cd512d6e2355c4f1b"
Nov 04 05:38:45.356848 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:45.356832    4357 scope.go:122] "RemoveContainer" containerID="b85ce524069e36fc408841ad2e6d24d6ea0d3dfcaf97ec0cd512d6e2355c4f1b"
Nov 04 05:38:45.357064 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:38:45.357045    4357 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b85ce524069e36fc408841ad2e6d24d6ea0d3dfcaf97ec0cd512d6e2355c4f1b\": container with ID starting with b85ce524069e36fc408841ad2e6d24d6ea0d3dfcaf97ec0cd512d6e2355c4f1b not found: ID does not exist" containerID="b85ce524069e36fc408841ad2e6d24d6ea0d3dfcaf97ec0cd512d6e2355c4f1b"
Nov 04 05:38:45.357127 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:45.357075    4357 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b85ce524069e36fc408841ad2e6d24d6ea0d3dfcaf97ec0cd512d6e2355c4f1b"} err="failed to get container status \"b85ce524069e36fc408841ad2e6d24d6ea0d3dfcaf97ec0cd512d6e2355c4f1b\": rpc error: code = NotFound desc = could not find container \"b85ce524069e36fc408841ad2e6d24d6ea0d3dfcaf97ec0cd512d6e2355c4f1b\": container with ID starting with b85ce524069e36fc408841ad2e6d24d6ea0d3dfcaf97ec0cd512d6e2355c4f1b not found: ID does not exist"
Nov 04 05:38:45.363283 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:45.363264    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-l7tns"]
Nov 04 05:38:45.366652 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:45.366633    4357 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-l7tns"]
Nov 04 05:38:47.273124 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:38:47.273089    4357 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="64594980-aa36-4c9d-8cec-1c7beaf9b32a" path="/var/lib/kubelet/pods/64594980-aa36-4c9d-8cec-1c7beaf9b32a/volumes"
Nov 04 05:38:47.275298 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:38:47.275271    4357 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-npgcv" containerName="extractor"
Nov 04 05:39:17.275258 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:39:17.275224    4357 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-npgcv" containerName="extractor"
Nov 04 05:39:47.275337 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:39:47.275266    4357 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-npgcv" containerName="extractor"
Nov 04 05:40:01.124271 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:01.124242    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-r4mf8"]
Nov 04 05:40:01.124749 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:01.124506    4357 cpu_manager.go:414] "containerMap: removing container" podUID="64594980-aa36-4c9d-8cec-1c7beaf9b32a" containerName="authorino"
Nov 04 05:40:01.124749 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:01.124605    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="64594980-aa36-4c9d-8cec-1c7beaf9b32a" containerName="authorino"
Nov 04 05:40:01.124749 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:01.124666    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="64594980-aa36-4c9d-8cec-1c7beaf9b32a" containerName="authorino"
Nov 04 05:40:01.127458 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:01.127443    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4mf8"
Nov 04 05:40:01.149261 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:01.149240    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Nov 04 05:40:01.149384 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:01.149369    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Nov 04 05:40:01.150171 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:01.150155    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-7kdb8\""
Nov 04 05:40:01.150261 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:01.150244    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Nov 04 05:40:01.165262 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:01.165244    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-r4mf8"]
Nov 04 05:40:01.211773 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:01.211751    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65c94d62-9401-47be-b57d-abe4f26b0075-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-r4mf8\" (UID: \"65c94d62-9401-47be-b57d-abe4f26b0075\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4mf8"
Nov 04 05:40:01.211858 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:01.211781    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65c94d62-9401-47be-b57d-abe4f26b0075-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-r4mf8\" (UID: \"65c94d62-9401-47be-b57d-abe4f26b0075\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4mf8"
Nov 04 05:40:01.211858 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:01.211812    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65c94d62-9401-47be-b57d-abe4f26b0075-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-r4mf8\" (UID: \"65c94d62-9401-47be-b57d-abe4f26b0075\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4mf8"
Nov 04 05:40:01.211931 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:01.211899    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65c94d62-9401-47be-b57d-abe4f26b0075-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-r4mf8\" (UID: \"65c94d62-9401-47be-b57d-abe4f26b0075\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4mf8"
Nov 04 05:40:01.211931 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:01.211924    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65c94d62-9401-47be-b57d-abe4f26b0075-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-r4mf8\" (UID: \"65c94d62-9401-47be-b57d-abe4f26b0075\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4mf8"
Nov 04 05:40:01.211988 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:01.211940    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpcgg\" (UniqueName: \"kubernetes.io/projected/65c94d62-9401-47be-b57d-abe4f26b0075-kube-api-access-wpcgg\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-r4mf8\" (UID: \"65c94d62-9401-47be-b57d-abe4f26b0075\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4mf8"
Nov 04 05:40:01.312591 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:01.312568    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65c94d62-9401-47be-b57d-abe4f26b0075-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-r4mf8\" (UID: \"65c94d62-9401-47be-b57d-abe4f26b0075\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4mf8"
Nov 04 05:40:01.312715 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:01.312600    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65c94d62-9401-47be-b57d-abe4f26b0075-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-r4mf8\" (UID: \"65c94d62-9401-47be-b57d-abe4f26b0075\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4mf8"
Nov 04 05:40:01.312715 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:01.312631    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65c94d62-9401-47be-b57d-abe4f26b0075-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-r4mf8\" (UID: \"65c94d62-9401-47be-b57d-abe4f26b0075\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4mf8"
Nov 04 05:40:01.312715 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:01.312651    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65c94d62-9401-47be-b57d-abe4f26b0075-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-r4mf8\" (UID: \"65c94d62-9401-47be-b57d-abe4f26b0075\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4mf8"
Nov 04 05:40:01.312715 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:01.312672    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65c94d62-9401-47be-b57d-abe4f26b0075-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-r4mf8\" (UID: \"65c94d62-9401-47be-b57d-abe4f26b0075\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4mf8"
Nov 04 05:40:01.312715 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:01.312689    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpcgg\" (UniqueName: \"kubernetes.io/projected/65c94d62-9401-47be-b57d-abe4f26b0075-kube-api-access-wpcgg\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-r4mf8\" (UID: \"65c94d62-9401-47be-b57d-abe4f26b0075\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4mf8"
Nov 04 05:40:01.313119 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:01.313000    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65c94d62-9401-47be-b57d-abe4f26b0075-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-r4mf8\" (UID: \"65c94d62-9401-47be-b57d-abe4f26b0075\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4mf8"
Nov 04 05:40:01.313119 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:01.313017    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65c94d62-9401-47be-b57d-abe4f26b0075-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-r4mf8\" (UID: \"65c94d62-9401-47be-b57d-abe4f26b0075\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4mf8"
Nov 04 05:40:01.313119 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:01.313083    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65c94d62-9401-47be-b57d-abe4f26b0075-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-r4mf8\" (UID: \"65c94d62-9401-47be-b57d-abe4f26b0075\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4mf8"
Nov 04 05:40:01.314841 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:01.314824    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65c94d62-9401-47be-b57d-abe4f26b0075-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-r4mf8\" (UID: \"65c94d62-9401-47be-b57d-abe4f26b0075\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4mf8"
Nov 04 05:40:01.315100 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:01.315083    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65c94d62-9401-47be-b57d-abe4f26b0075-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-r4mf8\" (UID: \"65c94d62-9401-47be-b57d-abe4f26b0075\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4mf8"
Nov 04 05:40:01.319621 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:01.319598    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpcgg\" (UniqueName: \"kubernetes.io/projected/65c94d62-9401-47be-b57d-abe4f26b0075-kube-api-access-wpcgg\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-r4mf8\" (UID: \"65c94d62-9401-47be-b57d-abe4f26b0075\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4mf8"
Nov 04 05:40:01.438980 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:01.438924    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4mf8"
Nov 04 05:40:01.706664 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:01.706467    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-r4mf8"]
Nov 04 05:40:01.709185 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:40:01.709147    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65c94d62_9401_47be_b57d_abe4f26b0075.slice/crio-e64bc7726d9e4f9fea580b1ba5c04d35a645aca149c40424ef34033851f3ff90 WatchSource:0}: Error finding container e64bc7726d9e4f9fea580b1ba5c04d35a645aca149c40424ef34033851f3ff90: Status 404 returned error can't find the container with id e64bc7726d9e4f9fea580b1ba5c04d35a645aca149c40424ef34033851f3ff90
Nov 04 05:40:02.619225 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:02.619186    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4mf8" event={"ID":"65c94d62-9401-47be-b57d-abe4f26b0075","Type":"ContainerStarted","Data":"e64bc7726d9e4f9fea580b1ba5c04d35a645aca149c40424ef34033851f3ff90"}
Nov 04 05:40:03.624216 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:03.624185    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4mf8" event={"ID":"65c94d62-9401-47be-b57d-abe4f26b0075","Type":"ContainerStarted","Data":"c138fd8ace66284de7dad0ac88db79a8e3772d27bbeb00fef2cd6b0bdfda76fb"}
Nov 04 05:40:03.648220 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:03.648171    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4mf8" podStartSLOduration=1.5114218689999999 podStartE2EDuration="2.64815935s" totalImagesPullingTime="1.136737481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:40:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:40:03.646733788 +0000 UTC m=+690.515397374" watchObservedRunningTime="2026-11-04 05:40:03.64815935 +0000 UTC m=+690.516822922"
Nov 04 05:40:04.440033 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:04.440003    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4mf8"
Nov 04 05:40:08.460374 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:08.460343    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-wnssk"]
Nov 04 05:40:08.463681 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:08.463655    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/echo-simulator-kserve-64b6f8f96c-wnssk"
Nov 04 05:40:08.473777 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:08.473753    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-wnssk"]
Nov 04 05:40:08.473905 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:08.473763    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"echo-simulator-kserve-self-signed-certs\""
Nov 04 05:40:08.569497 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:08.569471    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b398f61-5bce-4f2e-8302-dc73748baa37-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-wnssk\" (UID: \"7b398f61-5bce-4f2e-8302-dc73748baa37\") " pod="llm/echo-simulator-kserve-64b6f8f96c-wnssk"
Nov 04 05:40:08.569497 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:08.569500    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b398f61-5bce-4f2e-8302-dc73748baa37-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-wnssk\" (UID: \"7b398f61-5bce-4f2e-8302-dc73748baa37\") " pod="llm/echo-simulator-kserve-64b6f8f96c-wnssk"
Nov 04 05:40:08.569663 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:08.569615    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b398f61-5bce-4f2e-8302-dc73748baa37-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-wnssk\" (UID: \"7b398f61-5bce-4f2e-8302-dc73748baa37\") " pod="llm/echo-simulator-kserve-64b6f8f96c-wnssk"
Nov 04 05:40:08.569663 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:08.569642    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b398f61-5bce-4f2e-8302-dc73748baa37-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-wnssk\" (UID: \"7b398f61-5bce-4f2e-8302-dc73748baa37\") " pod="llm/echo-simulator-kserve-64b6f8f96c-wnssk"
Nov 04 05:40:08.569731 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:08.569672    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5x5nv\" (UniqueName: \"kubernetes.io/projected/7b398f61-5bce-4f2e-8302-dc73748baa37-kube-api-access-5x5nv\") pod \"echo-simulator-kserve-64b6f8f96c-wnssk\" (UID: \"7b398f61-5bce-4f2e-8302-dc73748baa37\") " pod="llm/echo-simulator-kserve-64b6f8f96c-wnssk"
Nov 04 05:40:08.569731 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:08.569711    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b398f61-5bce-4f2e-8302-dc73748baa37-home\") pod \"echo-simulator-kserve-64b6f8f96c-wnssk\" (UID: \"7b398f61-5bce-4f2e-8302-dc73748baa37\") " pod="llm/echo-simulator-kserve-64b6f8f96c-wnssk"
Nov 04 05:40:08.670747 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:08.670722    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b398f61-5bce-4f2e-8302-dc73748baa37-home\") pod \"echo-simulator-kserve-64b6f8f96c-wnssk\" (UID: \"7b398f61-5bce-4f2e-8302-dc73748baa37\") " pod="llm/echo-simulator-kserve-64b6f8f96c-wnssk"
Nov 04 05:40:08.670892 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:08.670753    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b398f61-5bce-4f2e-8302-dc73748baa37-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-wnssk\" (UID: \"7b398f61-5bce-4f2e-8302-dc73748baa37\") " pod="llm/echo-simulator-kserve-64b6f8f96c-wnssk"
Nov 04 05:40:08.670892 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:08.670773    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b398f61-5bce-4f2e-8302-dc73748baa37-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-wnssk\" (UID: \"7b398f61-5bce-4f2e-8302-dc73748baa37\") " pod="llm/echo-simulator-kserve-64b6f8f96c-wnssk"
Nov 04 05:40:08.670892 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:08.670831    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b398f61-5bce-4f2e-8302-dc73748baa37-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-wnssk\" (UID: \"7b398f61-5bce-4f2e-8302-dc73748baa37\") " pod="llm/echo-simulator-kserve-64b6f8f96c-wnssk"
Nov 04 05:40:08.670892 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:08.670874    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b398f61-5bce-4f2e-8302-dc73748baa37-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-wnssk\" (UID: \"7b398f61-5bce-4f2e-8302-dc73748baa37\") " pod="llm/echo-simulator-kserve-64b6f8f96c-wnssk"
Nov 04 05:40:08.671050 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:08.670924    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5x5nv\" (UniqueName: \"kubernetes.io/projected/7b398f61-5bce-4f2e-8302-dc73748baa37-kube-api-access-5x5nv\") pod \"echo-simulator-kserve-64b6f8f96c-wnssk\" (UID: \"7b398f61-5bce-4f2e-8302-dc73748baa37\") " pod="llm/echo-simulator-kserve-64b6f8f96c-wnssk"
Nov 04 05:40:08.671185 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:08.671157    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b398f61-5bce-4f2e-8302-dc73748baa37-home\") pod \"echo-simulator-kserve-64b6f8f96c-wnssk\" (UID: \"7b398f61-5bce-4f2e-8302-dc73748baa37\") " pod="llm/echo-simulator-kserve-64b6f8f96c-wnssk"
Nov 04 05:40:08.671273 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:08.671197    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b398f61-5bce-4f2e-8302-dc73748baa37-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-wnssk\" (UID: \"7b398f61-5bce-4f2e-8302-dc73748baa37\") " pod="llm/echo-simulator-kserve-64b6f8f96c-wnssk"
Nov 04 05:40:08.671273 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:08.671257    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b398f61-5bce-4f2e-8302-dc73748baa37-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-wnssk\" (UID: \"7b398f61-5bce-4f2e-8302-dc73748baa37\") " pod="llm/echo-simulator-kserve-64b6f8f96c-wnssk"
Nov 04 05:40:08.673155 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:08.673137    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b398f61-5bce-4f2e-8302-dc73748baa37-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-wnssk\" (UID: \"7b398f61-5bce-4f2e-8302-dc73748baa37\") " pod="llm/echo-simulator-kserve-64b6f8f96c-wnssk"
Nov 04 05:40:08.673346 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:08.673330    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b398f61-5bce-4f2e-8302-dc73748baa37-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-wnssk\" (UID: \"7b398f61-5bce-4f2e-8302-dc73748baa37\") " pod="llm/echo-simulator-kserve-64b6f8f96c-wnssk"
Nov 04 05:40:08.680665 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:08.680645    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5x5nv\" (UniqueName: \"kubernetes.io/projected/7b398f61-5bce-4f2e-8302-dc73748baa37-kube-api-access-5x5nv\") pod \"echo-simulator-kserve-64b6f8f96c-wnssk\" (UID: \"7b398f61-5bce-4f2e-8302-dc73748baa37\") " pod="llm/echo-simulator-kserve-64b6f8f96c-wnssk"
Nov 04 05:40:08.780144 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:08.780122    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/echo-simulator-kserve-64b6f8f96c-wnssk"
Nov 04 05:40:09.046994 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:09.046934    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-wnssk"]
Nov 04 05:40:09.050299 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:40:09.050273    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b398f61_5bce_4f2e_8302_dc73748baa37.slice/crio-fc19ad1d7769cbbf4d7ca99f1b9a6538b54d7402a4d780ee818eaa90f06b930c WatchSource:0}: Error finding container fc19ad1d7769cbbf4d7ca99f1b9a6538b54d7402a4d780ee818eaa90f06b930c: Status 404 returned error can't find the container with id fc19ad1d7769cbbf4d7ca99f1b9a6538b54d7402a4d780ee818eaa90f06b930c
Nov 04 05:40:09.646705 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:09.646670    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/echo-simulator-kserve-64b6f8f96c-wnssk" event={"ID":"7b398f61-5bce-4f2e-8302-dc73748baa37","Type":"ContainerStarted","Data":"fc19ad1d7769cbbf4d7ca99f1b9a6538b54d7402a4d780ee818eaa90f06b930c"}
Nov 04 05:40:10.903866 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:10.903835    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc"]
Nov 04 05:40:10.906996 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:10.906978    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc"
Nov 04 05:40:10.911163 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:10.911097    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Nov 04 05:40:10.919559 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:10.919533    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc"]
Nov 04 05:40:10.991721 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:10.991695    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20e1b7ee-3e36-4762-ad6e-5df2ce114a94-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc\" (UID: \"20e1b7ee-3e36-4762-ad6e-5df2ce114a94\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc"
Nov 04 05:40:10.991834 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:10.991732    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20e1b7ee-3e36-4762-ad6e-5df2ce114a94-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc\" (UID: \"20e1b7ee-3e36-4762-ad6e-5df2ce114a94\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc"
Nov 04 05:40:10.991834 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:10.991753    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dv2v\" (UniqueName: \"kubernetes.io/projected/20e1b7ee-3e36-4762-ad6e-5df2ce114a94-kube-api-access-8dv2v\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc\" (UID: \"20e1b7ee-3e36-4762-ad6e-5df2ce114a94\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc"
Nov 04 05:40:10.991834 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:10.991812    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20e1b7ee-3e36-4762-ad6e-5df2ce114a94-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc\" (UID: \"20e1b7ee-3e36-4762-ad6e-5df2ce114a94\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc"
Nov 04 05:40:10.991944 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:10.991930    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20e1b7ee-3e36-4762-ad6e-5df2ce114a94-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc\" (UID: \"20e1b7ee-3e36-4762-ad6e-5df2ce114a94\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc"
Nov 04 05:40:10.991978 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:10.991955    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20e1b7ee-3e36-4762-ad6e-5df2ce114a94-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc\" (UID: \"20e1b7ee-3e36-4762-ad6e-5df2ce114a94\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc"
Nov 04 05:40:11.092992 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:11.092958    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20e1b7ee-3e36-4762-ad6e-5df2ce114a94-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc\" (UID: \"20e1b7ee-3e36-4762-ad6e-5df2ce114a94\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc"
Nov 04 05:40:11.093123 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:11.093002    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dv2v\" (UniqueName: \"kubernetes.io/projected/20e1b7ee-3e36-4762-ad6e-5df2ce114a94-kube-api-access-8dv2v\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc\" (UID: \"20e1b7ee-3e36-4762-ad6e-5df2ce114a94\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc"
Nov 04 05:40:11.093123 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:11.093035    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20e1b7ee-3e36-4762-ad6e-5df2ce114a94-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc\" (UID: \"20e1b7ee-3e36-4762-ad6e-5df2ce114a94\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc"
Nov 04 05:40:11.093123 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:11.093076    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20e1b7ee-3e36-4762-ad6e-5df2ce114a94-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc\" (UID: \"20e1b7ee-3e36-4762-ad6e-5df2ce114a94\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc"
Nov 04 05:40:11.093123 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:11.093105    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20e1b7ee-3e36-4762-ad6e-5df2ce114a94-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc\" (UID: \"20e1b7ee-3e36-4762-ad6e-5df2ce114a94\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc"
Nov 04 05:40:11.093332 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:11.093180    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20e1b7ee-3e36-4762-ad6e-5df2ce114a94-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc\" (UID: \"20e1b7ee-3e36-4762-ad6e-5df2ce114a94\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc"
Nov 04 05:40:11.093379 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:11.093363    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20e1b7ee-3e36-4762-ad6e-5df2ce114a94-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc\" (UID: \"20e1b7ee-3e36-4762-ad6e-5df2ce114a94\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc"
Nov 04 05:40:11.093500 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:11.093481    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20e1b7ee-3e36-4762-ad6e-5df2ce114a94-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc\" (UID: \"20e1b7ee-3e36-4762-ad6e-5df2ce114a94\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc"
Nov 04 05:40:11.093601 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:11.093565    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20e1b7ee-3e36-4762-ad6e-5df2ce114a94-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc\" (UID: \"20e1b7ee-3e36-4762-ad6e-5df2ce114a94\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc"
Nov 04 05:40:11.095279 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:11.095253    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20e1b7ee-3e36-4762-ad6e-5df2ce114a94-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc\" (UID: \"20e1b7ee-3e36-4762-ad6e-5df2ce114a94\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc"
Nov 04 05:40:11.095619 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:11.095604    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20e1b7ee-3e36-4762-ad6e-5df2ce114a94-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc\" (UID: \"20e1b7ee-3e36-4762-ad6e-5df2ce114a94\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc"
Nov 04 05:40:11.100524 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:11.100496    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dv2v\" (UniqueName: \"kubernetes.io/projected/20e1b7ee-3e36-4762-ad6e-5df2ce114a94-kube-api-access-8dv2v\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc\" (UID: \"20e1b7ee-3e36-4762-ad6e-5df2ce114a94\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc"
Nov 04 05:40:11.219687 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:11.219638    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc"
Nov 04 05:40:11.439959 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:11.439931    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4mf8"
Nov 04 05:40:11.451996 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:11.451971    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4mf8"
Nov 04 05:40:11.488289 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:11.488228    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc"]
Nov 04 05:40:11.490986 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:40:11.490964    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20e1b7ee_3e36_4762_ad6e_5df2ce114a94.slice/crio-1284953becc0b2c2871940876809cbf1150c412e9ebd4d6550005ebeffc96c15 WatchSource:0}: Error finding container 1284953becc0b2c2871940876809cbf1150c412e9ebd4d6550005ebeffc96c15: Status 404 returned error can't find the container with id 1284953becc0b2c2871940876809cbf1150c412e9ebd4d6550005ebeffc96c15
Nov 04 05:40:11.531662 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:11.531635    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp"]
Nov 04 05:40:11.536336 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:11.536313    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp"
Nov 04 05:40:11.543014 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:11.542989    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Nov 04 05:40:11.544408 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:11.544389    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp"]
Nov 04 05:40:11.655578 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:11.655543    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/echo-simulator-kserve-64b6f8f96c-wnssk" event={"ID":"7b398f61-5bce-4f2e-8302-dc73748baa37","Type":"ContainerStarted","Data":"4ff40352c727fb3dfd1ea05cabf3938da00ba75e7aa805a7ecfc615f6b438d28"}
Nov 04 05:40:11.656812 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:11.656786    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc" event={"ID":"20e1b7ee-3e36-4762-ad6e-5df2ce114a94","Type":"ContainerStarted","Data":"1284953becc0b2c2871940876809cbf1150c412e9ebd4d6550005ebeffc96c15"}
Nov 04 05:40:11.668256 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:11.668238    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-r4mf8"
Nov 04 05:40:11.676133 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:11.676095    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/echo-simulator-kserve-64b6f8f96c-wnssk" podStartSLOduration=2.067222997 podStartE2EDuration="3.676081576s" totalImagesPullingTime="1.608858579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:40:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:40:11.675202106 +0000 UTC m=+698.543865678" watchObservedRunningTime="2026-11-04 05:40:11.676081576 +0000 UTC m=+698.544745177"
Nov 04 05:40:11.698575 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:11.698553    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56e89fbc-a03a-41fb-889e-4d96335c66f5-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp\" (UID: \"56e89fbc-a03a-41fb-889e-4d96335c66f5\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp"
Nov 04 05:40:11.698679 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:11.698593    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs6kf\" (UniqueName: \"kubernetes.io/projected/56e89fbc-a03a-41fb-889e-4d96335c66f5-kube-api-access-xs6kf\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp\" (UID: \"56e89fbc-a03a-41fb-889e-4d96335c66f5\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp"
Nov 04 05:40:11.698679 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:11.698628    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56e89fbc-a03a-41fb-889e-4d96335c66f5-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp\" (UID: \"56e89fbc-a03a-41fb-889e-4d96335c66f5\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp"
Nov 04 05:40:11.698774 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:11.698756    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56e89fbc-a03a-41fb-889e-4d96335c66f5-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp\" (UID: \"56e89fbc-a03a-41fb-889e-4d96335c66f5\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp"
Nov 04 05:40:11.698819 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:11.698792    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56e89fbc-a03a-41fb-889e-4d96335c66f5-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp\" (UID: \"56e89fbc-a03a-41fb-889e-4d96335c66f5\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp"
Nov 04 05:40:11.698819 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:11.698815    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56e89fbc-a03a-41fb-889e-4d96335c66f5-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp\" (UID: \"56e89fbc-a03a-41fb-889e-4d96335c66f5\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp"
Nov 04 05:40:11.780626 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:11.780603    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/echo-simulator-kserve-64b6f8f96c-wnssk"
Nov 04 05:40:11.799563 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:11.799535    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xs6kf\" (UniqueName: \"kubernetes.io/projected/56e89fbc-a03a-41fb-889e-4d96335c66f5-kube-api-access-xs6kf\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp\" (UID: \"56e89fbc-a03a-41fb-889e-4d96335c66f5\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp"
Nov 04 05:40:11.799681 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:11.799627    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56e89fbc-a03a-41fb-889e-4d96335c66f5-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp\" (UID: \"56e89fbc-a03a-41fb-889e-4d96335c66f5\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp"
Nov 04 05:40:11.799743 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:11.799709    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56e89fbc-a03a-41fb-889e-4d96335c66f5-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp\" (UID: \"56e89fbc-a03a-41fb-889e-4d96335c66f5\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp"
Nov 04 05:40:11.799805 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:11.799741    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56e89fbc-a03a-41fb-889e-4d96335c66f5-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp\" (UID: \"56e89fbc-a03a-41fb-889e-4d96335c66f5\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp"
Nov 04 05:40:11.799805 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:11.799773    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56e89fbc-a03a-41fb-889e-4d96335c66f5-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp\" (UID: \"56e89fbc-a03a-41fb-889e-4d96335c66f5\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp"
Nov 04 05:40:11.799922 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:11.799845    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56e89fbc-a03a-41fb-889e-4d96335c66f5-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp\" (UID: \"56e89fbc-a03a-41fb-889e-4d96335c66f5\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp"
Nov 04 05:40:11.800392 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:11.800149    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56e89fbc-a03a-41fb-889e-4d96335c66f5-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp\" (UID: \"56e89fbc-a03a-41fb-889e-4d96335c66f5\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp"
Nov 04 05:40:11.800392 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:11.800278    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56e89fbc-a03a-41fb-889e-4d96335c66f5-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp\" (UID: \"56e89fbc-a03a-41fb-889e-4d96335c66f5\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp"
Nov 04 05:40:11.800392 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:11.800303    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56e89fbc-a03a-41fb-889e-4d96335c66f5-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp\" (UID: \"56e89fbc-a03a-41fb-889e-4d96335c66f5\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp"
Nov 04 05:40:11.802351 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:11.802323    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56e89fbc-a03a-41fb-889e-4d96335c66f5-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp\" (UID: \"56e89fbc-a03a-41fb-889e-4d96335c66f5\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp"
Nov 04 05:40:11.802702 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:11.802681    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56e89fbc-a03a-41fb-889e-4d96335c66f5-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp\" (UID: \"56e89fbc-a03a-41fb-889e-4d96335c66f5\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp"
Nov 04 05:40:11.807866 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:11.807842    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs6kf\" (UniqueName: \"kubernetes.io/projected/56e89fbc-a03a-41fb-889e-4d96335c66f5-kube-api-access-xs6kf\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp\" (UID: \"56e89fbc-a03a-41fb-889e-4d96335c66f5\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp"
Nov 04 05:40:11.858706 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:11.858685    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp"
Nov 04 05:40:12.130993 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:12.130968    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp"]
Nov 04 05:40:12.132768 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:40:12.132740    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod56e89fbc_a03a_41fb_889e_4d96335c66f5.slice/crio-e04afd715056ed467feeb5c8fc4290609ce893ac14cc609554e8ab14597463fd WatchSource:0}: Error finding container e04afd715056ed467feeb5c8fc4290609ce893ac14cc609554e8ab14597463fd: Status 404 returned error can't find the container with id e04afd715056ed467feeb5c8fc4290609ce893ac14cc609554e8ab14597463fd
Nov 04 05:40:12.667021 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:12.666983    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc" event={"ID":"20e1b7ee-3e36-4762-ad6e-5df2ce114a94","Type":"ContainerStarted","Data":"b5bcfbf2caea1dbbc106b929e6a100053a7316b51cd2e06901deaac3486b168c"}
Nov 04 05:40:12.668444 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:12.668416    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp" event={"ID":"56e89fbc-a03a-41fb-889e-4d96335c66f5","Type":"ContainerStarted","Data":"253931ce8076ac2bc9ec5bc10227e7c7c813192e9599a4373d35d551cfbbe59b"}
Nov 04 05:40:12.668591 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:12.668450    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp" event={"ID":"56e89fbc-a03a-41fb-889e-4d96335c66f5","Type":"ContainerStarted","Data":"e04afd715056ed467feeb5c8fc4290609ce893ac14cc609554e8ab14597463fd"}
Nov 04 05:40:12.684463 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:12.684421    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc" podStartSLOduration=2.405333763 podStartE2EDuration="2.684409396s" totalImagesPullingTime="279.075633ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:40:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:40:12.682577495 +0000 UTC m=+699.551241066" watchObservedRunningTime="2026-11-04 05:40:12.684409396 +0000 UTC m=+699.553072968"
Nov 04 05:40:12.700625 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:12.700451    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp" podStartSLOduration=1.375154469 podStartE2EDuration="1.700438037s" totalImagesPullingTime="325.283568ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:40:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:40:12.69964448 +0000 UTC m=+699.568308052" watchObservedRunningTime="2026-11-04 05:40:12.700438037 +0000 UTC m=+699.569101610"
Nov 04 05:40:12.859665 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:12.859639    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp"
Nov 04 05:40:13.220206 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:13.220135    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc"
Nov 04 05:40:17.273710 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:40:17.273677    4357 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-npgcv" containerName="extractor"
Nov 04 05:40:18.781126 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:18.781094    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/echo-simulator-kserve-64b6f8f96c-wnssk"
Nov 04 05:40:18.793629 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:18.793609    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/echo-simulator-kserve-64b6f8f96c-wnssk"
Nov 04 05:40:19.706029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:19.705998    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/echo-simulator-kserve-64b6f8f96c-wnssk"
Nov 04 05:40:21.220080 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:21.220047    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc"
Nov 04 05:40:21.232313 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:21.232290    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc"
Nov 04 05:40:21.715532 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:21.715498    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc"
Nov 04 05:40:21.859347 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:21.859316    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp"
Nov 04 05:40:21.871263 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:21.871244    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp"
Nov 04 05:40:22.718624 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:22.718599    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp"
Nov 04 05:40:23.614185 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:23.614155    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7"]
Nov 04 05:40:23.617147 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:23.617129    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7"
Nov 04 05:40:23.623228 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:23.623207    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-j9xrs\""
Nov 04 05:40:23.628276 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:23.628255    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7"]
Nov 04 05:40:23.790489 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:23.790460    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23621eda-9b88-47e0-ba15-d45035dd4b3e-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-f2ws7\" (UID: \"23621eda-9b88-47e0-ba15-d45035dd4b3e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7"
Nov 04 05:40:23.790943 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:23.790500    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23621eda-9b88-47e0-ba15-d45035dd4b3e-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-f2ws7\" (UID: \"23621eda-9b88-47e0-ba15-d45035dd4b3e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7"
Nov 04 05:40:23.790943 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:23.790607    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23621eda-9b88-47e0-ba15-d45035dd4b3e-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-f2ws7\" (UID: \"23621eda-9b88-47e0-ba15-d45035dd4b3e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7"
Nov 04 05:40:23.790943 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:23.790652    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23621eda-9b88-47e0-ba15-d45035dd4b3e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-f2ws7\" (UID: \"23621eda-9b88-47e0-ba15-d45035dd4b3e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7"
Nov 04 05:40:23.790943 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:23.790722    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xm8k6\" (UniqueName: \"kubernetes.io/projected/23621eda-9b88-47e0-ba15-d45035dd4b3e-kube-api-access-xm8k6\") pod \"maas-default-gateway-openshift-default-694db55c87-f2ws7\" (UID: \"23621eda-9b88-47e0-ba15-d45035dd4b3e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7"
Nov 04 05:40:23.790943 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:23.790751    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23621eda-9b88-47e0-ba15-d45035dd4b3e-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-f2ws7\" (UID: \"23621eda-9b88-47e0-ba15-d45035dd4b3e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7"
Nov 04 05:40:23.790943 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:23.790785    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23621eda-9b88-47e0-ba15-d45035dd4b3e-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-f2ws7\" (UID: \"23621eda-9b88-47e0-ba15-d45035dd4b3e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7"
Nov 04 05:40:23.790943 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:23.790817    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23621eda-9b88-47e0-ba15-d45035dd4b3e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-f2ws7\" (UID: \"23621eda-9b88-47e0-ba15-d45035dd4b3e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7"
Nov 04 05:40:23.790943 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:23.790903    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23621eda-9b88-47e0-ba15-d45035dd4b3e-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-f2ws7\" (UID: \"23621eda-9b88-47e0-ba15-d45035dd4b3e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7"
Nov 04 05:40:23.891251 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:23.891176    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23621eda-9b88-47e0-ba15-d45035dd4b3e-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-f2ws7\" (UID: \"23621eda-9b88-47e0-ba15-d45035dd4b3e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7"
Nov 04 05:40:23.891251 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:23.891225    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23621eda-9b88-47e0-ba15-d45035dd4b3e-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-f2ws7\" (UID: \"23621eda-9b88-47e0-ba15-d45035dd4b3e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7"
Nov 04 05:40:23.891437 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:23.891350    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23621eda-9b88-47e0-ba15-d45035dd4b3e-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-f2ws7\" (UID: \"23621eda-9b88-47e0-ba15-d45035dd4b3e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7"
Nov 04 05:40:23.891437 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:23.891391    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23621eda-9b88-47e0-ba15-d45035dd4b3e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-f2ws7\" (UID: \"23621eda-9b88-47e0-ba15-d45035dd4b3e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7"
Nov 04 05:40:23.891437 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:23.891427    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xm8k6\" (UniqueName: \"kubernetes.io/projected/23621eda-9b88-47e0-ba15-d45035dd4b3e-kube-api-access-xm8k6\") pod \"maas-default-gateway-openshift-default-694db55c87-f2ws7\" (UID: \"23621eda-9b88-47e0-ba15-d45035dd4b3e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7"
Nov 04 05:40:23.891604 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:23.891457    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23621eda-9b88-47e0-ba15-d45035dd4b3e-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-f2ws7\" (UID: \"23621eda-9b88-47e0-ba15-d45035dd4b3e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7"
Nov 04 05:40:23.891604 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:23.891503    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23621eda-9b88-47e0-ba15-d45035dd4b3e-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-f2ws7\" (UID: \"23621eda-9b88-47e0-ba15-d45035dd4b3e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7"
Nov 04 05:40:23.891604 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:23.891549    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23621eda-9b88-47e0-ba15-d45035dd4b3e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-f2ws7\" (UID: \"23621eda-9b88-47e0-ba15-d45035dd4b3e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7"
Nov 04 05:40:23.891604 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:23.891589    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23621eda-9b88-47e0-ba15-d45035dd4b3e-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-f2ws7\" (UID: \"23621eda-9b88-47e0-ba15-d45035dd4b3e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7"
Nov 04 05:40:23.891774 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:23.891762    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23621eda-9b88-47e0-ba15-d45035dd4b3e-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-f2ws7\" (UID: \"23621eda-9b88-47e0-ba15-d45035dd4b3e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7"
Nov 04 05:40:23.891857 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:23.891834    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23621eda-9b88-47e0-ba15-d45035dd4b3e-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-f2ws7\" (UID: \"23621eda-9b88-47e0-ba15-d45035dd4b3e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7"
Nov 04 05:40:23.891955 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:23.891868    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23621eda-9b88-47e0-ba15-d45035dd4b3e-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-f2ws7\" (UID: \"23621eda-9b88-47e0-ba15-d45035dd4b3e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7"
Nov 04 05:40:23.891955 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:23.891926    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23621eda-9b88-47e0-ba15-d45035dd4b3e-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-f2ws7\" (UID: \"23621eda-9b88-47e0-ba15-d45035dd4b3e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7"
Nov 04 05:40:23.892312 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:23.892291    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23621eda-9b88-47e0-ba15-d45035dd4b3e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-f2ws7\" (UID: \"23621eda-9b88-47e0-ba15-d45035dd4b3e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7"
Nov 04 05:40:23.893704 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:23.893679    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23621eda-9b88-47e0-ba15-d45035dd4b3e-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-f2ws7\" (UID: \"23621eda-9b88-47e0-ba15-d45035dd4b3e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7"
Nov 04 05:40:23.894028 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:23.894005    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23621eda-9b88-47e0-ba15-d45035dd4b3e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-f2ws7\" (UID: \"23621eda-9b88-47e0-ba15-d45035dd4b3e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7"
Nov 04 05:40:23.899102 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:23.899084    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xm8k6\" (UniqueName: \"kubernetes.io/projected/23621eda-9b88-47e0-ba15-d45035dd4b3e-kube-api-access-xm8k6\") pod \"maas-default-gateway-openshift-default-694db55c87-f2ws7\" (UID: \"23621eda-9b88-47e0-ba15-d45035dd4b3e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7"
Nov 04 05:40:23.899201 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:23.899182    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23621eda-9b88-47e0-ba15-d45035dd4b3e-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-f2ws7\" (UID: \"23621eda-9b88-47e0-ba15-d45035dd4b3e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7"
Nov 04 05:40:23.930024 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:23.930003    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7"
Nov 04 05:40:24.202331 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:24.202308    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7"]
Nov 04 05:40:24.204406 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:40:24.204376    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23621eda_9b88_47e0_ba15_d45035dd4b3e.slice/crio-27dda2dfe9b0978908750fd81a650688f269575ea9bbc7c4db801f9c76549491 WatchSource:0}: Error finding container 27dda2dfe9b0978908750fd81a650688f269575ea9bbc7c4db801f9c76549491: Status 404 returned error can't find the container with id 27dda2dfe9b0978908750fd81a650688f269575ea9bbc7c4db801f9c76549491
Nov 04 05:40:24.717181 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:24.717151    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7" event={"ID":"23621eda-9b88-47e0-ba15-d45035dd4b3e","Type":"ContainerStarted","Data":"27dda2dfe9b0978908750fd81a650688f269575ea9bbc7c4db801f9c76549491"}
Nov 04 05:40:27.208459 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:27.208409    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:40:27.208709 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:27.208499    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:40:27.208709 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:27.208607    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:40:27.730497 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:27.730460    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7" event={"ID":"23621eda-9b88-47e0-ba15-d45035dd4b3e","Type":"ContainerStarted","Data":"19515dd92077612b2ce66ff2ce59428f262cb29c2223a56fdbe619263721f578"}
Nov 04 05:40:27.755320 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:27.755265    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7" podStartSLOduration=1.754423594 podStartE2EDuration="4.755251711s" totalImagesPullingTime="3.000828117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:40:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:40:27.752497399 +0000 UTC m=+714.621160985" watchObservedRunningTime="2026-11-04 05:40:27.755251711 +0000 UTC m=+714.623915286"
Nov 04 05:40:27.930912 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:27.930873    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7"
Nov 04 05:40:28.932110 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:28.932067    4357 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-f2ws7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body=
Nov 04 05:40:28.932582 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:28.932126    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7" podUID="23621eda-9b88-47e0-ba15-d45035dd4b3e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused"
Nov 04 05:40:29.931246 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:29.931211    4357 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-f2ws7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body=
Nov 04 05:40:29.931422 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:29.931276    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7" podUID="23621eda-9b88-47e0-ba15-d45035dd4b3e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused"
Nov 04 05:40:30.931065 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:30.930981    4357 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-f2ws7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body=
Nov 04 05:40:30.931065 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:30.931051    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7" podUID="23621eda-9b88-47e0-ba15-d45035dd4b3e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused"
Nov 04 05:40:31.930910 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:31.930874    4357 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-f2ws7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body=
Nov 04 05:40:31.931083 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:31.930942    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7" podUID="23621eda-9b88-47e0-ba15-d45035dd4b3e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused"
Nov 04 05:40:32.930564 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:32.930507    4357 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-f2ws7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body=
Nov 04 05:40:32.930821 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:32.930582    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7" podUID="23621eda-9b88-47e0-ba15-d45035dd4b3e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused"
Nov 04 05:40:33.930954 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:33.930911    4357 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-f2ws7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body=
Nov 04 05:40:33.931325 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:33.930996    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7" podUID="23621eda-9b88-47e0-ba15-d45035dd4b3e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused"
Nov 04 05:40:35.738048 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:35.738011    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7"
Nov 04 05:40:35.738504 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:35.738342    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7"
Nov 04 05:40:35.739211 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:35.739191    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7"
Nov 04 05:40:47.274650 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:40:47.274610    4357 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-npgcv" containerName="extractor"
Nov 04 05:40:53.659531 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.659493    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4"]
Nov 04 05:40:53.662864 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.662836    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4"
Nov 04 05:40:53.680899 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.680873    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4"]
Nov 04 05:40:53.689672 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.689651    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8"]
Nov 04 05:40:53.693019 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.693001    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8"
Nov 04 05:40:53.703340 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.703313    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8"]
Nov 04 05:40:53.741979 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.741953    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d011c75-4c48-46b9-920b-d7fa63ecdc3a-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-4l7f4\" (UID: \"7d011c75-4c48-46b9-920b-d7fa63ecdc3a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4"
Nov 04 05:40:53.742091 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.741991    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d011c75-4c48-46b9-920b-d7fa63ecdc3a-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-4l7f4\" (UID: \"7d011c75-4c48-46b9-920b-d7fa63ecdc3a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4"
Nov 04 05:40:53.742091 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.742015    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d011c75-4c48-46b9-920b-d7fa63ecdc3a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-4l7f4\" (UID: \"7d011c75-4c48-46b9-920b-d7fa63ecdc3a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4"
Nov 04 05:40:53.742091 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.742069    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsm5h\" (UniqueName: \"kubernetes.io/projected/7d011c75-4c48-46b9-920b-d7fa63ecdc3a-kube-api-access-lsm5h\") pod \"maas-default-gateway-openshift-default-694db55c87-4l7f4\" (UID: \"7d011c75-4c48-46b9-920b-d7fa63ecdc3a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4"
Nov 04 05:40:53.742215 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.742161    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d011c75-4c48-46b9-920b-d7fa63ecdc3a-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-4l7f4\" (UID: \"7d011c75-4c48-46b9-920b-d7fa63ecdc3a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4"
Nov 04 05:40:53.742215 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.742201    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d011c75-4c48-46b9-920b-d7fa63ecdc3a-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-4l7f4\" (UID: \"7d011c75-4c48-46b9-920b-d7fa63ecdc3a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4"
Nov 04 05:40:53.742287 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.742271    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d011c75-4c48-46b9-920b-d7fa63ecdc3a-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-4l7f4\" (UID: \"7d011c75-4c48-46b9-920b-d7fa63ecdc3a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4"
Nov 04 05:40:53.742332 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.742319    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d011c75-4c48-46b9-920b-d7fa63ecdc3a-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-4l7f4\" (UID: \"7d011c75-4c48-46b9-920b-d7fa63ecdc3a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4"
Nov 04 05:40:53.742374 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.742355    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d011c75-4c48-46b9-920b-d7fa63ecdc3a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-4l7f4\" (UID: \"7d011c75-4c48-46b9-920b-d7fa63ecdc3a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4"
Nov 04 05:40:53.842890 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.842861    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d011c75-4c48-46b9-920b-d7fa63ecdc3a-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-4l7f4\" (UID: \"7d011c75-4c48-46b9-920b-d7fa63ecdc3a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4"
Nov 04 05:40:53.843078 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.842896    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d011c75-4c48-46b9-920b-d7fa63ecdc3a-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-4l7f4\" (UID: \"7d011c75-4c48-46b9-920b-d7fa63ecdc3a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4"
Nov 04 05:40:53.843078 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.842919    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf2qx\" (UniqueName: \"kubernetes.io/projected/de916aeb-4496-4195-9c41-07b2c92f3bd7-kube-api-access-xf2qx\") pod \"maas-default-gateway-openshift-default-694db55c87-6x6f8\" (UID: \"de916aeb-4496-4195-9c41-07b2c92f3bd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8"
Nov 04 05:40:53.843078 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.842939    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de916aeb-4496-4195-9c41-07b2c92f3bd7-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-6x6f8\" (UID: \"de916aeb-4496-4195-9c41-07b2c92f3bd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8"
Nov 04 05:40:53.843078 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.842958    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d011c75-4c48-46b9-920b-d7fa63ecdc3a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-4l7f4\" (UID: \"7d011c75-4c48-46b9-920b-d7fa63ecdc3a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4"
Nov 04 05:40:53.843078 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.843005    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsm5h\" (UniqueName: \"kubernetes.io/projected/7d011c75-4c48-46b9-920b-d7fa63ecdc3a-kube-api-access-lsm5h\") pod \"maas-default-gateway-openshift-default-694db55c87-4l7f4\" (UID: \"7d011c75-4c48-46b9-920b-d7fa63ecdc3a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4"
Nov 04 05:40:53.843353 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.843076    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de916aeb-4496-4195-9c41-07b2c92f3bd7-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-6x6f8\" (UID: \"de916aeb-4496-4195-9c41-07b2c92f3bd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8"
Nov 04 05:40:53.843353 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.843111    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de916aeb-4496-4195-9c41-07b2c92f3bd7-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-6x6f8\" (UID: \"de916aeb-4496-4195-9c41-07b2c92f3bd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8"
Nov 04 05:40:53.843353 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.843168    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d011c75-4c48-46b9-920b-d7fa63ecdc3a-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-4l7f4\" (UID: \"7d011c75-4c48-46b9-920b-d7fa63ecdc3a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4"
Nov 04 05:40:53.843353 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.843190    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d011c75-4c48-46b9-920b-d7fa63ecdc3a-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-4l7f4\" (UID: \"7d011c75-4c48-46b9-920b-d7fa63ecdc3a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4"
Nov 04 05:40:53.843353 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.843217    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d011c75-4c48-46b9-920b-d7fa63ecdc3a-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-4l7f4\" (UID: \"7d011c75-4c48-46b9-920b-d7fa63ecdc3a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4"
Nov 04 05:40:53.843353 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.843250    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d011c75-4c48-46b9-920b-d7fa63ecdc3a-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-4l7f4\" (UID: \"7d011c75-4c48-46b9-920b-d7fa63ecdc3a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4"
Nov 04 05:40:53.843353 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.843268    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de916aeb-4496-4195-9c41-07b2c92f3bd7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-6x6f8\" (UID: \"de916aeb-4496-4195-9c41-07b2c92f3bd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8"
Nov 04 05:40:53.843353 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.843286    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de916aeb-4496-4195-9c41-07b2c92f3bd7-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-6x6f8\" (UID: \"de916aeb-4496-4195-9c41-07b2c92f3bd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8"
Nov 04 05:40:53.843353 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.843322    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d011c75-4c48-46b9-920b-d7fa63ecdc3a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-4l7f4\" (UID: \"7d011c75-4c48-46b9-920b-d7fa63ecdc3a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4"
Nov 04 05:40:53.843353 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.843324    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d011c75-4c48-46b9-920b-d7fa63ecdc3a-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-4l7f4\" (UID: \"7d011c75-4c48-46b9-920b-d7fa63ecdc3a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4"
Nov 04 05:40:53.843353 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.843337    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de916aeb-4496-4195-9c41-07b2c92f3bd7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-6x6f8\" (UID: \"de916aeb-4496-4195-9c41-07b2c92f3bd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8"
Nov 04 05:40:53.843353 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.843336    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d011c75-4c48-46b9-920b-d7fa63ecdc3a-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-4l7f4\" (UID: \"7d011c75-4c48-46b9-920b-d7fa63ecdc3a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4"
Nov 04 05:40:53.844063 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.843484    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de916aeb-4496-4195-9c41-07b2c92f3bd7-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-6x6f8\" (UID: \"de916aeb-4496-4195-9c41-07b2c92f3bd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8"
Nov 04 05:40:53.844063 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.843584    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de916aeb-4496-4195-9c41-07b2c92f3bd7-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-6x6f8\" (UID: \"de916aeb-4496-4195-9c41-07b2c92f3bd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8"
Nov 04 05:40:53.844063 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.843607    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d011c75-4c48-46b9-920b-d7fa63ecdc3a-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-4l7f4\" (UID: \"7d011c75-4c48-46b9-920b-d7fa63ecdc3a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4"
Nov 04 05:40:53.844063 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.843701    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d011c75-4c48-46b9-920b-d7fa63ecdc3a-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-4l7f4\" (UID: \"7d011c75-4c48-46b9-920b-d7fa63ecdc3a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4"
Nov 04 05:40:53.844185 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.844116    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d011c75-4c48-46b9-920b-d7fa63ecdc3a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-4l7f4\" (UID: \"7d011c75-4c48-46b9-920b-d7fa63ecdc3a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4"
Nov 04 05:40:53.845292 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.845265    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d011c75-4c48-46b9-920b-d7fa63ecdc3a-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-4l7f4\" (UID: \"7d011c75-4c48-46b9-920b-d7fa63ecdc3a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4"
Nov 04 05:40:53.845559 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.845541    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d011c75-4c48-46b9-920b-d7fa63ecdc3a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-4l7f4\" (UID: \"7d011c75-4c48-46b9-920b-d7fa63ecdc3a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4"
Nov 04 05:40:53.853806 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.853785    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsm5h\" (UniqueName: \"kubernetes.io/projected/7d011c75-4c48-46b9-920b-d7fa63ecdc3a-kube-api-access-lsm5h\") pod \"maas-default-gateway-openshift-default-694db55c87-4l7f4\" (UID: \"7d011c75-4c48-46b9-920b-d7fa63ecdc3a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4"
Nov 04 05:40:53.853912 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.853850    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d011c75-4c48-46b9-920b-d7fa63ecdc3a-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-4l7f4\" (UID: \"7d011c75-4c48-46b9-920b-d7fa63ecdc3a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4"
Nov 04 05:40:53.943993 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.943942    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de916aeb-4496-4195-9c41-07b2c92f3bd7-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-6x6f8\" (UID: \"de916aeb-4496-4195-9c41-07b2c92f3bd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8"
Nov 04 05:40:53.943993 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.943976    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de916aeb-4496-4195-9c41-07b2c92f3bd7-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-6x6f8\" (UID: \"de916aeb-4496-4195-9c41-07b2c92f3bd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8"
Nov 04 05:40:53.944111 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.944019    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf2qx\" (UniqueName: \"kubernetes.io/projected/de916aeb-4496-4195-9c41-07b2c92f3bd7-kube-api-access-xf2qx\") pod \"maas-default-gateway-openshift-default-694db55c87-6x6f8\" (UID: \"de916aeb-4496-4195-9c41-07b2c92f3bd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8"
Nov 04 05:40:53.944111 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.944043    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de916aeb-4496-4195-9c41-07b2c92f3bd7-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-6x6f8\" (UID: \"de916aeb-4496-4195-9c41-07b2c92f3bd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8"
Nov 04 05:40:53.944111 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.944060    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de916aeb-4496-4195-9c41-07b2c92f3bd7-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-6x6f8\" (UID: \"de916aeb-4496-4195-9c41-07b2c92f3bd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8"
Nov 04 05:40:53.944111 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.944087    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de916aeb-4496-4195-9c41-07b2c92f3bd7-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-6x6f8\" (UID: \"de916aeb-4496-4195-9c41-07b2c92f3bd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8"
Nov 04 05:40:53.944237 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.944146    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de916aeb-4496-4195-9c41-07b2c92f3bd7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-6x6f8\" (UID: \"de916aeb-4496-4195-9c41-07b2c92f3bd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8"
Nov 04 05:40:53.944237 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.944173    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de916aeb-4496-4195-9c41-07b2c92f3bd7-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-6x6f8\" (UID: \"de916aeb-4496-4195-9c41-07b2c92f3bd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8"
Nov 04 05:40:53.944237 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.944217    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de916aeb-4496-4195-9c41-07b2c92f3bd7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-6x6f8\" (UID: \"de916aeb-4496-4195-9c41-07b2c92f3bd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8"
Nov 04 05:40:53.944580 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.944545    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de916aeb-4496-4195-9c41-07b2c92f3bd7-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-6x6f8\" (UID: \"de916aeb-4496-4195-9c41-07b2c92f3bd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8"
Nov 04 05:40:53.944664 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.944622    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de916aeb-4496-4195-9c41-07b2c92f3bd7-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-6x6f8\" (UID: \"de916aeb-4496-4195-9c41-07b2c92f3bd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8"
Nov 04 05:40:53.944716 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.944660    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de916aeb-4496-4195-9c41-07b2c92f3bd7-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-6x6f8\" (UID: \"de916aeb-4496-4195-9c41-07b2c92f3bd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8"
Nov 04 05:40:53.944716 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.944686    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de916aeb-4496-4195-9c41-07b2c92f3bd7-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-6x6f8\" (UID: \"de916aeb-4496-4195-9c41-07b2c92f3bd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8"
Nov 04 05:40:53.945045 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.945023    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de916aeb-4496-4195-9c41-07b2c92f3bd7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-6x6f8\" (UID: \"de916aeb-4496-4195-9c41-07b2c92f3bd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8"
Nov 04 05:40:53.946086 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.946063    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de916aeb-4496-4195-9c41-07b2c92f3bd7-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-6x6f8\" (UID: \"de916aeb-4496-4195-9c41-07b2c92f3bd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8"
Nov 04 05:40:53.946368 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.946351    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de916aeb-4496-4195-9c41-07b2c92f3bd7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-6x6f8\" (UID: \"de916aeb-4496-4195-9c41-07b2c92f3bd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8"
Nov 04 05:40:53.951583 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.951565    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de916aeb-4496-4195-9c41-07b2c92f3bd7-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-6x6f8\" (UID: \"de916aeb-4496-4195-9c41-07b2c92f3bd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8"
Nov 04 05:40:53.951744 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.951721    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf2qx\" (UniqueName: \"kubernetes.io/projected/de916aeb-4496-4195-9c41-07b2c92f3bd7-kube-api-access-xf2qx\") pod \"maas-default-gateway-openshift-default-694db55c87-6x6f8\" (UID: \"de916aeb-4496-4195-9c41-07b2c92f3bd7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8"
Nov 04 05:40:53.982400 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:53.982377    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4"
Nov 04 05:40:54.029206 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:54.029175    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8"
Nov 04 05:40:54.268669 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:54.268250    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4"]
Nov 04 05:40:54.271204 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:40:54.271073    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d011c75_4c48_46b9_920b_d7fa63ecdc3a.slice/crio-753025d512910e75692c2b7996e79aa3fadec35ff44a086d9640106d76c04131 WatchSource:0}: Error finding container 753025d512910e75692c2b7996e79aa3fadec35ff44a086d9640106d76c04131: Status 404 returned error can't find the container with id 753025d512910e75692c2b7996e79aa3fadec35ff44a086d9640106d76c04131
Nov 04 05:40:54.274012 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:54.273977    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:40:54.274098 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:54.274080    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:40:54.274148 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:54.274132    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:40:54.317946 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:54.317915    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8"]
Nov 04 05:40:54.321110 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:40:54.321034    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde916aeb_4496_4195_9c41_07b2c92f3bd7.slice/crio-2c3a22fe4e90edf55cba908b01ad843402729572f3138ab3bda185212e33851f WatchSource:0}: Error finding container 2c3a22fe4e90edf55cba908b01ad843402729572f3138ab3bda185212e33851f: Status 404 returned error can't find the container with id 2c3a22fe4e90edf55cba908b01ad843402729572f3138ab3bda185212e33851f
Nov 04 05:40:54.323745 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:54.323706    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:40:54.323845 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:54.323786    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:40:54.323845 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:54.323833    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:40:54.842884 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:54.837651    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4" event={"ID":"7d011c75-4c48-46b9-920b-d7fa63ecdc3a","Type":"ContainerStarted","Data":"2a88d0f67c31c993ff8422acf9334a5496895b37b65b24b2a6ad3661b99a094a"}
Nov 04 05:40:54.842884 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:54.837716    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4" event={"ID":"7d011c75-4c48-46b9-920b-d7fa63ecdc3a","Type":"ContainerStarted","Data":"753025d512910e75692c2b7996e79aa3fadec35ff44a086d9640106d76c04131"}
Nov 04 05:40:54.842884 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:54.840142    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8" event={"ID":"de916aeb-4496-4195-9c41-07b2c92f3bd7","Type":"ContainerStarted","Data":"12d4d22f1a3424097c073d89379d035a4ba677cf56de961eb4caaf49175dda05"}
Nov 04 05:40:54.842884 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:54.840187    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8" event={"ID":"de916aeb-4496-4195-9c41-07b2c92f3bd7","Type":"ContainerStarted","Data":"2c3a22fe4e90edf55cba908b01ad843402729572f3138ab3bda185212e33851f"}
Nov 04 05:40:54.910539 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:54.907800    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8" podStartSLOduration=1.907778352 podStartE2EDuration="1.907778352s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:40:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:40:54.906727561 +0000 UTC m=+741.775391134" watchObservedRunningTime="2026-11-04 05:40:54.907778352 +0000 UTC m=+741.776441928"
Nov 04 05:40:54.910539 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:54.909014    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4" podStartSLOduration=1.909003737 podStartE2EDuration="1.909003737s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:40:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:40:54.861448648 +0000 UTC m=+741.730112240" watchObservedRunningTime="2026-11-04 05:40:54.909003737 +0000 UTC m=+741.777667379"
Nov 04 05:40:54.983541 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:54.982614    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4"
Nov 04 05:40:55.030179 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:55.030143    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8"
Nov 04 05:40:55.031218 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:55.031186    4357 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-6x6f8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Nov 04 05:40:55.031356 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:55.031243    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8" podUID="de916aeb-4496-4195-9c41-07b2c92f3bd7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Nov 04 05:40:55.991549 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:55.991211    4357 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-4l7f4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Nov 04 05:40:55.991549 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:55.991267    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4" podUID="7d011c75-4c48-46b9-920b-d7fa63ecdc3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Nov 04 05:40:56.030236 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:56.030201    4357 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-6x6f8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Nov 04 05:40:56.030393 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:56.030248    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8" podUID="de916aeb-4496-4195-9c41-07b2c92f3bd7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Nov 04 05:40:56.982941 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:56.982906    4357 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-4l7f4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Nov 04 05:40:56.983219 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:56.983192    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4" podUID="7d011c75-4c48-46b9-920b-d7fa63ecdc3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Nov 04 05:40:57.030273 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:57.030244    4357 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-6x6f8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Nov 04 05:40:57.030737 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:57.030712    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8" podUID="de916aeb-4496-4195-9c41-07b2c92f3bd7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Nov 04 05:40:57.985540 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:57.983864    4357 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-4l7f4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Nov 04 05:40:57.985540 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:57.983922    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4" podUID="7d011c75-4c48-46b9-920b-d7fa63ecdc3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Nov 04 05:40:58.030226 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:58.030192    4357 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-6x6f8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Nov 04 05:40:58.030386 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:58.030245    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8" podUID="de916aeb-4496-4195-9c41-07b2c92f3bd7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Nov 04 05:40:58.982940 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:58.982902    4357 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-4l7f4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Nov 04 05:40:58.983595 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:58.983566    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4" podUID="7d011c75-4c48-46b9-920b-d7fa63ecdc3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Nov 04 05:40:59.030092 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:59.030062    4357 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-6x6f8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Nov 04 05:40:59.030215 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:59.030113    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8" podUID="de916aeb-4496-4195-9c41-07b2c92f3bd7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Nov 04 05:40:59.983027 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:59.982990    4357 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-4l7f4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Nov 04 05:40:59.983659 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:40:59.983613    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4" podUID="7d011c75-4c48-46b9-920b-d7fa63ecdc3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Nov 04 05:41:00.029747 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:41:00.029718    4357 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-6x6f8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Nov 04 05:41:00.029942 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:41:00.029918    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8" podUID="de916aeb-4496-4195-9c41-07b2c92f3bd7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Nov 04 05:41:00.983403 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:41:00.983364    4357 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-4l7f4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Nov 04 05:41:00.983802 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:41:00.983441    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4" podUID="7d011c75-4c48-46b9-920b-d7fa63ecdc3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Nov 04 05:41:01.030341 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:41:01.030318    4357 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-6x6f8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Nov 04 05:41:01.030455 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:41:01.030367    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8" podUID="de916aeb-4496-4195-9c41-07b2c92f3bd7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Nov 04 05:41:01.983635 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:41:01.983599    4357 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-4l7f4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Nov 04 05:41:01.984043 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:41:01.983663    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4" podUID="7d011c75-4c48-46b9-920b-d7fa63ecdc3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Nov 04 05:41:02.029868 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:41:02.029837    4357 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-6x6f8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Nov 04 05:41:02.030007 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:41:02.029905    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8" podUID="de916aeb-4496-4195-9c41-07b2c92f3bd7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Nov 04 05:41:04.025711 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:41:04.025674    4357 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-4l7f4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 04 05:41:04.026490 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:41:04.026458    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4" podUID="7d011c75-4c48-46b9-920b-d7fa63ecdc3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 04 05:41:04.070667 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:41:04.070640    4357 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-6x6f8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 04 05:41:04.070865 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:41:04.070837    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8" podUID="de916aeb-4496-4195-9c41-07b2c92f3bd7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 04 05:41:05.068785 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:41:05.068749    4357 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-4l7f4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 04 05:41:05.069409 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:41:05.069359    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4" podUID="7d011c75-4c48-46b9-920b-d7fa63ecdc3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 04 05:41:05.112669 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:41:05.112638    4357 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-6x6f8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 04 05:41:05.112806 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:41:05.112688    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8" podUID="de916aeb-4496-4195-9c41-07b2c92f3bd7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 04 05:41:05.304029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:41:05.303993    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4"
Nov 04 05:41:05.305247 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:41:05.305190    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4"
Nov 04 05:41:05.308413 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:41:05.308389    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-4l7f4"
Nov 04 05:41:05.825970 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:41:05.825933    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8"
Nov 04 05:41:05.826281 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:41:05.826237    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8"
Nov 04 05:41:05.827007 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:41:05.826977    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6x6f8"
Nov 04 05:41:12.348166 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:41:12.348135    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-6b45cd5c6c-k5lhs"]
Nov 04 05:41:12.354813 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:41:12.354795    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-6b45cd5c6c-k5lhs"
Nov 04 05:41:12.360742 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:41:12.360717    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Nov 04 05:41:12.360877 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:41:12.360841    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"ai-gateway-controller-parameters\""
Nov 04 05:41:12.360877 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:41:12.360737    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Nov 04 05:41:12.361013 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:41:12.360932    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-metrics-tls\""
Nov 04 05:41:12.361235 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:41:12.361215    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-dockercfg-hw9rj\""
Nov 04 05:41:12.361460 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:41:12.361439    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-6b45cd5c6c-k5lhs"]
Nov 04 05:41:12.449406 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:41:12.449380    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc3a3e4b-9cff-4764-bed8-6f6a9fe7c40e-metrics-certs\") pod \"ai-gateway-controller-6b45cd5c6c-k5lhs\" (UID: \"cc3a3e4b-9cff-4764-bed8-6f6a9fe7c40e\") " pod="opendatahub/ai-gateway-controller-6b45cd5c6c-k5lhs"
Nov 04 05:41:12.449557 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:41:12.449418    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq47p\" (UniqueName: \"kubernetes.io/projected/cc3a3e4b-9cff-4764-bed8-6f6a9fe7c40e-kube-api-access-cq47p\") pod \"ai-gateway-controller-6b45cd5c6c-k5lhs\" (UID: \"cc3a3e4b-9cff-4764-bed8-6f6a9fe7c40e\") " pod="opendatahub/ai-gateway-controller-6b45cd5c6c-k5lhs"
Nov 04 05:41:12.550039 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:41:12.550015    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc3a3e4b-9cff-4764-bed8-6f6a9fe7c40e-metrics-certs\") pod \"ai-gateway-controller-6b45cd5c6c-k5lhs\" (UID: \"cc3a3e4b-9cff-4764-bed8-6f6a9fe7c40e\") " pod="opendatahub/ai-gateway-controller-6b45cd5c6c-k5lhs"
Nov 04 05:41:12.550176 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:41:12.550055    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cq47p\" (UniqueName: \"kubernetes.io/projected/cc3a3e4b-9cff-4764-bed8-6f6a9fe7c40e-kube-api-access-cq47p\") pod \"ai-gateway-controller-6b45cd5c6c-k5lhs\" (UID: \"cc3a3e4b-9cff-4764-bed8-6f6a9fe7c40e\") " pod="opendatahub/ai-gateway-controller-6b45cd5c6c-k5lhs"
Nov 04 05:41:12.552449 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:41:12.552425    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc3a3e4b-9cff-4764-bed8-6f6a9fe7c40e-metrics-certs\") pod \"ai-gateway-controller-6b45cd5c6c-k5lhs\" (UID: \"cc3a3e4b-9cff-4764-bed8-6f6a9fe7c40e\") " pod="opendatahub/ai-gateway-controller-6b45cd5c6c-k5lhs"
Nov 04 05:41:12.557579 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:41:12.557559    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq47p\" (UniqueName: \"kubernetes.io/projected/cc3a3e4b-9cff-4764-bed8-6f6a9fe7c40e-kube-api-access-cq47p\") pod \"ai-gateway-controller-6b45cd5c6c-k5lhs\" (UID: \"cc3a3e4b-9cff-4764-bed8-6f6a9fe7c40e\") " pod="opendatahub/ai-gateway-controller-6b45cd5c6c-k5lhs"
Nov 04 05:41:12.669652 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:41:12.669595    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-6b45cd5c6c-k5lhs"
Nov 04 05:41:12.939093 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:41:12.939017    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-6b45cd5c6c-k5lhs"]
Nov 04 05:41:12.941764 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:41:12.941730    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc3a3e4b_9cff_4764_bed8_6f6a9fe7c40e.slice/crio-057dee160321709c9f22a86fc6b4b6fe0fb9db25c2ffefb92988d1dcb355da2a WatchSource:0}: Error finding container 057dee160321709c9f22a86fc6b4b6fe0fb9db25c2ffefb92988d1dcb355da2a: Status 404 returned error can't find the container with id 057dee160321709c9f22a86fc6b4b6fe0fb9db25c2ffefb92988d1dcb355da2a
Nov 04 05:41:12.943100 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:41:12.943080    4357 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 05:41:13.918356 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:41:13.918317    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-6b45cd5c6c-k5lhs" event={"ID":"cc3a3e4b-9cff-4764-bed8-6f6a9fe7c40e","Type":"ContainerStarted","Data":"057dee160321709c9f22a86fc6b4b6fe0fb9db25c2ffefb92988d1dcb355da2a"}
Nov 04 05:41:15.928964 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:41:15.928925    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-6b45cd5c6c-k5lhs" event={"ID":"cc3a3e4b-9cff-4764-bed8-6f6a9fe7c40e","Type":"ContainerStarted","Data":"8f42924f53385ceea6525f1ffd65942847c8d5c3980cbe4235144bfc2b0348d6"}
Nov 04 05:41:15.929314 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:41:15.929018    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-6b45cd5c6c-k5lhs"
Nov 04 05:41:15.944201 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:41:15.944162    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-6b45cd5c6c-k5lhs" podStartSLOduration=1.664464586 podStartE2EDuration="3.944148537s" totalImagesPullingTime="2.279683951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:41:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:41:15.943302257 +0000 UTC m=+762.811965829" watchObservedRunningTime="2026-11-04 05:41:15.944148537 +0000 UTC m=+762.812812109"
Nov 04 05:41:17.274479 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:41:17.274400    4357 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-npgcv" containerName="extractor"
Nov 04 05:41:26.936391 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:41:26.936359    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-6b45cd5c6c-k5lhs"
Nov 04 05:41:47.274953 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:41:47.274916    4357 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-npgcv" containerName="extractor"
Nov 04 05:42:17.274429 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:42:17.274393    4357 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-npgcv" containerName="extractor"
Nov 04 05:42:21.146658 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.146619    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q"]
Nov 04 05:42:21.150154 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.150128    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q"
Nov 04 05:42:21.163274 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.163247    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q"]
Nov 04 05:42:21.178707 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.178681    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-workload-socket\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q\" (UID: \"43dd698a-4caf-4a7d-8dc3-dfe458da5c68\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q"
Nov 04 05:42:21.178829 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.178717    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-istio-token\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q\" (UID: \"43dd698a-4caf-4a7d-8dc3-dfe458da5c68\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q"
Nov 04 05:42:21.178829 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.178735    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-workload-certs\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q\" (UID: \"43dd698a-4caf-4a7d-8dc3-dfe458da5c68\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q"
Nov 04 05:42:21.178829 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.178815    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-istio-podinfo\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q\" (UID: \"43dd698a-4caf-4a7d-8dc3-dfe458da5c68\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q"
Nov 04 05:42:21.178996 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.178926    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-istio-envoy\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q\" (UID: \"43dd698a-4caf-4a7d-8dc3-dfe458da5c68\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q"
Nov 04 05:42:21.178996 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.178966    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-istiod-ca-cert\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q\" (UID: \"43dd698a-4caf-4a7d-8dc3-dfe458da5c68\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q"
Nov 04 05:42:21.179105 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.179072    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh9m2\" (UniqueName: \"kubernetes.io/projected/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-kube-api-access-vh9m2\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q\" (UID: \"43dd698a-4caf-4a7d-8dc3-dfe458da5c68\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q"
Nov 04 05:42:21.179169 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.179153    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-credential-socket\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q\" (UID: \"43dd698a-4caf-4a7d-8dc3-dfe458da5c68\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q"
Nov 04 05:42:21.179270 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.179241    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-istio-data\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q\" (UID: \"43dd698a-4caf-4a7d-8dc3-dfe458da5c68\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q"
Nov 04 05:42:21.187577 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.187556    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-f910f5-openshift-default-dockercfg-ttdqw\""
Nov 04 05:42:21.279826 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.279794    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-credential-socket\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q\" (UID: \"43dd698a-4caf-4a7d-8dc3-dfe458da5c68\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q"
Nov 04 05:42:21.279976 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.279835    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-istio-data\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q\" (UID: \"43dd698a-4caf-4a7d-8dc3-dfe458da5c68\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q"
Nov 04 05:42:21.279976 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.279950    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-workload-socket\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q\" (UID: \"43dd698a-4caf-4a7d-8dc3-dfe458da5c68\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q"
Nov 04 05:42:21.280089 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.279988    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-istio-token\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q\" (UID: \"43dd698a-4caf-4a7d-8dc3-dfe458da5c68\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q"
Nov 04 05:42:21.280089 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.280010    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-workload-certs\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q\" (UID: \"43dd698a-4caf-4a7d-8dc3-dfe458da5c68\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q"
Nov 04 05:42:21.280201 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.280129    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-istio-podinfo\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q\" (UID: \"43dd698a-4caf-4a7d-8dc3-dfe458da5c68\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q"
Nov 04 05:42:21.280201 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.280192    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-istio-envoy\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q\" (UID: \"43dd698a-4caf-4a7d-8dc3-dfe458da5c68\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q"
Nov 04 05:42:21.280309 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.280220    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-istiod-ca-cert\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q\" (UID: \"43dd698a-4caf-4a7d-8dc3-dfe458da5c68\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q"
Nov 04 05:42:21.280309 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.280263    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-istio-data\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q\" (UID: \"43dd698a-4caf-4a7d-8dc3-dfe458da5c68\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q"
Nov 04 05:42:21.280309 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.280284    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh9m2\" (UniqueName: \"kubernetes.io/projected/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-kube-api-access-vh9m2\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q\" (UID: \"43dd698a-4caf-4a7d-8dc3-dfe458da5c68\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q"
Nov 04 05:42:21.280466 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.280318    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-credential-socket\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q\" (UID: \"43dd698a-4caf-4a7d-8dc3-dfe458da5c68\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q"
Nov 04 05:42:21.280466 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.280341    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-workload-socket\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q\" (UID: \"43dd698a-4caf-4a7d-8dc3-dfe458da5c68\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q"
Nov 04 05:42:21.280466 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.280363    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-workload-certs\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q\" (UID: \"43dd698a-4caf-4a7d-8dc3-dfe458da5c68\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q"
Nov 04 05:42:21.280972 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.280946    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-istiod-ca-cert\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q\" (UID: \"43dd698a-4caf-4a7d-8dc3-dfe458da5c68\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q"
Nov 04 05:42:21.282400 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.282381    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-istio-envoy\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q\" (UID: \"43dd698a-4caf-4a7d-8dc3-dfe458da5c68\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q"
Nov 04 05:42:21.282669 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.282653    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-istio-podinfo\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q\" (UID: \"43dd698a-4caf-4a7d-8dc3-dfe458da5c68\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q"
Nov 04 05:42:21.288899 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.288872    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-istio-token\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q\" (UID: \"43dd698a-4caf-4a7d-8dc3-dfe458da5c68\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q"
Nov 04 05:42:21.288982 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.288907    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh9m2\" (UniqueName: \"kubernetes.io/projected/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-kube-api-access-vh9m2\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q\" (UID: \"43dd698a-4caf-4a7d-8dc3-dfe458da5c68\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q"
Nov 04 05:42:21.319847 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.319820    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn"]
Nov 04 05:42:21.327988 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.327970    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn"
Nov 04 05:42:21.335496 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.335277    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn"]
Nov 04 05:42:21.346285 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.346258    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w6-2b14d0-openshift-default-dockercfg-ccjw4\""
Nov 04 05:42:21.381210 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.381185    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d46061a-a82a-4a03-8200-c9ba11866b48-credential-socket\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn\" (UID: \"8d46061a-a82a-4a03-8200-c9ba11866b48\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn"
Nov 04 05:42:21.381315 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.381224    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d46061a-a82a-4a03-8200-c9ba11866b48-workload-socket\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn\" (UID: \"8d46061a-a82a-4a03-8200-c9ba11866b48\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn"
Nov 04 05:42:21.381358 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.381303    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d46061a-a82a-4a03-8200-c9ba11866b48-istio-token\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn\" (UID: \"8d46061a-a82a-4a03-8200-c9ba11866b48\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn"
Nov 04 05:42:21.381358 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.381344    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d46061a-a82a-4a03-8200-c9ba11866b48-istio-podinfo\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn\" (UID: \"8d46061a-a82a-4a03-8200-c9ba11866b48\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn"
Nov 04 05:42:21.381439 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.381378    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d46061a-a82a-4a03-8200-c9ba11866b48-istio-envoy\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn\" (UID: \"8d46061a-a82a-4a03-8200-c9ba11866b48\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn"
Nov 04 05:42:21.381578 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.381553    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d46061a-a82a-4a03-8200-c9ba11866b48-istio-data\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn\" (UID: \"8d46061a-a82a-4a03-8200-c9ba11866b48\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn"
Nov 04 05:42:21.381632 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.381596    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d46061a-a82a-4a03-8200-c9ba11866b48-workload-certs\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn\" (UID: \"8d46061a-a82a-4a03-8200-c9ba11866b48\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn"
Nov 04 05:42:21.381755 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.381696    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d46061a-a82a-4a03-8200-c9ba11866b48-istiod-ca-cert\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn\" (UID: \"8d46061a-a82a-4a03-8200-c9ba11866b48\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn"
Nov 04 05:42:21.381824 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.381769    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkqqh\" (UniqueName: \"kubernetes.io/projected/8d46061a-a82a-4a03-8200-c9ba11866b48-kube-api-access-xkqqh\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn\" (UID: \"8d46061a-a82a-4a03-8200-c9ba11866b48\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn"
Nov 04 05:42:21.466034 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.465972    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q"
Nov 04 05:42:21.481852 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.481823    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs"]
Nov 04 05:42:21.484010 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.483976    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d46061a-a82a-4a03-8200-c9ba11866b48-istio-data\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn\" (UID: \"8d46061a-a82a-4a03-8200-c9ba11866b48\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn"
Nov 04 05:42:21.484116 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.484017    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d46061a-a82a-4a03-8200-c9ba11866b48-workload-certs\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn\" (UID: \"8d46061a-a82a-4a03-8200-c9ba11866b48\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn"
Nov 04 05:42:21.484116 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.484057    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d46061a-a82a-4a03-8200-c9ba11866b48-istiod-ca-cert\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn\" (UID: \"8d46061a-a82a-4a03-8200-c9ba11866b48\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn"
Nov 04 05:42:21.485083 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.484497    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkqqh\" (UniqueName: \"kubernetes.io/projected/8d46061a-a82a-4a03-8200-c9ba11866b48-kube-api-access-xkqqh\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn\" (UID: \"8d46061a-a82a-4a03-8200-c9ba11866b48\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn"
Nov 04 05:42:21.485083 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.484739    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d46061a-a82a-4a03-8200-c9ba11866b48-credential-socket\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn\" (UID: \"8d46061a-a82a-4a03-8200-c9ba11866b48\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn"
Nov 04 05:42:21.485083 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.484777    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d46061a-a82a-4a03-8200-c9ba11866b48-workload-socket\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn\" (UID: \"8d46061a-a82a-4a03-8200-c9ba11866b48\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn"
Nov 04 05:42:21.485083 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.484856    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d46061a-a82a-4a03-8200-c9ba11866b48-istio-token\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn\" (UID: \"8d46061a-a82a-4a03-8200-c9ba11866b48\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn"
Nov 04 05:42:21.485083 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.484913    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d46061a-a82a-4a03-8200-c9ba11866b48-istio-podinfo\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn\" (UID: \"8d46061a-a82a-4a03-8200-c9ba11866b48\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn"
Nov 04 05:42:21.485083 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.484987    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d46061a-a82a-4a03-8200-c9ba11866b48-istio-envoy\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn\" (UID: \"8d46061a-a82a-4a03-8200-c9ba11866b48\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn"
Nov 04 05:42:21.485475 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.485218    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d46061a-a82a-4a03-8200-c9ba11866b48-istio-data\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn\" (UID: \"8d46061a-a82a-4a03-8200-c9ba11866b48\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn"
Nov 04 05:42:21.485936 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.485910    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d46061a-a82a-4a03-8200-c9ba11866b48-credential-socket\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn\" (UID: \"8d46061a-a82a-4a03-8200-c9ba11866b48\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn"
Nov 04 05:42:21.486068 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.485975    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d46061a-a82a-4a03-8200-c9ba11866b48-workload-socket\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn\" (UID: \"8d46061a-a82a-4a03-8200-c9ba11866b48\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn"
Nov 04 05:42:21.486068 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.486041    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d46061a-a82a-4a03-8200-c9ba11866b48-workload-certs\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn\" (UID: \"8d46061a-a82a-4a03-8200-c9ba11866b48\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn"
Nov 04 05:42:21.486596 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.486572    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d46061a-a82a-4a03-8200-c9ba11866b48-istiod-ca-cert\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn\" (UID: \"8d46061a-a82a-4a03-8200-c9ba11866b48\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn"
Nov 04 05:42:21.486784 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.486761    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs"
Nov 04 05:42:21.488221 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.488194    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d46061a-a82a-4a03-8200-c9ba11866b48-istio-envoy\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn\" (UID: \"8d46061a-a82a-4a03-8200-c9ba11866b48\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn"
Nov 04 05:42:21.488657 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.488637    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d46061a-a82a-4a03-8200-c9ba11866b48-istio-podinfo\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn\" (UID: \"8d46061a-a82a-4a03-8200-c9ba11866b48\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn"
Nov 04 05:42:21.493139 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.493107    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkqqh\" (UniqueName: \"kubernetes.io/projected/8d46061a-a82a-4a03-8200-c9ba11866b48-kube-api-access-xkqqh\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn\" (UID: \"8d46061a-a82a-4a03-8200-c9ba11866b48\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn"
Nov 04 05:42:21.502920 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.502893    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs"]
Nov 04 05:42:21.507823 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.504948    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d46061a-a82a-4a03-8200-c9ba11866b48-istio-token\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn\" (UID: \"8d46061a-a82a-4a03-8200-c9ba11866b48\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn"
Nov 04 05:42:21.507823 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.505429    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-9a0c8b-openshift-default-dockercfg-zrhdn\""
Nov 04 05:42:21.585975 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.585946    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74410632-d803-4ede-89e3-3bc956968fe0-istio-token\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs\" (UID: \"74410632-d803-4ede-89e3-3bc956968fe0\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs"
Nov 04 05:42:21.586100 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.585979    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74410632-d803-4ede-89e3-3bc956968fe0-istiod-ca-cert\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs\" (UID: \"74410632-d803-4ede-89e3-3bc956968fe0\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs"
Nov 04 05:42:21.586100 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.586002    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74410632-d803-4ede-89e3-3bc956968fe0-workload-socket\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs\" (UID: \"74410632-d803-4ede-89e3-3bc956968fe0\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs"
Nov 04 05:42:21.586192 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.586129    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74410632-d803-4ede-89e3-3bc956968fe0-istio-data\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs\" (UID: \"74410632-d803-4ede-89e3-3bc956968fe0\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs"
Nov 04 05:42:21.586240 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.586201    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74410632-d803-4ede-89e3-3bc956968fe0-credential-socket\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs\" (UID: \"74410632-d803-4ede-89e3-3bc956968fe0\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs"
Nov 04 05:42:21.586240 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.586222    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74410632-d803-4ede-89e3-3bc956968fe0-istio-envoy\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs\" (UID: \"74410632-d803-4ede-89e3-3bc956968fe0\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs"
Nov 04 05:42:21.586328 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.586248    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74410632-d803-4ede-89e3-3bc956968fe0-istio-podinfo\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs\" (UID: \"74410632-d803-4ede-89e3-3bc956968fe0\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs"
Nov 04 05:42:21.586382 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.586356    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86psp\" (UniqueName: \"kubernetes.io/projected/74410632-d803-4ede-89e3-3bc956968fe0-kube-api-access-86psp\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs\" (UID: \"74410632-d803-4ede-89e3-3bc956968fe0\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs"
Nov 04 05:42:21.586437 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.586405    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74410632-d803-4ede-89e3-3bc956968fe0-workload-certs\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs\" (UID: \"74410632-d803-4ede-89e3-3bc956968fe0\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs"
Nov 04 05:42:21.643285 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.643260    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn"
Nov 04 05:42:21.687210 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.687179    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74410632-d803-4ede-89e3-3bc956968fe0-istio-token\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs\" (UID: \"74410632-d803-4ede-89e3-3bc956968fe0\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs"
Nov 04 05:42:21.687210 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.687212    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74410632-d803-4ede-89e3-3bc956968fe0-istiod-ca-cert\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs\" (UID: \"74410632-d803-4ede-89e3-3bc956968fe0\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs"
Nov 04 05:42:21.687428 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.687232    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74410632-d803-4ede-89e3-3bc956968fe0-workload-socket\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs\" (UID: \"74410632-d803-4ede-89e3-3bc956968fe0\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs"
Nov 04 05:42:21.687428 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.687345    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74410632-d803-4ede-89e3-3bc956968fe0-istio-data\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs\" (UID: \"74410632-d803-4ede-89e3-3bc956968fe0\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs"
Nov 04 05:42:21.687588 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.687455    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74410632-d803-4ede-89e3-3bc956968fe0-credential-socket\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs\" (UID: \"74410632-d803-4ede-89e3-3bc956968fe0\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs"
Nov 04 05:42:21.687588 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.687489    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74410632-d803-4ede-89e3-3bc956968fe0-istio-envoy\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs\" (UID: \"74410632-d803-4ede-89e3-3bc956968fe0\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs"
Nov 04 05:42:21.687588 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.687553    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74410632-d803-4ede-89e3-3bc956968fe0-istio-podinfo\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs\" (UID: \"74410632-d803-4ede-89e3-3bc956968fe0\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs"
Nov 04 05:42:21.687588 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.687569    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74410632-d803-4ede-89e3-3bc956968fe0-workload-socket\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs\" (UID: \"74410632-d803-4ede-89e3-3bc956968fe0\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs"
Nov 04 05:42:21.688240 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.687846    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74410632-d803-4ede-89e3-3bc956968fe0-credential-socket\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs\" (UID: \"74410632-d803-4ede-89e3-3bc956968fe0\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs"
Nov 04 05:42:21.688240 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.687882    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74410632-d803-4ede-89e3-3bc956968fe0-istio-data\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs\" (UID: \"74410632-d803-4ede-89e3-3bc956968fe0\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs"
Nov 04 05:42:21.688240 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.687886    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86psp\" (UniqueName: \"kubernetes.io/projected/74410632-d803-4ede-89e3-3bc956968fe0-kube-api-access-86psp\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs\" (UID: \"74410632-d803-4ede-89e3-3bc956968fe0\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs"
Nov 04 05:42:21.688240 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.687945    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74410632-d803-4ede-89e3-3bc956968fe0-workload-certs\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs\" (UID: \"74410632-d803-4ede-89e3-3bc956968fe0\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs"
Nov 04 05:42:21.688240 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.688032    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74410632-d803-4ede-89e3-3bc956968fe0-istiod-ca-cert\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs\" (UID: \"74410632-d803-4ede-89e3-3bc956968fe0\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs"
Nov 04 05:42:21.688240 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.688237    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74410632-d803-4ede-89e3-3bc956968fe0-workload-certs\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs\" (UID: \"74410632-d803-4ede-89e3-3bc956968fe0\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs"
Nov 04 05:42:21.690843 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.690365    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74410632-d803-4ede-89e3-3bc956968fe0-istio-envoy\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs\" (UID: \"74410632-d803-4ede-89e3-3bc956968fe0\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs"
Nov 04 05:42:21.690843 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.690800    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74410632-d803-4ede-89e3-3bc956968fe0-istio-podinfo\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs\" (UID: \"74410632-d803-4ede-89e3-3bc956968fe0\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs"
Nov 04 05:42:21.699407 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.696241    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74410632-d803-4ede-89e3-3bc956968fe0-istio-token\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs\" (UID: \"74410632-d803-4ede-89e3-3bc956968fe0\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs"
Nov 04 05:42:21.699407 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.697799    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86psp\" (UniqueName: \"kubernetes.io/projected/74410632-d803-4ede-89e3-3bc956968fe0-kube-api-access-86psp\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs\" (UID: \"74410632-d803-4ede-89e3-3bc956968fe0\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs"
Nov 04 05:42:21.759366 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.758627    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:42:21.759366 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.758716    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:42:21.759366 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.758767    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:42:21.767309 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.767282    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q"]
Nov 04 05:42:21.819823 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.819798    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs"
Nov 04 05:42:21.932330 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.932300    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn"]
Nov 04 05:42:21.937280 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:42:21.937250    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d46061a_a82a_4a03_8200_c9ba11866b48.slice/crio-e39494b6d5c613767bec1aa3058e9d87ea67f66a7fd424b4e277f2a35c654572 WatchSource:0}: Error finding container e39494b6d5c613767bec1aa3058e9d87ea67f66a7fd424b4e277f2a35c654572: Status 404 returned error can't find the container with id e39494b6d5c613767bec1aa3058e9d87ea67f66a7fd424b4e277f2a35c654572
Nov 04 05:42:21.940375 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.940340    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:42:21.940462 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.940417    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:42:21.940570 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:21.940462    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:42:22.107001 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:22.106970    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs"]
Nov 04 05:42:22.110351 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:42:22.110323    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74410632_d803_4ede_89e3_3bc956968fe0.slice/crio-e472d20eb7c6f766222c731c527cf273098cbb97e72c8f100a763a8e2aabad13 WatchSource:0}: Error finding container e472d20eb7c6f766222c731c527cf273098cbb97e72c8f100a763a8e2aabad13: Status 404 returned error can't find the container with id e472d20eb7c6f766222c731c527cf273098cbb97e72c8f100a763a8e2aabad13
Nov 04 05:42:22.113427 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:22.113389    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:42:22.113546 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:22.113470    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:42:22.113546 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:22.113531    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:42:22.196606 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:22.196560    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn" event={"ID":"8d46061a-a82a-4a03-8200-c9ba11866b48","Type":"ContainerStarted","Data":"d3d03b75ec9f0e1bb3370abcc7369cf1a332e54c722fad8798f0b29b496e9e0c"}
Nov 04 05:42:22.197017 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:22.196803    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn" event={"ID":"8d46061a-a82a-4a03-8200-c9ba11866b48","Type":"ContainerStarted","Data":"e39494b6d5c613767bec1aa3058e9d87ea67f66a7fd424b4e277f2a35c654572"}
Nov 04 05:42:22.198585 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:22.198564    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q" event={"ID":"43dd698a-4caf-4a7d-8dc3-dfe458da5c68","Type":"ContainerStarted","Data":"9417792dab7e151685ef78d5bdae42d766555fffd8006b814ddc386077cebf9b"}
Nov 04 05:42:22.198710 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:22.198624    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q" event={"ID":"43dd698a-4caf-4a7d-8dc3-dfe458da5c68","Type":"ContainerStarted","Data":"2f25c2585f625129d0f584f4df6f11288e3af286a7b29e1ae5ee75b1baaf4cf5"}
Nov 04 05:42:22.201983 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:22.201749    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs" event={"ID":"74410632-d803-4ede-89e3-3bc956968fe0","Type":"ContainerStarted","Data":"5b039729140d3c8580791af55a16af1ac45e5fbea1791f2a56a83a65b0679f25"}
Nov 04 05:42:22.201983 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:22.201784    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs" event={"ID":"74410632-d803-4ede-89e3-3bc956968fe0","Type":"ContainerStarted","Data":"e472d20eb7c6f766222c731c527cf273098cbb97e72c8f100a763a8e2aabad13"}
Nov 04 05:42:22.218727 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:22.218665    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn" podStartSLOduration=1.21864927 podStartE2EDuration="1.21864927s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:42:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:42:22.215929674 +0000 UTC m=+829.084593291" watchObservedRunningTime="2026-11-04 05:42:22.21864927 +0000 UTC m=+829.087312845"
Nov 04 05:42:22.238555 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:22.237238    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q" podStartSLOduration=1.237220586 podStartE2EDuration="1.237220586s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:42:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:42:22.234576432 +0000 UTC m=+829.103240006" watchObservedRunningTime="2026-11-04 05:42:22.237220586 +0000 UTC m=+829.105884160"
Nov 04 05:42:22.258293 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:22.258206    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs" podStartSLOduration=1.258188609 podStartE2EDuration="1.258188609s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:42:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:42:22.256975817 +0000 UTC m=+829.125639409" watchObservedRunningTime="2026-11-04 05:42:22.258188609 +0000 UTC m=+829.126852180"
Nov 04 05:42:22.466401 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:22.466368    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q"
Nov 04 05:42:22.471963 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:22.471938    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q"
Nov 04 05:42:22.644332 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:22.644264    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn"
Nov 04 05:42:22.820994 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:22.820963    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs"
Nov 04 05:42:23.205884 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:23.205843    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q"
Nov 04 05:42:23.206449 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:23.206433    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q"
Nov 04 05:42:23.650020 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:23.649993    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn"
Nov 04 05:42:23.825211 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:23.825177    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs"
Nov 04 05:42:24.210217 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:24.210188    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn"
Nov 04 05:42:24.210659 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:24.210242    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs"
Nov 04 05:42:24.210754 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:24.210732    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs"
Nov 04 05:42:24.210805 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:24.210786    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn"
Nov 04 05:42:25.862581 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:25.862543    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-f910f5-668ff7855-g8p5s"]
Nov 04 05:42:25.866213 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:25.866194    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-f910f5-668ff7855-g8p5s"
Nov 04 05:42:25.874983 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:25.874957    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-f910f5-668ff7855-g8p5s"]
Nov 04 05:42:25.876932 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:25.876913    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w3-f910f5-dockercfg-rx545\""
Nov 04 05:42:25.877023 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:25.876950    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w3-f910f5\""
Nov 04 05:42:25.900942 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:25.900915    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-f910f5-58ddd75998-7rkwk"]
Nov 04 05:42:25.904758 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:25.904738    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-f910f5-58ddd75998-7rkwk"
Nov 04 05:42:25.911412 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:25.911354    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-f910f5-58ddd75998-7rkwk"]
Nov 04 05:42:25.954643 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:25.954563    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpp4s\" (UniqueName: \"kubernetes.io/projected/aaf73a4d-306e-43bd-a6b7-b3dfb2f29dee-kube-api-access-xpp4s\") pod \"payload-processing-e2e-worker-w3-f910f5-58ddd75998-7rkwk\" (UID: \"aaf73a4d-306e-43bd-a6b7-b3dfb2f29dee\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-f910f5-58ddd75998-7rkwk"
Nov 04 05:42:25.969817 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:25.969778    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrhxf\" (UniqueName: \"kubernetes.io/projected/6c343ea7-372f-4d66-9534-c758209541b0-kube-api-access-nrhxf\") pod \"payload-pre-processing-e2e-worker-w3-f910f5-668ff7855-g8p5s\" (UID: \"6c343ea7-372f-4d66-9534-c758209541b0\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-f910f5-668ff7855-g8p5s"
Nov 04 05:42:25.970067 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:25.970045    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c343ea7-372f-4d66-9534-c758209541b0-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-f910f5-668ff7855-g8p5s\" (UID: \"6c343ea7-372f-4d66-9534-c758209541b0\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-f910f5-668ff7855-g8p5s"
Nov 04 05:42:25.970361 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:25.970339    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aaf73a4d-306e-43bd-a6b7-b3dfb2f29dee-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-f910f5-58ddd75998-7rkwk\" (UID: \"aaf73a4d-306e-43bd-a6b7-b3dfb2f29dee\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-f910f5-58ddd75998-7rkwk"
Nov 04 05:42:26.071243 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:26.071211    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aaf73a4d-306e-43bd-a6b7-b3dfb2f29dee-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-f910f5-58ddd75998-7rkwk\" (UID: \"aaf73a4d-306e-43bd-a6b7-b3dfb2f29dee\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-f910f5-58ddd75998-7rkwk"
Nov 04 05:42:26.071432 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:26.071258    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpp4s\" (UniqueName: \"kubernetes.io/projected/aaf73a4d-306e-43bd-a6b7-b3dfb2f29dee-kube-api-access-xpp4s\") pod \"payload-processing-e2e-worker-w3-f910f5-58ddd75998-7rkwk\" (UID: \"aaf73a4d-306e-43bd-a6b7-b3dfb2f29dee\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-f910f5-58ddd75998-7rkwk"
Nov 04 05:42:26.071432 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:26.071367    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrhxf\" (UniqueName: \"kubernetes.io/projected/6c343ea7-372f-4d66-9534-c758209541b0-kube-api-access-nrhxf\") pod \"payload-pre-processing-e2e-worker-w3-f910f5-668ff7855-g8p5s\" (UID: \"6c343ea7-372f-4d66-9534-c758209541b0\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-f910f5-668ff7855-g8p5s"
Nov 04 05:42:26.071432 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:26.071393    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c343ea7-372f-4d66-9534-c758209541b0-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-f910f5-668ff7855-g8p5s\" (UID: \"6c343ea7-372f-4d66-9534-c758209541b0\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-f910f5-668ff7855-g8p5s"
Nov 04 05:42:26.072121 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:26.072096    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aaf73a4d-306e-43bd-a6b7-b3dfb2f29dee-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-f910f5-58ddd75998-7rkwk\" (UID: \"aaf73a4d-306e-43bd-a6b7-b3dfb2f29dee\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-f910f5-58ddd75998-7rkwk"
Nov 04 05:42:26.072228 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:26.072122    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c343ea7-372f-4d66-9534-c758209541b0-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-f910f5-668ff7855-g8p5s\" (UID: \"6c343ea7-372f-4d66-9534-c758209541b0\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-f910f5-668ff7855-g8p5s"
Nov 04 05:42:26.083390 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:26.083367    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpp4s\" (UniqueName: \"kubernetes.io/projected/aaf73a4d-306e-43bd-a6b7-b3dfb2f29dee-kube-api-access-xpp4s\") pod \"payload-processing-e2e-worker-w3-f910f5-58ddd75998-7rkwk\" (UID: \"aaf73a4d-306e-43bd-a6b7-b3dfb2f29dee\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-f910f5-58ddd75998-7rkwk"
Nov 04 05:42:26.084765 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:26.084748    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrhxf\" (UniqueName: \"kubernetes.io/projected/6c343ea7-372f-4d66-9534-c758209541b0-kube-api-access-nrhxf\") pod \"payload-pre-processing-e2e-worker-w3-f910f5-668ff7855-g8p5s\" (UID: \"6c343ea7-372f-4d66-9534-c758209541b0\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-f910f5-668ff7855-g8p5s"
Nov 04 05:42:26.181828 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:26.181767    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-f910f5-668ff7855-g8p5s"
Nov 04 05:42:26.219346 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:26.219318    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-f910f5-58ddd75998-7rkwk"
Nov 04 05:42:26.456015 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:26.455992    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-f910f5-668ff7855-g8p5s"]
Nov 04 05:42:26.457988 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:42:26.457958    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c343ea7_372f_4d66_9534_c758209541b0.slice/crio-2d72826b2a1918f5f08405883ae1b010f64e14c9653109bfb11b51753b50da85 WatchSource:0}: Error finding container 2d72826b2a1918f5f08405883ae1b010f64e14c9653109bfb11b51753b50da85: Status 404 returned error can't find the container with id 2d72826b2a1918f5f08405883ae1b010f64e14c9653109bfb11b51753b50da85
Nov 04 05:42:26.478402 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:26.478382    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-2b14d0-6996d75467-hndgq"]
Nov 04 05:42:26.482863 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:26.482849    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-2b14d0-6996d75467-hndgq"
Nov 04 05:42:26.489897 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:26.489826    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w6-2b14d0-dockercfg-sdvfr\""
Nov 04 05:42:26.491631 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:26.491412    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-2b14d0-6996d75467-hndgq"]
Nov 04 05:42:26.514257 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:26.514229    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-f910f5-58ddd75998-7rkwk"]
Nov 04 05:42:26.516383 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:42:26.516354    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaf73a4d_306e_43bd_a6b7_b3dfb2f29dee.slice/crio-5b0d91fba212c30a2879b5a134819db7b29d6132d450bb25c0d64663b05c642c WatchSource:0}: Error finding container 5b0d91fba212c30a2879b5a134819db7b29d6132d450bb25c0d64663b05c642c: Status 404 returned error can't find the container with id 5b0d91fba212c30a2879b5a134819db7b29d6132d450bb25c0d64663b05c642c
Nov 04 05:42:26.562784 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:26.562761    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w6-2b14d0\""
Nov 04 05:42:26.584268 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:26.578468    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psv2z\" (UniqueName: \"kubernetes.io/projected/4c9a887b-1a65-414a-b186-7745adf36f4e-kube-api-access-psv2z\") pod \"payload-pre-processing-e2e-worker-w6-2b14d0-6996d75467-hndgq\" (UID: \"4c9a887b-1a65-414a-b186-7745adf36f4e\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-2b14d0-6996d75467-hndgq"
Nov 04 05:42:26.584268 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:26.578648    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c9a887b-1a65-414a-b186-7745adf36f4e-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w6-2b14d0-6996d75467-hndgq\" (UID: \"4c9a887b-1a65-414a-b186-7745adf36f4e\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-2b14d0-6996d75467-hndgq"
Nov 04 05:42:26.679943 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:26.679908    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psv2z\" (UniqueName: \"kubernetes.io/projected/4c9a887b-1a65-414a-b186-7745adf36f4e-kube-api-access-psv2z\") pod \"payload-pre-processing-e2e-worker-w6-2b14d0-6996d75467-hndgq\" (UID: \"4c9a887b-1a65-414a-b186-7745adf36f4e\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-2b14d0-6996d75467-hndgq"
Nov 04 05:42:26.680104 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:26.679973    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c9a887b-1a65-414a-b186-7745adf36f4e-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w6-2b14d0-6996d75467-hndgq\" (UID: \"4c9a887b-1a65-414a-b186-7745adf36f4e\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-2b14d0-6996d75467-hndgq"
Nov 04 05:42:26.680737 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:26.680720    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c9a887b-1a65-414a-b186-7745adf36f4e-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w6-2b14d0-6996d75467-hndgq\" (UID: \"4c9a887b-1a65-414a-b186-7745adf36f4e\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-2b14d0-6996d75467-hndgq"
Nov 04 05:42:26.687316 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:26.687289    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psv2z\" (UniqueName: \"kubernetes.io/projected/4c9a887b-1a65-414a-b186-7745adf36f4e-kube-api-access-psv2z\") pod \"payload-pre-processing-e2e-worker-w6-2b14d0-6996d75467-hndgq\" (UID: \"4c9a887b-1a65-414a-b186-7745adf36f4e\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-2b14d0-6996d75467-hndgq"
Nov 04 05:42:26.798842 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:26.798818    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-2b14d0-6996d75467-hndgq"
Nov 04 05:42:27.070175 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:27.070148    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-2b14d0-6996d75467-hndgq"]
Nov 04 05:42:27.073396 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:42:27.073357    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c9a887b_1a65_414a_b186_7745adf36f4e.slice/crio-6272e705a66e79c2042bc7bfdc2d6a7832d1e58082762e18e5532bf65ab780e7 WatchSource:0}: Error finding container 6272e705a66e79c2042bc7bfdc2d6a7832d1e58082762e18e5532bf65ab780e7: Status 404 returned error can't find the container with id 6272e705a66e79c2042bc7bfdc2d6a7832d1e58082762e18e5532bf65ab780e7
Nov 04 05:42:27.228584 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:27.228546    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-2b14d0-6996d75467-hndgq" event={"ID":"4c9a887b-1a65-414a-b186-7745adf36f4e","Type":"ContainerStarted","Data":"6272e705a66e79c2042bc7bfdc2d6a7832d1e58082762e18e5532bf65ab780e7"}
Nov 04 05:42:27.233242 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:27.233210    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-f910f5-668ff7855-g8p5s" event={"ID":"6c343ea7-372f-4d66-9534-c758209541b0","Type":"ContainerStarted","Data":"2d72826b2a1918f5f08405883ae1b010f64e14c9653109bfb11b51753b50da85"}
Nov 04 05:42:27.235648 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:27.235620    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-f910f5-58ddd75998-7rkwk" event={"ID":"aaf73a4d-306e-43bd-a6b7-b3dfb2f29dee","Type":"ContainerStarted","Data":"5b0d91fba212c30a2879b5a134819db7b29d6132d450bb25c0d64663b05c642c"}
Nov 04 05:42:27.249536 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:27.247646    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-9a0c8b-74cc6fdc84-xbzmp"]
Nov 04 05:42:27.251446 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:27.251422    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-9a0c8b-74cc6fdc84-xbzmp"
Nov 04 05:42:27.257366 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:27.257328    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-9a0c8b-74cc6fdc84-xbzmp"]
Nov 04 05:42:27.260113 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:27.260095    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-9a0c8b\""
Nov 04 05:42:27.406817 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:27.406731    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b64e7e74-8b44-4678-ab75-e5237143a2b1-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-9a0c8b-74cc6fdc84-xbzmp\" (UID: \"b64e7e74-8b44-4678-ab75-e5237143a2b1\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-9a0c8b-74cc6fdc84-xbzmp"
Nov 04 05:42:27.406817 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:27.406795    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4xsc\" (UniqueName: \"kubernetes.io/projected/b64e7e74-8b44-4678-ab75-e5237143a2b1-kube-api-access-q4xsc\") pod \"payload-processing-e2e-worker-w4-9a0c8b-74cc6fdc84-xbzmp\" (UID: \"b64e7e74-8b44-4678-ab75-e5237143a2b1\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-9a0c8b-74cc6fdc84-xbzmp"
Nov 04 05:42:27.508007 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:27.507970    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b64e7e74-8b44-4678-ab75-e5237143a2b1-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-9a0c8b-74cc6fdc84-xbzmp\" (UID: \"b64e7e74-8b44-4678-ab75-e5237143a2b1\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-9a0c8b-74cc6fdc84-xbzmp"
Nov 04 05:42:27.508180 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:27.508027    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4xsc\" (UniqueName: \"kubernetes.io/projected/b64e7e74-8b44-4678-ab75-e5237143a2b1-kube-api-access-q4xsc\") pod \"payload-processing-e2e-worker-w4-9a0c8b-74cc6fdc84-xbzmp\" (UID: \"b64e7e74-8b44-4678-ab75-e5237143a2b1\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-9a0c8b-74cc6fdc84-xbzmp"
Nov 04 05:42:27.509412 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:27.509383    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b64e7e74-8b44-4678-ab75-e5237143a2b1-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-9a0c8b-74cc6fdc84-xbzmp\" (UID: \"b64e7e74-8b44-4678-ab75-e5237143a2b1\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-9a0c8b-74cc6fdc84-xbzmp"
Nov 04 05:42:27.519712 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:27.519685    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4xsc\" (UniqueName: \"kubernetes.io/projected/b64e7e74-8b44-4678-ab75-e5237143a2b1-kube-api-access-q4xsc\") pod \"payload-processing-e2e-worker-w4-9a0c8b-74cc6fdc84-xbzmp\" (UID: \"b64e7e74-8b44-4678-ab75-e5237143a2b1\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-9a0c8b-74cc6fdc84-xbzmp"
Nov 04 05:42:27.572783 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:27.572501    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-9a0c8b-74cc6fdc84-xbzmp"
Nov 04 05:42:27.602971 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:27.602940    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-27935d-6dffddbb9f-8k6nc"]
Nov 04 05:42:27.607685 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:27.607660    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-27935d-6dffddbb9f-8k6nc"
Nov 04 05:42:27.614811 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:27.614780    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-27935d-6dffddbb9f-8k6nc"]
Nov 04 05:42:27.693245 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:27.693177    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-27935d\""
Nov 04 05:42:27.693567 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:27.693505    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-27935d-dockercfg-vzw29\""
Nov 04 05:42:27.711852 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:27.711826    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq2ff\" (UniqueName: \"kubernetes.io/projected/5ed67653-cc0f-4000-aa56-edd9d733b025-kube-api-access-jq2ff\") pod \"payload-pre-processing-e2e-worker-w0-27935d-6dffddbb9f-8k6nc\" (UID: \"5ed67653-cc0f-4000-aa56-edd9d733b025\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-27935d-6dffddbb9f-8k6nc"
Nov 04 05:42:27.711970 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:27.711872    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ed67653-cc0f-4000-aa56-edd9d733b025-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-27935d-6dffddbb9f-8k6nc\" (UID: \"5ed67653-cc0f-4000-aa56-edd9d733b025\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-27935d-6dffddbb9f-8k6nc"
Nov 04 05:42:27.814560 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:27.813383    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq2ff\" (UniqueName: \"kubernetes.io/projected/5ed67653-cc0f-4000-aa56-edd9d733b025-kube-api-access-jq2ff\") pod \"payload-pre-processing-e2e-worker-w0-27935d-6dffddbb9f-8k6nc\" (UID: \"5ed67653-cc0f-4000-aa56-edd9d733b025\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-27935d-6dffddbb9f-8k6nc"
Nov 04 05:42:27.814560 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:27.813436    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ed67653-cc0f-4000-aa56-edd9d733b025-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-27935d-6dffddbb9f-8k6nc\" (UID: \"5ed67653-cc0f-4000-aa56-edd9d733b025\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-27935d-6dffddbb9f-8k6nc"
Nov 04 05:42:27.814560 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:27.814264    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ed67653-cc0f-4000-aa56-edd9d733b025-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-27935d-6dffddbb9f-8k6nc\" (UID: \"5ed67653-cc0f-4000-aa56-edd9d733b025\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-27935d-6dffddbb9f-8k6nc"
Nov 04 05:42:27.838125 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:27.837777    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq2ff\" (UniqueName: \"kubernetes.io/projected/5ed67653-cc0f-4000-aa56-edd9d733b025-kube-api-access-jq2ff\") pod \"payload-pre-processing-e2e-worker-w0-27935d-6dffddbb9f-8k6nc\" (UID: \"5ed67653-cc0f-4000-aa56-edd9d733b025\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-27935d-6dffddbb9f-8k6nc"
Nov 04 05:42:27.887048 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:27.886903    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-9a0c8b-74cc6fdc84-xbzmp"]
Nov 04 05:42:27.931921 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:27.931891    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-27935d-6dffddbb9f-8k6nc"
Nov 04 05:42:28.244837 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:28.244758    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-9a0c8b-74cc6fdc84-xbzmp" event={"ID":"b64e7e74-8b44-4678-ab75-e5237143a2b1","Type":"ContainerStarted","Data":"a5185423b2554ceb4d62548f78542570d174c16c9145f9b1942613e2926e46f8"}
Nov 04 05:42:28.270000 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:28.266866    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-27935d-6dffddbb9f-8k6nc"]
Nov 04 05:42:29.254439 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:29.254357    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-27935d-6dffddbb9f-8k6nc" event={"ID":"5ed67653-cc0f-4000-aa56-edd9d733b025","Type":"ContainerStarted","Data":"4e6887d2fe64cff6e22e6d203e994da166835bd077ba7fd9e57809275df7133c"}
Nov 04 05:42:29.287959 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:29.285981    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-f9b4a9-856cdf867f-gstt5"]
Nov 04 05:42:29.292778 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:29.291881    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-f9b4a9-856cdf867f-gstt5"]
Nov 04 05:42:29.292778 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:29.291987    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-f9b4a9-856cdf867f-gstt5"
Nov 04 05:42:29.297788 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:29.297737    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w1-f9b4a9-dockercfg-x7jbx\""
Nov 04 05:42:29.297788 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:29.297764    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w1-f9b4a9\""
Nov 04 05:42:29.325945 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:29.322991    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-f9b4a9-6895875fc8-pt6t4"]
Nov 04 05:42:29.327344 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:29.327022    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-f9b4a9-6895875fc8-pt6t4"
Nov 04 05:42:29.335865 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:29.335329    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-f9b4a9-6895875fc8-pt6t4"]
Nov 04 05:42:29.354384 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:29.353650    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/708bb5a0-772d-4606-9d36-cbff726e0e1a-plugins-config-volume\") pod \"payload-processing-e2e-worker-w1-f9b4a9-6895875fc8-pt6t4\" (UID: \"708bb5a0-772d-4606-9d36-cbff726e0e1a\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-f9b4a9-6895875fc8-pt6t4"
Nov 04 05:42:29.354384 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:29.353704    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lddv\" (UniqueName: \"kubernetes.io/projected/708bb5a0-772d-4606-9d36-cbff726e0e1a-kube-api-access-9lddv\") pod \"payload-processing-e2e-worker-w1-f9b4a9-6895875fc8-pt6t4\" (UID: \"708bb5a0-772d-4606-9d36-cbff726e0e1a\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-f9b4a9-6895875fc8-pt6t4"
Nov 04 05:42:29.354384 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:29.353803    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e884e3e-ffb9-4a89-85a5-d9ad28f085ea-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-f9b4a9-856cdf867f-gstt5\" (UID: \"2e884e3e-ffb9-4a89-85a5-d9ad28f085ea\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-f9b4a9-856cdf867f-gstt5"
Nov 04 05:42:29.354384 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:29.353857    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdtns\" (UniqueName: \"kubernetes.io/projected/2e884e3e-ffb9-4a89-85a5-d9ad28f085ea-kube-api-access-cdtns\") pod \"payload-pre-processing-e2e-worker-w1-f9b4a9-856cdf867f-gstt5\" (UID: \"2e884e3e-ffb9-4a89-85a5-d9ad28f085ea\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-f9b4a9-856cdf867f-gstt5"
Nov 04 05:42:29.457399 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:29.454935    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/708bb5a0-772d-4606-9d36-cbff726e0e1a-plugins-config-volume\") pod \"payload-processing-e2e-worker-w1-f9b4a9-6895875fc8-pt6t4\" (UID: \"708bb5a0-772d-4606-9d36-cbff726e0e1a\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-f9b4a9-6895875fc8-pt6t4"
Nov 04 05:42:29.457399 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:29.454986    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lddv\" (UniqueName: \"kubernetes.io/projected/708bb5a0-772d-4606-9d36-cbff726e0e1a-kube-api-access-9lddv\") pod \"payload-processing-e2e-worker-w1-f9b4a9-6895875fc8-pt6t4\" (UID: \"708bb5a0-772d-4606-9d36-cbff726e0e1a\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-f9b4a9-6895875fc8-pt6t4"
Nov 04 05:42:29.457399 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:29.455046    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e884e3e-ffb9-4a89-85a5-d9ad28f085ea-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-f9b4a9-856cdf867f-gstt5\" (UID: \"2e884e3e-ffb9-4a89-85a5-d9ad28f085ea\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-f9b4a9-856cdf867f-gstt5"
Nov 04 05:42:29.457399 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:29.455094    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdtns\" (UniqueName: \"kubernetes.io/projected/2e884e3e-ffb9-4a89-85a5-d9ad28f085ea-kube-api-access-cdtns\") pod \"payload-pre-processing-e2e-worker-w1-f9b4a9-856cdf867f-gstt5\" (UID: \"2e884e3e-ffb9-4a89-85a5-d9ad28f085ea\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-f9b4a9-856cdf867f-gstt5"
Nov 04 05:42:29.457399 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:29.456356    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/708bb5a0-772d-4606-9d36-cbff726e0e1a-plugins-config-volume\") pod \"payload-processing-e2e-worker-w1-f9b4a9-6895875fc8-pt6t4\" (UID: \"708bb5a0-772d-4606-9d36-cbff726e0e1a\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-f9b4a9-6895875fc8-pt6t4"
Nov 04 05:42:29.457399 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:29.457356    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e884e3e-ffb9-4a89-85a5-d9ad28f085ea-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-f9b4a9-856cdf867f-gstt5\" (UID: \"2e884e3e-ffb9-4a89-85a5-d9ad28f085ea\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-f9b4a9-856cdf867f-gstt5"
Nov 04 05:42:29.481066 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:29.480999    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdtns\" (UniqueName: \"kubernetes.io/projected/2e884e3e-ffb9-4a89-85a5-d9ad28f085ea-kube-api-access-cdtns\") pod \"payload-pre-processing-e2e-worker-w1-f9b4a9-856cdf867f-gstt5\" (UID: \"2e884e3e-ffb9-4a89-85a5-d9ad28f085ea\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-f9b4a9-856cdf867f-gstt5"
Nov 04 05:42:29.495366 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:29.493567    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lddv\" (UniqueName: \"kubernetes.io/projected/708bb5a0-772d-4606-9d36-cbff726e0e1a-kube-api-access-9lddv\") pod \"payload-processing-e2e-worker-w1-f9b4a9-6895875fc8-pt6t4\" (UID: \"708bb5a0-772d-4606-9d36-cbff726e0e1a\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-f9b4a9-6895875fc8-pt6t4"
Nov 04 05:42:29.611722 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:29.611378    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-f9b4a9-856cdf867f-gstt5"
Nov 04 05:42:29.659983 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:29.659952    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-f9b4a9-6895875fc8-pt6t4"
Nov 04 05:42:29.860859 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:29.860822    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-ade2e8-5f56b646c-fgxpm"]
Nov 04 05:42:29.868793 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:29.868635    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-ade2e8-5f56b646c-fgxpm"
Nov 04 05:42:29.873996 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:29.873495    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-ade2e8-5f56b646c-fgxpm"]
Nov 04 05:42:29.873996 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:29.873825    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w2-ade2e8\""
Nov 04 05:42:29.873996 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:29.873948    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w2-ade2e8-dockercfg-zlkz5\""
Nov 04 05:42:29.930607 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:29.928559    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-f9b4a9-856cdf867f-gstt5"]
Nov 04 05:42:29.930607 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:42:29.930254    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e884e3e_ffb9_4a89_85a5_d9ad28f085ea.slice/crio-bb1c55e13184be4fb762a50e75e6bd74c9343d405412f9da5c9bac03aee8a334 WatchSource:0}: Error finding container bb1c55e13184be4fb762a50e75e6bd74c9343d405412f9da5c9bac03aee8a334: Status 404 returned error can't find the container with id bb1c55e13184be4fb762a50e75e6bd74c9343d405412f9da5c9bac03aee8a334
Nov 04 05:42:30.037599 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:30.036458    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-f9b4a9-6895875fc8-pt6t4"]
Nov 04 05:42:30.041561 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:42:30.041493    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod708bb5a0_772d_4606_9d36_cbff726e0e1a.slice/crio-d9c8797bac8a3687d87db40e82d781afea1a69207097bc6c7db9c17537b2ba90 WatchSource:0}: Error finding container d9c8797bac8a3687d87db40e82d781afea1a69207097bc6c7db9c17537b2ba90: Status 404 returned error can't find the container with id d9c8797bac8a3687d87db40e82d781afea1a69207097bc6c7db9c17537b2ba90
Nov 04 05:42:30.065839 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:30.065572    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ghgw\" (UniqueName: \"kubernetes.io/projected/81d52dbf-1499-4af2-a403-40ab053e7c38-kube-api-access-2ghgw\") pod \"payload-pre-processing-e2e-worker-w2-ade2e8-5f56b646c-fgxpm\" (UID: \"81d52dbf-1499-4af2-a403-40ab053e7c38\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-ade2e8-5f56b646c-fgxpm"
Nov 04 05:42:30.065839 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:30.065660    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81d52dbf-1499-4af2-a403-40ab053e7c38-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-ade2e8-5f56b646c-fgxpm\" (UID: \"81d52dbf-1499-4af2-a403-40ab053e7c38\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-ade2e8-5f56b646c-fgxpm"
Nov 04 05:42:30.170601 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:30.167590    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ghgw\" (UniqueName: \"kubernetes.io/projected/81d52dbf-1499-4af2-a403-40ab053e7c38-kube-api-access-2ghgw\") pod \"payload-pre-processing-e2e-worker-w2-ade2e8-5f56b646c-fgxpm\" (UID: \"81d52dbf-1499-4af2-a403-40ab053e7c38\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-ade2e8-5f56b646c-fgxpm"
Nov 04 05:42:30.170601 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:30.167737    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81d52dbf-1499-4af2-a403-40ab053e7c38-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-ade2e8-5f56b646c-fgxpm\" (UID: \"81d52dbf-1499-4af2-a403-40ab053e7c38\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-ade2e8-5f56b646c-fgxpm"
Nov 04 05:42:30.170601 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:30.168810    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81d52dbf-1499-4af2-a403-40ab053e7c38-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-ade2e8-5f56b646c-fgxpm\" (UID: \"81d52dbf-1499-4af2-a403-40ab053e7c38\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-ade2e8-5f56b646c-fgxpm"
Nov 04 05:42:30.180724 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:30.180659    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ghgw\" (UniqueName: \"kubernetes.io/projected/81d52dbf-1499-4af2-a403-40ab053e7c38-kube-api-access-2ghgw\") pod \"payload-pre-processing-e2e-worker-w2-ade2e8-5f56b646c-fgxpm\" (UID: \"81d52dbf-1499-4af2-a403-40ab053e7c38\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-ade2e8-5f56b646c-fgxpm"
Nov 04 05:42:30.193464 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:30.193361    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-ade2e8-5f56b646c-fgxpm"
Nov 04 05:42:30.265692 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:30.263934    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-f9b4a9-856cdf867f-gstt5" event={"ID":"2e884e3e-ffb9-4a89-85a5-d9ad28f085ea","Type":"ContainerStarted","Data":"bb1c55e13184be4fb762a50e75e6bd74c9343d405412f9da5c9bac03aee8a334"}
Nov 04 05:42:30.266885 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:30.266341    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-f9b4a9-6895875fc8-pt6t4" event={"ID":"708bb5a0-772d-4606-9d36-cbff726e0e1a","Type":"ContainerStarted","Data":"d9c8797bac8a3687d87db40e82d781afea1a69207097bc6c7db9c17537b2ba90"}
Nov 04 05:42:30.488976 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:30.488945    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-ade2e8-5f56b646c-fgxpm"]
Nov 04 05:42:31.200487 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:31.200456    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-9d808e-7788c7bbdd-59fzm"]
Nov 04 05:42:31.206167 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:31.206143    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-9d808e-7788c7bbdd-59fzm"
Nov 04 05:42:31.216580 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:31.214924    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-9d808e-7788c7bbdd-59fzm"]
Nov 04 05:42:31.223269 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:31.223245    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Nov 04 05:42:31.223394 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:31.223356    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-dcrf5\""
Nov 04 05:42:31.223681 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:31.223449    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 04 05:42:31.223681 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:31.223509    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w5-9d808e-serving-cert\""
Nov 04 05:42:31.223681 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:31.223590    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 04 05:42:31.284912 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:31.282636    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-ade2e8-5f56b646c-fgxpm" event={"ID":"81d52dbf-1499-4af2-a403-40ab053e7c38","Type":"ContainerStarted","Data":"a2e0c698f117712cb274f4a0e89b652222dab895624f753fbffba1168c66d26c"}
Nov 04 05:42:31.389416 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:31.388054    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8h9ng\" (UniqueName: \"kubernetes.io/projected/43beb0ed-3d03-4b8f-864e-62ba395ba26d-kube-api-access-8h9ng\") pod \"maas-api-e2e-worker-w5-9d808e-7788c7bbdd-59fzm\" (UID: \"43beb0ed-3d03-4b8f-864e-62ba395ba26d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-9d808e-7788c7bbdd-59fzm"
Nov 04 05:42:31.389416 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:31.388326    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/43beb0ed-3d03-4b8f-864e-62ba395ba26d-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-9d808e-7788c7bbdd-59fzm\" (UID: \"43beb0ed-3d03-4b8f-864e-62ba395ba26d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-9d808e-7788c7bbdd-59fzm"
Nov 04 05:42:31.389416 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:31.388356    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43beb0ed-3d03-4b8f-864e-62ba395ba26d-metrics-certs\") pod \"maas-api-e2e-worker-w5-9d808e-7788c7bbdd-59fzm\" (UID: \"43beb0ed-3d03-4b8f-864e-62ba395ba26d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-9d808e-7788c7bbdd-59fzm"
Nov 04 05:42:31.389416 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:31.388442    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43beb0ed-3d03-4b8f-864e-62ba395ba26d-maas-api-tls\") pod \"maas-api-e2e-worker-w5-9d808e-7788c7bbdd-59fzm\" (UID: \"43beb0ed-3d03-4b8f-864e-62ba395ba26d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-9d808e-7788c7bbdd-59fzm"
Nov 04 05:42:31.491302 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:31.491217    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43beb0ed-3d03-4b8f-864e-62ba395ba26d-maas-api-tls\") pod \"maas-api-e2e-worker-w5-9d808e-7788c7bbdd-59fzm\" (UID: \"43beb0ed-3d03-4b8f-864e-62ba395ba26d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-9d808e-7788c7bbdd-59fzm"
Nov 04 05:42:31.491302 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:31.491285    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8h9ng\" (UniqueName: \"kubernetes.io/projected/43beb0ed-3d03-4b8f-864e-62ba395ba26d-kube-api-access-8h9ng\") pod \"maas-api-e2e-worker-w5-9d808e-7788c7bbdd-59fzm\" (UID: \"43beb0ed-3d03-4b8f-864e-62ba395ba26d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-9d808e-7788c7bbdd-59fzm"
Nov 04 05:42:31.491553 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:31.491437    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/43beb0ed-3d03-4b8f-864e-62ba395ba26d-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-9d808e-7788c7bbdd-59fzm\" (UID: \"43beb0ed-3d03-4b8f-864e-62ba395ba26d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-9d808e-7788c7bbdd-59fzm"
Nov 04 05:42:31.491553 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:31.491472    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43beb0ed-3d03-4b8f-864e-62ba395ba26d-metrics-certs\") pod \"maas-api-e2e-worker-w5-9d808e-7788c7bbdd-59fzm\" (UID: \"43beb0ed-3d03-4b8f-864e-62ba395ba26d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-9d808e-7788c7bbdd-59fzm"
Nov 04 05:42:31.496894 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:31.494146    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/43beb0ed-3d03-4b8f-864e-62ba395ba26d-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-9d808e-7788c7bbdd-59fzm\" (UID: \"43beb0ed-3d03-4b8f-864e-62ba395ba26d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-9d808e-7788c7bbdd-59fzm"
Nov 04 05:42:31.507856 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:31.507826    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8h9ng\" (UniqueName: \"kubernetes.io/projected/43beb0ed-3d03-4b8f-864e-62ba395ba26d-kube-api-access-8h9ng\") pod \"maas-api-e2e-worker-w5-9d808e-7788c7bbdd-59fzm\" (UID: \"43beb0ed-3d03-4b8f-864e-62ba395ba26d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-9d808e-7788c7bbdd-59fzm"
Nov 04 05:42:31.515798 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:31.515716    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43beb0ed-3d03-4b8f-864e-62ba395ba26d-metrics-certs\") pod \"maas-api-e2e-worker-w5-9d808e-7788c7bbdd-59fzm\" (UID: \"43beb0ed-3d03-4b8f-864e-62ba395ba26d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-9d808e-7788c7bbdd-59fzm"
Nov 04 05:42:31.521012 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:31.520957    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43beb0ed-3d03-4b8f-864e-62ba395ba26d-maas-api-tls\") pod \"maas-api-e2e-worker-w5-9d808e-7788c7bbdd-59fzm\" (UID: \"43beb0ed-3d03-4b8f-864e-62ba395ba26d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-9d808e-7788c7bbdd-59fzm"
Nov 04 05:42:31.537400 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:31.537369    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-9d808e-7788c7bbdd-59fzm"
Nov 04 05:42:31.925551 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:31.924594    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-9d808e-7788c7bbdd-59fzm"]
Nov 04 05:42:32.295907 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:32.295786    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-9d808e-7788c7bbdd-59fzm" event={"ID":"43beb0ed-3d03-4b8f-864e-62ba395ba26d","Type":"ContainerStarted","Data":"27e9eb9dbbf1f29cae8ce8a744aeac7aae37cd98e2eb7ed81afca94e38a840f4"}
Nov 04 05:42:32.298216 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:32.298010    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-f910f5-58ddd75998-7rkwk" event={"ID":"aaf73a4d-306e-43bd-a6b7-b3dfb2f29dee","Type":"ContainerStarted","Data":"d0ac334bc29691636db49984ab82b9fbc0f4609fdf27d4f165b321e8bb953225"}
Nov 04 05:42:32.298723 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:32.298706    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w3-f910f5-58ddd75998-7rkwk"
Nov 04 05:42:32.302368 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:32.300792    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-27935d-6dffddbb9f-8k6nc" event={"ID":"5ed67653-cc0f-4000-aa56-edd9d733b025","Type":"ContainerStarted","Data":"926bbda821115dc3e4fe8c35c17083b064dd5f8c0d59ce7d82e3bd159709f8b5"}
Nov 04 05:42:32.302368 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:32.301412    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-27935d-6dffddbb9f-8k6nc"
Nov 04 05:42:32.305705 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:32.305678    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-ade2e8-5f56b646c-fgxpm" event={"ID":"81d52dbf-1499-4af2-a403-40ab053e7c38","Type":"ContainerStarted","Data":"a6b221afb265e6755061dbcc6baef4ddf12a97a890e2c5a7b67b12fdf9c1f5f9"}
Nov 04 05:42:32.306257 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:32.306239    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-ade2e8-5f56b646c-fgxpm"
Nov 04 05:42:32.308963 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:32.308779    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-f910f5-668ff7855-g8p5s" event={"ID":"6c343ea7-372f-4d66-9534-c758209541b0","Type":"ContainerStarted","Data":"b9b10d6504efd8555670fdd8384501f36a2030a9431bb0fc76f0f694511d6fec"}
Nov 04 05:42:32.309360 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:32.309316    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-f910f5-668ff7855-g8p5s"
Nov 04 05:42:32.314487 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:32.314440    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w3-f910f5-58ddd75998-7rkwk" podStartSLOduration=2.4011254490000002 podStartE2EDuration="7.314425062s" totalImagesPullingTime="4.913299613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:42:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:42:32.313845116 +0000 UTC m=+839.182508688" watchObservedRunningTime="2026-11-04 05:42:32.314425062 +0000 UTC m=+839.183088635"
Nov 04 05:42:32.334698 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:32.334652    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-27935d-6dffddbb9f-8k6nc" podStartSLOduration=2.211403952 podStartE2EDuration="5.334636714s" totalImagesPullingTime="3.123232762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:42:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:42:32.333217769 +0000 UTC m=+839.201881354" watchObservedRunningTime="2026-11-04 05:42:32.334636714 +0000 UTC m=+839.203300288"
Nov 04 05:42:32.348588 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:32.348499    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-f910f5-668ff7855-g8p5s" podStartSLOduration=2.174802279 podStartE2EDuration="7.348483493s" totalImagesPullingTime="5.173681214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:42:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:42:32.346336461 +0000 UTC m=+839.215000038" watchObservedRunningTime="2026-11-04 05:42:32.348483493 +0000 UTC m=+839.217147067"
Nov 04 05:42:32.381358 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:32.370400    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-ade2e8-5f56b646c-fgxpm" podStartSLOduration=2.113102414 podStartE2EDuration="3.370382622s" totalImagesPullingTime="1.257280208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:42:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:42:32.369889545 +0000 UTC m=+839.238553113" watchObservedRunningTime="2026-11-04 05:42:32.370382622 +0000 UTC m=+839.239046195"
Nov 04 05:42:33.321940 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:33.320916    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-2b14d0-6996d75467-hndgq" event={"ID":"4c9a887b-1a65-414a-b186-7745adf36f4e","Type":"ContainerStarted","Data":"f350e9a5a8305a0ca6ee905a849ca6593341678b7b32caa2010649408125f004"}
Nov 04 05:42:33.321940 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:33.321597    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-2b14d0-6996d75467-hndgq"
Nov 04 05:42:33.356595 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:33.351139    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-2b14d0-6996d75467-hndgq" podStartSLOduration=2.010676928 podStartE2EDuration="7.3511194s" totalImagesPullingTime="5.340442472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:42:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:42:33.348039554 +0000 UTC m=+840.216703140" watchObservedRunningTime="2026-11-04 05:42:33.3511194 +0000 UTC m=+840.219782975"
Nov 04 05:42:34.336576 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:34.336501    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-f9b4a9-6895875fc8-pt6t4" event={"ID":"708bb5a0-772d-4606-9d36-cbff726e0e1a","Type":"ContainerStarted","Data":"a56755705fd4babf503db6b48a5f9c5f6551a870060c8b7752b6da2bdbd76073"}
Nov 04 05:42:34.337408 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:34.337385    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w1-f9b4a9-6895875fc8-pt6t4"
Nov 04 05:42:34.381451 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:34.381383    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w1-f9b4a9-6895875fc8-pt6t4" podStartSLOduration=1.9749620540000001 podStartE2EDuration="5.381361065s" totalImagesPullingTime="3.406399011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:42:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:42:34.36597798 +0000 UTC m=+841.234641553" watchObservedRunningTime="2026-11-04 05:42:34.381361065 +0000 UTC m=+841.250024639"
Nov 04 05:42:34.389002 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:34.387864    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-9a0c8b-74cc6fdc84-xbzmp" event={"ID":"b64e7e74-8b44-4678-ab75-e5237143a2b1","Type":"ContainerStarted","Data":"8cc1d126dfb78e630365ed0a66e656fb772c83553087b435cab565db1091af2f"}
Nov 04 05:42:34.389223 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:34.389204    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-9a0c8b-74cc6fdc84-xbzmp"
Nov 04 05:42:34.412304 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:34.412270    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-f9b4a9-856cdf867f-gstt5" event={"ID":"2e884e3e-ffb9-4a89-85a5-d9ad28f085ea","Type":"ContainerStarted","Data":"dd15bd305f34a617d9508c18dd6182626f7df6ecfc8d04edb9ec10e3a50bfa5a"}
Nov 04 05:42:34.412535 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:34.412499    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-f9b4a9-856cdf867f-gstt5"
Nov 04 05:42:34.417142 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:34.416974    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w4-9a0c8b-74cc6fdc84-xbzmp" podStartSLOduration=1.549966944 podStartE2EDuration="7.416960983s" totalImagesPullingTime="5.866994039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:42:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:42:34.41642958 +0000 UTC m=+841.285093154" watchObservedRunningTime="2026-11-04 05:42:34.416960983 +0000 UTC m=+841.285624555"
Nov 04 05:42:34.440926 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:34.440863    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-f9b4a9-856cdf867f-gstt5" podStartSLOduration=2.15581374 podStartE2EDuration="5.440844138s" totalImagesPullingTime="3.285030398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:42:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:42:34.43657346 +0000 UTC m=+841.305237033" watchObservedRunningTime="2026-11-04 05:42:34.440844138 +0000 UTC m=+841.309507711"
Nov 04 05:42:35.419304 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:35.419262    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-9d808e-7788c7bbdd-59fzm" event={"ID":"43beb0ed-3d03-4b8f-864e-62ba395ba26d","Type":"ContainerStarted","Data":"4dd2ff7406e5c3e9a5d5ba3fcd4a3cdd9064d2c80b1edf72e2619ef52b1cb01a"}
Nov 04 05:42:35.419791 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:35.419388    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-9d808e-7788c7bbdd-59fzm"
Nov 04 05:42:35.435961 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:35.435907    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-9d808e-7788c7bbdd-59fzm" podStartSLOduration=1.666427352 podStartE2EDuration="4.435882626s" totalImagesPullingTime="2.769455274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:42:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:42:35.435731495 +0000 UTC m=+842.304395067" watchObservedRunningTime="2026-11-04 05:42:35.435882626 +0000 UTC m=+842.304546197"
Nov 04 05:42:39.251732 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:39.251688    4357 patch_prober.go:29] interesting pod/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 04 05:42:39.252214 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:39.252175    4357 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q" podUID="43dd698a-4caf-4a7d-8dc3-dfe458da5c68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 04 05:42:41.452460 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:41.452404    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-9d808e-7788c7bbdd-59fzm"
Nov 04 05:42:43.300895 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:43.300860    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-f910f5/simulator-w3-f910f5-kserve-7b898c5797-pgfjz"]
Nov 04 05:42:43.304659 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:43.304639    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-f910f5/simulator-w3-f910f5-kserve-7b898c5797-pgfjz"
Nov 04 05:42:43.312585 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:43.312305    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-f910f5\"/\"kube-root-ca.crt\""
Nov 04 05:42:43.312585 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:43.312472    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-f910f5\"/\"simulator-w3-f910f5-kserve-self-signed-certs\""
Nov 04 05:42:43.312784 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:43.312596    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-f910f5\"/\"openshift-service-ca.crt\""
Nov 04 05:42:43.312784 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:43.312704    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-f910f5\"/\"default-dockercfg-nm5gm\""
Nov 04 05:42:43.316017 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:43.315993    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-f910f5/simulator-w3-f910f5-kserve-7b898c5797-pgfjz"]
Nov 04 05:42:43.377509 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:43.377483    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e-home\") pod \"simulator-w3-f910f5-kserve-7b898c5797-pgfjz\" (UID: \"9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e\") " pod="e2e-models-e2e-worker-w3-f910f5/simulator-w3-f910f5-kserve-7b898c5797-pgfjz"
Nov 04 05:42:43.377676 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:43.377572    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e-model-cache\") pod \"simulator-w3-f910f5-kserve-7b898c5797-pgfjz\" (UID: \"9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e\") " pod="e2e-models-e2e-worker-w3-f910f5/simulator-w3-f910f5-kserve-7b898c5797-pgfjz"
Nov 04 05:42:43.377730 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:43.377673    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e-tmp-dir\") pod \"simulator-w3-f910f5-kserve-7b898c5797-pgfjz\" (UID: \"9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e\") " pod="e2e-models-e2e-worker-w3-f910f5/simulator-w3-f910f5-kserve-7b898c5797-pgfjz"
Nov 04 05:42:43.377806 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:43.377785    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2lg7\" (UniqueName: \"kubernetes.io/projected/9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e-kube-api-access-h2lg7\") pod \"simulator-w3-f910f5-kserve-7b898c5797-pgfjz\" (UID: \"9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e\") " pod="e2e-models-e2e-worker-w3-f910f5/simulator-w3-f910f5-kserve-7b898c5797-pgfjz"
Nov 04 05:42:43.377944 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:43.377927    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e-tls-certs\") pod \"simulator-w3-f910f5-kserve-7b898c5797-pgfjz\" (UID: \"9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e\") " pod="e2e-models-e2e-worker-w3-f910f5/simulator-w3-f910f5-kserve-7b898c5797-pgfjz"
Nov 04 05:42:43.378067 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:43.377958    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e-dshm\") pod \"simulator-w3-f910f5-kserve-7b898c5797-pgfjz\" (UID: \"9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e\") " pod="e2e-models-e2e-worker-w3-f910f5/simulator-w3-f910f5-kserve-7b898c5797-pgfjz"
Nov 04 05:42:43.478794 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:43.478717    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2lg7\" (UniqueName: \"kubernetes.io/projected/9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e-kube-api-access-h2lg7\") pod \"simulator-w3-f910f5-kserve-7b898c5797-pgfjz\" (UID: \"9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e\") " pod="e2e-models-e2e-worker-w3-f910f5/simulator-w3-f910f5-kserve-7b898c5797-pgfjz"
Nov 04 05:42:43.478974 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:43.478860    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e-tls-certs\") pod \"simulator-w3-f910f5-kserve-7b898c5797-pgfjz\" (UID: \"9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e\") " pod="e2e-models-e2e-worker-w3-f910f5/simulator-w3-f910f5-kserve-7b898c5797-pgfjz"
Nov 04 05:42:43.478974 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:43.478891    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e-dshm\") pod \"simulator-w3-f910f5-kserve-7b898c5797-pgfjz\" (UID: \"9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e\") " pod="e2e-models-e2e-worker-w3-f910f5/simulator-w3-f910f5-kserve-7b898c5797-pgfjz"
Nov 04 05:42:43.478974 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:43.478963    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e-home\") pod \"simulator-w3-f910f5-kserve-7b898c5797-pgfjz\" (UID: \"9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e\") " pod="e2e-models-e2e-worker-w3-f910f5/simulator-w3-f910f5-kserve-7b898c5797-pgfjz"
Nov 04 05:42:43.479152 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:43.479054    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e-model-cache\") pod \"simulator-w3-f910f5-kserve-7b898c5797-pgfjz\" (UID: \"9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e\") " pod="e2e-models-e2e-worker-w3-f910f5/simulator-w3-f910f5-kserve-7b898c5797-pgfjz"
Nov 04 05:42:43.479152 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:43.479088    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e-tmp-dir\") pod \"simulator-w3-f910f5-kserve-7b898c5797-pgfjz\" (UID: \"9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e\") " pod="e2e-models-e2e-worker-w3-f910f5/simulator-w3-f910f5-kserve-7b898c5797-pgfjz"
Nov 04 05:42:43.479746 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:43.479668    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e-home\") pod \"simulator-w3-f910f5-kserve-7b898c5797-pgfjz\" (UID: \"9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e\") " pod="e2e-models-e2e-worker-w3-f910f5/simulator-w3-f910f5-kserve-7b898c5797-pgfjz"
Nov 04 05:42:43.479853 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:43.479769    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e-model-cache\") pod \"simulator-w3-f910f5-kserve-7b898c5797-pgfjz\" (UID: \"9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e\") " pod="e2e-models-e2e-worker-w3-f910f5/simulator-w3-f910f5-kserve-7b898c5797-pgfjz"
Nov 04 05:42:43.479928 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:43.479912    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e-tmp-dir\") pod \"simulator-w3-f910f5-kserve-7b898c5797-pgfjz\" (UID: \"9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e\") " pod="e2e-models-e2e-worker-w3-f910f5/simulator-w3-f910f5-kserve-7b898c5797-pgfjz"
Nov 04 05:42:43.481278 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:43.481246    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e-dshm\") pod \"simulator-w3-f910f5-kserve-7b898c5797-pgfjz\" (UID: \"9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e\") " pod="e2e-models-e2e-worker-w3-f910f5/simulator-w3-f910f5-kserve-7b898c5797-pgfjz"
Nov 04 05:42:43.481928 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:43.481776    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e-tls-certs\") pod \"simulator-w3-f910f5-kserve-7b898c5797-pgfjz\" (UID: \"9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e\") " pod="e2e-models-e2e-worker-w3-f910f5/simulator-w3-f910f5-kserve-7b898c5797-pgfjz"
Nov 04 05:42:43.486230 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:43.486206    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2lg7\" (UniqueName: \"kubernetes.io/projected/9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e-kube-api-access-h2lg7\") pod \"simulator-w3-f910f5-kserve-7b898c5797-pgfjz\" (UID: \"9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e\") " pod="e2e-models-e2e-worker-w3-f910f5/simulator-w3-f910f5-kserve-7b898c5797-pgfjz"
Nov 04 05:42:43.527976 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:43.527926    4357 generic.go:356] "Generic (PLEG): container finished" podID="43dd698a-4caf-4a7d-8dc3-dfe458da5c68" containerID="9417792dab7e151685ef78d5bdae42d766555fffd8006b814ddc386077cebf9b" exitCode=0
Nov 04 05:42:43.528158 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:43.528041    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q" event={"ID":"43dd698a-4caf-4a7d-8dc3-dfe458da5c68","Type":"ContainerDied","Data":"9417792dab7e151685ef78d5bdae42d766555fffd8006b814ddc386077cebf9b"}
Nov 04 05:42:43.529194 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:43.528605    4357 scope.go:122] "RemoveContainer" containerID="9417792dab7e151685ef78d5bdae42d766555fffd8006b814ddc386077cebf9b"
Nov 04 05:42:43.530363 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:43.530325    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:42:43.530480 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:43.530418    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:42:43.530480 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:43.530470    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:42:43.619055 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:43.619016    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-f910f5/simulator-w3-f910f5-kserve-7b898c5797-pgfjz"
Nov 04 05:42:43.911350 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:43.911098    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-f910f5/simulator-w3-f910f5-kserve-7b898c5797-pgfjz"]
Nov 04 05:42:43.912020 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:42:43.911985    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9eb4ca7b_9cff_4ac0_947a_bbfd189b4f1e.slice/crio-9a5e2d12d38606931ab36d22ed01f37541c244f9837f61135dd65718407c6d8c WatchSource:0}: Error finding container 9a5e2d12d38606931ab36d22ed01f37541c244f9837f61135dd65718407c6d8c: Status 404 returned error can't find the container with id 9a5e2d12d38606931ab36d22ed01f37541c244f9837f61135dd65718407c6d8c
Nov 04 05:42:44.426540 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:44.426043    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-27935d-6dffddbb9f-8k6nc"
Nov 04 05:42:44.426540 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:44.426201    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-ade2e8-5f56b646c-fgxpm"
Nov 04 05:42:44.427045 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:44.426605    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w3-f910f5-58ddd75998-7rkwk"
Nov 04 05:42:44.427045 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:44.426788    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-f910f5-668ff7855-g8p5s"
Nov 04 05:42:44.534325 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:44.534291    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-f910f5/simulator-w3-f910f5-kserve-7b898c5797-pgfjz" event={"ID":"9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e","Type":"ContainerStarted","Data":"cf2b293d4618287b19330ebf869625b210a5f751e5ba390b80404388668872d5"}
Nov 04 05:42:44.534575 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:44.534554    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-f910f5/simulator-w3-f910f5-kserve-7b898c5797-pgfjz" event={"ID":"9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e","Type":"ContainerStarted","Data":"9a5e2d12d38606931ab36d22ed01f37541c244f9837f61135dd65718407c6d8c"}
Nov 04 05:42:44.537655 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:44.537630    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q" event={"ID":"43dd698a-4caf-4a7d-8dc3-dfe458da5c68","Type":"ContainerStarted","Data":"8e61e417f55a556154f58480608b2d3b32895136182ebbcd93755e184fa2c96a"}
Nov 04 05:42:44.556077 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:44.556027    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-f910f5/simulator-w3-f910f5-kserve-7b898c5797-pgfjz" podStartSLOduration=1.556013399 podStartE2EDuration="1.556013399s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:42:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:42:44.552052015 +0000 UTC m=+851.420715588" watchObservedRunningTime="2026-11-04 05:42:44.556013399 +0000 UTC m=+851.424676970"
Nov 04 05:42:44.619476 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:44.619438    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-f910f5/simulator-w3-f910f5-kserve-7b898c5797-pgfjz"
Nov 04 05:42:45.423378 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:45.423309    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-2b14d0-6996d75467-hndgq"
Nov 04 05:42:45.483541 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:45.481679    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q"
Nov 04 05:42:45.483541 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:45.482058    4357 patch_prober.go:29] interesting pod/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Nov 04 05:42:45.483541 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:45.482110    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q" podUID="43dd698a-4caf-4a7d-8dc3-dfe458da5c68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Nov 04 05:42:45.543574 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:45.543545    4357 generic.go:356] "Generic (PLEG): container finished" podID="74410632-d803-4ede-89e3-3bc956968fe0" containerID="5b039729140d3c8580791af55a16af1ac45e5fbea1791f2a56a83a65b0679f25" exitCode=0
Nov 04 05:42:45.543748 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:45.543612    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs" event={"ID":"74410632-d803-4ede-89e3-3bc956968fe0","Type":"ContainerDied","Data":"5b039729140d3c8580791af55a16af1ac45e5fbea1791f2a56a83a65b0679f25"}
Nov 04 05:42:45.544052 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:45.544032    4357 scope.go:122] "RemoveContainer" containerID="5b039729140d3c8580791af55a16af1ac45e5fbea1791f2a56a83a65b0679f25"
Nov 04 05:42:45.545646 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:45.545618    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:42:45.545767 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:45.545694    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:42:45.545767 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:45.545736    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:42:45.545767 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:45.545746    4357 generic.go:356] "Generic (PLEG): container finished" podID="8d46061a-a82a-4a03-8200-c9ba11866b48" containerID="d3d03b75ec9f0e1bb3370abcc7369cf1a332e54c722fad8798f0b29b496e9e0c" exitCode=0
Nov 04 05:42:45.545955 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:45.545810    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn" event={"ID":"8d46061a-a82a-4a03-8200-c9ba11866b48","Type":"ContainerDied","Data":"d3d03b75ec9f0e1bb3370abcc7369cf1a332e54c722fad8798f0b29b496e9e0c"}
Nov 04 05:42:45.551865 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:45.551588    4357 scope.go:122] "RemoveContainer" containerID="d3d03b75ec9f0e1bb3370abcc7369cf1a332e54c722fad8798f0b29b496e9e0c"
Nov 04 05:42:45.586980 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:45.586037    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:42:45.586980 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:45.586129    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:42:45.586980 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:45.586171    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:42:46.454984 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:46.454875    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-9a0c8b-74cc6fdc84-xbzmp"
Nov 04 05:42:46.455179 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:46.455113    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w1-f9b4a9-6895875fc8-pt6t4"
Nov 04 05:42:46.457693 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:46.457670    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-f9b4a9-856cdf867f-gstt5"
Nov 04 05:42:46.482181 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:46.481808    4357 patch_prober.go:29] interesting pod/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Nov 04 05:42:46.482181 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:46.481866    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q" podUID="43dd698a-4caf-4a7d-8dc3-dfe458da5c68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Nov 04 05:42:46.653404 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:46.653374    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs" event={"ID":"74410632-d803-4ede-89e3-3bc956968fe0","Type":"ContainerStarted","Data":"94a7c62b8d33d26af321a3ab113d03e8207f3099a0b384ece3491b59bc9dc2f9"}
Nov 04 05:42:46.682539 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:46.660533    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn" event={"ID":"8d46061a-a82a-4a03-8200-c9ba11866b48","Type":"ContainerStarted","Data":"bb1348c0a36c99d899fa8e06318093134429bac30b0878b825e131a4315afd25"}
Nov 04 05:42:46.858913 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:46.858879    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs"
Nov 04 05:42:46.859172 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:46.858926    4357 patch_prober.go:29] interesting pod/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Nov 04 05:42:46.859172 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:46.858973    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs" podUID="74410632-d803-4ede-89e3-3bc956968fe0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Nov 04 05:42:47.476573 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:47.475838    4357 patch_prober.go:29] interesting pod/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Nov 04 05:42:47.476573 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:47.475916    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q" podUID="43dd698a-4caf-4a7d-8dc3-dfe458da5c68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Nov 04 05:42:47.489540 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:42:47.483134    4357 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-npgcv" containerName="extractor"
Nov 04 05:42:47.643949 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:47.643762    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn"
Nov 04 05:42:47.644158 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:47.643979    4357 patch_prober.go:29] interesting pod/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Nov 04 05:42:47.644158 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:47.644032    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn" podUID="8d46061a-a82a-4a03-8200-c9ba11866b48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Nov 04 05:42:47.822540 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:47.821853    4357 patch_prober.go:29] interesting pod/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Nov 04 05:42:47.822540 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:47.821912    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs" podUID="74410632-d803-4ede-89e3-3bc956968fe0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Nov 04 05:42:48.468054 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:48.468019    4357 patch_prober.go:29] interesting pod/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Nov 04 05:42:48.468496 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:48.468442    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q" podUID="43dd698a-4caf-4a7d-8dc3-dfe458da5c68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Nov 04 05:42:48.644288 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:48.644100    4357 patch_prober.go:29] interesting pod/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Nov 04 05:42:48.644288 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:48.644159    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn" podUID="8d46061a-a82a-4a03-8200-c9ba11866b48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Nov 04 05:42:48.823124 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:48.823089    4357 patch_prober.go:29] interesting pod/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Nov 04 05:42:48.823777 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:48.823729    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs" podUID="74410632-d803-4ede-89e3-3bc956968fe0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Nov 04 05:42:49.477540 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:49.467603    4357 patch_prober.go:29] interesting pod/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Nov 04 05:42:49.477540 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:49.467661    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q" podUID="43dd698a-4caf-4a7d-8dc3-dfe458da5c68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Nov 04 05:42:49.646972 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:49.646940    4357 patch_prober.go:29] interesting pod/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Nov 04 05:42:49.647228 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:49.647200    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn" podUID="8d46061a-a82a-4a03-8200-c9ba11866b48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Nov 04 05:42:49.823304 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:49.822878    4357 patch_prober.go:29] interesting pod/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Nov 04 05:42:49.823304 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:49.822934    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs" podUID="74410632-d803-4ede-89e3-3bc956968fe0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Nov 04 05:42:50.644233 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:50.644201    4357 patch_prober.go:29] interesting pod/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Nov 04 05:42:50.644409 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:50.644258    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn" podUID="8d46061a-a82a-4a03-8200-c9ba11866b48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Nov 04 05:42:50.831186 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:50.831151    4357 patch_prober.go:29] interesting pod/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Nov 04 05:42:50.831851 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:50.831801    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs" podUID="74410632-d803-4ede-89e3-3bc956968fe0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Nov 04 05:42:51.047001 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:51.046974    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q"
Nov 04 05:42:51.047748 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:51.047733    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q"
Nov 04 05:42:51.048803 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:51.048785    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q"
Nov 04 05:42:51.644310 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:51.644274    4357 patch_prober.go:29] interesting pod/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Nov 04 05:42:51.644471 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:51.644327    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn" podUID="8d46061a-a82a-4a03-8200-c9ba11866b48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Nov 04 05:42:51.822926 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:51.822837    4357 patch_prober.go:29] interesting pod/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Nov 04 05:42:51.823101 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:51.823064    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs" podUID="74410632-d803-4ede-89e3-3bc956968fe0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Nov 04 05:42:52.207082 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:52.207032    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-9a0c8b/simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf"]
Nov 04 05:42:52.222461 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:52.222422    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-9a0c8b/simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf"
Nov 04 05:42:52.229541 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:52.229478    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-9a0c8b\"/\"openshift-service-ca.crt\""
Nov 04 05:42:52.229541 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:52.229601    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-9a0c8b\"/\"simulator-w4-9a0c8b-kserve-self-signed-certs\""
Nov 04 05:42:52.229541 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:52.229669    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-9a0c8b\"/\"default-dockercfg-mhxj5\""
Nov 04 05:42:52.230014 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:52.229752    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-9a0c8b\"/\"kube-root-ca.crt\""
Nov 04 05:42:52.244305 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:52.242949    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-9a0c8b/simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf"]
Nov 04 05:42:52.256240 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:52.256207    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tpzb\" (UniqueName: \"kubernetes.io/projected/3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c-kube-api-access-6tpzb\") pod \"simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf\" (UID: \"3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c\") " pod="e2e-models-e2e-worker-w4-9a0c8b/simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf"
Nov 04 05:42:52.256397 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:52.256333    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c-dshm\") pod \"simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf\" (UID: \"3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c\") " pod="e2e-models-e2e-worker-w4-9a0c8b/simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf"
Nov 04 05:42:52.256468 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:52.256413    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c-model-cache\") pod \"simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf\" (UID: \"3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c\") " pod="e2e-models-e2e-worker-w4-9a0c8b/simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf"
Nov 04 05:42:52.256468 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:52.256455    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c-tmp-dir\") pod \"simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf\" (UID: \"3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c\") " pod="e2e-models-e2e-worker-w4-9a0c8b/simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf"
Nov 04 05:42:52.256624 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:52.256606    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c-home\") pod \"simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf\" (UID: \"3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c\") " pod="e2e-models-e2e-worker-w4-9a0c8b/simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf"
Nov 04 05:42:52.256713 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:52.256654    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c-tls-certs\") pod \"simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf\" (UID: \"3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c\") " pod="e2e-models-e2e-worker-w4-9a0c8b/simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf"
Nov 04 05:42:52.357891 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:52.357854    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tpzb\" (UniqueName: \"kubernetes.io/projected/3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c-kube-api-access-6tpzb\") pod \"simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf\" (UID: \"3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c\") " pod="e2e-models-e2e-worker-w4-9a0c8b/simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf"
Nov 04 05:42:52.358078 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:52.357906    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c-dshm\") pod \"simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf\" (UID: \"3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c\") " pod="e2e-models-e2e-worker-w4-9a0c8b/simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf"
Nov 04 05:42:52.358078 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:52.357951    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c-model-cache\") pod \"simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf\" (UID: \"3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c\") " pod="e2e-models-e2e-worker-w4-9a0c8b/simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf"
Nov 04 05:42:52.358078 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:52.357980    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c-tmp-dir\") pod \"simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf\" (UID: \"3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c\") " pod="e2e-models-e2e-worker-w4-9a0c8b/simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf"
Nov 04 05:42:52.358078 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:52.358076    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c-home\") pod \"simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf\" (UID: \"3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c\") " pod="e2e-models-e2e-worker-w4-9a0c8b/simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf"
Nov 04 05:42:52.358269 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:52.358115    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c-tls-certs\") pod \"simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf\" (UID: \"3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c\") " pod="e2e-models-e2e-worker-w4-9a0c8b/simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf"
Nov 04 05:42:52.358414 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:52.358392    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c-model-cache\") pod \"simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf\" (UID: \"3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c\") " pod="e2e-models-e2e-worker-w4-9a0c8b/simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf"
Nov 04 05:42:52.358471 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:52.358440    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c-home\") pod \"simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf\" (UID: \"3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c\") " pod="e2e-models-e2e-worker-w4-9a0c8b/simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf"
Nov 04 05:42:52.358529 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:52.358466    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c-tmp-dir\") pod \"simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf\" (UID: \"3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c\") " pod="e2e-models-e2e-worker-w4-9a0c8b/simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf"
Nov 04 05:42:52.360149 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:52.360132    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c-dshm\") pod \"simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf\" (UID: \"3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c\") " pod="e2e-models-e2e-worker-w4-9a0c8b/simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf"
Nov 04 05:42:52.360590 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:52.360571    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c-tls-certs\") pod \"simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf\" (UID: \"3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c\") " pod="e2e-models-e2e-worker-w4-9a0c8b/simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf"
Nov 04 05:42:52.364861 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:52.364840    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tpzb\" (UniqueName: \"kubernetes.io/projected/3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c-kube-api-access-6tpzb\") pod \"simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf\" (UID: \"3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c\") " pod="e2e-models-e2e-worker-w4-9a0c8b/simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf"
Nov 04 05:42:52.550808 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:52.550779    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-9a0c8b/simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf"
Nov 04 05:42:52.648922 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:52.648895    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn"
Nov 04 05:42:52.649452 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:52.649401    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn"
Nov 04 05:42:52.650477 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:52.650458    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn"
Nov 04 05:42:52.824845 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:52.824751    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs"
Nov 04 05:42:52.825810 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:52.825783    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs"
Nov 04 05:42:52.826446 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:52.826425    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs"
Nov 04 05:42:52.827278 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:52.827260    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-9a0c8b/simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf"]
Nov 04 05:42:52.829329 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:42:52.829307    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3fb2c23b_1cfa_49b7_b21d_c13dc34c5b6c.slice/crio-1194e39c63f86fe19b553238a96bb8f5a21d686a0fc547a09bdafacd80a61efd WatchSource:0}: Error finding container 1194e39c63f86fe19b553238a96bb8f5a21d686a0fc547a09bdafacd80a61efd: Status 404 returned error can't find the container with id 1194e39c63f86fe19b553238a96bb8f5a21d686a0fc547a09bdafacd80a61efd
Nov 04 05:42:53.619803 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:53.619771    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-f910f5/simulator-w3-f910f5-kserve-7b898c5797-pgfjz"
Nov 04 05:42:53.632376 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:53.632353    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-f910f5/simulator-w3-f910f5-kserve-7b898c5797-pgfjz"
Nov 04 05:42:53.816983 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:53.816949    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-9a0c8b/simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf" event={"ID":"3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c","Type":"ContainerStarted","Data":"2276c32c194e2b98dfb1c9684231686f8d55557f1ab661e77c6dc7ccf14d0daf"}
Nov 04 05:42:53.817145 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:53.816993    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-9a0c8b/simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf" event={"ID":"3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c","Type":"ContainerStarted","Data":"1194e39c63f86fe19b553238a96bb8f5a21d686a0fc547a09bdafacd80a61efd"}
Nov 04 05:42:53.828186 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:53.828165    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-f910f5/simulator-w3-f910f5-kserve-7b898c5797-pgfjz"
Nov 04 05:42:53.836926 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:53.836773    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-9a0c8b/simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf" podStartSLOduration=1.836730779 podStartE2EDuration="1.836730779s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:42:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:42:53.83571823 +0000 UTC m=+860.704381803" watchObservedRunningTime="2026-11-04 05:42:53.836730779 +0000 UTC m=+860.705394353"
Nov 04 05:42:54.491149 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:54.491108    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-9d808e/simulator-w5-9d808e-kserve-bccd5db46-88b5x"]
Nov 04 05:42:54.496080 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:54.496057    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-9d808e/simulator-w5-9d808e-kserve-bccd5db46-88b5x"
Nov 04 05:42:54.502655 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:54.502086    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-9d808e\"/\"openshift-service-ca.crt\""
Nov 04 05:42:54.502655 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:54.502102    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-9d808e\"/\"kube-root-ca.crt\""
Nov 04 05:42:54.502655 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:54.502129    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-9d808e\"/\"default-dockercfg-r9vd2\""
Nov 04 05:42:54.502655 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:54.502201    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-9d808e\"/\"simulator-w5-9d808e-kserve-self-signed-certs\""
Nov 04 05:42:54.504271 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:54.504249    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-9d808e/simulator-w5-9d808e-kserve-bccd5db46-88b5x"]
Nov 04 05:42:54.551494 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:54.551467    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-9a0c8b/simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf"
Nov 04 05:42:54.585411 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:54.585385    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6f1cb38-ae78-424c-ba8a-dd470888a1b1-dshm\") pod \"simulator-w5-9d808e-kserve-bccd5db46-88b5x\" (UID: \"f6f1cb38-ae78-424c-ba8a-dd470888a1b1\") " pod="e2e-models-e2e-worker-w5-9d808e/simulator-w5-9d808e-kserve-bccd5db46-88b5x"
Nov 04 05:42:54.585552 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:54.585420    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6f1cb38-ae78-424c-ba8a-dd470888a1b1-home\") pod \"simulator-w5-9d808e-kserve-bccd5db46-88b5x\" (UID: \"f6f1cb38-ae78-424c-ba8a-dd470888a1b1\") " pod="e2e-models-e2e-worker-w5-9d808e/simulator-w5-9d808e-kserve-bccd5db46-88b5x"
Nov 04 05:42:54.585606 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:54.585551    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6f1cb38-ae78-424c-ba8a-dd470888a1b1-tls-certs\") pod \"simulator-w5-9d808e-kserve-bccd5db46-88b5x\" (UID: \"f6f1cb38-ae78-424c-ba8a-dd470888a1b1\") " pod="e2e-models-e2e-worker-w5-9d808e/simulator-w5-9d808e-kserve-bccd5db46-88b5x"
Nov 04 05:42:54.585606 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:54.585583    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6f1cb38-ae78-424c-ba8a-dd470888a1b1-tmp-dir\") pod \"simulator-w5-9d808e-kserve-bccd5db46-88b5x\" (UID: \"f6f1cb38-ae78-424c-ba8a-dd470888a1b1\") " pod="e2e-models-e2e-worker-w5-9d808e/simulator-w5-9d808e-kserve-bccd5db46-88b5x"
Nov 04 05:42:54.585671 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:54.585606    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6f1cb38-ae78-424c-ba8a-dd470888a1b1-model-cache\") pod \"simulator-w5-9d808e-kserve-bccd5db46-88b5x\" (UID: \"f6f1cb38-ae78-424c-ba8a-dd470888a1b1\") " pod="e2e-models-e2e-worker-w5-9d808e/simulator-w5-9d808e-kserve-bccd5db46-88b5x"
Nov 04 05:42:54.585764 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:54.585742    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p82cw\" (UniqueName: \"kubernetes.io/projected/f6f1cb38-ae78-424c-ba8a-dd470888a1b1-kube-api-access-p82cw\") pod \"simulator-w5-9d808e-kserve-bccd5db46-88b5x\" (UID: \"f6f1cb38-ae78-424c-ba8a-dd470888a1b1\") " pod="e2e-models-e2e-worker-w5-9d808e/simulator-w5-9d808e-kserve-bccd5db46-88b5x"
Nov 04 05:42:54.686746 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:54.686697    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6f1cb38-ae78-424c-ba8a-dd470888a1b1-tmp-dir\") pod \"simulator-w5-9d808e-kserve-bccd5db46-88b5x\" (UID: \"f6f1cb38-ae78-424c-ba8a-dd470888a1b1\") " pod="e2e-models-e2e-worker-w5-9d808e/simulator-w5-9d808e-kserve-bccd5db46-88b5x"
Nov 04 05:42:54.686746 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:54.686760    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6f1cb38-ae78-424c-ba8a-dd470888a1b1-model-cache\") pod \"simulator-w5-9d808e-kserve-bccd5db46-88b5x\" (UID: \"f6f1cb38-ae78-424c-ba8a-dd470888a1b1\") " pod="e2e-models-e2e-worker-w5-9d808e/simulator-w5-9d808e-kserve-bccd5db46-88b5x"
Nov 04 05:42:54.687270 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:54.686844    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p82cw\" (UniqueName: \"kubernetes.io/projected/f6f1cb38-ae78-424c-ba8a-dd470888a1b1-kube-api-access-p82cw\") pod \"simulator-w5-9d808e-kserve-bccd5db46-88b5x\" (UID: \"f6f1cb38-ae78-424c-ba8a-dd470888a1b1\") " pod="e2e-models-e2e-worker-w5-9d808e/simulator-w5-9d808e-kserve-bccd5db46-88b5x"
Nov 04 05:42:54.687270 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:54.686910    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6f1cb38-ae78-424c-ba8a-dd470888a1b1-dshm\") pod \"simulator-w5-9d808e-kserve-bccd5db46-88b5x\" (UID: \"f6f1cb38-ae78-424c-ba8a-dd470888a1b1\") " pod="e2e-models-e2e-worker-w5-9d808e/simulator-w5-9d808e-kserve-bccd5db46-88b5x"
Nov 04 05:42:54.687270 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:54.686945    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6f1cb38-ae78-424c-ba8a-dd470888a1b1-home\") pod \"simulator-w5-9d808e-kserve-bccd5db46-88b5x\" (UID: \"f6f1cb38-ae78-424c-ba8a-dd470888a1b1\") " pod="e2e-models-e2e-worker-w5-9d808e/simulator-w5-9d808e-kserve-bccd5db46-88b5x"
Nov 04 05:42:54.687270 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:54.687017    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6f1cb38-ae78-424c-ba8a-dd470888a1b1-tls-certs\") pod \"simulator-w5-9d808e-kserve-bccd5db46-88b5x\" (UID: \"f6f1cb38-ae78-424c-ba8a-dd470888a1b1\") " pod="e2e-models-e2e-worker-w5-9d808e/simulator-w5-9d808e-kserve-bccd5db46-88b5x"
Nov 04 05:42:54.689168 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:54.689137    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6f1cb38-ae78-424c-ba8a-dd470888a1b1-tmp-dir\") pod \"simulator-w5-9d808e-kserve-bccd5db46-88b5x\" (UID: \"f6f1cb38-ae78-424c-ba8a-dd470888a1b1\") " pod="e2e-models-e2e-worker-w5-9d808e/simulator-w5-9d808e-kserve-bccd5db46-88b5x"
Nov 04 05:42:54.689422 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:54.689399    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6f1cb38-ae78-424c-ba8a-dd470888a1b1-model-cache\") pod \"simulator-w5-9d808e-kserve-bccd5db46-88b5x\" (UID: \"f6f1cb38-ae78-424c-ba8a-dd470888a1b1\") " pod="e2e-models-e2e-worker-w5-9d808e/simulator-w5-9d808e-kserve-bccd5db46-88b5x"
Nov 04 05:42:54.693125 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:54.692630    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6f1cb38-ae78-424c-ba8a-dd470888a1b1-home\") pod \"simulator-w5-9d808e-kserve-bccd5db46-88b5x\" (UID: \"f6f1cb38-ae78-424c-ba8a-dd470888a1b1\") " pod="e2e-models-e2e-worker-w5-9d808e/simulator-w5-9d808e-kserve-bccd5db46-88b5x"
Nov 04 05:42:54.693450 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:54.693404    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6f1cb38-ae78-424c-ba8a-dd470888a1b1-tls-certs\") pod \"simulator-w5-9d808e-kserve-bccd5db46-88b5x\" (UID: \"f6f1cb38-ae78-424c-ba8a-dd470888a1b1\") " pod="e2e-models-e2e-worker-w5-9d808e/simulator-w5-9d808e-kserve-bccd5db46-88b5x"
Nov 04 05:42:54.707539 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:54.701665    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6f1cb38-ae78-424c-ba8a-dd470888a1b1-dshm\") pod \"simulator-w5-9d808e-kserve-bccd5db46-88b5x\" (UID: \"f6f1cb38-ae78-424c-ba8a-dd470888a1b1\") " pod="e2e-models-e2e-worker-w5-9d808e/simulator-w5-9d808e-kserve-bccd5db46-88b5x"
Nov 04 05:42:54.713536 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:54.712093    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p82cw\" (UniqueName: \"kubernetes.io/projected/f6f1cb38-ae78-424c-ba8a-dd470888a1b1-kube-api-access-p82cw\") pod \"simulator-w5-9d808e-kserve-bccd5db46-88b5x\" (UID: \"f6f1cb38-ae78-424c-ba8a-dd470888a1b1\") " pod="e2e-models-e2e-worker-w5-9d808e/simulator-w5-9d808e-kserve-bccd5db46-88b5x"
Nov 04 05:42:54.823364 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:54.822976    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-9d808e/simulator-w5-9d808e-kserve-bccd5db46-88b5x"
Nov 04 05:42:55.096411 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:55.096387    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-9d808e/simulator-w5-9d808e-kserve-bccd5db46-88b5x"]
Nov 04 05:42:55.098676 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:42:55.098646    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf6f1cb38_ae78_424c_ba8a_dd470888a1b1.slice/crio-fb88a31212b2d4f18b70e2651a35ad52b8b26887043a56b5ff9c2b4956bb7c91 WatchSource:0}: Error finding container fb88a31212b2d4f18b70e2651a35ad52b8b26887043a56b5ff9c2b4956bb7c91: Status 404 returned error can't find the container with id fb88a31212b2d4f18b70e2651a35ad52b8b26887043a56b5ff9c2b4956bb7c91
Nov 04 05:42:55.836167 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:55.836131    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-9d808e/simulator-w5-9d808e-kserve-bccd5db46-88b5x" event={"ID":"f6f1cb38-ae78-424c-ba8a-dd470888a1b1","Type":"ContainerStarted","Data":"07898a5c9ea11c0ce89bb434f8ccec8d49d69feb107397a9fde5d7f1a3d340ea"}
Nov 04 05:42:55.836601 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:55.836181    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-9d808e/simulator-w5-9d808e-kserve-bccd5db46-88b5x" event={"ID":"f6f1cb38-ae78-424c-ba8a-dd470888a1b1","Type":"ContainerStarted","Data":"fb88a31212b2d4f18b70e2651a35ad52b8b26887043a56b5ff9c2b4956bb7c91"}
Nov 04 05:42:55.862229 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:55.862181    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-9d808e/simulator-w5-9d808e-kserve-bccd5db46-88b5x" podStartSLOduration=1.8621642870000001 podStartE2EDuration="1.862164287s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:42:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:42:55.860045886 +0000 UTC m=+862.728709459" watchObservedRunningTime="2026-11-04 05:42:55.862164287 +0000 UTC m=+862.730827858"
Nov 04 05:42:56.825754 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:42:56.825719    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-9d808e/simulator-w5-9d808e-kserve-bccd5db46-88b5x"
Nov 04 05:43:02.551747 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:02.551709    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-9a0c8b/simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf"
Nov 04 05:43:02.564391 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:02.564371    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-9a0c8b/simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf"
Nov 04 05:43:02.916235 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:02.916070    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-9a0c8b/simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf"
Nov 04 05:43:04.825858 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:04.825204    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-9d808e/simulator-w5-9d808e-kserve-bccd5db46-88b5x"
Nov 04 05:43:04.838561 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:04.838535    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-9d808e/simulator-w5-9d808e-kserve-bccd5db46-88b5x"
Nov 04 05:43:04.900897 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:04.900874    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-9d808e/simulator-w5-9d808e-kserve-bccd5db46-88b5x"
Nov 04 05:43:13.650845 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:13.650813    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-27935d/premium-w0-27935d-kserve-856d6bf896-2zx8h"]
Nov 04 05:43:13.655620 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:13.655597    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-27935d/premium-w0-27935d-kserve-856d6bf896-2zx8h"
Nov 04 05:43:13.665072 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:13.665046    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-27935d/premium-w0-27935d-kserve-856d6bf896-2zx8h"]
Nov 04 05:43:13.665315 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:13.665294    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-27935d\"/\"openshift-service-ca.crt\""
Nov 04 05:43:13.665375 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:13.665331    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-27935d\"/\"default-dockercfg-r78l2\""
Nov 04 05:43:13.665440 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:13.665386    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-27935d\"/\"kube-root-ca.crt\""
Nov 04 05:43:13.665440 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:13.665421    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-27935d\"/\"premium-w0-27935d-kserve-self-signed-certs\""
Nov 04 05:43:13.696243 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:13.696210    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f575cbaf-3226-4b7f-8dd8-341f77abb887-tls-certs\") pod \"premium-w0-27935d-kserve-856d6bf896-2zx8h\" (UID: \"f575cbaf-3226-4b7f-8dd8-341f77abb887\") " pod="e2e-models-e2e-worker-w0-27935d/premium-w0-27935d-kserve-856d6bf896-2zx8h"
Nov 04 05:43:13.696374 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:13.696277    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6p82\" (UniqueName: \"kubernetes.io/projected/f575cbaf-3226-4b7f-8dd8-341f77abb887-kube-api-access-b6p82\") pod \"premium-w0-27935d-kserve-856d6bf896-2zx8h\" (UID: \"f575cbaf-3226-4b7f-8dd8-341f77abb887\") " pod="e2e-models-e2e-worker-w0-27935d/premium-w0-27935d-kserve-856d6bf896-2zx8h"
Nov 04 05:43:13.696445 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:13.696371    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f575cbaf-3226-4b7f-8dd8-341f77abb887-tmp-dir\") pod \"premium-w0-27935d-kserve-856d6bf896-2zx8h\" (UID: \"f575cbaf-3226-4b7f-8dd8-341f77abb887\") " pod="e2e-models-e2e-worker-w0-27935d/premium-w0-27935d-kserve-856d6bf896-2zx8h"
Nov 04 05:43:13.696445 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:13.696413    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f575cbaf-3226-4b7f-8dd8-341f77abb887-model-cache\") pod \"premium-w0-27935d-kserve-856d6bf896-2zx8h\" (UID: \"f575cbaf-3226-4b7f-8dd8-341f77abb887\") " pod="e2e-models-e2e-worker-w0-27935d/premium-w0-27935d-kserve-856d6bf896-2zx8h"
Nov 04 05:43:13.696596 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:13.696582    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f575cbaf-3226-4b7f-8dd8-341f77abb887-home\") pod \"premium-w0-27935d-kserve-856d6bf896-2zx8h\" (UID: \"f575cbaf-3226-4b7f-8dd8-341f77abb887\") " pod="e2e-models-e2e-worker-w0-27935d/premium-w0-27935d-kserve-856d6bf896-2zx8h"
Nov 04 05:43:13.696665 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:13.696634    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f575cbaf-3226-4b7f-8dd8-341f77abb887-dshm\") pod \"premium-w0-27935d-kserve-856d6bf896-2zx8h\" (UID: \"f575cbaf-3226-4b7f-8dd8-341f77abb887\") " pod="e2e-models-e2e-worker-w0-27935d/premium-w0-27935d-kserve-856d6bf896-2zx8h"
Nov 04 05:43:13.797546 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:13.797473    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f575cbaf-3226-4b7f-8dd8-341f77abb887-home\") pod \"premium-w0-27935d-kserve-856d6bf896-2zx8h\" (UID: \"f575cbaf-3226-4b7f-8dd8-341f77abb887\") " pod="e2e-models-e2e-worker-w0-27935d/premium-w0-27935d-kserve-856d6bf896-2zx8h"
Nov 04 05:43:13.797750 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:13.797558    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f575cbaf-3226-4b7f-8dd8-341f77abb887-dshm\") pod \"premium-w0-27935d-kserve-856d6bf896-2zx8h\" (UID: \"f575cbaf-3226-4b7f-8dd8-341f77abb887\") " pod="e2e-models-e2e-worker-w0-27935d/premium-w0-27935d-kserve-856d6bf896-2zx8h"
Nov 04 05:43:13.797750 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:13.797619    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f575cbaf-3226-4b7f-8dd8-341f77abb887-tls-certs\") pod \"premium-w0-27935d-kserve-856d6bf896-2zx8h\" (UID: \"f575cbaf-3226-4b7f-8dd8-341f77abb887\") " pod="e2e-models-e2e-worker-w0-27935d/premium-w0-27935d-kserve-856d6bf896-2zx8h"
Nov 04 05:43:13.797750 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:13.797646    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6p82\" (UniqueName: \"kubernetes.io/projected/f575cbaf-3226-4b7f-8dd8-341f77abb887-kube-api-access-b6p82\") pod \"premium-w0-27935d-kserve-856d6bf896-2zx8h\" (UID: \"f575cbaf-3226-4b7f-8dd8-341f77abb887\") " pod="e2e-models-e2e-worker-w0-27935d/premium-w0-27935d-kserve-856d6bf896-2zx8h"
Nov 04 05:43:13.797750 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:13.797708    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f575cbaf-3226-4b7f-8dd8-341f77abb887-tmp-dir\") pod \"premium-w0-27935d-kserve-856d6bf896-2zx8h\" (UID: \"f575cbaf-3226-4b7f-8dd8-341f77abb887\") " pod="e2e-models-e2e-worker-w0-27935d/premium-w0-27935d-kserve-856d6bf896-2zx8h"
Nov 04 05:43:13.797750 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:13.797746    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f575cbaf-3226-4b7f-8dd8-341f77abb887-model-cache\") pod \"premium-w0-27935d-kserve-856d6bf896-2zx8h\" (UID: \"f575cbaf-3226-4b7f-8dd8-341f77abb887\") " pod="e2e-models-e2e-worker-w0-27935d/premium-w0-27935d-kserve-856d6bf896-2zx8h"
Nov 04 05:43:13.798195 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:13.798166    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f575cbaf-3226-4b7f-8dd8-341f77abb887-model-cache\") pod \"premium-w0-27935d-kserve-856d6bf896-2zx8h\" (UID: \"f575cbaf-3226-4b7f-8dd8-341f77abb887\") " pod="e2e-models-e2e-worker-w0-27935d/premium-w0-27935d-kserve-856d6bf896-2zx8h"
Nov 04 05:43:13.798310 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:13.798286    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f575cbaf-3226-4b7f-8dd8-341f77abb887-tmp-dir\") pod \"premium-w0-27935d-kserve-856d6bf896-2zx8h\" (UID: \"f575cbaf-3226-4b7f-8dd8-341f77abb887\") " pod="e2e-models-e2e-worker-w0-27935d/premium-w0-27935d-kserve-856d6bf896-2zx8h"
Nov 04 05:43:13.800134 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:13.798624    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f575cbaf-3226-4b7f-8dd8-341f77abb887-home\") pod \"premium-w0-27935d-kserve-856d6bf896-2zx8h\" (UID: \"f575cbaf-3226-4b7f-8dd8-341f77abb887\") " pod="e2e-models-e2e-worker-w0-27935d/premium-w0-27935d-kserve-856d6bf896-2zx8h"
Nov 04 05:43:13.808866 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:13.808788    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f575cbaf-3226-4b7f-8dd8-341f77abb887-dshm\") pod \"premium-w0-27935d-kserve-856d6bf896-2zx8h\" (UID: \"f575cbaf-3226-4b7f-8dd8-341f77abb887\") " pod="e2e-models-e2e-worker-w0-27935d/premium-w0-27935d-kserve-856d6bf896-2zx8h"
Nov 04 05:43:13.821603 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:13.812138    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f575cbaf-3226-4b7f-8dd8-341f77abb887-tls-certs\") pod \"premium-w0-27935d-kserve-856d6bf896-2zx8h\" (UID: \"f575cbaf-3226-4b7f-8dd8-341f77abb887\") " pod="e2e-models-e2e-worker-w0-27935d/premium-w0-27935d-kserve-856d6bf896-2zx8h"
Nov 04 05:43:13.821603 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:13.812296    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6p82\" (UniqueName: \"kubernetes.io/projected/f575cbaf-3226-4b7f-8dd8-341f77abb887-kube-api-access-b6p82\") pod \"premium-w0-27935d-kserve-856d6bf896-2zx8h\" (UID: \"f575cbaf-3226-4b7f-8dd8-341f77abb887\") " pod="e2e-models-e2e-worker-w0-27935d/premium-w0-27935d-kserve-856d6bf896-2zx8h"
Nov 04 05:43:13.971896 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:13.971826    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-27935d/premium-w0-27935d-kserve-856d6bf896-2zx8h"
Nov 04 05:43:14.261184 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:14.261155    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-27935d/premium-w0-27935d-kserve-856d6bf896-2zx8h"]
Nov 04 05:43:14.263323 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:43:14.263289    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf575cbaf_3226_4b7f_8dd8_341f77abb887.slice/crio-72999c49b4e82057130b98364d969de3ad4890ce8f76efc37ec9d4762c2a96ae WatchSource:0}: Error finding container 72999c49b4e82057130b98364d969de3ad4890ce8f76efc37ec9d4762c2a96ae: Status 404 returned error can't find the container with id 72999c49b4e82057130b98364d969de3ad4890ce8f76efc37ec9d4762c2a96ae
Nov 04 05:43:14.971789 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:14.971747    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-27935d/premium-w0-27935d-kserve-856d6bf896-2zx8h" event={"ID":"f575cbaf-3226-4b7f-8dd8-341f77abb887","Type":"ContainerStarted","Data":"3db205646ce60e900b442626a51ee41e4005ddf4f2ad8d426a7a5c92245e889f"}
Nov 04 05:43:14.972178 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:14.971796    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-27935d/premium-w0-27935d-kserve-856d6bf896-2zx8h" event={"ID":"f575cbaf-3226-4b7f-8dd8-341f77abb887","Type":"ContainerStarted","Data":"72999c49b4e82057130b98364d969de3ad4890ce8f76efc37ec9d4762c2a96ae"}
Nov 04 05:43:14.972178 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:14.971895    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-27935d/premium-w0-27935d-kserve-856d6bf896-2zx8h"
Nov 04 05:43:14.988444 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:14.988394    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-27935d/premium-w0-27935d-kserve-856d6bf896-2zx8h" podStartSLOduration=1.988380903 podStartE2EDuration="1.988380903s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:43:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:43:14.986946838 +0000 UTC m=+881.855610410" watchObservedRunningTime="2026-11-04 05:43:14.988380903 +0000 UTC m=+881.857044475"
Nov 04 05:43:17.316431 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:43:17.316397    4357 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-npgcv" containerName="extractor"
Nov 04 05:43:22.221663 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:22.221624    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w6-2b14d0/premium-w6-2b14d0-kserve-7f599dc4b7-44v6n"]
Nov 04 05:43:22.225429 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:22.225404    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-2b14d0/premium-w6-2b14d0-kserve-7f599dc4b7-44v6n"
Nov 04 05:43:22.232226 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:22.232204    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-2b14d0\"/\"kube-root-ca.crt\""
Nov 04 05:43:22.232346 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:22.232300    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-2b14d0\"/\"openshift-service-ca.crt\""
Nov 04 05:43:22.232460 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:22.232442    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-2b14d0\"/\"default-dockercfg-l9x7p\""
Nov 04 05:43:22.232614 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:22.232596    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-2b14d0\"/\"premium-w6-2b14d0-kserve-self-signed-certs\""
Nov 04 05:43:22.235352 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:22.235331    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-2b14d0/premium-w6-2b14d0-kserve-7f599dc4b7-44v6n"]
Nov 04 05:43:22.304454 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:22.304425    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6c5f359-cad7-401a-9bd4-fc8e13b43910-dshm\") pod \"premium-w6-2b14d0-kserve-7f599dc4b7-44v6n\" (UID: \"a6c5f359-cad7-401a-9bd4-fc8e13b43910\") " pod="e2e-models-e2e-worker-w6-2b14d0/premium-w6-2b14d0-kserve-7f599dc4b7-44v6n"
Nov 04 05:43:22.304600 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:22.304462    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6c5f359-cad7-401a-9bd4-fc8e13b43910-tmp-dir\") pod \"premium-w6-2b14d0-kserve-7f599dc4b7-44v6n\" (UID: \"a6c5f359-cad7-401a-9bd4-fc8e13b43910\") " pod="e2e-models-e2e-worker-w6-2b14d0/premium-w6-2b14d0-kserve-7f599dc4b7-44v6n"
Nov 04 05:43:22.304600 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:22.304565    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6c5f359-cad7-401a-9bd4-fc8e13b43910-model-cache\") pod \"premium-w6-2b14d0-kserve-7f599dc4b7-44v6n\" (UID: \"a6c5f359-cad7-401a-9bd4-fc8e13b43910\") " pod="e2e-models-e2e-worker-w6-2b14d0/premium-w6-2b14d0-kserve-7f599dc4b7-44v6n"
Nov 04 05:43:22.304681 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:22.304607    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6c5f359-cad7-401a-9bd4-fc8e13b43910-tls-certs\") pod \"premium-w6-2b14d0-kserve-7f599dc4b7-44v6n\" (UID: \"a6c5f359-cad7-401a-9bd4-fc8e13b43910\") " pod="e2e-models-e2e-worker-w6-2b14d0/premium-w6-2b14d0-kserve-7f599dc4b7-44v6n"
Nov 04 05:43:22.304736 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:22.304715    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcs8h\" (UniqueName: \"kubernetes.io/projected/a6c5f359-cad7-401a-9bd4-fc8e13b43910-kube-api-access-tcs8h\") pod \"premium-w6-2b14d0-kserve-7f599dc4b7-44v6n\" (UID: \"a6c5f359-cad7-401a-9bd4-fc8e13b43910\") " pod="e2e-models-e2e-worker-w6-2b14d0/premium-w6-2b14d0-kserve-7f599dc4b7-44v6n"
Nov 04 05:43:22.304769 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:22.304753    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6c5f359-cad7-401a-9bd4-fc8e13b43910-home\") pod \"premium-w6-2b14d0-kserve-7f599dc4b7-44v6n\" (UID: \"a6c5f359-cad7-401a-9bd4-fc8e13b43910\") " pod="e2e-models-e2e-worker-w6-2b14d0/premium-w6-2b14d0-kserve-7f599dc4b7-44v6n"
Nov 04 05:43:22.405402 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:22.405361    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6c5f359-cad7-401a-9bd4-fc8e13b43910-tls-certs\") pod \"premium-w6-2b14d0-kserve-7f599dc4b7-44v6n\" (UID: \"a6c5f359-cad7-401a-9bd4-fc8e13b43910\") " pod="e2e-models-e2e-worker-w6-2b14d0/premium-w6-2b14d0-kserve-7f599dc4b7-44v6n"
Nov 04 05:43:22.405628 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:22.405469    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcs8h\" (UniqueName: \"kubernetes.io/projected/a6c5f359-cad7-401a-9bd4-fc8e13b43910-kube-api-access-tcs8h\") pod \"premium-w6-2b14d0-kserve-7f599dc4b7-44v6n\" (UID: \"a6c5f359-cad7-401a-9bd4-fc8e13b43910\") " pod="e2e-models-e2e-worker-w6-2b14d0/premium-w6-2b14d0-kserve-7f599dc4b7-44v6n"
Nov 04 05:43:22.405628 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:22.405569    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6c5f359-cad7-401a-9bd4-fc8e13b43910-home\") pod \"premium-w6-2b14d0-kserve-7f599dc4b7-44v6n\" (UID: \"a6c5f359-cad7-401a-9bd4-fc8e13b43910\") " pod="e2e-models-e2e-worker-w6-2b14d0/premium-w6-2b14d0-kserve-7f599dc4b7-44v6n"
Nov 04 05:43:22.405758 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:22.405660    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6c5f359-cad7-401a-9bd4-fc8e13b43910-dshm\") pod \"premium-w6-2b14d0-kserve-7f599dc4b7-44v6n\" (UID: \"a6c5f359-cad7-401a-9bd4-fc8e13b43910\") " pod="e2e-models-e2e-worker-w6-2b14d0/premium-w6-2b14d0-kserve-7f599dc4b7-44v6n"
Nov 04 05:43:22.405758 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:22.405710    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6c5f359-cad7-401a-9bd4-fc8e13b43910-tmp-dir\") pod \"premium-w6-2b14d0-kserve-7f599dc4b7-44v6n\" (UID: \"a6c5f359-cad7-401a-9bd4-fc8e13b43910\") " pod="e2e-models-e2e-worker-w6-2b14d0/premium-w6-2b14d0-kserve-7f599dc4b7-44v6n"
Nov 04 05:43:22.405840 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:22.405798    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6c5f359-cad7-401a-9bd4-fc8e13b43910-model-cache\") pod \"premium-w6-2b14d0-kserve-7f599dc4b7-44v6n\" (UID: \"a6c5f359-cad7-401a-9bd4-fc8e13b43910\") " pod="e2e-models-e2e-worker-w6-2b14d0/premium-w6-2b14d0-kserve-7f599dc4b7-44v6n"
Nov 04 05:43:22.406048 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:22.406023    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6c5f359-cad7-401a-9bd4-fc8e13b43910-home\") pod \"premium-w6-2b14d0-kserve-7f599dc4b7-44v6n\" (UID: \"a6c5f359-cad7-401a-9bd4-fc8e13b43910\") " pod="e2e-models-e2e-worker-w6-2b14d0/premium-w6-2b14d0-kserve-7f599dc4b7-44v6n"
Nov 04 05:43:22.406196 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:22.406073    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6c5f359-cad7-401a-9bd4-fc8e13b43910-tmp-dir\") pod \"premium-w6-2b14d0-kserve-7f599dc4b7-44v6n\" (UID: \"a6c5f359-cad7-401a-9bd4-fc8e13b43910\") " pod="e2e-models-e2e-worker-w6-2b14d0/premium-w6-2b14d0-kserve-7f599dc4b7-44v6n"
Nov 04 05:43:22.406196 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:22.406129    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6c5f359-cad7-401a-9bd4-fc8e13b43910-model-cache\") pod \"premium-w6-2b14d0-kserve-7f599dc4b7-44v6n\" (UID: \"a6c5f359-cad7-401a-9bd4-fc8e13b43910\") " pod="e2e-models-e2e-worker-w6-2b14d0/premium-w6-2b14d0-kserve-7f599dc4b7-44v6n"
Nov 04 05:43:22.407825 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:22.407806    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6c5f359-cad7-401a-9bd4-fc8e13b43910-dshm\") pod \"premium-w6-2b14d0-kserve-7f599dc4b7-44v6n\" (UID: \"a6c5f359-cad7-401a-9bd4-fc8e13b43910\") " pod="e2e-models-e2e-worker-w6-2b14d0/premium-w6-2b14d0-kserve-7f599dc4b7-44v6n"
Nov 04 05:43:22.407979 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:22.407961    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6c5f359-cad7-401a-9bd4-fc8e13b43910-tls-certs\") pod \"premium-w6-2b14d0-kserve-7f599dc4b7-44v6n\" (UID: \"a6c5f359-cad7-401a-9bd4-fc8e13b43910\") " pod="e2e-models-e2e-worker-w6-2b14d0/premium-w6-2b14d0-kserve-7f599dc4b7-44v6n"
Nov 04 05:43:22.413076 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:22.413054    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcs8h\" (UniqueName: \"kubernetes.io/projected/a6c5f359-cad7-401a-9bd4-fc8e13b43910-kube-api-access-tcs8h\") pod \"premium-w6-2b14d0-kserve-7f599dc4b7-44v6n\" (UID: \"a6c5f359-cad7-401a-9bd4-fc8e13b43910\") " pod="e2e-models-e2e-worker-w6-2b14d0/premium-w6-2b14d0-kserve-7f599dc4b7-44v6n"
Nov 04 05:43:22.539510 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:22.539472    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-2b14d0/premium-w6-2b14d0-kserve-7f599dc4b7-44v6n"
Nov 04 05:43:22.809480 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:22.809454    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-2b14d0/premium-w6-2b14d0-kserve-7f599dc4b7-44v6n"]
Nov 04 05:43:22.811155 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:43:22.811129    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda6c5f359_cad7_401a_9bd4_fc8e13b43910.slice/crio-69517ff8497887650506982026515dc77f288dde070b2413629cccba35b375ae WatchSource:0}: Error finding container 69517ff8497887650506982026515dc77f288dde070b2413629cccba35b375ae: Status 404 returned error can't find the container with id 69517ff8497887650506982026515dc77f288dde070b2413629cccba35b375ae
Nov 04 05:43:23.013094 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:23.013058    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-2b14d0/premium-w6-2b14d0-kserve-7f599dc4b7-44v6n" event={"ID":"a6c5f359-cad7-401a-9bd4-fc8e13b43910","Type":"ContainerStarted","Data":"1d8b0ca87632b3728c4dcae9faba0c5c76365e25b4227538ca61aaceacf17145"}
Nov 04 05:43:23.013254 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:23.013103    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-2b14d0/premium-w6-2b14d0-kserve-7f599dc4b7-44v6n" event={"ID":"a6c5f359-cad7-401a-9bd4-fc8e13b43910","Type":"ContainerStarted","Data":"69517ff8497887650506982026515dc77f288dde070b2413629cccba35b375ae"}
Nov 04 05:43:23.034402 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:23.034344    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w6-2b14d0/premium-w6-2b14d0-kserve-7f599dc4b7-44v6n" podStartSLOduration=1.034327211 podStartE2EDuration="1.034327211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:43:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:43:23.033056993 +0000 UTC m=+889.901720588" watchObservedRunningTime="2026-11-04 05:43:23.034327211 +0000 UTC m=+889.902990784"
Nov 04 05:43:23.539576 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:23.539543    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-2b14d0/premium-w6-2b14d0-kserve-7f599dc4b7-44v6n"
Nov 04 05:43:23.972678 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:23.972597    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-27935d/premium-w0-27935d-kserve-856d6bf896-2zx8h"
Nov 04 05:43:23.985274 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:23.985250    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-27935d/premium-w0-27935d-kserve-856d6bf896-2zx8h"
Nov 04 05:43:24.029611 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:24.029587    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-27935d/premium-w0-27935d-kserve-856d6bf896-2zx8h"
Nov 04 05:43:31.383863 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:31.383832    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-ade2e8/premium-w2-ade2e8-kserve-b66657957-wnfww"]
Nov 04 05:43:31.389418 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:31.389398    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-ade2e8/premium-w2-ade2e8-kserve-b66657957-wnfww"
Nov 04 05:43:31.395238 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:31.395210    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-ade2e8/premium-w2-ade2e8-kserve-b66657957-wnfww"]
Nov 04 05:43:31.395543 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:31.395503    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-ade2e8\"/\"kube-root-ca.crt\""
Nov 04 05:43:31.395657 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:31.395614    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-ade2e8\"/\"openshift-service-ca.crt\""
Nov 04 05:43:31.395735 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:31.395717    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-ade2e8\"/\"premium-w2-ade2e8-kserve-self-signed-certs\""
Nov 04 05:43:31.493888 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:31.493865    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-ade2e8\"/\"default-dockercfg-q5cbg\""
Nov 04 05:43:31.520802 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:31.520776    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef483385-b12d-4ce4-9f4e-891a9f4369dc-tmp-dir\") pod \"premium-w2-ade2e8-kserve-b66657957-wnfww\" (UID: \"ef483385-b12d-4ce4-9f4e-891a9f4369dc\") " pod="e2e-models-e2e-worker-w2-ade2e8/premium-w2-ade2e8-kserve-b66657957-wnfww"
Nov 04 05:43:31.520916 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:31.520807    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45c7x\" (UniqueName: \"kubernetes.io/projected/ef483385-b12d-4ce4-9f4e-891a9f4369dc-kube-api-access-45c7x\") pod \"premium-w2-ade2e8-kserve-b66657957-wnfww\" (UID: \"ef483385-b12d-4ce4-9f4e-891a9f4369dc\") " pod="e2e-models-e2e-worker-w2-ade2e8/premium-w2-ade2e8-kserve-b66657957-wnfww"
Nov 04 05:43:31.520916 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:31.520840    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef483385-b12d-4ce4-9f4e-891a9f4369dc-dshm\") pod \"premium-w2-ade2e8-kserve-b66657957-wnfww\" (UID: \"ef483385-b12d-4ce4-9f4e-891a9f4369dc\") " pod="e2e-models-e2e-worker-w2-ade2e8/premium-w2-ade2e8-kserve-b66657957-wnfww"
Nov 04 05:43:31.520986 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:31.520935    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef483385-b12d-4ce4-9f4e-891a9f4369dc-model-cache\") pod \"premium-w2-ade2e8-kserve-b66657957-wnfww\" (UID: \"ef483385-b12d-4ce4-9f4e-891a9f4369dc\") " pod="e2e-models-e2e-worker-w2-ade2e8/premium-w2-ade2e8-kserve-b66657957-wnfww"
Nov 04 05:43:31.520986 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:31.520972    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef483385-b12d-4ce4-9f4e-891a9f4369dc-tls-certs\") pod \"premium-w2-ade2e8-kserve-b66657957-wnfww\" (UID: \"ef483385-b12d-4ce4-9f4e-891a9f4369dc\") " pod="e2e-models-e2e-worker-w2-ade2e8/premium-w2-ade2e8-kserve-b66657957-wnfww"
Nov 04 05:43:31.521051 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:31.521006    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef483385-b12d-4ce4-9f4e-891a9f4369dc-home\") pod \"premium-w2-ade2e8-kserve-b66657957-wnfww\" (UID: \"ef483385-b12d-4ce4-9f4e-891a9f4369dc\") " pod="e2e-models-e2e-worker-w2-ade2e8/premium-w2-ade2e8-kserve-b66657957-wnfww"
Nov 04 05:43:31.628119 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:31.628077    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef483385-b12d-4ce4-9f4e-891a9f4369dc-tmp-dir\") pod \"premium-w2-ade2e8-kserve-b66657957-wnfww\" (UID: \"ef483385-b12d-4ce4-9f4e-891a9f4369dc\") " pod="e2e-models-e2e-worker-w2-ade2e8/premium-w2-ade2e8-kserve-b66657957-wnfww"
Nov 04 05:43:31.628358 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:31.628134    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45c7x\" (UniqueName: \"kubernetes.io/projected/ef483385-b12d-4ce4-9f4e-891a9f4369dc-kube-api-access-45c7x\") pod \"premium-w2-ade2e8-kserve-b66657957-wnfww\" (UID: \"ef483385-b12d-4ce4-9f4e-891a9f4369dc\") " pod="e2e-models-e2e-worker-w2-ade2e8/premium-w2-ade2e8-kserve-b66657957-wnfww"
Nov 04 05:43:31.628358 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:31.628178    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef483385-b12d-4ce4-9f4e-891a9f4369dc-dshm\") pod \"premium-w2-ade2e8-kserve-b66657957-wnfww\" (UID: \"ef483385-b12d-4ce4-9f4e-891a9f4369dc\") " pod="e2e-models-e2e-worker-w2-ade2e8/premium-w2-ade2e8-kserve-b66657957-wnfww"
Nov 04 05:43:31.628358 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:31.628215    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef483385-b12d-4ce4-9f4e-891a9f4369dc-model-cache\") pod \"premium-w2-ade2e8-kserve-b66657957-wnfww\" (UID: \"ef483385-b12d-4ce4-9f4e-891a9f4369dc\") " pod="e2e-models-e2e-worker-w2-ade2e8/premium-w2-ade2e8-kserve-b66657957-wnfww"
Nov 04 05:43:31.628358 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:31.628251    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef483385-b12d-4ce4-9f4e-891a9f4369dc-tls-certs\") pod \"premium-w2-ade2e8-kserve-b66657957-wnfww\" (UID: \"ef483385-b12d-4ce4-9f4e-891a9f4369dc\") " pod="e2e-models-e2e-worker-w2-ade2e8/premium-w2-ade2e8-kserve-b66657957-wnfww"
Nov 04 05:43:31.628358 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:31.628294    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef483385-b12d-4ce4-9f4e-891a9f4369dc-home\") pod \"premium-w2-ade2e8-kserve-b66657957-wnfww\" (UID: \"ef483385-b12d-4ce4-9f4e-891a9f4369dc\") " pod="e2e-models-e2e-worker-w2-ade2e8/premium-w2-ade2e8-kserve-b66657957-wnfww"
Nov 04 05:43:31.629011 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:31.628819    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef483385-b12d-4ce4-9f4e-891a9f4369dc-home\") pod \"premium-w2-ade2e8-kserve-b66657957-wnfww\" (UID: \"ef483385-b12d-4ce4-9f4e-891a9f4369dc\") " pod="e2e-models-e2e-worker-w2-ade2e8/premium-w2-ade2e8-kserve-b66657957-wnfww"
Nov 04 05:43:31.629126 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:31.629067    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef483385-b12d-4ce4-9f4e-891a9f4369dc-tmp-dir\") pod \"premium-w2-ade2e8-kserve-b66657957-wnfww\" (UID: \"ef483385-b12d-4ce4-9f4e-891a9f4369dc\") " pod="e2e-models-e2e-worker-w2-ade2e8/premium-w2-ade2e8-kserve-b66657957-wnfww"
Nov 04 05:43:31.630810 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:31.630788    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef483385-b12d-4ce4-9f4e-891a9f4369dc-model-cache\") pod \"premium-w2-ade2e8-kserve-b66657957-wnfww\" (UID: \"ef483385-b12d-4ce4-9f4e-891a9f4369dc\") " pod="e2e-models-e2e-worker-w2-ade2e8/premium-w2-ade2e8-kserve-b66657957-wnfww"
Nov 04 05:43:31.639272 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:31.639203    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef483385-b12d-4ce4-9f4e-891a9f4369dc-tls-certs\") pod \"premium-w2-ade2e8-kserve-b66657957-wnfww\" (UID: \"ef483385-b12d-4ce4-9f4e-891a9f4369dc\") " pod="e2e-models-e2e-worker-w2-ade2e8/premium-w2-ade2e8-kserve-b66657957-wnfww"
Nov 04 05:43:31.659610 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:31.659560    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef483385-b12d-4ce4-9f4e-891a9f4369dc-dshm\") pod \"premium-w2-ade2e8-kserve-b66657957-wnfww\" (UID: \"ef483385-b12d-4ce4-9f4e-891a9f4369dc\") " pod="e2e-models-e2e-worker-w2-ade2e8/premium-w2-ade2e8-kserve-b66657957-wnfww"
Nov 04 05:43:31.666673 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:31.666367    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45c7x\" (UniqueName: \"kubernetes.io/projected/ef483385-b12d-4ce4-9f4e-891a9f4369dc-kube-api-access-45c7x\") pod \"premium-w2-ade2e8-kserve-b66657957-wnfww\" (UID: \"ef483385-b12d-4ce4-9f4e-891a9f4369dc\") " pod="e2e-models-e2e-worker-w2-ade2e8/premium-w2-ade2e8-kserve-b66657957-wnfww"
Nov 04 05:43:31.703568 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:31.703511    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-ade2e8/premium-w2-ade2e8-kserve-b66657957-wnfww"
Nov 04 05:43:31.977188 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:31.977159    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-ade2e8/premium-w2-ade2e8-kserve-b66657957-wnfww"]
Nov 04 05:43:31.978560 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:43:31.978533    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef483385_b12d_4ce4_9f4e_891a9f4369dc.slice/crio-46a4d067b45d14ab763fba8839061186b2b544ce26a5e1e1259abddaafb60d48 WatchSource:0}: Error finding container 46a4d067b45d14ab763fba8839061186b2b544ce26a5e1e1259abddaafb60d48: Status 404 returned error can't find the container with id 46a4d067b45d14ab763fba8839061186b2b544ce26a5e1e1259abddaafb60d48
Nov 04 05:43:32.064889 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:32.064863    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-ade2e8/premium-w2-ade2e8-kserve-b66657957-wnfww" event={"ID":"ef483385-b12d-4ce4-9f4e-891a9f4369dc","Type":"ContainerStarted","Data":"e6e7de5f1befd4fd69dd628ab81a4cfe43d4b011b14380f51ba439b56f2c7631"}
Nov 04 05:43:32.065029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:32.064911    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-ade2e8/premium-w2-ade2e8-kserve-b66657957-wnfww" event={"ID":"ef483385-b12d-4ce4-9f4e-891a9f4369dc","Type":"ContainerStarted","Data":"46a4d067b45d14ab763fba8839061186b2b544ce26a5e1e1259abddaafb60d48"}
Nov 04 05:43:32.080438 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:32.080400    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-ade2e8/premium-w2-ade2e8-kserve-b66657957-wnfww" podStartSLOduration=1.080388025 podStartE2EDuration="1.080388025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:43:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:43:32.080226694 +0000 UTC m=+898.948890267" watchObservedRunningTime="2026-11-04 05:43:32.080388025 +0000 UTC m=+898.949051597"
Nov 04 05:43:32.539717 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:32.539684    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w6-2b14d0/premium-w6-2b14d0-kserve-7f599dc4b7-44v6n"
Nov 04 05:43:32.552121 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:32.552097    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w6-2b14d0/premium-w6-2b14d0-kserve-7f599dc4b7-44v6n"
Nov 04 05:43:32.703614 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:32.703590    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-ade2e8/premium-w2-ade2e8-kserve-b66657957-wnfww"
Nov 04 05:43:33.080592 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:33.080563    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-2b14d0/premium-w6-2b14d0-kserve-7f599dc4b7-44v6n"
Nov 04 05:43:33.328667 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:33.328633    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dlb7_f1f789ee-b574-48ba-abd5-cfac0b3d7f40/ovn-acl-logging/0.log"
Nov 04 05:43:33.331016 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:33.330947    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dlb7_f1f789ee-b574-48ba-abd5-cfac0b3d7f40/ovn-acl-logging/0.log"
Nov 04 05:43:36.507580 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.507547    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph"]
Nov 04 05:43:36.512344 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.512326    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph"
Nov 04 05:43:36.518922 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.518895    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w5-9d808e-openshift-default-dockercfg-sqq5t\""
Nov 04 05:43:36.522709 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.522687    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph"]
Nov 04 05:43:36.576437 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.576413    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnvv6\" (UniqueName: \"kubernetes.io/projected/283c52c3-ef70-4c20-9862-02ce8f496e47-kube-api-access-jnvv6\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph\" (UID: \"283c52c3-ef70-4c20-9862-02ce8f496e47\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph"
Nov 04 05:43:36.576583 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.576450    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/283c52c3-ef70-4c20-9862-02ce8f496e47-credential-socket\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph\" (UID: \"283c52c3-ef70-4c20-9862-02ce8f496e47\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph"
Nov 04 05:43:36.576583 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.576480    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/283c52c3-ef70-4c20-9862-02ce8f496e47-istio-token\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph\" (UID: \"283c52c3-ef70-4c20-9862-02ce8f496e47\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph"
Nov 04 05:43:36.576791 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.576621    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/283c52c3-ef70-4c20-9862-02ce8f496e47-istio-data\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph\" (UID: \"283c52c3-ef70-4c20-9862-02ce8f496e47\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph"
Nov 04 05:43:36.576791 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.576663    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/283c52c3-ef70-4c20-9862-02ce8f496e47-istiod-ca-cert\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph\" (UID: \"283c52c3-ef70-4c20-9862-02ce8f496e47\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph"
Nov 04 05:43:36.576791 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.576728    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/283c52c3-ef70-4c20-9862-02ce8f496e47-istio-envoy\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph\" (UID: \"283c52c3-ef70-4c20-9862-02ce8f496e47\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph"
Nov 04 05:43:36.576889 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.576844    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/283c52c3-ef70-4c20-9862-02ce8f496e47-workload-certs\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph\" (UID: \"283c52c3-ef70-4c20-9862-02ce8f496e47\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph"
Nov 04 05:43:36.576889 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.576880    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/283c52c3-ef70-4c20-9862-02ce8f496e47-workload-socket\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph\" (UID: \"283c52c3-ef70-4c20-9862-02ce8f496e47\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph"
Nov 04 05:43:36.576974 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.576900    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/283c52c3-ef70-4c20-9862-02ce8f496e47-istio-podinfo\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph\" (UID: \"283c52c3-ef70-4c20-9862-02ce8f496e47\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph"
Nov 04 05:43:36.677548 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.677501    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/283c52c3-ef70-4c20-9862-02ce8f496e47-workload-certs\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph\" (UID: \"283c52c3-ef70-4c20-9862-02ce8f496e47\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph"
Nov 04 05:43:36.677696 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.677564    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/283c52c3-ef70-4c20-9862-02ce8f496e47-workload-socket\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph\" (UID: \"283c52c3-ef70-4c20-9862-02ce8f496e47\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph"
Nov 04 05:43:36.677696 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.677668    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/283c52c3-ef70-4c20-9862-02ce8f496e47-istio-podinfo\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph\" (UID: \"283c52c3-ef70-4c20-9862-02ce8f496e47\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph"
Nov 04 05:43:36.677802 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.677714    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnvv6\" (UniqueName: \"kubernetes.io/projected/283c52c3-ef70-4c20-9862-02ce8f496e47-kube-api-access-jnvv6\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph\" (UID: \"283c52c3-ef70-4c20-9862-02ce8f496e47\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph"
Nov 04 05:43:36.677841 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.677801    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/283c52c3-ef70-4c20-9862-02ce8f496e47-credential-socket\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph\" (UID: \"283c52c3-ef70-4c20-9862-02ce8f496e47\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph"
Nov 04 05:43:36.677894 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.677844    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/283c52c3-ef70-4c20-9862-02ce8f496e47-istio-token\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph\" (UID: \"283c52c3-ef70-4c20-9862-02ce8f496e47\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph"
Nov 04 05:43:36.677950 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.677909    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/283c52c3-ef70-4c20-9862-02ce8f496e47-istio-data\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph\" (UID: \"283c52c3-ef70-4c20-9862-02ce8f496e47\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph"
Nov 04 05:43:36.677950 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.677916    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/283c52c3-ef70-4c20-9862-02ce8f496e47-workload-certs\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph\" (UID: \"283c52c3-ef70-4c20-9862-02ce8f496e47\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph"
Nov 04 05:43:36.677950 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.677936    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/283c52c3-ef70-4c20-9862-02ce8f496e47-istiod-ca-cert\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph\" (UID: \"283c52c3-ef70-4c20-9862-02ce8f496e47\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph"
Nov 04 05:43:36.678099 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.677974    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/283c52c3-ef70-4c20-9862-02ce8f496e47-istio-envoy\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph\" (UID: \"283c52c3-ef70-4c20-9862-02ce8f496e47\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph"
Nov 04 05:43:36.678154 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.677975    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/283c52c3-ef70-4c20-9862-02ce8f496e47-workload-socket\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph\" (UID: \"283c52c3-ef70-4c20-9862-02ce8f496e47\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph"
Nov 04 05:43:36.678209 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.678186    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/283c52c3-ef70-4c20-9862-02ce8f496e47-credential-socket\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph\" (UID: \"283c52c3-ef70-4c20-9862-02ce8f496e47\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph"
Nov 04 05:43:36.678255 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.678202    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/283c52c3-ef70-4c20-9862-02ce8f496e47-istio-data\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph\" (UID: \"283c52c3-ef70-4c20-9862-02ce8f496e47\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph"
Nov 04 05:43:36.678544 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.678500    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/283c52c3-ef70-4c20-9862-02ce8f496e47-istiod-ca-cert\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph\" (UID: \"283c52c3-ef70-4c20-9862-02ce8f496e47\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph"
Nov 04 05:43:36.680053 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.680031    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/283c52c3-ef70-4c20-9862-02ce8f496e47-istio-envoy\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph\" (UID: \"283c52c3-ef70-4c20-9862-02ce8f496e47\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph"
Nov 04 05:43:36.680164 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.680153    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/283c52c3-ef70-4c20-9862-02ce8f496e47-istio-podinfo\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph\" (UID: \"283c52c3-ef70-4c20-9862-02ce8f496e47\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph"
Nov 04 05:43:36.684975 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.684954    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/283c52c3-ef70-4c20-9862-02ce8f496e47-istio-token\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph\" (UID: \"283c52c3-ef70-4c20-9862-02ce8f496e47\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph"
Nov 04 05:43:36.685165 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.685146    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnvv6\" (UniqueName: \"kubernetes.io/projected/283c52c3-ef70-4c20-9862-02ce8f496e47-kube-api-access-jnvv6\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph\" (UID: \"283c52c3-ef70-4c20-9862-02ce8f496e47\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph"
Nov 04 05:43:36.757981 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.757921    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb"]
Nov 04 05:43:36.762687 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.762671    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb"
Nov 04 05:43:36.768770 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.768735    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-27935d-openshift-default-dockercfg-72clk\""
Nov 04 05:43:36.771938 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.771913    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb"]
Nov 04 05:43:36.779400 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.779375    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e96333d-b91c-4a31-80d0-369af77f5eb8-istio-podinfo\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb\" (UID: \"9e96333d-b91c-4a31-80d0-369af77f5eb8\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb"
Nov 04 05:43:36.779507 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.779433    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e96333d-b91c-4a31-80d0-369af77f5eb8-istio-data\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb\" (UID: \"9e96333d-b91c-4a31-80d0-369af77f5eb8\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb"
Nov 04 05:43:36.779587 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.779562    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e96333d-b91c-4a31-80d0-369af77f5eb8-istio-token\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb\" (UID: \"9e96333d-b91c-4a31-80d0-369af77f5eb8\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb"
Nov 04 05:43:36.779639 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.779614    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e96333d-b91c-4a31-80d0-369af77f5eb8-credential-socket\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb\" (UID: \"9e96333d-b91c-4a31-80d0-369af77f5eb8\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb"
Nov 04 05:43:36.779720 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.779701    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e96333d-b91c-4a31-80d0-369af77f5eb8-workload-socket\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb\" (UID: \"9e96333d-b91c-4a31-80d0-369af77f5eb8\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb"
Nov 04 05:43:36.779773 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.779757    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e96333d-b91c-4a31-80d0-369af77f5eb8-workload-certs\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb\" (UID: \"9e96333d-b91c-4a31-80d0-369af77f5eb8\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb"
Nov 04 05:43:36.779932 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.779914    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e96333d-b91c-4a31-80d0-369af77f5eb8-istiod-ca-cert\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb\" (UID: \"9e96333d-b91c-4a31-80d0-369af77f5eb8\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb"
Nov 04 05:43:36.780001 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.779953    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e96333d-b91c-4a31-80d0-369af77f5eb8-istio-envoy\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb\" (UID: \"9e96333d-b91c-4a31-80d0-369af77f5eb8\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb"
Nov 04 05:43:36.780064 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.780028    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5kfd\" (UniqueName: \"kubernetes.io/projected/9e96333d-b91c-4a31-80d0-369af77f5eb8-kube-api-access-l5kfd\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb\" (UID: \"9e96333d-b91c-4a31-80d0-369af77f5eb8\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb"
Nov 04 05:43:36.827237 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.827213    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph"
Nov 04 05:43:36.881682 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.881650    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e96333d-b91c-4a31-80d0-369af77f5eb8-istiod-ca-cert\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb\" (UID: \"9e96333d-b91c-4a31-80d0-369af77f5eb8\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb"
Nov 04 05:43:36.881771 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.881702    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e96333d-b91c-4a31-80d0-369af77f5eb8-istio-envoy\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb\" (UID: \"9e96333d-b91c-4a31-80d0-369af77f5eb8\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb"
Nov 04 05:43:36.881771 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.881737    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5kfd\" (UniqueName: \"kubernetes.io/projected/9e96333d-b91c-4a31-80d0-369af77f5eb8-kube-api-access-l5kfd\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb\" (UID: \"9e96333d-b91c-4a31-80d0-369af77f5eb8\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb"
Nov 04 05:43:36.881881 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.881784    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e96333d-b91c-4a31-80d0-369af77f5eb8-istio-podinfo\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb\" (UID: \"9e96333d-b91c-4a31-80d0-369af77f5eb8\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb"
Nov 04 05:43:36.881881 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.881826    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e96333d-b91c-4a31-80d0-369af77f5eb8-istio-data\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb\" (UID: \"9e96333d-b91c-4a31-80d0-369af77f5eb8\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb"
Nov 04 05:43:36.881881 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.881873    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e96333d-b91c-4a31-80d0-369af77f5eb8-istio-token\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb\" (UID: \"9e96333d-b91c-4a31-80d0-369af77f5eb8\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb"
Nov 04 05:43:36.882035 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.881910    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e96333d-b91c-4a31-80d0-369af77f5eb8-credential-socket\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb\" (UID: \"9e96333d-b91c-4a31-80d0-369af77f5eb8\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb"
Nov 04 05:43:36.882035 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.881942    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e96333d-b91c-4a31-80d0-369af77f5eb8-workload-socket\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb\" (UID: \"9e96333d-b91c-4a31-80d0-369af77f5eb8\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb"
Nov 04 05:43:36.882035 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.881975    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e96333d-b91c-4a31-80d0-369af77f5eb8-workload-certs\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb\" (UID: \"9e96333d-b91c-4a31-80d0-369af77f5eb8\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb"
Nov 04 05:43:36.883417 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.882333    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e96333d-b91c-4a31-80d0-369af77f5eb8-workload-certs\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb\" (UID: \"9e96333d-b91c-4a31-80d0-369af77f5eb8\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb"
Nov 04 05:43:36.883417 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.882556    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e96333d-b91c-4a31-80d0-369af77f5eb8-istiod-ca-cert\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb\" (UID: \"9e96333d-b91c-4a31-80d0-369af77f5eb8\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb"
Nov 04 05:43:36.891009 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.890724    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e96333d-b91c-4a31-80d0-369af77f5eb8-istio-data\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb\" (UID: \"9e96333d-b91c-4a31-80d0-369af77f5eb8\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb"
Nov 04 05:43:36.897892 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.897862    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e96333d-b91c-4a31-80d0-369af77f5eb8-credential-socket\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb\" (UID: \"9e96333d-b91c-4a31-80d0-369af77f5eb8\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb"
Nov 04 05:43:36.898832 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.898807    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e96333d-b91c-4a31-80d0-369af77f5eb8-istio-envoy\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb\" (UID: \"9e96333d-b91c-4a31-80d0-369af77f5eb8\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb"
Nov 04 05:43:36.898964 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.898855    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e96333d-b91c-4a31-80d0-369af77f5eb8-workload-socket\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb\" (UID: \"9e96333d-b91c-4a31-80d0-369af77f5eb8\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb"
Nov 04 05:43:36.899645 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.899325    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e96333d-b91c-4a31-80d0-369af77f5eb8-istio-podinfo\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb\" (UID: \"9e96333d-b91c-4a31-80d0-369af77f5eb8\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb"
Nov 04 05:43:36.901842 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.901820    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e96333d-b91c-4a31-80d0-369af77f5eb8-istio-token\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb\" (UID: \"9e96333d-b91c-4a31-80d0-369af77f5eb8\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb"
Nov 04 05:43:36.902336 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:36.902265    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5kfd\" (UniqueName: \"kubernetes.io/projected/9e96333d-b91c-4a31-80d0-369af77f5eb8-kube-api-access-l5kfd\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb\" (UID: \"9e96333d-b91c-4a31-80d0-369af77f5eb8\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb"
Nov 04 05:43:37.078023 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:37.077956    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb"
Nov 04 05:43:37.104028 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:37.104003    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph"]
Nov 04 05:43:37.105479 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:43:37.105456    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod283c52c3_ef70_4c20_9862_02ce8f496e47.slice/crio-25fbb4f9268d3313d742a278bed98d26996af3120607e96bdca17e71b246294b WatchSource:0}: Error finding container 25fbb4f9268d3313d742a278bed98d26996af3120607e96bdca17e71b246294b: Status 404 returned error can't find the container with id 25fbb4f9268d3313d742a278bed98d26996af3120607e96bdca17e71b246294b
Nov 04 05:43:37.107900 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:37.107869    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:43:37.107997 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:37.107952    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:43:37.108059 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:37.107997    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:43:37.359927 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:37.359899    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb"]
Nov 04 05:43:37.360127 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:43:37.360101    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e96333d_b91c_4a31_80d0_369af77f5eb8.slice/crio-9385c24c62f7a25a657de3a3960840b04f964107c96c84c4724e8449d4bb7c70 WatchSource:0}: Error finding container 9385c24c62f7a25a657de3a3960840b04f964107c96c84c4724e8449d4bb7c70: Status 404 returned error can't find the container with id 9385c24c62f7a25a657de3a3960840b04f964107c96c84c4724e8449d4bb7c70
Nov 04 05:43:37.362639 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:37.362608    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:43:37.362719 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:37.362671    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:43:37.362779 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:37.362722    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:43:38.110434 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:38.110396    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb" event={"ID":"9e96333d-b91c-4a31-80d0-369af77f5eb8","Type":"ContainerStarted","Data":"a736664a68b278b227e1536e0da094db32ad532b6039f39c027dba56786f6c48"}
Nov 04 05:43:38.113635 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:38.113603    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb" event={"ID":"9e96333d-b91c-4a31-80d0-369af77f5eb8","Type":"ContainerStarted","Data":"9385c24c62f7a25a657de3a3960840b04f964107c96c84c4724e8449d4bb7c70"}
Nov 04 05:43:38.114896 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:38.114873    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph" event={"ID":"283c52c3-ef70-4c20-9862-02ce8f496e47","Type":"ContainerStarted","Data":"f9b30df84ec3c4d41b55aaa8a4685adf1b92d23b733ef859e7272ab928a7d854"}
Nov 04 05:43:38.115073 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:38.115044    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph" event={"ID":"283c52c3-ef70-4c20-9862-02ce8f496e47","Type":"ContainerStarted","Data":"25fbb4f9268d3313d742a278bed98d26996af3120607e96bdca17e71b246294b"}
Nov 04 05:43:38.137383 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:38.137342    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb" podStartSLOduration=2.137328893 podStartE2EDuration="2.137328893s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:43:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:43:38.135905486 +0000 UTC m=+905.004569059" watchObservedRunningTime="2026-11-04 05:43:38.137328893 +0000 UTC m=+905.005992465"
Nov 04 05:43:38.157746 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:38.157703    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph" podStartSLOduration=2.157690948 podStartE2EDuration="2.157690948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:43:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:43:38.156290119 +0000 UTC m=+905.024953694" watchObservedRunningTime="2026-11-04 05:43:38.157690948 +0000 UTC m=+905.026354520"
Nov 04 05:43:38.827880 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:38.827847    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph"
Nov 04 05:43:38.829607 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:38.829578    4357 patch_prober.go:29] interesting pod/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Nov 04 05:43:38.829756 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:38.829649    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph" podUID="283c52c3-ef70-4c20-9862-02ce8f496e47" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Nov 04 05:43:39.081618 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:39.079785    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb"
Nov 04 05:43:39.102539 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:39.082615    4357 patch_prober.go:29] interesting pod/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Nov 04 05:43:39.102539 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:39.082679    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb" podUID="9e96333d-b91c-4a31-80d0-369af77f5eb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Nov 04 05:43:39.828811 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:39.828753    4357 patch_prober.go:29] interesting pod/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Nov 04 05:43:39.829184 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:39.828814    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph" podUID="283c52c3-ef70-4c20-9862-02ce8f496e47" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Nov 04 05:43:40.082742 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:40.080815    4357 patch_prober.go:29] interesting pod/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Nov 04 05:43:40.082742 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:40.080875    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb" podUID="9e96333d-b91c-4a31-80d0-369af77f5eb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Nov 04 05:43:40.832283 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:40.830979    4357 patch_prober.go:29] interesting pod/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Nov 04 05:43:40.832283 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:40.831046    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph" podUID="283c52c3-ef70-4c20-9862-02ce8f496e47" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Nov 04 05:43:41.081540 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:41.080843    4357 patch_prober.go:29] interesting pod/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Nov 04 05:43:41.081540 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:41.080914    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb" podUID="9e96333d-b91c-4a31-80d0-369af77f5eb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Nov 04 05:43:41.708447 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:41.708416    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-ade2e8/premium-w2-ade2e8-kserve-b66657957-wnfww"
Nov 04 05:43:41.731276 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:41.731243    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-ade2e8/premium-w2-ade2e8-kserve-b66657957-wnfww"
Nov 04 05:43:41.827962 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:41.827929    4357 patch_prober.go:29] interesting pod/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Nov 04 05:43:41.828105 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:41.827977    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph" podUID="283c52c3-ef70-4c20-9862-02ce8f496e47" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Nov 04 05:43:42.087540 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:42.081919    4357 patch_prober.go:29] interesting pod/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Nov 04 05:43:42.087540 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:42.081977    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb" podUID="9e96333d-b91c-4a31-80d0-369af77f5eb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Nov 04 05:43:42.317766 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:42.317731    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-ade2e8/premium-w2-ade2e8-kserve-b66657957-wnfww"
Nov 04 05:43:42.827739 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:42.827697    4357 patch_prober.go:29] interesting pod/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Nov 04 05:43:42.827946 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:42.827775    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph" podUID="283c52c3-ef70-4c20-9862-02ce8f496e47" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Nov 04 05:43:43.081598 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:43.079643    4357 patch_prober.go:29] interesting pod/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Nov 04 05:43:43.081598 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:43.079717    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb" podUID="9e96333d-b91c-4a31-80d0-369af77f5eb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Nov 04 05:43:43.836406 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:43.832650    4357 patch_prober.go:29] interesting pod/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Nov 04 05:43:43.836406 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:43.832721    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph" podUID="283c52c3-ef70-4c20-9862-02ce8f496e47" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Nov 04 05:43:44.079161 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:44.079120    4357 patch_prober.go:29] interesting pod/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Nov 04 05:43:44.079370 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:44.079189    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb" podUID="9e96333d-b91c-4a31-80d0-369af77f5eb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Nov 04 05:43:44.832213 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:44.832183    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph"
Nov 04 05:43:44.832451 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:44.832431    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph"
Nov 04 05:43:44.833238 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:44.833221    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph"
Nov 04 05:43:45.281452 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:45.281426    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb"
Nov 04 05:43:45.281910 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:45.281734    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb"
Nov 04 05:43:45.282504 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:43:45.282485    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb"
Nov 04 05:43:47.276482 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:43:47.276452    4357 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-npgcv" containerName="extractor"
Nov 04 05:44:06.203046 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.203013    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4"]
Nov 04 05:44:06.207225 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.207202    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4"
Nov 04 05:44:06.216376 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.216352    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-ade2e8-openshift-default-dockercfg-9dzpp\""
Nov 04 05:44:06.218484 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.218454    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4"]
Nov 04 05:44:06.294823 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.294792    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz96s\" (UniqueName: \"kubernetes.io/projected/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-kube-api-access-dz96s\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4\" (UID: \"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4"
Nov 04 05:44:06.294943 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.294829    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-workload-socket\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4\" (UID: \"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4"
Nov 04 05:44:06.294943 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.294847    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-istio-envoy\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4\" (UID: \"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4"
Nov 04 05:44:06.295019 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.294936    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-istio-data\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4\" (UID: \"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4"
Nov 04 05:44:06.295054 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.295032    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-istio-podinfo\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4\" (UID: \"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4"
Nov 04 05:44:06.295087 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.295078    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-istiod-ca-cert\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4\" (UID: \"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4"
Nov 04 05:44:06.295120 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.295106    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-istio-token\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4\" (UID: \"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4"
Nov 04 05:44:06.295211 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.295192    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-credential-socket\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4\" (UID: \"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4"
Nov 04 05:44:06.295248 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.295224    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-workload-certs\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4\" (UID: \"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4"
Nov 04 05:44:06.389880 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.389849    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5"]
Nov 04 05:44:06.393429 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.393412    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5"
Nov 04 05:44:06.395920 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.395897    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-istio-podinfo\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4\" (UID: \"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4"
Nov 04 05:44:06.396035 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.395951    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-istiod-ca-cert\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4\" (UID: \"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4"
Nov 04 05:44:06.396035 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.395990    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-istio-token\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4\" (UID: \"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4"
Nov 04 05:44:06.396184 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.396034    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-credential-socket\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4\" (UID: \"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4"
Nov 04 05:44:06.396184 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.396066    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-workload-certs\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4\" (UID: \"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4"
Nov 04 05:44:06.396184 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.396132    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz96s\" (UniqueName: \"kubernetes.io/projected/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-kube-api-access-dz96s\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4\" (UID: \"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4"
Nov 04 05:44:06.396184 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.396170    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-workload-socket\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4\" (UID: \"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4"
Nov 04 05:44:06.396445 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.396196    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-istio-envoy\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4\" (UID: \"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4"
Nov 04 05:44:06.396445 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.396229    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-istio-data\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4\" (UID: \"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4"
Nov 04 05:44:06.396626 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.396575    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-workload-certs\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4\" (UID: \"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4"
Nov 04 05:44:06.396741 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.396668    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-workload-socket\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4\" (UID: \"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4"
Nov 04 05:44:06.396822 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.396808    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-istio-data\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4\" (UID: \"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4"
Nov 04 05:44:06.396904 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.396878    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-credential-socket\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4\" (UID: \"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4"
Nov 04 05:44:06.396965 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.396922    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-istiod-ca-cert\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4\" (UID: \"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4"
Nov 04 05:44:06.397233 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.397212    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-f9b4a9-openshift-default-dockercfg-7nw4r\""
Nov 04 05:44:06.398621 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.398599    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-istio-podinfo\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4\" (UID: \"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4"
Nov 04 05:44:06.398621 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.398610    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-istio-envoy\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4\" (UID: \"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4"
Nov 04 05:44:06.403442 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.403421    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5"]
Nov 04 05:44:06.407712 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.407691    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-istio-token\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4\" (UID: \"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4"
Nov 04 05:44:06.407904 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.407882    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz96s\" (UniqueName: \"kubernetes.io/projected/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-kube-api-access-dz96s\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4\" (UID: \"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4"
Nov 04 05:44:06.497163 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.497096    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0179edc6-8ab0-4668-a77e-5d490d9324a9-istiod-ca-cert\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5\" (UID: \"0179edc6-8ab0-4668-a77e-5d490d9324a9\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5"
Nov 04 05:44:06.497280 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.497165    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0179edc6-8ab0-4668-a77e-5d490d9324a9-workload-socket\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5\" (UID: \"0179edc6-8ab0-4668-a77e-5d490d9324a9\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5"
Nov 04 05:44:06.497280 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.497240    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0179edc6-8ab0-4668-a77e-5d490d9324a9-credential-socket\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5\" (UID: \"0179edc6-8ab0-4668-a77e-5d490d9324a9\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5"
Nov 04 05:44:06.497371 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.497280    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86gxv\" (UniqueName: \"kubernetes.io/projected/0179edc6-8ab0-4668-a77e-5d490d9324a9-kube-api-access-86gxv\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5\" (UID: \"0179edc6-8ab0-4668-a77e-5d490d9324a9\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5"
Nov 04 05:44:06.497432 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.497418    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0179edc6-8ab0-4668-a77e-5d490d9324a9-istio-podinfo\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5\" (UID: \"0179edc6-8ab0-4668-a77e-5d490d9324a9\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5"
Nov 04 05:44:06.497470 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.497445    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0179edc6-8ab0-4668-a77e-5d490d9324a9-istio-token\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5\" (UID: \"0179edc6-8ab0-4668-a77e-5d490d9324a9\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5"
Nov 04 05:44:06.497470 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.497466    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0179edc6-8ab0-4668-a77e-5d490d9324a9-workload-certs\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5\" (UID: \"0179edc6-8ab0-4668-a77e-5d490d9324a9\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5"
Nov 04 05:44:06.497588 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.497481    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0179edc6-8ab0-4668-a77e-5d490d9324a9-istio-data\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5\" (UID: \"0179edc6-8ab0-4668-a77e-5d490d9324a9\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5"
Nov 04 05:44:06.497636 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.497612    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0179edc6-8ab0-4668-a77e-5d490d9324a9-istio-envoy\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5\" (UID: \"0179edc6-8ab0-4668-a77e-5d490d9324a9\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5"
Nov 04 05:44:06.522672 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.522647    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4"
Nov 04 05:44:06.599269 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.599239    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0179edc6-8ab0-4668-a77e-5d490d9324a9-istio-envoy\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5\" (UID: \"0179edc6-8ab0-4668-a77e-5d490d9324a9\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5"
Nov 04 05:44:06.599412 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.599292    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0179edc6-8ab0-4668-a77e-5d490d9324a9-istiod-ca-cert\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5\" (UID: \"0179edc6-8ab0-4668-a77e-5d490d9324a9\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5"
Nov 04 05:44:06.599412 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.599325    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0179edc6-8ab0-4668-a77e-5d490d9324a9-workload-socket\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5\" (UID: \"0179edc6-8ab0-4668-a77e-5d490d9324a9\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5"
Nov 04 05:44:06.599412 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.599344    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0179edc6-8ab0-4668-a77e-5d490d9324a9-credential-socket\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5\" (UID: \"0179edc6-8ab0-4668-a77e-5d490d9324a9\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5"
Nov 04 05:44:06.599412 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.599366    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86gxv\" (UniqueName: \"kubernetes.io/projected/0179edc6-8ab0-4668-a77e-5d490d9324a9-kube-api-access-86gxv\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5\" (UID: \"0179edc6-8ab0-4668-a77e-5d490d9324a9\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5"
Nov 04 05:44:06.599642 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.599435    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0179edc6-8ab0-4668-a77e-5d490d9324a9-istio-podinfo\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5\" (UID: \"0179edc6-8ab0-4668-a77e-5d490d9324a9\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5"
Nov 04 05:44:06.599642 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.599457    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0179edc6-8ab0-4668-a77e-5d490d9324a9-istio-token\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5\" (UID: \"0179edc6-8ab0-4668-a77e-5d490d9324a9\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5"
Nov 04 05:44:06.599642 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.599480    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0179edc6-8ab0-4668-a77e-5d490d9324a9-workload-certs\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5\" (UID: \"0179edc6-8ab0-4668-a77e-5d490d9324a9\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5"
Nov 04 05:44:06.599642 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.599494    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0179edc6-8ab0-4668-a77e-5d490d9324a9-istio-data\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5\" (UID: \"0179edc6-8ab0-4668-a77e-5d490d9324a9\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5"
Nov 04 05:44:06.599861 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.599837    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0179edc6-8ab0-4668-a77e-5d490d9324a9-istio-data\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5\" (UID: \"0179edc6-8ab0-4668-a77e-5d490d9324a9\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5"
Nov 04 05:44:06.600419 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.600182    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0179edc6-8ab0-4668-a77e-5d490d9324a9-workload-socket\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5\" (UID: \"0179edc6-8ab0-4668-a77e-5d490d9324a9\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5"
Nov 04 05:44:06.600419 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.600243    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0179edc6-8ab0-4668-a77e-5d490d9324a9-credential-socket\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5\" (UID: \"0179edc6-8ab0-4668-a77e-5d490d9324a9\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5"
Nov 04 05:44:06.600660 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.600636    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0179edc6-8ab0-4668-a77e-5d490d9324a9-workload-certs\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5\" (UID: \"0179edc6-8ab0-4668-a77e-5d490d9324a9\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5"
Nov 04 05:44:06.600786 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.600769    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0179edc6-8ab0-4668-a77e-5d490d9324a9-istiod-ca-cert\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5\" (UID: \"0179edc6-8ab0-4668-a77e-5d490d9324a9\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5"
Nov 04 05:44:06.601719 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.601698    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0179edc6-8ab0-4668-a77e-5d490d9324a9-istio-envoy\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5\" (UID: \"0179edc6-8ab0-4668-a77e-5d490d9324a9\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5"
Nov 04 05:44:06.602912 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.602893    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0179edc6-8ab0-4668-a77e-5d490d9324a9-istio-podinfo\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5\" (UID: \"0179edc6-8ab0-4668-a77e-5d490d9324a9\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5"
Nov 04 05:44:06.614390 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.614367    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0179edc6-8ab0-4668-a77e-5d490d9324a9-istio-token\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5\" (UID: \"0179edc6-8ab0-4668-a77e-5d490d9324a9\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5"
Nov 04 05:44:06.614686 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.614668    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86gxv\" (UniqueName: \"kubernetes.io/projected/0179edc6-8ab0-4668-a77e-5d490d9324a9-kube-api-access-86gxv\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5\" (UID: \"0179edc6-8ab0-4668-a77e-5d490d9324a9\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5"
Nov 04 05:44:06.742305 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.741962    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5"
Nov 04 05:44:06.798834 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.798813    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4"]
Nov 04 05:44:06.809032 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.808421    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:44:06.809032 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.808486    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:44:06.809032 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:06.808532    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:44:07.018406 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:44:07.018370    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0179edc6_8ab0_4668_a77e_5d490d9324a9.slice/crio-7320b0fad880e690c6d268f31f30c4dcc53d3d26e5e64ca26e0e532d1885cf11 WatchSource:0}: Error finding container 7320b0fad880e690c6d268f31f30c4dcc53d3d26e5e64ca26e0e532d1885cf11: Status 404 returned error can't find the container with id 7320b0fad880e690c6d268f31f30c4dcc53d3d26e5e64ca26e0e532d1885cf11
Nov 04 05:44:07.018566 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:07.018446    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5"]
Nov 04 05:44:07.021232 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:07.021185    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:44:07.021327 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:07.021282    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:44:07.021370 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:07.021328    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:44:07.281927 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:07.281845    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5" event={"ID":"0179edc6-8ab0-4668-a77e-5d490d9324a9","Type":"ContainerStarted","Data":"563efce8ce5da7b68d08e72659c363f732af8836624e5517752958816cac5fd8"}
Nov 04 05:44:07.281927 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:07.281903    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5" event={"ID":"0179edc6-8ab0-4668-a77e-5d490d9324a9","Type":"ContainerStarted","Data":"7320b0fad880e690c6d268f31f30c4dcc53d3d26e5e64ca26e0e532d1885cf11"}
Nov 04 05:44:07.281927 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:07.281924    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4" event={"ID":"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7","Type":"ContainerStarted","Data":"1c3580a6fa90d49399e27240ba63c1d9dcc7d32103fbcceca542b451702132be"}
Nov 04 05:44:07.282353 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:07.281948    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4" event={"ID":"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7","Type":"ContainerStarted","Data":"2b4020ddd24beca09f9280aba46063ebb647e05252c0c8bbc3b3a9cc57710d24"}
Nov 04 05:44:07.288654 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:07.288612    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5" podStartSLOduration=1.28859942 podStartE2EDuration="1.28859942s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:44:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:44:07.286844456 +0000 UTC m=+934.155508040" watchObservedRunningTime="2026-11-04 05:44:07.28859942 +0000 UTC m=+934.157262993"
Nov 04 05:44:07.312511 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:07.312463    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4" podStartSLOduration=1.312450063 podStartE2EDuration="1.312450063s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:44:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:44:07.311347088 +0000 UTC m=+934.180010662" watchObservedRunningTime="2026-11-04 05:44:07.312450063 +0000 UTC m=+934.181113635"
Nov 04 05:44:07.523777 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:07.523739    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4"
Nov 04 05:44:07.525144 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:07.525116    4357 patch_prober.go:29] interesting pod/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Nov 04 05:44:07.525297 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:07.525170    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4" podUID="7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Nov 04 05:44:07.742736 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:07.742623    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5"
Nov 04 05:44:08.523606 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:08.523574    4357 patch_prober.go:29] interesting pod/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Nov 04 05:44:08.524022 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:08.523628    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4" podUID="7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Nov 04 05:44:08.751568 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:08.748723    4357 patch_prober.go:29] interesting pod/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Nov 04 05:44:08.751568 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:08.748803    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5" podUID="0179edc6-8ab0-4668-a77e-5d490d9324a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Nov 04 05:44:09.523259 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:09.523223    4357 patch_prober.go:29] interesting pod/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Nov 04 05:44:09.523465 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:09.523284    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4" podUID="7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Nov 04 05:44:09.742544 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:09.742484    4357 patch_prober.go:29] interesting pod/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Nov 04 05:44:09.743022 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:09.742568    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5" podUID="0179edc6-8ab0-4668-a77e-5d490d9324a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Nov 04 05:44:10.523629 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:10.523589    4357 patch_prober.go:29] interesting pod/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Nov 04 05:44:10.523806 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:10.523645    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4" podUID="7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Nov 04 05:44:10.742990 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:10.742952    4357 patch_prober.go:29] interesting pod/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Nov 04 05:44:10.743364 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:10.743000    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5" podUID="0179edc6-8ab0-4668-a77e-5d490d9324a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Nov 04 05:44:11.523358 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:11.523327    4357 patch_prober.go:29] interesting pod/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Nov 04 05:44:11.523564 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:11.523384    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4" podUID="7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Nov 04 05:44:11.742967 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:11.742934    4357 patch_prober.go:29] interesting pod/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Nov 04 05:44:11.743141 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:11.742984    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5" podUID="0179edc6-8ab0-4668-a77e-5d490d9324a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Nov 04 05:44:12.531687 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:12.529933    4357 patch_prober.go:29] interesting pod/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Nov 04 05:44:12.531687 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:12.530011    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4" podUID="7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Nov 04 05:44:12.742747 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:12.742706    4357 patch_prober.go:29] interesting pod/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Nov 04 05:44:12.742960 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:12.742939    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5" podUID="0179edc6-8ab0-4668-a77e-5d490d9324a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Nov 04 05:44:13.522977 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:13.522945    4357 patch_prober.go:29] interesting pod/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Nov 04 05:44:13.523387 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:13.522993    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4" podUID="7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Nov 04 05:44:13.742713 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:13.742675    4357 patch_prober.go:29] interesting pod/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Nov 04 05:44:13.742921 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:13.742729    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5" podUID="0179edc6-8ab0-4668-a77e-5d490d9324a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Nov 04 05:44:14.527862 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:14.527830    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4"
Nov 04 05:44:14.528334 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:14.528236    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4"
Nov 04 05:44:14.528940 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:14.528921    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4"
Nov 04 05:44:14.746837 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:14.746804    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5"
Nov 04 05:44:14.747094 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:14.747077    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5"
Nov 04 05:44:14.747769 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:14.747749    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5"
Nov 04 05:44:17.274885 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:44:17.274809    4357 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-npgcv" containerName="extractor"
Nov 04 05:44:31.310846 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:31.310811    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-ade2e8/premium-w2-ade2e8-kserve-b66657957-wnfww"]
Nov 04 05:44:40.431469 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:40.431432    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-9a0c8b/simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf"]
Nov 04 05:44:43.290894 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:43.290860    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-ade2e8-5f56b646c-fgxpm"]
Nov 04 05:44:46.331313 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:46.331276    4357 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-ade2e8/premium-w2-ade2e8-kserve-b66657957-wnfww" podUID="ef483385-b12d-4ce4-9f4e-891a9f4369dc" containerName="main" containerID="cri-o://e6e7de5f1befd4fd69dd628ab81a4cfe43d4b011b14380f51ba439b56f2c7631" gracePeriod=45
Nov 04 05:44:46.614878 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:46.614853    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-ade2e8/premium-w2-ade2e8-kserve-b66657957-wnfww"
Nov 04 05:44:46.657954 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:46.657923    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ef483385-b12d-4ce4-9f4e-891a9f4369dc-dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef483385-b12d-4ce4-9f4e-891a9f4369dc-dshm\") pod \"ef483385-b12d-4ce4-9f4e-891a9f4369dc\" (UID: \"ef483385-b12d-4ce4-9f4e-891a9f4369dc\") "
Nov 04 05:44:46.662602 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:46.657988    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ef483385-b12d-4ce4-9f4e-891a9f4369dc-tls-certs\" (UniqueName: \"kubernetes.io/secret/ef483385-b12d-4ce4-9f4e-891a9f4369dc-tls-certs\") pod \"ef483385-b12d-4ce4-9f4e-891a9f4369dc\" (UID: \"ef483385-b12d-4ce4-9f4e-891a9f4369dc\") "
Nov 04 05:44:46.662602 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:46.658059    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ef483385-b12d-4ce4-9f4e-891a9f4369dc-kube-api-access-45c7x\" (UniqueName: \"kubernetes.io/projected/ef483385-b12d-4ce4-9f4e-891a9f4369dc-kube-api-access-45c7x\") pod \"ef483385-b12d-4ce4-9f4e-891a9f4369dc\" (UID: \"ef483385-b12d-4ce4-9f4e-891a9f4369dc\") "
Nov 04 05:44:46.662602 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:46.658090    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ef483385-b12d-4ce4-9f4e-891a9f4369dc-home\" (UniqueName: \"kubernetes.io/empty-dir/ef483385-b12d-4ce4-9f4e-891a9f4369dc-home\") pod \"ef483385-b12d-4ce4-9f4e-891a9f4369dc\" (UID: \"ef483385-b12d-4ce4-9f4e-891a9f4369dc\") "
Nov 04 05:44:46.662602 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:46.658203    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ef483385-b12d-4ce4-9f4e-891a9f4369dc-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef483385-b12d-4ce4-9f4e-891a9f4369dc-model-cache\") pod \"ef483385-b12d-4ce4-9f4e-891a9f4369dc\" (UID: \"ef483385-b12d-4ce4-9f4e-891a9f4369dc\") "
Nov 04 05:44:46.662602 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:46.658259    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ef483385-b12d-4ce4-9f4e-891a9f4369dc-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef483385-b12d-4ce4-9f4e-891a9f4369dc-tmp-dir\") pod \"ef483385-b12d-4ce4-9f4e-891a9f4369dc\" (UID: \"ef483385-b12d-4ce4-9f4e-891a9f4369dc\") "
Nov 04 05:44:46.662602 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:46.658613    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef483385-b12d-4ce4-9f4e-891a9f4369dc-home" pod "ef483385-b12d-4ce4-9f4e-891a9f4369dc" (UID: "ef483385-b12d-4ce4-9f4e-891a9f4369dc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:44:46.662602 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:46.658896    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef483385-b12d-4ce4-9f4e-891a9f4369dc-tmp-dir" pod "ef483385-b12d-4ce4-9f4e-891a9f4369dc" (UID: "ef483385-b12d-4ce4-9f4e-891a9f4369dc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:44:46.662602 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:46.659180    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef483385-b12d-4ce4-9f4e-891a9f4369dc-model-cache" pod "ef483385-b12d-4ce4-9f4e-891a9f4369dc" (UID: "ef483385-b12d-4ce4-9f4e-891a9f4369dc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:44:46.662602 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:46.660012    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-ade2e8/premium-w2-ade2e8-kserve-b66657957-wnfww"
Nov 04 05:44:46.662602 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:46.660036    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-ade2e8/premium-w2-ade2e8-kserve-b66657957-wnfww" event={"ID":"ef483385-b12d-4ce4-9f4e-891a9f4369dc","Type":"ContainerDied","Data":"e6e7de5f1befd4fd69dd628ab81a4cfe43d4b011b14380f51ba439b56f2c7631"}
Nov 04 05:44:46.662602 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:46.660090    4357 scope.go:122] "RemoveContainer" containerID="e6e7de5f1befd4fd69dd628ab81a4cfe43d4b011b14380f51ba439b56f2c7631"
Nov 04 05:44:46.662602 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:46.659832    4357 generic.go:356] "Generic (PLEG): container finished" podID="ef483385-b12d-4ce4-9f4e-891a9f4369dc" containerID="e6e7de5f1befd4fd69dd628ab81a4cfe43d4b011b14380f51ba439b56f2c7631" exitCode=0
Nov 04 05:44:46.662602 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:46.660550    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-ade2e8/premium-w2-ade2e8-kserve-b66657957-wnfww" event={"ID":"ef483385-b12d-4ce4-9f4e-891a9f4369dc","Type":"ContainerDied","Data":"46a4d067b45d14ab763fba8839061186b2b544ce26a5e1e1259abddaafb60d48"}
Nov 04 05:44:46.662602 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:46.660918    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef483385-b12d-4ce4-9f4e-891a9f4369dc-tls-certs" pod "ef483385-b12d-4ce4-9f4e-891a9f4369dc" (UID: "ef483385-b12d-4ce4-9f4e-891a9f4369dc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:44:46.662602 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:46.661295    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef483385-b12d-4ce4-9f4e-891a9f4369dc-kube-api-access-45c7x" pod "ef483385-b12d-4ce4-9f4e-891a9f4369dc" (UID: "ef483385-b12d-4ce4-9f4e-891a9f4369dc"). InnerVolumeSpecName "kube-api-access-45c7x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:44:46.662602 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:46.662092    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef483385-b12d-4ce4-9f4e-891a9f4369dc-dshm" pod "ef483385-b12d-4ce4-9f4e-891a9f4369dc" (UID: "ef483385-b12d-4ce4-9f4e-891a9f4369dc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:44:46.690924 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:46.690904    4357 scope.go:122] "RemoveContainer" containerID="e6e7de5f1befd4fd69dd628ab81a4cfe43d4b011b14380f51ba439b56f2c7631"
Nov 04 05:44:46.691243 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:44:46.691212    4357 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6e7de5f1befd4fd69dd628ab81a4cfe43d4b011b14380f51ba439b56f2c7631\": container with ID starting with e6e7de5f1befd4fd69dd628ab81a4cfe43d4b011b14380f51ba439b56f2c7631 not found: ID does not exist" containerID="e6e7de5f1befd4fd69dd628ab81a4cfe43d4b011b14380f51ba439b56f2c7631"
Nov 04 05:44:46.691335 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:46.691251    4357 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6e7de5f1befd4fd69dd628ab81a4cfe43d4b011b14380f51ba439b56f2c7631"} err="failed to get container status \"e6e7de5f1befd4fd69dd628ab81a4cfe43d4b011b14380f51ba439b56f2c7631\": rpc error: code = NotFound desc = could not find container \"e6e7de5f1befd4fd69dd628ab81a4cfe43d4b011b14380f51ba439b56f2c7631\": container with ID starting with e6e7de5f1befd4fd69dd628ab81a4cfe43d4b011b14380f51ba439b56f2c7631 not found: ID does not exist"
Nov 04 05:44:46.759273 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:46.759238    4357 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef483385-b12d-4ce4-9f4e-891a9f4369dc-tls-certs\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:46.759273 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:46.759267    4357 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45c7x\" (UniqueName: \"kubernetes.io/projected/ef483385-b12d-4ce4-9f4e-891a9f4369dc-kube-api-access-45c7x\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:46.759273 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:46.759279    4357 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef483385-b12d-4ce4-9f4e-891a9f4369dc-home\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:46.759481 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:46.759288    4357 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef483385-b12d-4ce4-9f4e-891a9f4369dc-model-cache\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:46.759481 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:46.759297    4357 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef483385-b12d-4ce4-9f4e-891a9f4369dc-tmp-dir\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:46.759481 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:46.759306    4357 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef483385-b12d-4ce4-9f4e-891a9f4369dc-dshm\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:46.982865 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:46.982838    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-ade2e8/premium-w2-ade2e8-kserve-b66657957-wnfww"]
Nov 04 05:44:46.984970 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:46.984949    4357 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-ade2e8/premium-w2-ade2e8-kserve-b66657957-wnfww"]
Nov 04 05:44:47.274939 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:44:47.274906    4357 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-npgcv" containerName="extractor"
Nov 04 05:44:47.275229 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:47.275208    4357 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ef483385-b12d-4ce4-9f4e-891a9f4369dc" path="/var/lib/kubelet/pods/ef483385-b12d-4ce4-9f4e-891a9f4369dc/volumes"
Nov 04 05:44:48.027588 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:48.027558    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-f9b4a9-6895875fc8-pt6t4"]
Nov 04 05:44:48.037676 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:48.037653    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-f9b4a9-856cdf867f-gstt5"]
Nov 04 05:44:48.302484 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:48.302340    4357 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-ade2e8-5f56b646c-fgxpm" podUID="81d52dbf-1499-4af2-a403-40ab053e7c38" containerName="payload-pre-processing" containerID="cri-o://a6b221afb265e6755061dbcc6baef4ddf12a97a890e2c5a7b67b12fdf9c1f5f9" gracePeriod=25
Nov 04 05:44:48.567887 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:48.567828    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-ade2e8-5f56b646c-fgxpm"
Nov 04 05:44:48.673835 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:48.673804    4357 generic.go:356] "Generic (PLEG): container finished" podID="81d52dbf-1499-4af2-a403-40ab053e7c38" containerID="a6b221afb265e6755061dbcc6baef4ddf12a97a890e2c5a7b67b12fdf9c1f5f9" exitCode=0
Nov 04 05:44:48.673988 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:48.673861    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-ade2e8-5f56b646c-fgxpm"
Nov 04 05:44:48.673988 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:48.673882    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-ade2e8-5f56b646c-fgxpm" event={"ID":"81d52dbf-1499-4af2-a403-40ab053e7c38","Type":"ContainerDied","Data":"a6b221afb265e6755061dbcc6baef4ddf12a97a890e2c5a7b67b12fdf9c1f5f9"}
Nov 04 05:44:48.673988 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:48.673961    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-ade2e8-5f56b646c-fgxpm" event={"ID":"81d52dbf-1499-4af2-a403-40ab053e7c38","Type":"ContainerDied","Data":"a2e0c698f117712cb274f4a0e89b652222dab895624f753fbffba1168c66d26c"}
Nov 04 05:44:48.673988 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:48.673986    4357 scope.go:122] "RemoveContainer" containerID="a6b221afb265e6755061dbcc6baef4ddf12a97a890e2c5a7b67b12fdf9c1f5f9"
Nov 04 05:44:48.683310 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:48.683287    4357 scope.go:122] "RemoveContainer" containerID="a6b221afb265e6755061dbcc6baef4ddf12a97a890e2c5a7b67b12fdf9c1f5f9"
Nov 04 05:44:48.683608 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:44:48.683588    4357 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6b221afb265e6755061dbcc6baef4ddf12a97a890e2c5a7b67b12fdf9c1f5f9\": container with ID starting with a6b221afb265e6755061dbcc6baef4ddf12a97a890e2c5a7b67b12fdf9c1f5f9 not found: ID does not exist" containerID="a6b221afb265e6755061dbcc6baef4ddf12a97a890e2c5a7b67b12fdf9c1f5f9"
Nov 04 05:44:48.683676 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:48.683617    4357 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6b221afb265e6755061dbcc6baef4ddf12a97a890e2c5a7b67b12fdf9c1f5f9"} err="failed to get container status \"a6b221afb265e6755061dbcc6baef4ddf12a97a890e2c5a7b67b12fdf9c1f5f9\": rpc error: code = NotFound desc = could not find container \"a6b221afb265e6755061dbcc6baef4ddf12a97a890e2c5a7b67b12fdf9c1f5f9\": container with ID starting with a6b221afb265e6755061dbcc6baef4ddf12a97a890e2c5a7b67b12fdf9c1f5f9 not found: ID does not exist"
Nov 04 05:44:48.713779 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:48.713756    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/81d52dbf-1499-4af2-a403-40ab053e7c38-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81d52dbf-1499-4af2-a403-40ab053e7c38-plugins-config-volume\") pod \"81d52dbf-1499-4af2-a403-40ab053e7c38\" (UID: \"81d52dbf-1499-4af2-a403-40ab053e7c38\") "
Nov 04 05:44:48.713881 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:48.713837    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/81d52dbf-1499-4af2-a403-40ab053e7c38-kube-api-access-2ghgw\" (UniqueName: \"kubernetes.io/projected/81d52dbf-1499-4af2-a403-40ab053e7c38-kube-api-access-2ghgw\") pod \"81d52dbf-1499-4af2-a403-40ab053e7c38\" (UID: \"81d52dbf-1499-4af2-a403-40ab053e7c38\") "
Nov 04 05:44:48.714120 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:48.714093    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81d52dbf-1499-4af2-a403-40ab053e7c38-plugins-config-volume" pod "81d52dbf-1499-4af2-a403-40ab053e7c38" (UID: "81d52dbf-1499-4af2-a403-40ab053e7c38"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:44:48.714401 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:48.714380    4357 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81d52dbf-1499-4af2-a403-40ab053e7c38-plugins-config-volume\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:48.716090 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:48.716069    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81d52dbf-1499-4af2-a403-40ab053e7c38-kube-api-access-2ghgw" pod "81d52dbf-1499-4af2-a403-40ab053e7c38" (UID: "81d52dbf-1499-4af2-a403-40ab053e7c38"). InnerVolumeSpecName "kube-api-access-2ghgw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:44:48.815894 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:48.815852    4357 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ghgw\" (UniqueName: \"kubernetes.io/projected/81d52dbf-1499-4af2-a403-40ab053e7c38-kube-api-access-2ghgw\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:49.000862 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:49.000278    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-ade2e8-5f56b646c-fgxpm"]
Nov 04 05:44:49.004717 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:49.004693    4357 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-ade2e8-5f56b646c-fgxpm"]
Nov 04 05:44:49.275807 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:49.275771    4357 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="81d52dbf-1499-4af2-a403-40ab053e7c38" path="/var/lib/kubelet/pods/81d52dbf-1499-4af2-a403-40ab053e7c38/volumes"
Nov 04 05:44:50.259612 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:50.259580    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b83493ec-k54hm"]
Nov 04 05:44:50.260260 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:50.260233    4357 cpu_manager.go:414] "containerMap: removing container" podUID="ef483385-b12d-4ce4-9f4e-891a9f4369dc" containerName="main"
Nov 04 05:44:50.260260 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:50.260259    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ef483385-b12d-4ce4-9f4e-891a9f4369dc" containerName="main"
Nov 04 05:44:50.260427 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:50.260287    4357 cpu_manager.go:414] "containerMap: removing container" podUID="81d52dbf-1499-4af2-a403-40ab053e7c38" containerName="payload-pre-processing"
Nov 04 05:44:50.260427 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:50.260296    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="81d52dbf-1499-4af2-a403-40ab053e7c38" containerName="payload-pre-processing"
Nov 04 05:44:50.260502 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:50.260439    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="ef483385-b12d-4ce4-9f4e-891a9f4369dc" containerName="main"
Nov 04 05:44:50.260502 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:50.260450    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="81d52dbf-1499-4af2-a403-40ab053e7c38" containerName="payload-pre-processing"
Nov 04 05:44:50.265071 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:50.265054    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b83493ec-k54hm"
Nov 04 05:44:50.268719 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:50.268696    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 04 05:44:50.268837 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:50.268796    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nsl8n\""
Nov 04 05:44:50.271648 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:50.271625    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b83493ec-k54hm"]
Nov 04 05:44:50.335983 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:50.335950    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/cda24186-2be0-4f65-95bf-451172f238fa-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-b83493ec-k54hm\" (UID: \"cda24186-2be0-4f65-95bf-451172f238fa\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b83493ec-k54hm"
Nov 04 05:44:50.336382 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:50.336010    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sngp\" (UniqueName: \"kubernetes.io/projected/cda24186-2be0-4f65-95bf-451172f238fa-kube-api-access-4sngp\") pod \"maas-api-revoke-sub-b83493ec-k54hm\" (UID: \"cda24186-2be0-4f65-95bf-451172f238fa\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b83493ec-k54hm"
Nov 04 05:44:50.336382 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:50.336284    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/cda24186-2be0-4f65-95bf-451172f238fa-maas-api-xks-ca\") pod \"maas-api-revoke-sub-b83493ec-k54hm\" (UID: \"cda24186-2be0-4f65-95bf-451172f238fa\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b83493ec-k54hm"
Nov 04 05:44:50.444613 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:50.440411    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sngp\" (UniqueName: \"kubernetes.io/projected/cda24186-2be0-4f65-95bf-451172f238fa-kube-api-access-4sngp\") pod \"maas-api-revoke-sub-b83493ec-k54hm\" (UID: \"cda24186-2be0-4f65-95bf-451172f238fa\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b83493ec-k54hm"
Nov 04 05:44:50.444613 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:50.440649    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/cda24186-2be0-4f65-95bf-451172f238fa-maas-api-xks-ca\") pod \"maas-api-revoke-sub-b83493ec-k54hm\" (UID: \"cda24186-2be0-4f65-95bf-451172f238fa\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b83493ec-k54hm"
Nov 04 05:44:50.444613 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:50.440704    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/cda24186-2be0-4f65-95bf-451172f238fa-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-b83493ec-k54hm\" (UID: \"cda24186-2be0-4f65-95bf-451172f238fa\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b83493ec-k54hm"
Nov 04 05:44:50.444613 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:50.441610    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/cda24186-2be0-4f65-95bf-451172f238fa-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-b83493ec-k54hm\" (UID: \"cda24186-2be0-4f65-95bf-451172f238fa\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b83493ec-k54hm"
Nov 04 05:44:50.457536 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:50.456466    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/cda24186-2be0-4f65-95bf-451172f238fa-maas-api-xks-ca\") pod \"maas-api-revoke-sub-b83493ec-k54hm\" (UID: \"cda24186-2be0-4f65-95bf-451172f238fa\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b83493ec-k54hm"
Nov 04 05:44:50.468536 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:50.460700    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sngp\" (UniqueName: \"kubernetes.io/projected/cda24186-2be0-4f65-95bf-451172f238fa-kube-api-access-4sngp\") pod \"maas-api-revoke-sub-b83493ec-k54hm\" (UID: \"cda24186-2be0-4f65-95bf-451172f238fa\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b83493ec-k54hm"
Nov 04 05:44:50.551216 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:50.551150    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-9a0c8b-74cc6fdc84-xbzmp"]
Nov 04 05:44:50.580084 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:50.580057    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b83493ec-k54hm"
Nov 04 05:44:50.876589 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:50.875943    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b83493ec-k54hm"]
Nov 04 05:44:50.910695 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:44:50.909553    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcda24186_2be0_4f65_95bf_451172f238fa.slice/crio-e93955d571c48b89368623bd5018d64496f1d798175fae836344c5f576230e34 WatchSource:0}: Error finding container e93955d571c48b89368623bd5018d64496f1d798175fae836344c5f576230e34: Status 404 returned error can't find the container with id e93955d571c48b89368623bd5018d64496f1d798175fae836344c5f576230e34
Nov 04 05:44:51.716323 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:51.716290    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b83493ec-k54hm" event={"ID":"cda24186-2be0-4f65-95bf-451172f238fa","Type":"ContainerStarted","Data":"e93955d571c48b89368623bd5018d64496f1d798175fae836344c5f576230e34"}
Nov 04 05:44:53.028155 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:53.028080    4357 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w1-f9b4a9-6895875fc8-pt6t4" podUID="708bb5a0-772d-4606-9d36-cbff726e0e1a" containerName="payload-processing" containerID="cri-o://a56755705fd4babf503db6b48a5f9c5f6551a870060c8b7752b6da2bdbd76073" gracePeriod=25
Nov 04 05:44:53.038728 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:53.038645    4357 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-f9b4a9-856cdf867f-gstt5" podUID="2e884e3e-ffb9-4a89-85a5-d9ad28f085ea" containerName="payload-pre-processing" containerID="cri-o://dd15bd305f34a617d9508c18dd6182626f7df6ecfc8d04edb9ec10e3a50bfa5a" gracePeriod=25
Nov 04 05:44:53.740119 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:53.740089    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b83493ec-k54hm" event={"ID":"cda24186-2be0-4f65-95bf-451172f238fa","Type":"ContainerStarted","Data":"7287b0baafd36571ce44001ee5eac83af99aaed6672104f592924a4983bd8f84"}
Nov 04 05:44:53.760383 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:53.760342    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b83493ec-k54hm" podStartSLOduration=1.274078451 podStartE2EDuration="3.760327941s" totalImagesPullingTime="2.48624949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:44:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:44:53.758663208 +0000 UTC m=+980.627326777" watchObservedRunningTime="2026-11-04 05:44:53.760327941 +0000 UTC m=+980.628991531"
Nov 04 05:44:54.746692 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:54.746654    4357 generic.go:356] "Generic (PLEG): container finished" podID="cda24186-2be0-4f65-95bf-451172f238fa" containerID="7287b0baafd36571ce44001ee5eac83af99aaed6672104f592924a4983bd8f84" exitCode=0
Nov 04 05:44:54.747053 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:54.746699    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b83493ec-k54hm" event={"ID":"cda24186-2be0-4f65-95bf-451172f238fa","Type":"ContainerDied","Data":"7287b0baafd36571ce44001ee5eac83af99aaed6672104f592924a4983bd8f84"}
Nov 04 05:44:55.454043 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:55.454008    4357 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-9a0c8b/simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf" podUID="3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c" containerName="main" containerID="cri-o://2276c32c194e2b98dfb1c9684231686f8d55557f1ab661e77c6dc7ccf14d0daf" gracePeriod=45
Nov 04 05:44:55.552130 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:55.552080    4357 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w4-9a0c8b-74cc6fdc84-xbzmp" podUID="b64e7e74-8b44-4678-ab75-e5237143a2b1" containerName="payload-processing" containerID="cri-o://8cc1d126dfb78e630365ed0a66e656fb772c83553087b435cab565db1091af2f" gracePeriod=25
Nov 04 05:44:55.711595 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:55.709447    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-9a0c8b/simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf"
Nov 04 05:44:55.754750 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:55.754713    4357 generic.go:356] "Generic (PLEG): container finished" podID="3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c" containerID="2276c32c194e2b98dfb1c9684231686f8d55557f1ab661e77c6dc7ccf14d0daf" exitCode=0
Nov 04 05:44:55.755068 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:55.754818    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-9a0c8b/simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf" event={"ID":"3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c","Type":"ContainerDied","Data":"2276c32c194e2b98dfb1c9684231686f8d55557f1ab661e77c6dc7ccf14d0daf"}
Nov 04 05:44:55.755068 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:55.754852    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-9a0c8b/simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf" event={"ID":"3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c","Type":"ContainerDied","Data":"1194e39c63f86fe19b553238a96bb8f5a21d686a0fc547a09bdafacd80a61efd"}
Nov 04 05:44:55.755068 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:55.754875    4357 scope.go:122] "RemoveContainer" containerID="2276c32c194e2b98dfb1c9684231686f8d55557f1ab661e77c6dc7ccf14d0daf"
Nov 04 05:44:55.755068 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:55.755002    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-9a0c8b/simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf"
Nov 04 05:44:55.756990 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:55.756969    4357 generic.go:356] "Generic (PLEG): container finished" podID="b64e7e74-8b44-4678-ab75-e5237143a2b1" containerID="8cc1d126dfb78e630365ed0a66e656fb772c83553087b435cab565db1091af2f" exitCode=0
Nov 04 05:44:55.757081 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:55.757039    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-9a0c8b-74cc6fdc84-xbzmp" event={"ID":"b64e7e74-8b44-4678-ab75-e5237143a2b1","Type":"ContainerDied","Data":"8cc1d126dfb78e630365ed0a66e656fb772c83553087b435cab565db1091af2f"}
Nov 04 05:44:55.766736 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:55.766704    4357 scope.go:122] "RemoveContainer" containerID="2276c32c194e2b98dfb1c9684231686f8d55557f1ab661e77c6dc7ccf14d0daf"
Nov 04 05:44:55.767059 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:44:55.767030    4357 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2276c32c194e2b98dfb1c9684231686f8d55557f1ab661e77c6dc7ccf14d0daf\": container with ID starting with 2276c32c194e2b98dfb1c9684231686f8d55557f1ab661e77c6dc7ccf14d0daf not found: ID does not exist" containerID="2276c32c194e2b98dfb1c9684231686f8d55557f1ab661e77c6dc7ccf14d0daf"
Nov 04 05:44:55.767157 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:55.767070    4357 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2276c32c194e2b98dfb1c9684231686f8d55557f1ab661e77c6dc7ccf14d0daf"} err="failed to get container status \"2276c32c194e2b98dfb1c9684231686f8d55557f1ab661e77c6dc7ccf14d0daf\": rpc error: code = NotFound desc = could not find container \"2276c32c194e2b98dfb1c9684231686f8d55557f1ab661e77c6dc7ccf14d0daf\": container with ID starting with 2276c32c194e2b98dfb1c9684231686f8d55557f1ab661e77c6dc7ccf14d0daf not found: ID does not exist"
Nov 04 05:44:55.817511 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:55.817383    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c-tls-certs\" (UniqueName: \"kubernetes.io/secret/3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c-tls-certs\") pod \"3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c\" (UID: \"3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c\") "
Nov 04 05:44:55.817511 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:55.817434    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c-model-cache\") pod \"3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c\" (UID: \"3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c\") "
Nov 04 05:44:55.817707 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:55.817560    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c-dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c-dshm\") pod \"3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c\" (UID: \"3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c\") "
Nov 04 05:44:55.817707 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:55.817640    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c-tmp-dir\") pod \"3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c\" (UID: \"3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c\") "
Nov 04 05:44:55.817707 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:55.817685    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c-home\" (UniqueName: \"kubernetes.io/empty-dir/3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c-home\") pod \"3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c\" (UID: \"3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c\") "
Nov 04 05:44:55.818703 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:55.817813    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c-kube-api-access-6tpzb\" (UniqueName: \"kubernetes.io/projected/3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c-kube-api-access-6tpzb\") pod \"3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c\" (UID: \"3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c\") "
Nov 04 05:44:55.818703 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:55.817956    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c-tmp-dir" pod "3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c" (UID: "3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:44:55.818703 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:55.818055    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c-home" pod "3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c" (UID: "3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:44:55.818703 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:55.818136    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c-model-cache" pod "3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c" (UID: "3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:44:55.818703 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:55.818335    4357 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c-model-cache\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:55.818703 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:55.818358    4357 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c-tmp-dir\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:55.818703 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:55.818375    4357 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c-home\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:55.820601 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:55.820578    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c-kube-api-access-6tpzb" pod "3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c" (UID: "3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c"). InnerVolumeSpecName "kube-api-access-6tpzb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:44:55.820901 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:55.820882    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c-dshm" pod "3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c" (UID: "3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:44:55.821018 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:55.820982    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c-tls-certs" pod "3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c" (UID: "3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:44:55.831510 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:55.831489    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-9a0c8b-74cc6fdc84-xbzmp"
Nov 04 05:44:55.908232 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:55.908204    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b83493ec-k54hm"
Nov 04 05:44:55.919049 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:55.919021    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b64e7e74-8b44-4678-ab75-e5237143a2b1-kube-api-access-q4xsc\" (UniqueName: \"kubernetes.io/projected/b64e7e74-8b44-4678-ab75-e5237143a2b1-kube-api-access-q4xsc\") pod \"b64e7e74-8b44-4678-ab75-e5237143a2b1\" (UID: \"b64e7e74-8b44-4678-ab75-e5237143a2b1\") "
Nov 04 05:44:55.919238 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:55.919222    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b64e7e74-8b44-4678-ab75-e5237143a2b1-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b64e7e74-8b44-4678-ab75-e5237143a2b1-plugins-config-volume\") pod \"b64e7e74-8b44-4678-ab75-e5237143a2b1\" (UID: \"b64e7e74-8b44-4678-ab75-e5237143a2b1\") "
Nov 04 05:44:55.919568 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:55.919538    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b64e7e74-8b44-4678-ab75-e5237143a2b1-plugins-config-volume" pod "b64e7e74-8b44-4678-ab75-e5237143a2b1" (UID: "b64e7e74-8b44-4678-ab75-e5237143a2b1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:44:55.919568 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:55.919558    4357 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c-dshm\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:55.919726 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:55.919578    4357 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6tpzb\" (UniqueName: \"kubernetes.io/projected/3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c-kube-api-access-6tpzb\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:55.919726 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:55.919589    4357 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c-tls-certs\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:55.920985 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:55.920967    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b64e7e74-8b44-4678-ab75-e5237143a2b1-kube-api-access-q4xsc" pod "b64e7e74-8b44-4678-ab75-e5237143a2b1" (UID: "b64e7e74-8b44-4678-ab75-e5237143a2b1"). InnerVolumeSpecName "kube-api-access-q4xsc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:44:56.020107 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:56.020079    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cda24186-2be0-4f65-95bf-451172f238fa-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/cda24186-2be0-4f65-95bf-451172f238fa-maas-api-openshift-ca\") pod \"cda24186-2be0-4f65-95bf-451172f238fa\" (UID: \"cda24186-2be0-4f65-95bf-451172f238fa\") "
Nov 04 05:44:56.020286 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:56.020141    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cda24186-2be0-4f65-95bf-451172f238fa-kube-api-access-4sngp\" (UniqueName: \"kubernetes.io/projected/cda24186-2be0-4f65-95bf-451172f238fa-kube-api-access-4sngp\") pod \"cda24186-2be0-4f65-95bf-451172f238fa\" (UID: \"cda24186-2be0-4f65-95bf-451172f238fa\") "
Nov 04 05:44:56.020286 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:56.020245    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cda24186-2be0-4f65-95bf-451172f238fa-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/cda24186-2be0-4f65-95bf-451172f238fa-maas-api-xks-ca\") pod \"cda24186-2be0-4f65-95bf-451172f238fa\" (UID: \"cda24186-2be0-4f65-95bf-451172f238fa\") "
Nov 04 05:44:56.020500 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:56.020477    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cda24186-2be0-4f65-95bf-451172f238fa-maas-api-openshift-ca" pod "cda24186-2be0-4f65-95bf-451172f238fa" (UID: "cda24186-2be0-4f65-95bf-451172f238fa"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:44:56.020668 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:56.020649    4357 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/cda24186-2be0-4f65-95bf-451172f238fa-maas-api-openshift-ca\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:56.020740 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:56.020669    4357 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b64e7e74-8b44-4678-ab75-e5237143a2b1-plugins-config-volume\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:56.020740 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:56.020679    4357 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4xsc\" (UniqueName: \"kubernetes.io/projected/b64e7e74-8b44-4678-ab75-e5237143a2b1-kube-api-access-q4xsc\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:56.022434 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:56.022407    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cda24186-2be0-4f65-95bf-451172f238fa-maas-api-xks-ca" pod "cda24186-2be0-4f65-95bf-451172f238fa" (UID: "cda24186-2be0-4f65-95bf-451172f238fa"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:44:56.022606 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:56.022589    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cda24186-2be0-4f65-95bf-451172f238fa-kube-api-access-4sngp" pod "cda24186-2be0-4f65-95bf-451172f238fa" (UID: "cda24186-2be0-4f65-95bf-451172f238fa"). InnerVolumeSpecName "kube-api-access-4sngp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:44:56.076992 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:56.076965    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-9a0c8b/simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf"]
Nov 04 05:44:56.080168 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:56.080146    4357 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-9a0c8b/simulator-w4-9a0c8b-kserve-6545bdc864-tmqkf"]
Nov 04 05:44:56.135880 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:56.134059    4357 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/cda24186-2be0-4f65-95bf-451172f238fa-maas-api-xks-ca\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:56.135880 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:56.134096    4357 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4sngp\" (UniqueName: \"kubernetes.io/projected/cda24186-2be0-4f65-95bf-451172f238fa-kube-api-access-4sngp\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:56.447162 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:56.447076    4357 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-f9b4a9-856cdf867f-gstt5" podUID="2e884e3e-ffb9-4a89-85a5-d9ad28f085ea" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 05:44:56.447355 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:56.447326    4357 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w1-f9b4a9-6895875fc8-pt6t4" podUID="708bb5a0-772d-4606-9d36-cbff726e0e1a" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 05:44:56.763164 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:56.763129    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b83493ec-k54hm"
Nov 04 05:44:56.763572 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:56.763179    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b83493ec-k54hm" event={"ID":"cda24186-2be0-4f65-95bf-451172f238fa","Type":"ContainerDied","Data":"e93955d571c48b89368623bd5018d64496f1d798175fae836344c5f576230e34"}
Nov 04 05:44:56.763572 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:56.763224    4357 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e93955d571c48b89368623bd5018d64496f1d798175fae836344c5f576230e34"
Nov 04 05:44:56.765528 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:56.765493    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-9a0c8b-74cc6fdc84-xbzmp"
Nov 04 05:44:56.765618 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:56.765508    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-9a0c8b-74cc6fdc84-xbzmp" event={"ID":"b64e7e74-8b44-4678-ab75-e5237143a2b1","Type":"ContainerDied","Data":"a5185423b2554ceb4d62548f78542570d174c16c9145f9b1942613e2926e46f8"}
Nov 04 05:44:56.765618 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:56.765588    4357 scope.go:122] "RemoveContainer" containerID="8cc1d126dfb78e630365ed0a66e656fb772c83553087b435cab565db1091af2f"
Nov 04 05:44:56.796844 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:56.796824    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-9a0c8b-74cc6fdc84-xbzmp"]
Nov 04 05:44:56.800623 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:56.800601    4357 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-9a0c8b-74cc6fdc84-xbzmp"]
Nov 04 05:44:57.274394 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:57.274364    4357 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c" path="/var/lib/kubelet/pods/3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c/volumes"
Nov 04 05:44:57.274807 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:57.274793    4357 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b64e7e74-8b44-4678-ab75-e5237143a2b1" path="/var/lib/kubelet/pods/b64e7e74-8b44-4678-ab75-e5237143a2b1/volumes"
Nov 04 05:44:57.375919 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:57.375894    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-9d808e/distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq"]
Nov 04 05:44:57.376306 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:57.376294    4357 cpu_manager.go:414] "containerMap: removing container" podUID="cda24186-2be0-4f65-95bf-451172f238fa" containerName="revoke-keys"
Nov 04 05:44:57.376345 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:57.376308    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cda24186-2be0-4f65-95bf-451172f238fa" containerName="revoke-keys"
Nov 04 05:44:57.376345 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:57.376326    4357 cpu_manager.go:414] "containerMap: removing container" podUID="3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c" containerName="main"
Nov 04 05:44:57.376345 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:57.376332    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c" containerName="main"
Nov 04 05:44:57.376438 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:57.376349    4357 cpu_manager.go:414] "containerMap: removing container" podUID="b64e7e74-8b44-4678-ab75-e5237143a2b1" containerName="payload-processing"
Nov 04 05:44:57.376438 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:57.376355    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b64e7e74-8b44-4678-ab75-e5237143a2b1" containerName="payload-processing"
Nov 04 05:44:57.376438 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:57.376425    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="3fb2c23b-1cfa-49b7-b21d-c13dc34c5b6c" containerName="main"
Nov 04 05:44:57.376438 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:57.376435    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="b64e7e74-8b44-4678-ab75-e5237143a2b1" containerName="payload-processing"
Nov 04 05:44:57.376568 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:57.376445    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="cda24186-2be0-4f65-95bf-451172f238fa" containerName="revoke-keys"
Nov 04 05:44:57.379701 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:57.379686    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-9d808e/distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq"
Nov 04 05:44:57.388765 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:57.388744    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-9d808e\"/\"distinct-2-w5-9d808e-kserve-self-signed-certs\""
Nov 04 05:44:57.391886 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:57.391868    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-9d808e/distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq"]
Nov 04 05:44:57.552245 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:57.552183    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2dd133f2-fc05-4874-b309-cd4b235bf8e9-model-cache\") pod \"distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq\" (UID: \"2dd133f2-fc05-4874-b309-cd4b235bf8e9\") " pod="e2e-models-e2e-worker-w5-9d808e/distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq"
Nov 04 05:44:57.552389 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:57.552256    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2dd133f2-fc05-4874-b309-cd4b235bf8e9-home\") pod \"distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq\" (UID: \"2dd133f2-fc05-4874-b309-cd4b235bf8e9\") " pod="e2e-models-e2e-worker-w5-9d808e/distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq"
Nov 04 05:44:57.552389 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:57.552332    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cz2m\" (UniqueName: \"kubernetes.io/projected/2dd133f2-fc05-4874-b309-cd4b235bf8e9-kube-api-access-8cz2m\") pod \"distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq\" (UID: \"2dd133f2-fc05-4874-b309-cd4b235bf8e9\") " pod="e2e-models-e2e-worker-w5-9d808e/distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq"
Nov 04 05:44:57.552389 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:57.552369    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2dd133f2-fc05-4874-b309-cd4b235bf8e9-tmp-dir\") pod \"distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq\" (UID: \"2dd133f2-fc05-4874-b309-cd4b235bf8e9\") " pod="e2e-models-e2e-worker-w5-9d808e/distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq"
Nov 04 05:44:57.552549 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:57.552396    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2dd133f2-fc05-4874-b309-cd4b235bf8e9-tls-certs\") pod \"distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq\" (UID: \"2dd133f2-fc05-4874-b309-cd4b235bf8e9\") " pod="e2e-models-e2e-worker-w5-9d808e/distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq"
Nov 04 05:44:57.552599 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:57.552547    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2dd133f2-fc05-4874-b309-cd4b235bf8e9-dshm\") pod \"distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq\" (UID: \"2dd133f2-fc05-4874-b309-cd4b235bf8e9\") " pod="e2e-models-e2e-worker-w5-9d808e/distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq"
Nov 04 05:44:57.653929 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:57.653899    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2dd133f2-fc05-4874-b309-cd4b235bf8e9-home\") pod \"distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq\" (UID: \"2dd133f2-fc05-4874-b309-cd4b235bf8e9\") " pod="e2e-models-e2e-worker-w5-9d808e/distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq"
Nov 04 05:44:57.654043 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:57.653941    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cz2m\" (UniqueName: \"kubernetes.io/projected/2dd133f2-fc05-4874-b309-cd4b235bf8e9-kube-api-access-8cz2m\") pod \"distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq\" (UID: \"2dd133f2-fc05-4874-b309-cd4b235bf8e9\") " pod="e2e-models-e2e-worker-w5-9d808e/distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq"
Nov 04 05:44:57.654043 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:57.653963    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2dd133f2-fc05-4874-b309-cd4b235bf8e9-tmp-dir\") pod \"distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq\" (UID: \"2dd133f2-fc05-4874-b309-cd4b235bf8e9\") " pod="e2e-models-e2e-worker-w5-9d808e/distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq"
Nov 04 05:44:57.654043 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:57.653993    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2dd133f2-fc05-4874-b309-cd4b235bf8e9-tls-certs\") pod \"distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq\" (UID: \"2dd133f2-fc05-4874-b309-cd4b235bf8e9\") " pod="e2e-models-e2e-worker-w5-9d808e/distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq"
Nov 04 05:44:57.654209 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:57.654177    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2dd133f2-fc05-4874-b309-cd4b235bf8e9-dshm\") pod \"distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq\" (UID: \"2dd133f2-fc05-4874-b309-cd4b235bf8e9\") " pod="e2e-models-e2e-worker-w5-9d808e/distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq"
Nov 04 05:44:57.654323 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:57.654300    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2dd133f2-fc05-4874-b309-cd4b235bf8e9-model-cache\") pod \"distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq\" (UID: \"2dd133f2-fc05-4874-b309-cd4b235bf8e9\") " pod="e2e-models-e2e-worker-w5-9d808e/distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq"
Nov 04 05:44:57.654439 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:57.654343    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2dd133f2-fc05-4874-b309-cd4b235bf8e9-home\") pod \"distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq\" (UID: \"2dd133f2-fc05-4874-b309-cd4b235bf8e9\") " pod="e2e-models-e2e-worker-w5-9d808e/distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq"
Nov 04 05:44:57.654439 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:57.654366    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2dd133f2-fc05-4874-b309-cd4b235bf8e9-tmp-dir\") pod \"distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq\" (UID: \"2dd133f2-fc05-4874-b309-cd4b235bf8e9\") " pod="e2e-models-e2e-worker-w5-9d808e/distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq"
Nov 04 05:44:57.654664 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:57.654645    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2dd133f2-fc05-4874-b309-cd4b235bf8e9-model-cache\") pod \"distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq\" (UID: \"2dd133f2-fc05-4874-b309-cd4b235bf8e9\") " pod="e2e-models-e2e-worker-w5-9d808e/distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq"
Nov 04 05:44:57.656539 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:57.656492    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2dd133f2-fc05-4874-b309-cd4b235bf8e9-tls-certs\") pod \"distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq\" (UID: \"2dd133f2-fc05-4874-b309-cd4b235bf8e9\") " pod="e2e-models-e2e-worker-w5-9d808e/distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq"
Nov 04 05:44:57.656930 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:57.656908    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2dd133f2-fc05-4874-b309-cd4b235bf8e9-dshm\") pod \"distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq\" (UID: \"2dd133f2-fc05-4874-b309-cd4b235bf8e9\") " pod="e2e-models-e2e-worker-w5-9d808e/distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq"
Nov 04 05:44:57.661846 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:57.661826    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cz2m\" (UniqueName: \"kubernetes.io/projected/2dd133f2-fc05-4874-b309-cd4b235bf8e9-kube-api-access-8cz2m\") pod \"distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq\" (UID: \"2dd133f2-fc05-4874-b309-cd4b235bf8e9\") " pod="e2e-models-e2e-worker-w5-9d808e/distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq"
Nov 04 05:44:57.694174 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:57.693813    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-9d808e/distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq"
Nov 04 05:44:58.058484 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:58.058386    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-9d808e/distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq"]
Nov 04 05:44:58.060453 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:44:58.060424    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2dd133f2_fc05_4874_b309_cd4b235bf8e9.slice/crio-826927ed0a7a1bede43107da213b293cb38e0f35d738a39ca0dbdafb48240429 WatchSource:0}: Error finding container 826927ed0a7a1bede43107da213b293cb38e0f35d738a39ca0dbdafb48240429: Status 404 returned error can't find the container with id 826927ed0a7a1bede43107da213b293cb38e0f35d738a39ca0dbdafb48240429
Nov 04 05:44:58.802727 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:58.802690    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-9d808e/distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq" event={"ID":"2dd133f2-fc05-4874-b309-cd4b235bf8e9","Type":"ContainerStarted","Data":"f441e327974cbbe0748d9ec6a90f6cd1dc1d303dcd239344dc69785666df61b5"}
Nov 04 05:44:58.802988 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:58.802964    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-9d808e/distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq" event={"ID":"2dd133f2-fc05-4874-b309-cd4b235bf8e9","Type":"ContainerStarted","Data":"826927ed0a7a1bede43107da213b293cb38e0f35d738a39ca0dbdafb48240429"}
Nov 04 05:44:58.829180 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:58.829127    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-9d808e/distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq" podStartSLOduration=1.8291110019999999 podStartE2EDuration="1.829111002s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:44:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:44:58.827831057 +0000 UTC m=+985.696494633" watchObservedRunningTime="2026-11-04 05:44:58.829111002 +0000 UTC m=+985.697774591"
Nov 04 05:44:59.694844 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:44:59.694803    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-9d808e/distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq"
Nov 04 05:45:00.153542 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:00.152904    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29896185-6smnz"]
Nov 04 05:45:00.173900 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:00.173851    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-9a0c8b-29896185-w8842"]
Nov 04 05:45:00.179322 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:00.179291    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-9d808e-29896185-xd8jx"]
Nov 04 05:45:00.182876 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:00.182852    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-9a0c8b-29896185-w8842"
Nov 04 05:45:00.184801 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:00.184776    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896185-6smnz"
Nov 04 05:45:00.187192 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:00.187160    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-9a0c8b-29896185-w8842"]
Nov 04 05:45:00.187317 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:00.187261    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-9d808e-29896185-xd8jx"
Nov 04 05:45:00.191211 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:00.191190    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-27935d-29896185-7pslg"]
Nov 04 05:45:00.194697 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:00.194683    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29896185-6smnz"]
Nov 04 05:45:00.194867 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:00.194856    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-27935d-29896185-7pslg"
Nov 04 05:45:00.199707 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:00.199691    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nsl8n\""
Nov 04 05:45:00.202177 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:00.202154    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-9d808e-29896185-xd8jx"]
Nov 04 05:45:00.204291 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:00.204270    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-27935d-29896185-7pslg"]
Nov 04 05:45:00.348513 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:00.348476    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2-maas-api-service-ca\") pod \"maas-api-key-cleanup-29896185-6smnz\" (UID: \"306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896185-6smnz"
Nov 04 05:45:00.348806 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:00.348750    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p64x4\" (UniqueName: \"kubernetes.io/projected/fa84199d-f00a-43e8-ba40-077b8d38bdef-kube-api-access-p64x4\") pod \"maas-api-key-cleanup-e2e-worker-w5-9d808e-29896185-xd8jx\" (UID: \"fa84199d-f00a-43e8-ba40-077b8d38bdef\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-9d808e-29896185-xd8jx"
Nov 04 05:45:00.348806 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:00.348795    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f58fb3b0-0da4-41c2-b31f-e937ce1daab7-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-27935d-29896185-7pslg\" (UID: \"f58fb3b0-0da4-41c2-b31f-e937ce1daab7\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-27935d-29896185-7pslg"
Nov 04 05:45:00.349008 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:00.348836    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfp6p\" (UniqueName: \"kubernetes.io/projected/306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2-kube-api-access-bfp6p\") pod \"maas-api-key-cleanup-29896185-6smnz\" (UID: \"306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896185-6smnz"
Nov 04 05:45:00.349008 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:00.348867    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmsl2\" (UniqueName: \"kubernetes.io/projected/4d2ba792-a3a6-4856-a039-08822d3c1e39-kube-api-access-lmsl2\") pod \"maas-api-key-cleanup-e2e-worker-w4-9a0c8b-29896185-w8842\" (UID: \"4d2ba792-a3a6-4856-a039-08822d3c1e39\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-9a0c8b-29896185-w8842"
Nov 04 05:45:00.349008 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:00.348900    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c852r\" (UniqueName: \"kubernetes.io/projected/f58fb3b0-0da4-41c2-b31f-e937ce1daab7-kube-api-access-c852r\") pod \"maas-api-key-cleanup-e2e-worker-w0-27935d-29896185-7pslg\" (UID: \"f58fb3b0-0da4-41c2-b31f-e937ce1daab7\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-27935d-29896185-7pslg"
Nov 04 05:45:00.349008 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:00.348937    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa84199d-f00a-43e8-ba40-077b8d38bdef-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w5-9d808e-29896185-xd8jx\" (UID: \"fa84199d-f00a-43e8-ba40-077b8d38bdef\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-9d808e-29896185-xd8jx"
Nov 04 05:45:00.349202 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:00.349026    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d2ba792-a3a6-4856-a039-08822d3c1e39-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-9a0c8b-29896185-w8842\" (UID: \"4d2ba792-a3a6-4856-a039-08822d3c1e39\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-9a0c8b-29896185-w8842"
Nov 04 05:45:00.450067 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:00.449990    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p64x4\" (UniqueName: \"kubernetes.io/projected/fa84199d-f00a-43e8-ba40-077b8d38bdef-kube-api-access-p64x4\") pod \"maas-api-key-cleanup-e2e-worker-w5-9d808e-29896185-xd8jx\" (UID: \"fa84199d-f00a-43e8-ba40-077b8d38bdef\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-9d808e-29896185-xd8jx"
Nov 04 05:45:00.450067 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:00.450027    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f58fb3b0-0da4-41c2-b31f-e937ce1daab7-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-27935d-29896185-7pslg\" (UID: \"f58fb3b0-0da4-41c2-b31f-e937ce1daab7\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-27935d-29896185-7pslg"
Nov 04 05:45:00.450067 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:00.450054    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfp6p\" (UniqueName: \"kubernetes.io/projected/306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2-kube-api-access-bfp6p\") pod \"maas-api-key-cleanup-29896185-6smnz\" (UID: \"306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896185-6smnz"
Nov 04 05:45:00.450358 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:00.450071    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmsl2\" (UniqueName: \"kubernetes.io/projected/4d2ba792-a3a6-4856-a039-08822d3c1e39-kube-api-access-lmsl2\") pod \"maas-api-key-cleanup-e2e-worker-w4-9a0c8b-29896185-w8842\" (UID: \"4d2ba792-a3a6-4856-a039-08822d3c1e39\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-9a0c8b-29896185-w8842"
Nov 04 05:45:00.450358 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:00.450090    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c852r\" (UniqueName: \"kubernetes.io/projected/f58fb3b0-0da4-41c2-b31f-e937ce1daab7-kube-api-access-c852r\") pod \"maas-api-key-cleanup-e2e-worker-w0-27935d-29896185-7pslg\" (UID: \"f58fb3b0-0da4-41c2-b31f-e937ce1daab7\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-27935d-29896185-7pslg"
Nov 04 05:45:00.450358 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:00.450111    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa84199d-f00a-43e8-ba40-077b8d38bdef-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w5-9d808e-29896185-xd8jx\" (UID: \"fa84199d-f00a-43e8-ba40-077b8d38bdef\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-9d808e-29896185-xd8jx"
Nov 04 05:45:00.450358 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:00.450180    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d2ba792-a3a6-4856-a039-08822d3c1e39-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-9a0c8b-29896185-w8842\" (UID: \"4d2ba792-a3a6-4856-a039-08822d3c1e39\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-9a0c8b-29896185-w8842"
Nov 04 05:45:00.450358 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:00.450281    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2-maas-api-service-ca\") pod \"maas-api-key-cleanup-29896185-6smnz\" (UID: \"306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896185-6smnz"
Nov 04 05:45:00.450868 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:00.450844    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f58fb3b0-0da4-41c2-b31f-e937ce1daab7-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-27935d-29896185-7pslg\" (UID: \"f58fb3b0-0da4-41c2-b31f-e937ce1daab7\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-27935d-29896185-7pslg"
Nov 04 05:45:00.450950 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:00.450889    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa84199d-f00a-43e8-ba40-077b8d38bdef-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w5-9d808e-29896185-xd8jx\" (UID: \"fa84199d-f00a-43e8-ba40-077b8d38bdef\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-9d808e-29896185-xd8jx"
Nov 04 05:45:00.450950 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:00.450906    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d2ba792-a3a6-4856-a039-08822d3c1e39-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-9a0c8b-29896185-w8842\" (UID: \"4d2ba792-a3a6-4856-a039-08822d3c1e39\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-9a0c8b-29896185-w8842"
Nov 04 05:45:00.451010 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:00.450971    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2-maas-api-service-ca\") pod \"maas-api-key-cleanup-29896185-6smnz\" (UID: \"306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896185-6smnz"
Nov 04 05:45:00.457753 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:00.457729    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c852r\" (UniqueName: \"kubernetes.io/projected/f58fb3b0-0da4-41c2-b31f-e937ce1daab7-kube-api-access-c852r\") pod \"maas-api-key-cleanup-e2e-worker-w0-27935d-29896185-7pslg\" (UID: \"f58fb3b0-0da4-41c2-b31f-e937ce1daab7\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-27935d-29896185-7pslg"
Nov 04 05:45:00.457901 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:00.457877    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p64x4\" (UniqueName: \"kubernetes.io/projected/fa84199d-f00a-43e8-ba40-077b8d38bdef-kube-api-access-p64x4\") pod \"maas-api-key-cleanup-e2e-worker-w5-9d808e-29896185-xd8jx\" (UID: \"fa84199d-f00a-43e8-ba40-077b8d38bdef\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-9d808e-29896185-xd8jx"
Nov 04 05:45:00.458302 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:00.458278    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmsl2\" (UniqueName: \"kubernetes.io/projected/4d2ba792-a3a6-4856-a039-08822d3c1e39-kube-api-access-lmsl2\") pod \"maas-api-key-cleanup-e2e-worker-w4-9a0c8b-29896185-w8842\" (UID: \"4d2ba792-a3a6-4856-a039-08822d3c1e39\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-9a0c8b-29896185-w8842"
Nov 04 05:45:00.458593 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:00.458577    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfp6p\" (UniqueName: \"kubernetes.io/projected/306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2-kube-api-access-bfp6p\") pod \"maas-api-key-cleanup-29896185-6smnz\" (UID: \"306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896185-6smnz"
Nov 04 05:45:00.514489 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:00.514458    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-9a0c8b-29896185-w8842"
Nov 04 05:45:00.524818 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:00.524800    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896185-6smnz"
Nov 04 05:45:00.534715 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:00.534693    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-9d808e-29896185-xd8jx"
Nov 04 05:45:00.540658 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:00.540640    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-27935d-29896185-7pslg"
Nov 04 05:45:00.806820 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:00.806792    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-9a0c8b-29896185-w8842"]
Nov 04 05:45:00.807943 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:45:00.807921    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d2ba792_a3a6_4856_a039_08822d3c1e39.slice/crio-778f1cc706bfafb2fb914ebfb1d1099daa2254232c46526b06a45c851e782b31 WatchSource:0}: Error finding container 778f1cc706bfafb2fb914ebfb1d1099daa2254232c46526b06a45c851e782b31: Status 404 returned error can't find the container with id 778f1cc706bfafb2fb914ebfb1d1099daa2254232c46526b06a45c851e782b31
Nov 04 05:45:00.819693 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:00.819668    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-9a0c8b-29896185-w8842" event={"ID":"4d2ba792-a3a6-4856-a039-08822d3c1e39","Type":"ContainerStarted","Data":"778f1cc706bfafb2fb914ebfb1d1099daa2254232c46526b06a45c851e782b31"}
Nov 04 05:45:00.824292 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:00.824271    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29896185-6smnz"]
Nov 04 05:45:00.834175 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:00.834154    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-27935d-29896185-7pslg"]
Nov 04 05:45:00.837872 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:00.837844    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-9d808e-29896185-xd8jx"]
Nov 04 05:45:00.845920 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:45:00.845825    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa84199d_f00a_43e8_ba40_077b8d38bdef.slice/crio-1a1ef3975aaf60c05ae0c095a632d82f8bb7f04e18287bf1269e662569a4ece9 WatchSource:0}: Error finding container 1a1ef3975aaf60c05ae0c095a632d82f8bb7f04e18287bf1269e662569a4ece9: Status 404 returned error can't find the container with id 1a1ef3975aaf60c05ae0c095a632d82f8bb7f04e18287bf1269e662569a4ece9
Nov 04 05:45:01.827457 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:01.827429    4357 generic.go:356] "Generic (PLEG): container finished" podID="4d2ba792-a3a6-4856-a039-08822d3c1e39" containerID="9d0247a0c27b9315f01fd640c49664578bd06c8261199c194be9e1800e01b170" exitCode=60
Nov 04 05:45:01.827868 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:01.827509    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-9a0c8b-29896185-w8842" event={"ID":"4d2ba792-a3a6-4856-a039-08822d3c1e39","Type":"ContainerDied","Data":"9d0247a0c27b9315f01fd640c49664578bd06c8261199c194be9e1800e01b170"}
Nov 04 05:45:01.827868 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:01.827790    4357 scope.go:122] "RemoveContainer" containerID="9d0247a0c27b9315f01fd640c49664578bd06c8261199c194be9e1800e01b170"
Nov 04 05:45:01.829666 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:01.829640    4357 generic.go:356] "Generic (PLEG): container finished" podID="fa84199d-f00a-43e8-ba40-077b8d38bdef" containerID="a75e9d66c0dd80f89c8296e99ddf64f6786b96f0e74b5c82afbca912f56625d5" exitCode=60
Nov 04 05:45:01.829984 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:01.829709    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-9d808e-29896185-xd8jx" event={"ID":"fa84199d-f00a-43e8-ba40-077b8d38bdef","Type":"ContainerDied","Data":"a75e9d66c0dd80f89c8296e99ddf64f6786b96f0e74b5c82afbca912f56625d5"}
Nov 04 05:45:01.830072 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:01.830016    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-9d808e-29896185-xd8jx" event={"ID":"fa84199d-f00a-43e8-ba40-077b8d38bdef","Type":"ContainerStarted","Data":"1a1ef3975aaf60c05ae0c095a632d82f8bb7f04e18287bf1269e662569a4ece9"}
Nov 04 05:45:01.830072 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:01.829924    4357 scope.go:122] "RemoveContainer" containerID="a75e9d66c0dd80f89c8296e99ddf64f6786b96f0e74b5c82afbca912f56625d5"
Nov 04 05:45:01.831530 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:01.831493    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-27935d-29896185-7pslg" event={"ID":"f58fb3b0-0da4-41c2-b31f-e937ce1daab7","Type":"ContainerStarted","Data":"192f931696e67a97454b5505e69e1a58bb982e8bd7454d7b5753afeba566363a"}
Nov 04 05:45:01.831634 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:01.831579    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-27935d-29896185-7pslg" event={"ID":"f58fb3b0-0da4-41c2-b31f-e937ce1daab7","Type":"ContainerStarted","Data":"641540131b5e728e41711d9441f855499555ca0fbcf592147f40241f924c84b8"}
Nov 04 05:45:01.833713 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:01.833677    4357 generic.go:356] "Generic (PLEG): container finished" podID="306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2" containerID="83849724cb4160daada8e7e419ac6e664f810d999597df881dceda9002c9b2d4" exitCode=60
Nov 04 05:45:01.833820 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:01.833735    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896185-6smnz" event={"ID":"306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2","Type":"ContainerDied","Data":"83849724cb4160daada8e7e419ac6e664f810d999597df881dceda9002c9b2d4"}
Nov 04 05:45:01.833820 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:01.833770    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896185-6smnz" event={"ID":"306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2","Type":"ContainerStarted","Data":"18ebf410147c10719f7d165401b9dc9c6513fa794bf5c97959e1d3b3c9bfd963"}
Nov 04 05:45:01.833915 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:01.833904    4357 scope.go:122] "RemoveContainer" containerID="83849724cb4160daada8e7e419ac6e664f810d999597df881dceda9002c9b2d4"
Nov 04 05:45:01.896526 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:01.896470    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-27935d-29896185-7pslg" podStartSLOduration=1.8964570859999998 podStartE2EDuration="1.896457086s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:45:01.894094489 +0000 UTC m=+988.762758063" watchObservedRunningTime="2026-11-04 05:45:01.896457086 +0000 UTC m=+988.765120658"
Nov 04 05:45:02.479142 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:02.479109    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-9a0c8b-29896185-w8842"]
Nov 04 05:45:02.841230 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:02.841197    4357 generic.go:356] "Generic (PLEG): container finished" podID="fa84199d-f00a-43e8-ba40-077b8d38bdef" containerID="a1f73873b9b9a04856b75d85a5b815a55545ce42611a76d3f2f2c82eddb212ad" exitCode=60
Nov 04 05:45:02.841617 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:02.841276    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-9d808e-29896185-xd8jx" event={"ID":"fa84199d-f00a-43e8-ba40-077b8d38bdef","Type":"ContainerDied","Data":"a1f73873b9b9a04856b75d85a5b815a55545ce42611a76d3f2f2c82eddb212ad"}
Nov 04 05:45:02.841617 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:02.841342    4357 scope.go:122] "RemoveContainer" containerID="a75e9d66c0dd80f89c8296e99ddf64f6786b96f0e74b5c82afbca912f56625d5"
Nov 04 05:45:02.841740 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:02.841627    4357 scope.go:122] "RemoveContainer" containerID="a1f73873b9b9a04856b75d85a5b815a55545ce42611a76d3f2f2c82eddb212ad"
Nov 04 05:45:02.842072 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:45:02.842046    4357 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w5-9d808e-29896185-xd8jx_odh-ai-gateway-infra(fa84199d-f00a-43e8-ba40-077b8d38bdef)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-9d808e-29896185-xd8jx" podUID="fa84199d-f00a-43e8-ba40-077b8d38bdef"
Nov 04 05:45:02.843035 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:02.843012    4357 generic.go:356] "Generic (PLEG): container finished" podID="f58fb3b0-0da4-41c2-b31f-e937ce1daab7" containerID="192f931696e67a97454b5505e69e1a58bb982e8bd7454d7b5753afeba566363a" exitCode=60
Nov 04 05:45:02.843123 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:02.843094    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-27935d-29896185-7pslg" event={"ID":"f58fb3b0-0da4-41c2-b31f-e937ce1daab7","Type":"ContainerDied","Data":"192f931696e67a97454b5505e69e1a58bb982e8bd7454d7b5753afeba566363a"}
Nov 04 05:45:02.843354 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:02.843331    4357 scope.go:122] "RemoveContainer" containerID="192f931696e67a97454b5505e69e1a58bb982e8bd7454d7b5753afeba566363a"
Nov 04 05:45:02.844978 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:02.844958    4357 generic.go:356] "Generic (PLEG): container finished" podID="306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2" containerID="b78c3911b7340d5f4c7b4afcaa24c7d52217cbb8867ad057e45cf1a0844ca164" exitCode=60
Nov 04 05:45:02.845082 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:02.845037    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896185-6smnz" event={"ID":"306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2","Type":"ContainerDied","Data":"b78c3911b7340d5f4c7b4afcaa24c7d52217cbb8867ad057e45cf1a0844ca164"}
Nov 04 05:45:02.845331 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:02.845287    4357 scope.go:122] "RemoveContainer" containerID="b78c3911b7340d5f4c7b4afcaa24c7d52217cbb8867ad057e45cf1a0844ca164"
Nov 04 05:45:02.845568 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:45:02.845494    4357 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29896185-6smnz_odh-ai-gateway-infra(306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896185-6smnz" podUID="306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2"
Nov 04 05:45:02.847681 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:02.847612    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-9a0c8b-29896185-w8842" event={"ID":"4d2ba792-a3a6-4856-a039-08822d3c1e39","Type":"ContainerStarted","Data":"f9d7092ac5dc146a3312696dc8616e24dd6fe79788c3f22c67456e57015575aa"}
Nov 04 05:45:02.856047 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:02.856028    4357 scope.go:122] "RemoveContainer" containerID="83849724cb4160daada8e7e419ac6e664f810d999597df881dceda9002c9b2d4"
Nov 04 05:45:02.912547 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:02.909645    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-9a0c8b-29896185-w8842" podStartSLOduration=2.9096235310000003 podStartE2EDuration="2.909623531s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:45:02.909307108 +0000 UTC m=+989.777970681" watchObservedRunningTime="2026-11-04 05:45:02.909623531 +0000 UTC m=+989.778287108"
Nov 04 05:45:03.855112 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:03.855080    4357 scope.go:122] "RemoveContainer" containerID="a1f73873b9b9a04856b75d85a5b815a55545ce42611a76d3f2f2c82eddb212ad"
Nov 04 05:45:03.855580 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:45:03.855326    4357 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w5-9d808e-29896185-xd8jx_odh-ai-gateway-infra(fa84199d-f00a-43e8-ba40-077b8d38bdef)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-9d808e-29896185-xd8jx" podUID="fa84199d-f00a-43e8-ba40-077b8d38bdef"
Nov 04 05:45:03.856941 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:03.856917    4357 generic.go:356] "Generic (PLEG): container finished" podID="f58fb3b0-0da4-41c2-b31f-e937ce1daab7" containerID="09e3ea134f7e2874061db8b0cea79e09cb214f33c03bb2099e63eea17a050ccc" exitCode=60
Nov 04 05:45:03.857042 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:03.856954    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-27935d-29896185-7pslg" event={"ID":"f58fb3b0-0da4-41c2-b31f-e937ce1daab7","Type":"ContainerDied","Data":"09e3ea134f7e2874061db8b0cea79e09cb214f33c03bb2099e63eea17a050ccc"}
Nov 04 05:45:03.857042 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:03.857017    4357 scope.go:122] "RemoveContainer" containerID="192f931696e67a97454b5505e69e1a58bb982e8bd7454d7b5753afeba566363a"
Nov 04 05:45:03.857208 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:03.857193    4357 scope.go:122] "RemoveContainer" containerID="09e3ea134f7e2874061db8b0cea79e09cb214f33c03bb2099e63eea17a050ccc"
Nov 04 05:45:03.857440 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:45:03.857414    4357 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-27935d-29896185-7pslg_odh-ai-gateway-infra(f58fb3b0-0da4-41c2-b31f-e937ce1daab7)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-27935d-29896185-7pslg" podUID="f58fb3b0-0da4-41c2-b31f-e937ce1daab7"
Nov 04 05:45:03.858901 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:03.858879    4357 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-9a0c8b-29896185-w8842" podUID="4d2ba792-a3a6-4856-a039-08822d3c1e39" containerName="cleanup" containerID="cri-o://f9d7092ac5dc146a3312696dc8616e24dd6fe79788c3f22c67456e57015575aa" gracePeriod=30
Nov 04 05:45:03.858966 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:03.858924    4357 scope.go:122] "RemoveContainer" containerID="b78c3911b7340d5f4c7b4afcaa24c7d52217cbb8867ad057e45cf1a0844ca164"
Nov 04 05:45:03.859208 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:45:03.859101    4357 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29896185-6smnz_odh-ai-gateway-infra(306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896185-6smnz" podUID="306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2"
Nov 04 05:45:04.865567 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:04.865540    4357 scope.go:122] "RemoveContainer" containerID="09e3ea134f7e2874061db8b0cea79e09cb214f33c03bb2099e63eea17a050ccc"
Nov 04 05:45:04.865999 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:45:04.865829    4357 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-27935d-29896185-7pslg_odh-ai-gateway-infra(f58fb3b0-0da4-41c2-b31f-e937ce1daab7)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-27935d-29896185-7pslg" podUID="f58fb3b0-0da4-41c2-b31f-e937ce1daab7"
Nov 04 05:45:06.446367 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:06.446324    4357 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-f9b4a9-856cdf867f-gstt5" podUID="2e884e3e-ffb9-4a89-85a5-d9ad28f085ea" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 05:45:06.447352 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:06.447329    4357 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w1-f9b4a9-6895875fc8-pt6t4" podUID="708bb5a0-772d-4606-9d36-cbff726e0e1a" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 05:45:06.541364 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:06.541320    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6"]
Nov 04 05:45:06.546841 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:06.546815    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6"
Nov 04 05:45:06.558466 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:06.558444    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6"]
Nov 04 05:45:06.686133 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:06.686101    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7aa548d9-1602-4daa-8568-cd9c053f8a38-workload-socket\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6\" (UID: \"7aa548d9-1602-4daa-8568-cd9c053f8a38\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6"
Nov 04 05:45:06.686258 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:06.686141    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7aa548d9-1602-4daa-8568-cd9c053f8a38-istio-podinfo\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6\" (UID: \"7aa548d9-1602-4daa-8568-cd9c053f8a38\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6"
Nov 04 05:45:06.686308 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:06.686245    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7aa548d9-1602-4daa-8568-cd9c053f8a38-istio-data\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6\" (UID: \"7aa548d9-1602-4daa-8568-cd9c053f8a38\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6"
Nov 04 05:45:06.686308 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:06.686283    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7aa548d9-1602-4daa-8568-cd9c053f8a38-workload-certs\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6\" (UID: \"7aa548d9-1602-4daa-8568-cd9c053f8a38\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6"
Nov 04 05:45:06.686377 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:06.686309    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7aa548d9-1602-4daa-8568-cd9c053f8a38-istiod-ca-cert\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6\" (UID: \"7aa548d9-1602-4daa-8568-cd9c053f8a38\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6"
Nov 04 05:45:06.686407 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:06.686387    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7aa548d9-1602-4daa-8568-cd9c053f8a38-istio-token\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6\" (UID: \"7aa548d9-1602-4daa-8568-cd9c053f8a38\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6"
Nov 04 05:45:06.686452 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:06.686439    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7aa548d9-1602-4daa-8568-cd9c053f8a38-credential-socket\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6\" (UID: \"7aa548d9-1602-4daa-8568-cd9c053f8a38\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6"
Nov 04 05:45:06.686587 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:06.686562    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7aa548d9-1602-4daa-8568-cd9c053f8a38-istio-envoy\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6\" (UID: \"7aa548d9-1602-4daa-8568-cd9c053f8a38\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6"
Nov 04 05:45:06.686716 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:06.686619    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp4hg\" (UniqueName: \"kubernetes.io/projected/7aa548d9-1602-4daa-8568-cd9c053f8a38-kube-api-access-mp4hg\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6\" (UID: \"7aa548d9-1602-4daa-8568-cd9c053f8a38\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6"
Nov 04 05:45:06.742587 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:06.742504    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-2b14d0/premium-w6-2b14d0-kserve-7f599dc4b7-44v6n"]
Nov 04 05:45:06.787341 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:06.787312    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7aa548d9-1602-4daa-8568-cd9c053f8a38-istio-token\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6\" (UID: \"7aa548d9-1602-4daa-8568-cd9c053f8a38\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6"
Nov 04 05:45:06.787467 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:06.787366    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7aa548d9-1602-4daa-8568-cd9c053f8a38-credential-socket\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6\" (UID: \"7aa548d9-1602-4daa-8568-cd9c053f8a38\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6"
Nov 04 05:45:06.787467 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:06.787410    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7aa548d9-1602-4daa-8568-cd9c053f8a38-istio-envoy\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6\" (UID: \"7aa548d9-1602-4daa-8568-cd9c053f8a38\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6"
Nov 04 05:45:06.787467 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:06.787429    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp4hg\" (UniqueName: \"kubernetes.io/projected/7aa548d9-1602-4daa-8568-cd9c053f8a38-kube-api-access-mp4hg\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6\" (UID: \"7aa548d9-1602-4daa-8568-cd9c053f8a38\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6"
Nov 04 05:45:06.787617 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:06.787588    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7aa548d9-1602-4daa-8568-cd9c053f8a38-workload-socket\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6\" (UID: \"7aa548d9-1602-4daa-8568-cd9c053f8a38\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6"
Nov 04 05:45:06.787673 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:06.787659    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7aa548d9-1602-4daa-8568-cd9c053f8a38-istio-podinfo\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6\" (UID: \"7aa548d9-1602-4daa-8568-cd9c053f8a38\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6"
Nov 04 05:45:06.787754 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:06.787739    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7aa548d9-1602-4daa-8568-cd9c053f8a38-istio-data\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6\" (UID: \"7aa548d9-1602-4daa-8568-cd9c053f8a38\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6"
Nov 04 05:45:06.787801 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:06.787779    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7aa548d9-1602-4daa-8568-cd9c053f8a38-workload-certs\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6\" (UID: \"7aa548d9-1602-4daa-8568-cd9c053f8a38\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6"
Nov 04 05:45:06.787856 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:06.787818    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7aa548d9-1602-4daa-8568-cd9c053f8a38-istiod-ca-cert\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6\" (UID: \"7aa548d9-1602-4daa-8568-cd9c053f8a38\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6"
Nov 04 05:45:06.787856 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:06.787841    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7aa548d9-1602-4daa-8568-cd9c053f8a38-credential-socket\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6\" (UID: \"7aa548d9-1602-4daa-8568-cd9c053f8a38\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6"
Nov 04 05:45:06.787962 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:06.787936    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7aa548d9-1602-4daa-8568-cd9c053f8a38-workload-socket\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6\" (UID: \"7aa548d9-1602-4daa-8568-cd9c053f8a38\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6"
Nov 04 05:45:06.788125 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:06.788103    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7aa548d9-1602-4daa-8568-cd9c053f8a38-istio-data\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6\" (UID: \"7aa548d9-1602-4daa-8568-cd9c053f8a38\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6"
Nov 04 05:45:06.788207 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:06.788167    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7aa548d9-1602-4daa-8568-cd9c053f8a38-workload-certs\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6\" (UID: \"7aa548d9-1602-4daa-8568-cd9c053f8a38\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6"
Nov 04 05:45:06.788426 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:06.788410    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7aa548d9-1602-4daa-8568-cd9c053f8a38-istiod-ca-cert\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6\" (UID: \"7aa548d9-1602-4daa-8568-cd9c053f8a38\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6"
Nov 04 05:45:06.789599 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:06.789582    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7aa548d9-1602-4daa-8568-cd9c053f8a38-istio-envoy\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6\" (UID: \"7aa548d9-1602-4daa-8568-cd9c053f8a38\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6"
Nov 04 05:45:06.790019 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:06.790002    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7aa548d9-1602-4daa-8568-cd9c053f8a38-istio-podinfo\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6\" (UID: \"7aa548d9-1602-4daa-8568-cd9c053f8a38\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6"
Nov 04 05:45:06.795332 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:06.795309    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7aa548d9-1602-4daa-8568-cd9c053f8a38-istio-token\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6\" (UID: \"7aa548d9-1602-4daa-8568-cd9c053f8a38\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6"
Nov 04 05:45:06.795499 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:06.795482    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp4hg\" (UniqueName: \"kubernetes.io/projected/7aa548d9-1602-4daa-8568-cd9c053f8a38-kube-api-access-mp4hg\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6\" (UID: \"7aa548d9-1602-4daa-8568-cd9c053f8a38\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6"
Nov 04 05:45:06.865220 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:06.865198    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6"
Nov 04 05:45:07.155388 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:07.155365    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6"]
Nov 04 05:45:07.156853 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:45:07.156818    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aa548d9_1602_4daa_8568_cd9c053f8a38.slice/crio-4da0047230d5f3daa1eb9000cb2f4c3d5a1112731cf3684df7934149ce527ed1 WatchSource:0}: Error finding container 4da0047230d5f3daa1eb9000cb2f4c3d5a1112731cf3684df7934149ce527ed1: Status 404 returned error can't find the container with id 4da0047230d5f3daa1eb9000cb2f4c3d5a1112731cf3684df7934149ce527ed1
Nov 04 05:45:07.159381 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:07.159344    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:45:07.159463 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:07.159415    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:45:07.159463 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:07.159445    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:45:07.694867 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:07.694833    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-9d808e/distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq"
Nov 04 05:45:07.708871 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:07.708847    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-9d808e/distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq"
Nov 04 05:45:07.890180 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:07.890136    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6" event={"ID":"7aa548d9-1602-4daa-8568-cd9c053f8a38","Type":"ContainerStarted","Data":"348bc2de3c5d4d4592c6257ef87b68568685eb1b468f677bb36c1c4e1b895e25"}
Nov 04 05:45:07.890374 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:07.890201    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6" event={"ID":"7aa548d9-1602-4daa-8568-cd9c053f8a38","Type":"ContainerStarted","Data":"4da0047230d5f3daa1eb9000cb2f4c3d5a1112731cf3684df7934149ce527ed1"}
Nov 04 05:45:07.902555 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:07.902529    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-9d808e/distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq"
Nov 04 05:45:07.908990 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:07.908948    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6" podStartSLOduration=1.908934556 podStartE2EDuration="1.908934556s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:45:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:45:07.906618772 +0000 UTC m=+994.775282359" watchObservedRunningTime="2026-11-04 05:45:07.908934556 +0000 UTC m=+994.777598134"
Nov 04 05:45:08.884744 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:08.884706    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6"
Nov 04 05:45:08.886399 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:08.886375    4357 patch_prober.go:29] interesting pod/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Nov 04 05:45:08.886579 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:08.886424    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6" podUID="7aa548d9-1602-4daa-8568-cd9c053f8a38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Nov 04 05:45:09.871541 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:09.866835    4357 patch_prober.go:29] interesting pod/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Nov 04 05:45:09.871541 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:09.866895    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6" podUID="7aa548d9-1602-4daa-8568-cd9c053f8a38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Nov 04 05:45:10.884059 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:10.884024    4357 patch_prober.go:29] interesting pod/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Nov 04 05:45:10.884651 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:10.884620    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6" podUID="7aa548d9-1602-4daa-8568-cd9c053f8a38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Nov 04 05:45:10.893847 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:10.893819    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4"]
Nov 04 05:45:10.894054 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:10.894029    4357 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4" podUID="7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7" containerName="istio-proxy" containerID="cri-o://1c3580a6fa90d49399e27240ba63c1d9dcc7d32103fbcceca542b451702132be" gracePeriod=30
Nov 04 05:45:11.876561 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:11.874498    4357 patch_prober.go:29] interesting pod/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Nov 04 05:45:11.876561 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:11.874589    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6" podUID="7aa548d9-1602-4daa-8568-cd9c053f8a38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Nov 04 05:45:12.224404 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:12.224329    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-40e8492f-z5ngh"]
Nov 04 05:45:12.228099 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:12.228077    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-40e8492f-z5ngh"
Nov 04 05:45:12.237385 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:12.237268    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-40e8492f-z5ngh"]
Nov 04 05:45:12.305250 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:12.305217    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 04 05:45:12.315625 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:12.315590    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4b7ef80e-f057-4971-8b8b-c857784012bf-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-40e8492f-z5ngh\" (UID: \"4b7ef80e-f057-4971-8b8b-c857784012bf\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-40e8492f-z5ngh"
Nov 04 05:45:12.315778 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:12.315756    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8tcs\" (UniqueName: \"kubernetes.io/projected/4b7ef80e-f057-4971-8b8b-c857784012bf-kube-api-access-x8tcs\") pod \"maas-api-revoke-sub-40e8492f-z5ngh\" (UID: \"4b7ef80e-f057-4971-8b8b-c857784012bf\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-40e8492f-z5ngh"
Nov 04 05:45:12.315878 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:12.315855    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4b7ef80e-f057-4971-8b8b-c857784012bf-maas-api-xks-ca\") pod \"maas-api-revoke-sub-40e8492f-z5ngh\" (UID: \"4b7ef80e-f057-4971-8b8b-c857784012bf\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-40e8492f-z5ngh"
Nov 04 05:45:12.417467 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:12.417397    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8tcs\" (UniqueName: \"kubernetes.io/projected/4b7ef80e-f057-4971-8b8b-c857784012bf-kube-api-access-x8tcs\") pod \"maas-api-revoke-sub-40e8492f-z5ngh\" (UID: \"4b7ef80e-f057-4971-8b8b-c857784012bf\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-40e8492f-z5ngh"
Nov 04 05:45:12.417656 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:12.417500    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4b7ef80e-f057-4971-8b8b-c857784012bf-maas-api-xks-ca\") pod \"maas-api-revoke-sub-40e8492f-z5ngh\" (UID: \"4b7ef80e-f057-4971-8b8b-c857784012bf\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-40e8492f-z5ngh"
Nov 04 05:45:12.417656 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:12.417646    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4b7ef80e-f057-4971-8b8b-c857784012bf-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-40e8492f-z5ngh\" (UID: \"4b7ef80e-f057-4971-8b8b-c857784012bf\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-40e8492f-z5ngh"
Nov 04 05:45:12.418553 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:12.418495    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4b7ef80e-f057-4971-8b8b-c857784012bf-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-40e8492f-z5ngh\" (UID: \"4b7ef80e-f057-4971-8b8b-c857784012bf\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-40e8492f-z5ngh"
Nov 04 05:45:12.420175 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:12.420147    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4b7ef80e-f057-4971-8b8b-c857784012bf-maas-api-xks-ca\") pod \"maas-api-revoke-sub-40e8492f-z5ngh\" (UID: \"4b7ef80e-f057-4971-8b8b-c857784012bf\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-40e8492f-z5ngh"
Nov 04 05:45:12.424932 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:12.424909    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8tcs\" (UniqueName: \"kubernetes.io/projected/4b7ef80e-f057-4971-8b8b-c857784012bf-kube-api-access-x8tcs\") pod \"maas-api-revoke-sub-40e8492f-z5ngh\" (UID: \"4b7ef80e-f057-4971-8b8b-c857784012bf\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-40e8492f-z5ngh"
Nov 04 05:45:12.544985 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:12.544959    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-40e8492f-z5ngh"
Nov 04 05:45:12.844555 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:12.844510    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-40e8492f-z5ngh"]
Nov 04 05:45:12.846001 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:45:12.845966    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b7ef80e_f057_4971_8b8b_c857784012bf.slice/crio-0f5fcfbe813c737fea14a89ac668d75e671df7bfd0ddc56741bb25f0df225711 WatchSource:0}: Error finding container 0f5fcfbe813c737fea14a89ac668d75e671df7bfd0ddc56741bb25f0df225711: Status 404 returned error can't find the container with id 0f5fcfbe813c737fea14a89ac668d75e671df7bfd0ddc56741bb25f0df225711
Nov 04 05:45:12.884559 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:12.878277    4357 patch_prober.go:29] interesting pod/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Nov 04 05:45:12.884559 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:12.878329    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6" podUID="7aa548d9-1602-4daa-8568-cd9c053f8a38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Nov 04 05:45:12.922303 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:12.922274    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-40e8492f-z5ngh" event={"ID":"4b7ef80e-f057-4971-8b8b-c857784012bf","Type":"ContainerStarted","Data":"0f5fcfbe813c737fea14a89ac668d75e671df7bfd0ddc56741bb25f0df225711"}
Nov 04 05:45:13.270709 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:13.270676    4357 scope.go:122] "RemoveContainer" containerID="b78c3911b7340d5f4c7b4afcaa24c7d52217cbb8867ad057e45cf1a0844ca164"
Nov 04 05:45:13.303345 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:13.303315    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-f9b4a9-6895875fc8-pt6t4"
Nov 04 05:45:13.389924 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:13.384974    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/708bb5a0-772d-4606-9d36-cbff726e0e1a-kube-api-access-9lddv\" (UniqueName: \"kubernetes.io/projected/708bb5a0-772d-4606-9d36-cbff726e0e1a-kube-api-access-9lddv\") pod \"708bb5a0-772d-4606-9d36-cbff726e0e1a\" (UID: \"708bb5a0-772d-4606-9d36-cbff726e0e1a\") "
Nov 04 05:45:13.389924 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:13.385056    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/708bb5a0-772d-4606-9d36-cbff726e0e1a-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/708bb5a0-772d-4606-9d36-cbff726e0e1a-plugins-config-volume\") pod \"708bb5a0-772d-4606-9d36-cbff726e0e1a\" (UID: \"708bb5a0-772d-4606-9d36-cbff726e0e1a\") "
Nov 04 05:45:13.389924 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:13.386478    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/708bb5a0-772d-4606-9d36-cbff726e0e1a-plugins-config-volume" pod "708bb5a0-772d-4606-9d36-cbff726e0e1a" (UID: "708bb5a0-772d-4606-9d36-cbff726e0e1a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:45:13.460996 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:13.460959    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/708bb5a0-772d-4606-9d36-cbff726e0e1a-kube-api-access-9lddv" pod "708bb5a0-772d-4606-9d36-cbff726e0e1a" (UID: "708bb5a0-772d-4606-9d36-cbff726e0e1a"). InnerVolumeSpecName "kube-api-access-9lddv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:13.487100 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:13.487075    4357 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lddv\" (UniqueName: \"kubernetes.io/projected/708bb5a0-772d-4606-9d36-cbff726e0e1a-kube-api-access-9lddv\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:13.487217 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:13.487104    4357 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/708bb5a0-772d-4606-9d36-cbff726e0e1a-plugins-config-volume\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:13.513183 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:13.513163    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-f9b4a9-856cdf867f-gstt5"
Nov 04 05:45:13.594476 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:13.594438    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2e884e3e-ffb9-4a89-85a5-d9ad28f085ea-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e884e3e-ffb9-4a89-85a5-d9ad28f085ea-plugins-config-volume\") pod \"2e884e3e-ffb9-4a89-85a5-d9ad28f085ea\" (UID: \"2e884e3e-ffb9-4a89-85a5-d9ad28f085ea\") "
Nov 04 05:45:13.594680 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:13.594552    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2e884e3e-ffb9-4a89-85a5-d9ad28f085ea-kube-api-access-cdtns\" (UniqueName: \"kubernetes.io/projected/2e884e3e-ffb9-4a89-85a5-d9ad28f085ea-kube-api-access-cdtns\") pod \"2e884e3e-ffb9-4a89-85a5-d9ad28f085ea\" (UID: \"2e884e3e-ffb9-4a89-85a5-d9ad28f085ea\") "
Nov 04 05:45:13.594870 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:13.594844    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e884e3e-ffb9-4a89-85a5-d9ad28f085ea-plugins-config-volume" pod "2e884e3e-ffb9-4a89-85a5-d9ad28f085ea" (UID: "2e884e3e-ffb9-4a89-85a5-d9ad28f085ea"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:45:13.595051 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:13.595033    4357 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e884e3e-ffb9-4a89-85a5-d9ad28f085ea-plugins-config-volume\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:13.596991 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:13.596964    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e884e3e-ffb9-4a89-85a5-d9ad28f085ea-kube-api-access-cdtns" pod "2e884e3e-ffb9-4a89-85a5-d9ad28f085ea" (UID: "2e884e3e-ffb9-4a89-85a5-d9ad28f085ea"). InnerVolumeSpecName "kube-api-access-cdtns". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:13.696437 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:13.696408    4357 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdtns\" (UniqueName: \"kubernetes.io/projected/2e884e3e-ffb9-4a89-85a5-d9ad28f085ea-kube-api-access-cdtns\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:13.866579 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:13.866550    4357 patch_prober.go:29] interesting pod/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Nov 04 05:45:13.866704 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:13.866598    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6" podUID="7aa548d9-1602-4daa-8568-cd9c053f8a38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Nov 04 05:45:13.929661 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:13.929575    4357 generic.go:356] "Generic (PLEG): container finished" podID="4b7ef80e-f057-4971-8b8b-c857784012bf" containerID="08685da03cf1a3867a5e2b19afc2b745ebdb4628f3dccb11ccf5b964ee7b0cbc" exitCode=0
Nov 04 05:45:13.929801 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:13.929659    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-40e8492f-z5ngh" event={"ID":"4b7ef80e-f057-4971-8b8b-c857784012bf","Type":"ContainerDied","Data":"08685da03cf1a3867a5e2b19afc2b745ebdb4628f3dccb11ccf5b964ee7b0cbc"}
Nov 04 05:45:13.930955 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:13.930933    4357 generic.go:356] "Generic (PLEG): container finished" podID="2e884e3e-ffb9-4a89-85a5-d9ad28f085ea" containerID="dd15bd305f34a617d9508c18dd6182626f7df6ecfc8d04edb9ec10e3a50bfa5a" exitCode=0
Nov 04 05:45:13.931080 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:13.930979    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-f9b4a9-856cdf867f-gstt5"
Nov 04 05:45:13.931080 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:13.931007    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-f9b4a9-856cdf867f-gstt5" event={"ID":"2e884e3e-ffb9-4a89-85a5-d9ad28f085ea","Type":"ContainerDied","Data":"dd15bd305f34a617d9508c18dd6182626f7df6ecfc8d04edb9ec10e3a50bfa5a"}
Nov 04 05:45:13.931080 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:13.931046    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-f9b4a9-856cdf867f-gstt5" event={"ID":"2e884e3e-ffb9-4a89-85a5-d9ad28f085ea","Type":"ContainerDied","Data":"bb1c55e13184be4fb762a50e75e6bd74c9343d405412f9da5c9bac03aee8a334"}
Nov 04 05:45:13.931080 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:13.931069    4357 scope.go:122] "RemoveContainer" containerID="dd15bd305f34a617d9508c18dd6182626f7df6ecfc8d04edb9ec10e3a50bfa5a"
Nov 04 05:45:13.936472 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:13.936446    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896185-6smnz" event={"ID":"306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2","Type":"ContainerStarted","Data":"9b78943bbfb6aeb46e68b42807ce1a206e185a8461e46b60560425b1b0ba2e95"}
Nov 04 05:45:13.937695 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:13.937673    4357 generic.go:356] "Generic (PLEG): container finished" podID="708bb5a0-772d-4606-9d36-cbff726e0e1a" containerID="a56755705fd4babf503db6b48a5f9c5f6551a870060c8b7752b6da2bdbd76073" exitCode=0
Nov 04 05:45:13.937780 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:13.937701    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-f9b4a9-6895875fc8-pt6t4"
Nov 04 05:45:13.937780 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:13.937747    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-f9b4a9-6895875fc8-pt6t4" event={"ID":"708bb5a0-772d-4606-9d36-cbff726e0e1a","Type":"ContainerDied","Data":"a56755705fd4babf503db6b48a5f9c5f6551a870060c8b7752b6da2bdbd76073"}
Nov 04 05:45:13.937854 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:13.937784    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-f9b4a9-6895875fc8-pt6t4" event={"ID":"708bb5a0-772d-4606-9d36-cbff726e0e1a","Type":"ContainerDied","Data":"d9c8797bac8a3687d87db40e82d781afea1a69207097bc6c7db9c17537b2ba90"}
Nov 04 05:45:13.941498 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:13.941474    4357 scope.go:122] "RemoveContainer" containerID="dd15bd305f34a617d9508c18dd6182626f7df6ecfc8d04edb9ec10e3a50bfa5a"
Nov 04 05:45:13.941788 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:45:13.941768    4357 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd15bd305f34a617d9508c18dd6182626f7df6ecfc8d04edb9ec10e3a50bfa5a\": container with ID starting with dd15bd305f34a617d9508c18dd6182626f7df6ecfc8d04edb9ec10e3a50bfa5a not found: ID does not exist" containerID="dd15bd305f34a617d9508c18dd6182626f7df6ecfc8d04edb9ec10e3a50bfa5a"
Nov 04 05:45:13.941866 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:13.941794    4357 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd15bd305f34a617d9508c18dd6182626f7df6ecfc8d04edb9ec10e3a50bfa5a"} err="failed to get container status \"dd15bd305f34a617d9508c18dd6182626f7df6ecfc8d04edb9ec10e3a50bfa5a\": rpc error: code = NotFound desc = could not find container \"dd15bd305f34a617d9508c18dd6182626f7df6ecfc8d04edb9ec10e3a50bfa5a\": container with ID starting with dd15bd305f34a617d9508c18dd6182626f7df6ecfc8d04edb9ec10e3a50bfa5a not found: ID does not exist"
Nov 04 05:45:13.941866 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:13.941811    4357 scope.go:122] "RemoveContainer" containerID="a56755705fd4babf503db6b48a5f9c5f6551a870060c8b7752b6da2bdbd76073"
Nov 04 05:45:13.951721 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:13.951706    4357 scope.go:122] "RemoveContainer" containerID="a56755705fd4babf503db6b48a5f9c5f6551a870060c8b7752b6da2bdbd76073"
Nov 04 05:45:13.951986 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:45:13.951967    4357 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a56755705fd4babf503db6b48a5f9c5f6551a870060c8b7752b6da2bdbd76073\": container with ID starting with a56755705fd4babf503db6b48a5f9c5f6551a870060c8b7752b6da2bdbd76073 not found: ID does not exist" containerID="a56755705fd4babf503db6b48a5f9c5f6551a870060c8b7752b6da2bdbd76073"
Nov 04 05:45:13.952046 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:13.951997    4357 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a56755705fd4babf503db6b48a5f9c5f6551a870060c8b7752b6da2bdbd76073"} err="failed to get container status \"a56755705fd4babf503db6b48a5f9c5f6551a870060c8b7752b6da2bdbd76073\": rpc error: code = NotFound desc = could not find container \"a56755705fd4babf503db6b48a5f9c5f6551a870060c8b7752b6da2bdbd76073\": container with ID starting with a56755705fd4babf503db6b48a5f9c5f6551a870060c8b7752b6da2bdbd76073 not found: ID does not exist"
Nov 04 05:45:14.027496 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:14.027471    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-f9b4a9-856cdf867f-gstt5"]
Nov 04 05:45:14.035525 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:14.035501    4357 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-f9b4a9-856cdf867f-gstt5"]
Nov 04 05:45:14.094116 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:14.094092    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-f9b4a9-6895875fc8-pt6t4"]
Nov 04 05:45:14.103501 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:14.103469    4357 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-f9b4a9-6895875fc8-pt6t4"]
Nov 04 05:45:14.121189 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:14.121138    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896185-6smnz" podStartSLOduration=14.121122995 podStartE2EDuration="14.121122995s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:45:14.118818156 +0000 UTC m=+1000.987481729" watchObservedRunningTime="2026-11-04 05:45:14.121122995 +0000 UTC m=+1000.989786567"
Nov 04 05:45:14.267977 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:14.267954    4357 scope.go:122] "RemoveContainer" containerID="a1f73873b9b9a04856b75d85a5b815a55545ce42611a76d3f2f2c82eddb212ad"
Nov 04 05:45:14.378574 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:14.378477    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-2b14d0-6996d75467-hndgq"]
Nov 04 05:45:14.530274 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:14.530200    4357 patch_prober.go:29] interesting pod/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 04 05:45:14.530274 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:14.530256    4357 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4" podUID="7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 04 05:45:14.945447 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:14.945353    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-9d808e-29896185-xd8jx" event={"ID":"fa84199d-f00a-43e8-ba40-077b8d38bdef","Type":"ContainerStarted","Data":"7c8049e4f6a7b9ea4d9f8b2dc1a2be890ccd980f967efe7032f3e68b06674991"}
Nov 04 05:45:14.948152 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:14.948128    4357 generic.go:356] "Generic (PLEG): container finished" podID="306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2" containerID="9b78943bbfb6aeb46e68b42807ce1a206e185a8461e46b60560425b1b0ba2e95" exitCode=60
Nov 04 05:45:14.948282 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:14.948189    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896185-6smnz" event={"ID":"306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2","Type":"ContainerDied","Data":"9b78943bbfb6aeb46e68b42807ce1a206e185a8461e46b60560425b1b0ba2e95"}
Nov 04 05:45:14.948282 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:14.948241    4357 scope.go:122] "RemoveContainer" containerID="b78c3911b7340d5f4c7b4afcaa24c7d52217cbb8867ad057e45cf1a0844ca164"
Nov 04 05:45:14.948579 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:14.948563    4357 scope.go:122] "RemoveContainer" containerID="9b78943bbfb6aeb46e68b42807ce1a206e185a8461e46b60560425b1b0ba2e95"
Nov 04 05:45:14.948828 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:45:14.948807    4357 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-29896185-6smnz_odh-ai-gateway-infra(306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896185-6smnz" podUID="306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2"
Nov 04 05:45:14.964972 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:14.964923    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-9d808e-29896185-xd8jx" podStartSLOduration=14.964910641 podStartE2EDuration="14.964910641s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:45:14.964301856 +0000 UTC m=+1001.832965439" watchObservedRunningTime="2026-11-04 05:45:14.964910641 +0000 UTC m=+1001.833574212"
Nov 04 05:45:15.132960 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:15.132927    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29896185-6smnz"]
Nov 04 05:45:15.150073 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:15.150050    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-40e8492f-z5ngh"
Nov 04 05:45:15.224997 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:15.224969    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-27935d/premium-w0-27935d-kserve-856d6bf896-2zx8h"]
Nov 04 05:45:15.240103 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:15.240077    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4b7ef80e-f057-4971-8b8b-c857784012bf-kube-api-access-x8tcs\" (UniqueName: \"kubernetes.io/projected/4b7ef80e-f057-4971-8b8b-c857784012bf-kube-api-access-x8tcs\") pod \"4b7ef80e-f057-4971-8b8b-c857784012bf\" (UID: \"4b7ef80e-f057-4971-8b8b-c857784012bf\") "
Nov 04 05:45:15.240244 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:15.240193    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4b7ef80e-f057-4971-8b8b-c857784012bf-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4b7ef80e-f057-4971-8b8b-c857784012bf-maas-api-openshift-ca\") pod \"4b7ef80e-f057-4971-8b8b-c857784012bf\" (UID: \"4b7ef80e-f057-4971-8b8b-c857784012bf\") "
Nov 04 05:45:15.240303 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:15.240283    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4b7ef80e-f057-4971-8b8b-c857784012bf-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4b7ef80e-f057-4971-8b8b-c857784012bf-maas-api-xks-ca\") pod \"4b7ef80e-f057-4971-8b8b-c857784012bf\" (UID: \"4b7ef80e-f057-4971-8b8b-c857784012bf\") "
Nov 04 05:45:15.240630 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:15.240601    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b7ef80e-f057-4971-8b8b-c857784012bf-maas-api-openshift-ca" pod "4b7ef80e-f057-4971-8b8b-c857784012bf" (UID: "4b7ef80e-f057-4971-8b8b-c857784012bf"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:45:15.240752 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:15.240731    4357 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4b7ef80e-f057-4971-8b8b-c857784012bf-maas-api-openshift-ca\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:15.242215 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:15.242188    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b7ef80e-f057-4971-8b8b-c857784012bf-maas-api-xks-ca" pod "4b7ef80e-f057-4971-8b8b-c857784012bf" (UID: "4b7ef80e-f057-4971-8b8b-c857784012bf"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:45:15.242377 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:15.242360    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b7ef80e-f057-4971-8b8b-c857784012bf-kube-api-access-x8tcs" pod "4b7ef80e-f057-4971-8b8b-c857784012bf" (UID: "4b7ef80e-f057-4971-8b8b-c857784012bf"). InnerVolumeSpecName "kube-api-access-x8tcs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:15.268400 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:15.268373    4357 scope.go:122] "RemoveContainer" containerID="09e3ea134f7e2874061db8b0cea79e09cb214f33c03bb2099e63eea17a050ccc"
Nov 04 05:45:15.284545 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:15.279714    4357 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2e884e3e-ffb9-4a89-85a5-d9ad28f085ea" path="/var/lib/kubelet/pods/2e884e3e-ffb9-4a89-85a5-d9ad28f085ea/volumes"
Nov 04 05:45:15.284545 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:15.280256    4357 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="708bb5a0-772d-4606-9d36-cbff726e0e1a" path="/var/lib/kubelet/pods/708bb5a0-772d-4606-9d36-cbff726e0e1a/volumes"
Nov 04 05:45:15.342570 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:15.342512    4357 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x8tcs\" (UniqueName: \"kubernetes.io/projected/4b7ef80e-f057-4971-8b8b-c857784012bf-kube-api-access-x8tcs\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:15.342570 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:15.342562    4357 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4b7ef80e-f057-4971-8b8b-c857784012bf-maas-api-xks-ca\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:15.438713 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:15.438677    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-f910f5/simulator-w3-f910f5-kserve-7b898c5797-pgfjz"]
Nov 04 05:45:15.907657 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:15.907627    4357 patch_prober.go:29] interesting pod/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 04 05:45:15.907850 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:15.907680    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6" podUID="7aa548d9-1602-4daa-8568-cd9c053f8a38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 04 05:45:15.956774 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:15.956753    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-40e8492f-z5ngh"
Nov 04 05:45:15.956890 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:15.956791    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-40e8492f-z5ngh" event={"ID":"4b7ef80e-f057-4971-8b8b-c857784012bf","Type":"ContainerDied","Data":"0f5fcfbe813c737fea14a89ac668d75e671df7bfd0ddc56741bb25f0df225711"}
Nov 04 05:45:15.956890 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:15.956850    4357 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0f5fcfbe813c737fea14a89ac668d75e671df7bfd0ddc56741bb25f0df225711"
Nov 04 05:45:15.958889 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:15.958867    4357 generic.go:356] "Generic (PLEG): container finished" podID="fa84199d-f00a-43e8-ba40-077b8d38bdef" containerID="7c8049e4f6a7b9ea4d9f8b2dc1a2be890ccd980f967efe7032f3e68b06674991" exitCode=60
Nov 04 05:45:15.958982 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:15.958944    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-9d808e-29896185-xd8jx" event={"ID":"fa84199d-f00a-43e8-ba40-077b8d38bdef","Type":"ContainerDied","Data":"7c8049e4f6a7b9ea4d9f8b2dc1a2be890ccd980f967efe7032f3e68b06674991"}
Nov 04 05:45:15.959026 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:15.958997    4357 scope.go:122] "RemoveContainer" containerID="a1f73873b9b9a04856b75d85a5b815a55545ce42611a76d3f2f2c82eddb212ad"
Nov 04 05:45:15.959398 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:15.959379    4357 scope.go:122] "RemoveContainer" containerID="7c8049e4f6a7b9ea4d9f8b2dc1a2be890ccd980f967efe7032f3e68b06674991"
Nov 04 05:45:15.959657 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:45:15.959632    4357 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w5-9d808e-29896185-xd8jx_odh-ai-gateway-infra(fa84199d-f00a-43e8-ba40-077b8d38bdef)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-9d808e-29896185-xd8jx" podUID="fa84199d-f00a-43e8-ba40-077b8d38bdef"
Nov 04 05:45:15.961605 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:15.961579    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-27935d-29896185-7pslg" event={"ID":"f58fb3b0-0da4-41c2-b31f-e937ce1daab7","Type":"ContainerStarted","Data":"e5d67af42717a3064c3cea29ef128ffaf34c1487bd6fdc22c6893f5ca995a157"}
Nov 04 05:45:15.974602 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:15.974577    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-9d808e-29896185-xd8jx"]
Nov 04 05:45:16.233001 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.232974    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896185-6smnz"
Nov 04 05:45:16.257679 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.257652    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4"
Nov 04 05:45:16.371146 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.371119    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-istio-token\" (UniqueName: \"kubernetes.io/projected/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-istio-token\") pod \"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7\" (UID: \"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7\") "
Nov 04 05:45:16.371276 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.371172    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-credential-socket\") pod \"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7\" (UID: \"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7\") "
Nov 04 05:45:16.371276 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.371209    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-istio-data\") pod \"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7\" (UID: \"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7\") "
Nov 04 05:45:16.371400 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.371284    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-istiod-ca-cert\") pod \"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7\" (UID: \"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7\") "
Nov 04 05:45:16.371400 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.371316    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2-maas-api-service-ca\") pod \"306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2\" (UID: \"306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2\") "
Nov 04 05:45:16.371753 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.371706    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-istio-data" pod "7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7" (UID: "7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:16.371939 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.371418    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-istio-podinfo\") pod \"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7\" (UID: \"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7\") "
Nov 04 05:45:16.372089 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.371773    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2-maas-api-service-ca" pod "306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2" (UID: "306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:45:16.372089 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.371779    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-istiod-ca-cert" pod "7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7" (UID: "7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:45:16.372089 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.371965    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-credential-socket" pod "7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7" (UID: "7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:16.372089 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.372071    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2-kube-api-access-bfp6p\" (UniqueName: \"kubernetes.io/projected/306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2-kube-api-access-bfp6p\") pod \"306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2\" (UID: \"306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2\") "
Nov 04 05:45:16.372409 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.372377    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-kube-api-access-dz96s\" (UniqueName: \"kubernetes.io/projected/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-kube-api-access-dz96s\") pod \"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7\" (UID: \"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7\") "
Nov 04 05:45:16.372569 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.372550    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-workload-certs\") pod \"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7\" (UID: \"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7\") "
Nov 04 05:45:16.372756 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.372735    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-istio-envoy\") pod \"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7\" (UID: \"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7\") "
Nov 04 05:45:16.372889 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.372875    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-workload-socket\") pod \"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7\" (UID: \"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7\") "
Nov 04 05:45:16.373131 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.373105    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-workload-certs" pod "7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7" (UID: "7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:16.373215 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.373184    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-workload-socket" pod "7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7" (UID: "7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:16.373635 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.373616    4357 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-workload-certs\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:16.373763 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.373747    4357 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-workload-socket\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:16.373892 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.373868    4357 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-credential-socket\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:16.373892 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.373892    4357 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-istio-data\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:16.374172 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.373772    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-istio-token" pod "7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7" (UID: "7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:16.374172 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.373941    4357 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-istiod-ca-cert\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:16.374172 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.373958    4357 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2-maas-api-service-ca\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:16.374433 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.374413    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-istio-podinfo" pod "7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7" (UID: "7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 05:45:16.375245 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.375225    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2-kube-api-access-bfp6p" pod "306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2" (UID: "306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2"). InnerVolumeSpecName "kube-api-access-bfp6p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:16.375638 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.375619    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-kube-api-access-dz96s" pod "7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7" (UID: "7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7"). InnerVolumeSpecName "kube-api-access-dz96s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:16.375858 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.375818    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-istio-envoy" pod "7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7" (UID: "7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:16.445430 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.445393    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6"
Nov 04 05:45:16.445880 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.445858    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6"
Nov 04 05:45:16.446846 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.446824    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6"
Nov 04 05:45:16.474920 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.474850    4357 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-istio-podinfo\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:16.474920 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.474884    4357 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bfp6p\" (UniqueName: \"kubernetes.io/projected/306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2-kube-api-access-bfp6p\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:16.474920 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.474899    4357 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dz96s\" (UniqueName: \"kubernetes.io/projected/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-kube-api-access-dz96s\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:16.474920 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.474911    4357 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-istio-envoy\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:16.475115 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.474925    4357 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7-istio-token\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:16.829888 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.829855    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-9d808e/distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq"]
Nov 04 05:45:16.854088 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.854055    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-9d808e/simulator-w5-9d808e-kserve-bccd5db46-88b5x"]
Nov 04 05:45:16.973907 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.973883    4357 generic.go:356] "Generic (PLEG): container finished" podID="f58fb3b0-0da4-41c2-b31f-e937ce1daab7" containerID="e5d67af42717a3064c3cea29ef128ffaf34c1487bd6fdc22c6893f5ca995a157" exitCode=60
Nov 04 05:45:16.974032 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.973955    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-27935d-29896185-7pslg" event={"ID":"f58fb3b0-0da4-41c2-b31f-e937ce1daab7","Type":"ContainerDied","Data":"e5d67af42717a3064c3cea29ef128ffaf34c1487bd6fdc22c6893f5ca995a157"}
Nov 04 05:45:16.974090 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.974068    4357 scope.go:122] "RemoveContainer" containerID="09e3ea134f7e2874061db8b0cea79e09cb214f33c03bb2099e63eea17a050ccc"
Nov 04 05:45:16.974383 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.974362    4357 scope.go:122] "RemoveContainer" containerID="e5d67af42717a3064c3cea29ef128ffaf34c1487bd6fdc22c6893f5ca995a157"
Nov 04 05:45:16.974667 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:45:16.974637    4357 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-27935d-29896185-7pslg_odh-ai-gateway-infra(f58fb3b0-0da4-41c2-b31f-e937ce1daab7)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-27935d-29896185-7pslg" podUID="f58fb3b0-0da4-41c2-b31f-e937ce1daab7"
Nov 04 05:45:16.975367 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.975351    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896185-6smnz"
Nov 04 05:45:16.975481 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.975370    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896185-6smnz" event={"ID":"306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2","Type":"ContainerDied","Data":"18ebf410147c10719f7d165401b9dc9c6513fa794bf5c97959e1d3b3c9bfd963"}
Nov 04 05:45:16.976710 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.976690    4357 generic.go:356] "Generic (PLEG): container finished" podID="7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7" containerID="1c3580a6fa90d49399e27240ba63c1d9dcc7d32103fbcceca542b451702132be" exitCode=0
Nov 04 05:45:16.976805 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.976758    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4"
Nov 04 05:45:16.976805 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.976766    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4" event={"ID":"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7","Type":"ContainerDied","Data":"1c3580a6fa90d49399e27240ba63c1d9dcc7d32103fbcceca542b451702132be"}
Nov 04 05:45:16.976893 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.976807    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4" event={"ID":"7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7","Type":"ContainerDied","Data":"2b4020ddd24beca09f9280aba46063ebb647e05252c0c8bbc3b3a9cc57710d24"}
Nov 04 05:45:16.987464 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.987443    4357 scope.go:122] "RemoveContainer" containerID="9b78943bbfb6aeb46e68b42807ce1a206e185a8461e46b60560425b1b0ba2e95"
Nov 04 05:45:16.997201 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:16.997183    4357 scope.go:122] "RemoveContainer" containerID="1c3580a6fa90d49399e27240ba63c1d9dcc7d32103fbcceca542b451702132be"
Nov 04 05:45:17.003724 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:17.003703    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29896185-6smnz"]
Nov 04 05:45:17.005942 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:17.005922    4357 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29896185-6smnz"]
Nov 04 05:45:17.008641 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:17.007990    4357 scope.go:122] "RemoveContainer" containerID="1c3580a6fa90d49399e27240ba63c1d9dcc7d32103fbcceca542b451702132be"
Nov 04 05:45:17.008949 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:45:17.008928    4357 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c3580a6fa90d49399e27240ba63c1d9dcc7d32103fbcceca542b451702132be\": container with ID starting with 1c3580a6fa90d49399e27240ba63c1d9dcc7d32103fbcceca542b451702132be not found: ID does not exist" containerID="1c3580a6fa90d49399e27240ba63c1d9dcc7d32103fbcceca542b451702132be"
Nov 04 05:45:17.009050 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:17.008958    4357 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c3580a6fa90d49399e27240ba63c1d9dcc7d32103fbcceca542b451702132be"} err="failed to get container status \"1c3580a6fa90d49399e27240ba63c1d9dcc7d32103fbcceca542b451702132be\": rpc error: code = NotFound desc = could not find container \"1c3580a6fa90d49399e27240ba63c1d9dcc7d32103fbcceca542b451702132be\": container with ID starting with 1c3580a6fa90d49399e27240ba63c1d9dcc7d32103fbcceca542b451702132be not found: ID does not exist"
Nov 04 05:45:17.104695 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:17.103211    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4"]
Nov 04 05:45:17.124642 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:17.121985    4357 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-66jd4"]
Nov 04 05:45:17.125602 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:17.125574    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-27935d-29896185-7pslg"]
Nov 04 05:45:17.175459 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:17.175436    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-9d808e-29896185-xd8jx"
Nov 04 05:45:17.275686 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:45:17.275654    4357 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-npgcv" containerName="extractor"
Nov 04 05:45:17.276184 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:17.276165    4357 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2" path="/var/lib/kubelet/pods/306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2/volumes"
Nov 04 05:45:17.276657 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:17.276643    4357 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7" path="/var/lib/kubelet/pods/7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7/volumes"
Nov 04 05:45:17.293791 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:17.293766    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fa84199d-f00a-43e8-ba40-077b8d38bdef-kube-api-access-p64x4\" (UniqueName: \"kubernetes.io/projected/fa84199d-f00a-43e8-ba40-077b8d38bdef-kube-api-access-p64x4\") pod \"fa84199d-f00a-43e8-ba40-077b8d38bdef\" (UID: \"fa84199d-f00a-43e8-ba40-077b8d38bdef\") "
Nov 04 05:45:17.293911 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:17.293878    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fa84199d-f00a-43e8-ba40-077b8d38bdef-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa84199d-f00a-43e8-ba40-077b8d38bdef-maas-api-service-ca\") pod \"fa84199d-f00a-43e8-ba40-077b8d38bdef\" (UID: \"fa84199d-f00a-43e8-ba40-077b8d38bdef\") "
Nov 04 05:45:17.294187 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:17.294168    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa84199d-f00a-43e8-ba40-077b8d38bdef-maas-api-service-ca" pod "fa84199d-f00a-43e8-ba40-077b8d38bdef" (UID: "fa84199d-f00a-43e8-ba40-077b8d38bdef"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:45:17.295668 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:17.295648    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa84199d-f00a-43e8-ba40-077b8d38bdef-kube-api-access-p64x4" pod "fa84199d-f00a-43e8-ba40-077b8d38bdef" (UID: "fa84199d-f00a-43e8-ba40-077b8d38bdef"). InnerVolumeSpecName "kube-api-access-p64x4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:17.395608 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:17.395503    4357 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p64x4\" (UniqueName: \"kubernetes.io/projected/fa84199d-f00a-43e8-ba40-077b8d38bdef-kube-api-access-p64x4\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:17.395608 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:17.395563    4357 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa84199d-f00a-43e8-ba40-077b8d38bdef-maas-api-service-ca\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:17.988307 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:17.988277    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-9d808e-29896185-xd8jx" event={"ID":"fa84199d-f00a-43e8-ba40-077b8d38bdef","Type":"ContainerDied","Data":"1a1ef3975aaf60c05ae0c095a632d82f8bb7f04e18287bf1269e662569a4ece9"}
Nov 04 05:45:17.988723 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:17.988349    4357 scope.go:122] "RemoveContainer" containerID="7c8049e4f6a7b9ea4d9f8b2dc1a2be890ccd980f967efe7032f3e68b06674991"
Nov 04 05:45:17.988723 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:17.988292    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-9d808e-29896185-xd8jx"
Nov 04 05:45:18.069637 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:18.069601    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-9d808e-29896185-xd8jx"]
Nov 04 05:45:18.074539 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:18.072079    4357 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-9d808e-29896185-xd8jx"]
Nov 04 05:45:18.167122 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:18.167097    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-27935d-29896185-7pslg"
Nov 04 05:45:18.313163 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:18.313130    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5"]
Nov 04 05:45:18.313666 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:18.313634    4357 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5" podUID="0179edc6-8ab0-4668-a77e-5d490d9324a9" containerName="istio-proxy" containerID="cri-o://563efce8ce5da7b68d08e72659c363f732af8836624e5517752958816cac5fd8" gracePeriod=30
Nov 04 05:45:18.322524 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:18.322499    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f58fb3b0-0da4-41c2-b31f-e937ce1daab7-kube-api-access-c852r\" (UniqueName: \"kubernetes.io/projected/f58fb3b0-0da4-41c2-b31f-e937ce1daab7-kube-api-access-c852r\") pod \"f58fb3b0-0da4-41c2-b31f-e937ce1daab7\" (UID: \"f58fb3b0-0da4-41c2-b31f-e937ce1daab7\") "
Nov 04 05:45:18.322638 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:18.322558    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f58fb3b0-0da4-41c2-b31f-e937ce1daab7-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f58fb3b0-0da4-41c2-b31f-e937ce1daab7-maas-api-service-ca\") pod \"f58fb3b0-0da4-41c2-b31f-e937ce1daab7\" (UID: \"f58fb3b0-0da4-41c2-b31f-e937ce1daab7\") "
Nov 04 05:45:18.322916 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:18.322895    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f58fb3b0-0da4-41c2-b31f-e937ce1daab7-maas-api-service-ca" pod "f58fb3b0-0da4-41c2-b31f-e937ce1daab7" (UID: "f58fb3b0-0da4-41c2-b31f-e937ce1daab7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:45:18.325631 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:18.325608    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f58fb3b0-0da4-41c2-b31f-e937ce1daab7-kube-api-access-c852r" pod "f58fb3b0-0da4-41c2-b31f-e937ce1daab7" (UID: "f58fb3b0-0da4-41c2-b31f-e937ce1daab7"). InnerVolumeSpecName "kube-api-access-c852r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:18.430640 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:18.430597    4357 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c852r\" (UniqueName: \"kubernetes.io/projected/f58fb3b0-0da4-41c2-b31f-e937ce1daab7-kube-api-access-c852r\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:18.432813 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:18.432788    4357 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f58fb3b0-0da4-41c2-b31f-e937ce1daab7-maas-api-service-ca\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:19.000939 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:19.000903    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-27935d-29896185-7pslg" event={"ID":"f58fb3b0-0da4-41c2-b31f-e937ce1daab7","Type":"ContainerDied","Data":"641540131b5e728e41711d9441f855499555ca0fbcf592147f40241f924c84b8"}
Nov 04 05:45:19.001399 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:19.001002    4357 scope.go:122] "RemoveContainer" containerID="e5d67af42717a3064c3cea29ef128ffaf34c1487bd6fdc22c6893f5ca995a157"
Nov 04 05:45:19.001399 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:19.001136    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-27935d-29896185-7pslg"
Nov 04 05:45:19.026146 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:19.026116    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-27935d-29896185-7pslg"]
Nov 04 05:45:19.029959 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:19.029933    4357 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-27935d-29896185-7pslg"]
Nov 04 05:45:19.273744 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:19.273718    4357 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f58fb3b0-0da4-41c2-b31f-e937ce1daab7" path="/var/lib/kubelet/pods/f58fb3b0-0da4-41c2-b31f-e937ce1daab7/volumes"
Nov 04 05:45:19.274105 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:19.274092    4357 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fa84199d-f00a-43e8-ba40-077b8d38bdef" path="/var/lib/kubelet/pods/fa84199d-f00a-43e8-ba40-077b8d38bdef/volumes"
Nov 04 05:45:19.378887 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:19.378852    4357 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-2b14d0-6996d75467-hndgq" podUID="4c9a887b-1a65-414a-b186-7745adf36f4e" containerName="payload-pre-processing" containerID="cri-o://f350e9a5a8305a0ca6ee905a849ca6593341678b7b32caa2010649408125f004" gracePeriod=25
Nov 04 05:45:20.747186 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:20.747149    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs"]
Nov 04 05:45:20.747661 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:20.747372    4357 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs" podUID="74410632-d803-4ede-89e3-3bc956968fe0" containerName="istio-proxy" containerID="cri-o://94a7c62b8d33d26af321a3ab113d03e8207f3099a0b384ece3491b59bc9dc2f9" gracePeriod=30
Nov 04 05:45:21.638370 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.638337    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48"]
Nov 04 05:45:21.638818 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.638803    4357 cpu_manager.go:414] "containerMap: removing container" podUID="306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2" containerName="cleanup"
Nov 04 05:45:21.638869 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.638820    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2" containerName="cleanup"
Nov 04 05:45:21.638869 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.638830    4357 cpu_manager.go:414] "containerMap: removing container" podUID="fa84199d-f00a-43e8-ba40-077b8d38bdef" containerName="cleanup"
Nov 04 05:45:21.638869 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.638835    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fa84199d-f00a-43e8-ba40-077b8d38bdef" containerName="cleanup"
Nov 04 05:45:21.638869 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.638849    4357 cpu_manager.go:414] "containerMap: removing container" podUID="306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2" containerName="cleanup"
Nov 04 05:45:21.638869 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.638855    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2" containerName="cleanup"
Nov 04 05:45:21.638869 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.638864    4357 cpu_manager.go:414] "containerMap: removing container" podUID="f58fb3b0-0da4-41c2-b31f-e937ce1daab7" containerName="cleanup"
Nov 04 05:45:21.638869 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.638868    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f58fb3b0-0da4-41c2-b31f-e937ce1daab7" containerName="cleanup"
Nov 04 05:45:21.639062 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.638880    4357 cpu_manager.go:414] "containerMap: removing container" podUID="fa84199d-f00a-43e8-ba40-077b8d38bdef" containerName="cleanup"
Nov 04 05:45:21.639062 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.638885    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fa84199d-f00a-43e8-ba40-077b8d38bdef" containerName="cleanup"
Nov 04 05:45:21.639062 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.638893    4357 cpu_manager.go:414] "containerMap: removing container" podUID="2e884e3e-ffb9-4a89-85a5-d9ad28f085ea" containerName="payload-pre-processing"
Nov 04 05:45:21.639062 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.638897    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2e884e3e-ffb9-4a89-85a5-d9ad28f085ea" containerName="payload-pre-processing"
Nov 04 05:45:21.639062 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.638907    4357 cpu_manager.go:414] "containerMap: removing container" podUID="4b7ef80e-f057-4971-8b8b-c857784012bf" containerName="revoke-keys"
Nov 04 05:45:21.639062 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.638911    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4b7ef80e-f057-4971-8b8b-c857784012bf" containerName="revoke-keys"
Nov 04 05:45:21.639062 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.638920    4357 cpu_manager.go:414] "containerMap: removing container" podUID="fa84199d-f00a-43e8-ba40-077b8d38bdef" containerName="cleanup"
Nov 04 05:45:21.639062 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.638927    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fa84199d-f00a-43e8-ba40-077b8d38bdef" containerName="cleanup"
Nov 04 05:45:21.639062 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.638939    4357 cpu_manager.go:414] "containerMap: removing container" podUID="306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2" containerName="cleanup"
Nov 04 05:45:21.639062 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.638943    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2" containerName="cleanup"
Nov 04 05:45:21.639062 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.638955    4357 cpu_manager.go:414] "containerMap: removing container" podUID="f58fb3b0-0da4-41c2-b31f-e937ce1daab7" containerName="cleanup"
Nov 04 05:45:21.639062 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.638959    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f58fb3b0-0da4-41c2-b31f-e937ce1daab7" containerName="cleanup"
Nov 04 05:45:21.639062 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.638966    4357 cpu_manager.go:414] "containerMap: removing container" podUID="f58fb3b0-0da4-41c2-b31f-e937ce1daab7" containerName="cleanup"
Nov 04 05:45:21.639062 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.638971    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f58fb3b0-0da4-41c2-b31f-e937ce1daab7" containerName="cleanup"
Nov 04 05:45:21.639062 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.638981    4357 cpu_manager.go:414] "containerMap: removing container" podUID="7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7" containerName="istio-proxy"
Nov 04 05:45:21.639062 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.638986    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7" containerName="istio-proxy"
Nov 04 05:45:21.639062 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.638994    4357 cpu_manager.go:414] "containerMap: removing container" podUID="708bb5a0-772d-4606-9d36-cbff726e0e1a" containerName="payload-processing"
Nov 04 05:45:21.639062 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.639001    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="708bb5a0-772d-4606-9d36-cbff726e0e1a" containerName="payload-processing"
Nov 04 05:45:21.639062 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.639066    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="fa84199d-f00a-43e8-ba40-077b8d38bdef" containerName="cleanup"
Nov 04 05:45:21.639571 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.639078    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2" containerName="cleanup"
Nov 04 05:45:21.639571 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.639085    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="f58fb3b0-0da4-41c2-b31f-e937ce1daab7" containerName="cleanup"
Nov 04 05:45:21.639571 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.639092    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="2e884e3e-ffb9-4a89-85a5-d9ad28f085ea" containerName="payload-pre-processing"
Nov 04 05:45:21.639571 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.639099    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="4b7ef80e-f057-4971-8b8b-c857784012bf" containerName="revoke-keys"
Nov 04 05:45:21.639571 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.639104    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="fa84199d-f00a-43e8-ba40-077b8d38bdef" containerName="cleanup"
Nov 04 05:45:21.639571 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.639112    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="f58fb3b0-0da4-41c2-b31f-e937ce1daab7" containerName="cleanup"
Nov 04 05:45:21.639571 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.639118    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="7df62f6a-671b-4f8a-aaeb-fbd7c94d19d7" containerName="istio-proxy"
Nov 04 05:45:21.639571 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.639123    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="708bb5a0-772d-4606-9d36-cbff726e0e1a" containerName="payload-processing"
Nov 04 05:45:21.639571 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.639130    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2" containerName="cleanup"
Nov 04 05:45:21.643496 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.643481    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48"
Nov 04 05:45:21.657595 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.657558    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48"]
Nov 04 05:45:21.762952 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.762918    4357 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w6-2b14d0/premium-w6-2b14d0-kserve-7f599dc4b7-44v6n" podUID="a6c5f359-cad7-401a-9bd4-fc8e13b43910" containerName="main" containerID="cri-o://1d8b0ca87632b3728c4dcae9faba0c5c76365e25b4227538ca61aaceacf17145" gracePeriod=45
Nov 04 05:45:21.788739 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.788718    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54a708a2-3b46-489d-bc33-0954c018f253-credential-socket\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48\" (UID: \"54a708a2-3b46-489d-bc33-0954c018f253\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48"
Nov 04 05:45:21.788821 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.788746    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54a708a2-3b46-489d-bc33-0954c018f253-istiod-ca-cert\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48\" (UID: \"54a708a2-3b46-489d-bc33-0954c018f253\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48"
Nov 04 05:45:21.788821 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.788767    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54a708a2-3b46-489d-bc33-0954c018f253-workload-certs\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48\" (UID: \"54a708a2-3b46-489d-bc33-0954c018f253\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48"
Nov 04 05:45:21.788916 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.788821    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54a708a2-3b46-489d-bc33-0954c018f253-istio-token\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48\" (UID: \"54a708a2-3b46-489d-bc33-0954c018f253\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48"
Nov 04 05:45:21.788956 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.788934    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54a708a2-3b46-489d-bc33-0954c018f253-istio-data\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48\" (UID: \"54a708a2-3b46-489d-bc33-0954c018f253\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48"
Nov 04 05:45:21.788988 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.788975    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54a708a2-3b46-489d-bc33-0954c018f253-workload-socket\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48\" (UID: \"54a708a2-3b46-489d-bc33-0954c018f253\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48"
Nov 04 05:45:21.789101 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.789080    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54a708a2-3b46-489d-bc33-0954c018f253-istio-envoy\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48\" (UID: \"54a708a2-3b46-489d-bc33-0954c018f253\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48"
Nov 04 05:45:21.789165 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.789116    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rfkc\" (UniqueName: \"kubernetes.io/projected/54a708a2-3b46-489d-bc33-0954c018f253-kube-api-access-8rfkc\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48\" (UID: \"54a708a2-3b46-489d-bc33-0954c018f253\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48"
Nov 04 05:45:21.789211 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.789202    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54a708a2-3b46-489d-bc33-0954c018f253-istio-podinfo\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48\" (UID: \"54a708a2-3b46-489d-bc33-0954c018f253\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48"
Nov 04 05:45:21.880725 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.880699    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt"]
Nov 04 05:45:21.881464 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.881443    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="306ffc68-1d7d-4ceb-8213-b88dd0ae4ca2" containerName="cleanup"
Nov 04 05:45:21.881464 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.881465    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="f58fb3b0-0da4-41c2-b31f-e937ce1daab7" containerName="cleanup"
Nov 04 05:45:21.881644 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.881477    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="fa84199d-f00a-43e8-ba40-077b8d38bdef" containerName="cleanup"
Nov 04 05:45:21.884894 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.884876    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt"
Nov 04 05:45:21.889823 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.889774    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54a708a2-3b46-489d-bc33-0954c018f253-credential-socket\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48\" (UID: \"54a708a2-3b46-489d-bc33-0954c018f253\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48"
Nov 04 05:45:21.889823 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.889806    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54a708a2-3b46-489d-bc33-0954c018f253-istiod-ca-cert\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48\" (UID: \"54a708a2-3b46-489d-bc33-0954c018f253\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48"
Nov 04 05:45:21.889959 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.889826    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54a708a2-3b46-489d-bc33-0954c018f253-workload-certs\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48\" (UID: \"54a708a2-3b46-489d-bc33-0954c018f253\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48"
Nov 04 05:45:21.889959 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.889844    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54a708a2-3b46-489d-bc33-0954c018f253-istio-token\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48\" (UID: \"54a708a2-3b46-489d-bc33-0954c018f253\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48"
Nov 04 05:45:21.889959 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.889913    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54a708a2-3b46-489d-bc33-0954c018f253-istio-data\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48\" (UID: \"54a708a2-3b46-489d-bc33-0954c018f253\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48"
Nov 04 05:45:21.890109 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.889976    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54a708a2-3b46-489d-bc33-0954c018f253-workload-socket\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48\" (UID: \"54a708a2-3b46-489d-bc33-0954c018f253\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48"
Nov 04 05:45:21.890109 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.890050    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54a708a2-3b46-489d-bc33-0954c018f253-istio-envoy\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48\" (UID: \"54a708a2-3b46-489d-bc33-0954c018f253\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48"
Nov 04 05:45:21.890109 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.890075    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rfkc\" (UniqueName: \"kubernetes.io/projected/54a708a2-3b46-489d-bc33-0954c018f253-kube-api-access-8rfkc\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48\" (UID: \"54a708a2-3b46-489d-bc33-0954c018f253\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48"
Nov 04 05:45:21.890287 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.890115    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54a708a2-3b46-489d-bc33-0954c018f253-istio-podinfo\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48\" (UID: \"54a708a2-3b46-489d-bc33-0954c018f253\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48"
Nov 04 05:45:21.890287 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.890243    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54a708a2-3b46-489d-bc33-0954c018f253-workload-certs\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48\" (UID: \"54a708a2-3b46-489d-bc33-0954c018f253\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48"
Nov 04 05:45:21.890287 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.890256    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54a708a2-3b46-489d-bc33-0954c018f253-credential-socket\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48\" (UID: \"54a708a2-3b46-489d-bc33-0954c018f253\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48"
Nov 04 05:45:21.890474 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.890453    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54a708a2-3b46-489d-bc33-0954c018f253-workload-socket\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48\" (UID: \"54a708a2-3b46-489d-bc33-0954c018f253\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48"
Nov 04 05:45:21.893717 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.893693    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54a708a2-3b46-489d-bc33-0954c018f253-istio-podinfo\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48\" (UID: \"54a708a2-3b46-489d-bc33-0954c018f253\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48"
Nov 04 05:45:21.893890 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.893843    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54a708a2-3b46-489d-bc33-0954c018f253-istiod-ca-cert\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48\" (UID: \"54a708a2-3b46-489d-bc33-0954c018f253\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48"
Nov 04 05:45:21.894272 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.894249    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54a708a2-3b46-489d-bc33-0954c018f253-istio-data\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48\" (UID: \"54a708a2-3b46-489d-bc33-0954c018f253\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48"
Nov 04 05:45:21.899367 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.899323    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54a708a2-3b46-489d-bc33-0954c018f253-istio-envoy\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48\" (UID: \"54a708a2-3b46-489d-bc33-0954c018f253\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48"
Nov 04 05:45:21.904619 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.904540    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt"]
Nov 04 05:45:21.918570 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.918496    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rfkc\" (UniqueName: \"kubernetes.io/projected/54a708a2-3b46-489d-bc33-0954c018f253-kube-api-access-8rfkc\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48\" (UID: \"54a708a2-3b46-489d-bc33-0954c018f253\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48"
Nov 04 05:45:21.918697 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.918623    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54a708a2-3b46-489d-bc33-0954c018f253-istio-token\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48\" (UID: \"54a708a2-3b46-489d-bc33-0954c018f253\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48"
Nov 04 05:45:21.957073 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.956880    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48"
Nov 04 05:45:21.991311 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.991273    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33923021-e163-4976-a8bb-f74d79c5220a-workload-socket\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt\" (UID: \"33923021-e163-4976-a8bb-f74d79c5220a\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt"
Nov 04 05:45:21.991427 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.991339    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33923021-e163-4976-a8bb-f74d79c5220a-istio-envoy\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt\" (UID: \"33923021-e163-4976-a8bb-f74d79c5220a\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt"
Nov 04 05:45:21.991427 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.991385    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33923021-e163-4976-a8bb-f74d79c5220a-istiod-ca-cert\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt\" (UID: \"33923021-e163-4976-a8bb-f74d79c5220a\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt"
Nov 04 05:45:21.991499 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.991479    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33923021-e163-4976-a8bb-f74d79c5220a-istio-data\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt\" (UID: \"33923021-e163-4976-a8bb-f74d79c5220a\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt"
Nov 04 05:45:21.991621 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.991602    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33923021-e163-4976-a8bb-f74d79c5220a-workload-certs\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt\" (UID: \"33923021-e163-4976-a8bb-f74d79c5220a\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt"
Nov 04 05:45:21.991737 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.991652    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33923021-e163-4976-a8bb-f74d79c5220a-istio-podinfo\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt\" (UID: \"33923021-e163-4976-a8bb-f74d79c5220a\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt"
Nov 04 05:45:21.991737 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.991699    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33923021-e163-4976-a8bb-f74d79c5220a-istio-token\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt\" (UID: \"33923021-e163-4976-a8bb-f74d79c5220a\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt"
Nov 04 05:45:21.991810 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.991757    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbdkj\" (UniqueName: \"kubernetes.io/projected/33923021-e163-4976-a8bb-f74d79c5220a-kube-api-access-dbdkj\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt\" (UID: \"33923021-e163-4976-a8bb-f74d79c5220a\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt"
Nov 04 05:45:21.991850 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:21.991816    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33923021-e163-4976-a8bb-f74d79c5220a-credential-socket\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt\" (UID: \"33923021-e163-4976-a8bb-f74d79c5220a\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt"
Nov 04 05:45:22.026476 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.025927    4357 generic.go:356] "Generic (PLEG): container finished" podID="a6c5f359-cad7-401a-9bd4-fc8e13b43910" containerID="1d8b0ca87632b3728c4dcae9faba0c5c76365e25b4227538ca61aaceacf17145" exitCode=0
Nov 04 05:45:22.026476 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.026053    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-2b14d0/premium-w6-2b14d0-kserve-7f599dc4b7-44v6n" event={"ID":"a6c5f359-cad7-401a-9bd4-fc8e13b43910","Type":"ContainerDied","Data":"1d8b0ca87632b3728c4dcae9faba0c5c76365e25b4227538ca61aaceacf17145"}
Nov 04 05:45:22.097688 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.097632    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33923021-e163-4976-a8bb-f74d79c5220a-credential-socket\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt\" (UID: \"33923021-e163-4976-a8bb-f74d79c5220a\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt"
Nov 04 05:45:22.097844 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.097776    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33923021-e163-4976-a8bb-f74d79c5220a-workload-socket\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt\" (UID: \"33923021-e163-4976-a8bb-f74d79c5220a\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt"
Nov 04 05:45:22.097844 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.097814    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33923021-e163-4976-a8bb-f74d79c5220a-istio-envoy\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt\" (UID: \"33923021-e163-4976-a8bb-f74d79c5220a\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt"
Nov 04 05:45:22.097981 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.097853    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33923021-e163-4976-a8bb-f74d79c5220a-istiod-ca-cert\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt\" (UID: \"33923021-e163-4976-a8bb-f74d79c5220a\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt"
Nov 04 05:45:22.097981 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.097923    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33923021-e163-4976-a8bb-f74d79c5220a-istio-data\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt\" (UID: \"33923021-e163-4976-a8bb-f74d79c5220a\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt"
Nov 04 05:45:22.097981 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.097970    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33923021-e163-4976-a8bb-f74d79c5220a-workload-certs\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt\" (UID: \"33923021-e163-4976-a8bb-f74d79c5220a\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt"
Nov 04 05:45:22.098153 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.098001    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33923021-e163-4976-a8bb-f74d79c5220a-istio-podinfo\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt\" (UID: \"33923021-e163-4976-a8bb-f74d79c5220a\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt"
Nov 04 05:45:22.098153 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.098025    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33923021-e163-4976-a8bb-f74d79c5220a-istio-token\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt\" (UID: \"33923021-e163-4976-a8bb-f74d79c5220a\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt"
Nov 04 05:45:22.098153 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.098069    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbdkj\" (UniqueName: \"kubernetes.io/projected/33923021-e163-4976-a8bb-f74d79c5220a-kube-api-access-dbdkj\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt\" (UID: \"33923021-e163-4976-a8bb-f74d79c5220a\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt"
Nov 04 05:45:22.098821 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.098795    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33923021-e163-4976-a8bb-f74d79c5220a-credential-socket\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt\" (UID: \"33923021-e163-4976-a8bb-f74d79c5220a\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt"
Nov 04 05:45:22.099064 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.099044    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33923021-e163-4976-a8bb-f74d79c5220a-workload-socket\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt\" (UID: \"33923021-e163-4976-a8bb-f74d79c5220a\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt"
Nov 04 05:45:22.100029 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.099976    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33923021-e163-4976-a8bb-f74d79c5220a-workload-certs\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt\" (UID: \"33923021-e163-4976-a8bb-f74d79c5220a\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt"
Nov 04 05:45:22.100485 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.100436    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33923021-e163-4976-a8bb-f74d79c5220a-istio-data\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt\" (UID: \"33923021-e163-4976-a8bb-f74d79c5220a\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt"
Nov 04 05:45:22.101911 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.101889    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33923021-e163-4976-a8bb-f74d79c5220a-istio-envoy\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt\" (UID: \"33923021-e163-4976-a8bb-f74d79c5220a\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt"
Nov 04 05:45:22.102640 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.102609    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33923021-e163-4976-a8bb-f74d79c5220a-istio-podinfo\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt\" (UID: \"33923021-e163-4976-a8bb-f74d79c5220a\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt"
Nov 04 05:45:22.103471 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.103451    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33923021-e163-4976-a8bb-f74d79c5220a-istiod-ca-cert\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt\" (UID: \"33923021-e163-4976-a8bb-f74d79c5220a\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt"
Nov 04 05:45:22.106343 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.106323    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-2b14d0/premium-w6-2b14d0-kserve-7f599dc4b7-44v6n"
Nov 04 05:45:22.106555 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.106503    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbdkj\" (UniqueName: \"kubernetes.io/projected/33923021-e163-4976-a8bb-f74d79c5220a-kube-api-access-dbdkj\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt\" (UID: \"33923021-e163-4976-a8bb-f74d79c5220a\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt"
Nov 04 05:45:22.116089 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.116071    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33923021-e163-4976-a8bb-f74d79c5220a-istio-token\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt\" (UID: \"33923021-e163-4976-a8bb-f74d79c5220a\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt"
Nov 04 05:45:22.198807 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.198743    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a6c5f359-cad7-401a-9bd4-fc8e13b43910-tls-certs\" (UniqueName: \"kubernetes.io/secret/a6c5f359-cad7-401a-9bd4-fc8e13b43910-tls-certs\") pod \"a6c5f359-cad7-401a-9bd4-fc8e13b43910\" (UID: \"a6c5f359-cad7-401a-9bd4-fc8e13b43910\") "
Nov 04 05:45:22.198807 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.198798    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a6c5f359-cad7-401a-9bd4-fc8e13b43910-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6c5f359-cad7-401a-9bd4-fc8e13b43910-tmp-dir\") pod \"a6c5f359-cad7-401a-9bd4-fc8e13b43910\" (UID: \"a6c5f359-cad7-401a-9bd4-fc8e13b43910\") "
Nov 04 05:45:22.198990 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.198827    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a6c5f359-cad7-401a-9bd4-fc8e13b43910-kube-api-access-tcs8h\" (UniqueName: \"kubernetes.io/projected/a6c5f359-cad7-401a-9bd4-fc8e13b43910-kube-api-access-tcs8h\") pod \"a6c5f359-cad7-401a-9bd4-fc8e13b43910\" (UID: \"a6c5f359-cad7-401a-9bd4-fc8e13b43910\") "
Nov 04 05:45:22.198990 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.198888    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a6c5f359-cad7-401a-9bd4-fc8e13b43910-home\" (UniqueName: \"kubernetes.io/empty-dir/a6c5f359-cad7-401a-9bd4-fc8e13b43910-home\") pod \"a6c5f359-cad7-401a-9bd4-fc8e13b43910\" (UID: \"a6c5f359-cad7-401a-9bd4-fc8e13b43910\") "
Nov 04 05:45:22.198990 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.198985    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a6c5f359-cad7-401a-9bd4-fc8e13b43910-dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6c5f359-cad7-401a-9bd4-fc8e13b43910-dshm\") pod \"a6c5f359-cad7-401a-9bd4-fc8e13b43910\" (UID: \"a6c5f359-cad7-401a-9bd4-fc8e13b43910\") "
Nov 04 05:45:22.199110 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.199076    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a6c5f359-cad7-401a-9bd4-fc8e13b43910-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6c5f359-cad7-401a-9bd4-fc8e13b43910-model-cache\") pod \"a6c5f359-cad7-401a-9bd4-fc8e13b43910\" (UID: \"a6c5f359-cad7-401a-9bd4-fc8e13b43910\") "
Nov 04 05:45:22.199110 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.199075    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6c5f359-cad7-401a-9bd4-fc8e13b43910-tmp-dir" pod "a6c5f359-cad7-401a-9bd4-fc8e13b43910" (UID: "a6c5f359-cad7-401a-9bd4-fc8e13b43910"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:22.199324 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.199243    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6c5f359-cad7-401a-9bd4-fc8e13b43910-home" pod "a6c5f359-cad7-401a-9bd4-fc8e13b43910" (UID: "a6c5f359-cad7-401a-9bd4-fc8e13b43910"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:22.199476 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.199448    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6c5f359-cad7-401a-9bd4-fc8e13b43910-model-cache" pod "a6c5f359-cad7-401a-9bd4-fc8e13b43910" (UID: "a6c5f359-cad7-401a-9bd4-fc8e13b43910"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:22.199699 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.199677    4357 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6c5f359-cad7-401a-9bd4-fc8e13b43910-model-cache\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:22.199779 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.199705    4357 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6c5f359-cad7-401a-9bd4-fc8e13b43910-tmp-dir\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:22.199779 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.199721    4357 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6c5f359-cad7-401a-9bd4-fc8e13b43910-home\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:22.200994 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.200972    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6c5f359-cad7-401a-9bd4-fc8e13b43910-tls-certs" pod "a6c5f359-cad7-401a-9bd4-fc8e13b43910" (UID: "a6c5f359-cad7-401a-9bd4-fc8e13b43910"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:45:22.201321 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.201300    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6c5f359-cad7-401a-9bd4-fc8e13b43910-dshm" pod "a6c5f359-cad7-401a-9bd4-fc8e13b43910" (UID: "a6c5f359-cad7-401a-9bd4-fc8e13b43910"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:22.201387 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.201358    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6c5f359-cad7-401a-9bd4-fc8e13b43910-kube-api-access-tcs8h" pod "a6c5f359-cad7-401a-9bd4-fc8e13b43910" (UID: "a6c5f359-cad7-401a-9bd4-fc8e13b43910"). InnerVolumeSpecName "kube-api-access-tcs8h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:22.219795 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.219772    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt"
Nov 04 05:45:22.252547 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.244727    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48"]
Nov 04 05:45:22.254708 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.254677    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:45:22.254799 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.254748    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:45:22.254799 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.254780    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:45:22.301132 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.301101    4357 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6c5f359-cad7-401a-9bd4-fc8e13b43910-tls-certs\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:22.301237 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.301140    4357 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tcs8h\" (UniqueName: \"kubernetes.io/projected/a6c5f359-cad7-401a-9bd4-fc8e13b43910-kube-api-access-tcs8h\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:22.301237 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.301157    4357 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6c5f359-cad7-401a-9bd4-fc8e13b43910-dshm\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:22.502776 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.502748    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt"]
Nov 04 05:45:22.504529 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:45:22.504490    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33923021_e163_4976_a8bb_f74d79c5220a.slice/crio-bcb2a78642044610c33dd55bde1416e90050580ad6bb627ee8d199a704816d90 WatchSource:0}: Error finding container bcb2a78642044610c33dd55bde1416e90050580ad6bb627ee8d199a704816d90: Status 404 returned error can't find the container with id bcb2a78642044610c33dd55bde1416e90050580ad6bb627ee8d199a704816d90
Nov 04 05:45:22.507155 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.507115    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:45:22.507247 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.507196    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:45:22.507285 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.507246    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:45:22.828455 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.828141    4357 patch_prober.go:29] interesting pod/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 04 05:45:22.828455 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:22.828205    4357 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs" podUID="74410632-d803-4ede-89e3-3bc956968fe0" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 04 05:45:23.044234 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:23.044138    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48" event={"ID":"54a708a2-3b46-489d-bc33-0954c018f253","Type":"ContainerStarted","Data":"cd16634b8c4907d667a0341e7c494aef4c97d3b1755aba1ced2bedee797eefbd"}
Nov 04 05:45:23.044234 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:23.044199    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48" event={"ID":"54a708a2-3b46-489d-bc33-0954c018f253","Type":"ContainerStarted","Data":"e9c9d07557e910125deea3753f777a88e140cc8a4b107a92a91b1cbc4b79a8fa"}
Nov 04 05:45:23.046134 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:23.046110    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-2b14d0/premium-w6-2b14d0-kserve-7f599dc4b7-44v6n"
Nov 04 05:45:23.046328 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:23.046298    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-2b14d0/premium-w6-2b14d0-kserve-7f599dc4b7-44v6n" event={"ID":"a6c5f359-cad7-401a-9bd4-fc8e13b43910","Type":"ContainerDied","Data":"69517ff8497887650506982026515dc77f288dde070b2413629cccba35b375ae"}
Nov 04 05:45:23.046449 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:23.046344    4357 scope.go:122] "RemoveContainer" containerID="1d8b0ca87632b3728c4dcae9faba0c5c76365e25b4227538ca61aaceacf17145"
Nov 04 05:45:23.048613 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:23.048592    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt" event={"ID":"33923021-e163-4976-a8bb-f74d79c5220a","Type":"ContainerStarted","Data":"bc78e40bb5c04f94d1c4b10a5755b837245cc0528b224a8f17baa41e51966da9"}
Nov 04 05:45:23.048714 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:23.048637    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt" event={"ID":"33923021-e163-4976-a8bb-f74d79c5220a","Type":"ContainerStarted","Data":"bcb2a78642044610c33dd55bde1416e90050580ad6bb627ee8d199a704816d90"}
Nov 04 05:45:23.088359 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:23.087605    4357 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-2b14d0/premium-w6-2b14d0-kserve-7f599dc4b7-44v6n" podUID="a6c5f359-cad7-401a-9bd4-fc8e13b43910" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 04 05:45:23.114258 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:23.114193    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48" podStartSLOduration=2.114172347 podStartE2EDuration="2.114172347s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:45:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:45:23.088150001 +0000 UTC m=+1009.956813581" watchObservedRunningTime="2026-11-04 05:45:23.114172347 +0000 UTC m=+1009.982835920"
Nov 04 05:45:23.116463 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:23.116440    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-2b14d0/premium-w6-2b14d0-kserve-7f599dc4b7-44v6n"]
Nov 04 05:45:23.120060 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:23.120037    4357 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w6-2b14d0/premium-w6-2b14d0-kserve-7f599dc4b7-44v6n"]
Nov 04 05:45:23.133849 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:23.133804    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt" podStartSLOduration=2.133790724 podStartE2EDuration="2.133790724s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:45:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:45:23.131643851 +0000 UTC m=+1010.000307464" watchObservedRunningTime="2026-11-04 05:45:23.133790724 +0000 UTC m=+1010.002454296"
Nov 04 05:45:23.220935 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:23.220901    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt"
Nov 04 05:45:23.222559 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:23.222512    4357 patch_prober.go:29] interesting pod/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Nov 04 05:45:23.222693 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:23.222576    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt" podUID="33923021-e163-4976-a8bb-f74d79c5220a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Nov 04 05:45:23.300636 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:23.300554    4357 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a6c5f359-cad7-401a-9bd4-fc8e13b43910" path="/var/lib/kubelet/pods/a6c5f359-cad7-401a-9bd4-fc8e13b43910/volumes"
Nov 04 05:45:24.082546 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:24.081606    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48"
Nov 04 05:45:24.140200 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:24.140170    4357 patch_prober.go:29] interesting pod/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Nov 04 05:45:24.141477 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:24.141446    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48" podUID="54a708a2-3b46-489d-bc33-0954c018f253" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Nov 04 05:45:24.159893 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:24.153923    4357 generic.go:356] "Generic (PLEG): container finished" podID="0179edc6-8ab0-4668-a77e-5d490d9324a9" containerID="563efce8ce5da7b68d08e72659c363f732af8836624e5517752958816cac5fd8" exitCode=0
Nov 04 05:45:24.159893 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:24.154883    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5" event={"ID":"0179edc6-8ab0-4668-a77e-5d490d9324a9","Type":"ContainerDied","Data":"563efce8ce5da7b68d08e72659c363f732af8836624e5517752958816cac5fd8"}
Nov 04 05:45:24.192010 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:24.191970    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5"
Nov 04 05:45:24.242544 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:24.227640    4357 patch_prober.go:29] interesting pod/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Nov 04 05:45:24.242544 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:24.227697    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt" podUID="33923021-e163-4976-a8bb-f74d79c5220a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Nov 04 05:45:24.345488 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:24.345447    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0179edc6-8ab0-4668-a77e-5d490d9324a9-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0179edc6-8ab0-4668-a77e-5d490d9324a9-istio-podinfo\") pod \"0179edc6-8ab0-4668-a77e-5d490d9324a9\" (UID: \"0179edc6-8ab0-4668-a77e-5d490d9324a9\") "
Nov 04 05:45:24.345777 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:24.345753    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0179edc6-8ab0-4668-a77e-5d490d9324a9-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0179edc6-8ab0-4668-a77e-5d490d9324a9-workload-socket\") pod \"0179edc6-8ab0-4668-a77e-5d490d9324a9\" (UID: \"0179edc6-8ab0-4668-a77e-5d490d9324a9\") "
Nov 04 05:45:24.345946 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:24.345927    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0179edc6-8ab0-4668-a77e-5d490d9324a9-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0179edc6-8ab0-4668-a77e-5d490d9324a9-credential-socket\") pod \"0179edc6-8ab0-4668-a77e-5d490d9324a9\" (UID: \"0179edc6-8ab0-4668-a77e-5d490d9324a9\") "
Nov 04 05:45:24.346121 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:24.346103    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0179edc6-8ab0-4668-a77e-5d490d9324a9-kube-api-access-86gxv\" (UniqueName: \"kubernetes.io/projected/0179edc6-8ab0-4668-a77e-5d490d9324a9-kube-api-access-86gxv\") pod \"0179edc6-8ab0-4668-a77e-5d490d9324a9\" (UID: \"0179edc6-8ab0-4668-a77e-5d490d9324a9\") "
Nov 04 05:45:24.349538 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:24.346259    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0179edc6-8ab0-4668-a77e-5d490d9324a9-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0179edc6-8ab0-4668-a77e-5d490d9324a9-istiod-ca-cert\") pod \"0179edc6-8ab0-4668-a77e-5d490d9324a9\" (UID: \"0179edc6-8ab0-4668-a77e-5d490d9324a9\") "
Nov 04 05:45:24.349762 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:24.349739    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0179edc6-8ab0-4668-a77e-5d490d9324a9-istio-token\" (UniqueName: \"kubernetes.io/projected/0179edc6-8ab0-4668-a77e-5d490d9324a9-istio-token\") pod \"0179edc6-8ab0-4668-a77e-5d490d9324a9\" (UID: \"0179edc6-8ab0-4668-a77e-5d490d9324a9\") "
Nov 04 05:45:24.359543 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:24.349902    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0179edc6-8ab0-4668-a77e-5d490d9324a9-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0179edc6-8ab0-4668-a77e-5d490d9324a9-istio-envoy\") pod \"0179edc6-8ab0-4668-a77e-5d490d9324a9\" (UID: \"0179edc6-8ab0-4668-a77e-5d490d9324a9\") "
Nov 04 05:45:24.360428 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:24.360390    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0179edc6-8ab0-4668-a77e-5d490d9324a9-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0179edc6-8ab0-4668-a77e-5d490d9324a9-workload-certs\") pod \"0179edc6-8ab0-4668-a77e-5d490d9324a9\" (UID: \"0179edc6-8ab0-4668-a77e-5d490d9324a9\") "
Nov 04 05:45:24.360635 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:24.360615    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0179edc6-8ab0-4668-a77e-5d490d9324a9-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0179edc6-8ab0-4668-a77e-5d490d9324a9-istio-data\") pod \"0179edc6-8ab0-4668-a77e-5d490d9324a9\" (UID: \"0179edc6-8ab0-4668-a77e-5d490d9324a9\") "
Nov 04 05:45:24.371300 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:24.369757    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0179edc6-8ab0-4668-a77e-5d490d9324a9-workload-certs" pod "0179edc6-8ab0-4668-a77e-5d490d9324a9" (UID: "0179edc6-8ab0-4668-a77e-5d490d9324a9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:24.399633 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:24.391728    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0179edc6-8ab0-4668-a77e-5d490d9324a9-istiod-ca-cert" pod "0179edc6-8ab0-4668-a77e-5d490d9324a9" (UID: "0179edc6-8ab0-4668-a77e-5d490d9324a9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:45:24.448584 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:24.417746    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0179edc6-8ab0-4668-a77e-5d490d9324a9-credential-socket" pod "0179edc6-8ab0-4668-a77e-5d490d9324a9" (UID: "0179edc6-8ab0-4668-a77e-5d490d9324a9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:24.448584 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:24.433939    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0179edc6-8ab0-4668-a77e-5d490d9324a9-workload-socket" pod "0179edc6-8ab0-4668-a77e-5d490d9324a9" (UID: "0179edc6-8ab0-4668-a77e-5d490d9324a9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:24.448584 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:24.434129    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0179edc6-8ab0-4668-a77e-5d490d9324a9-istio-data" pod "0179edc6-8ab0-4668-a77e-5d490d9324a9" (UID: "0179edc6-8ab0-4668-a77e-5d490d9324a9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:24.455205 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:24.454615    4357 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0179edc6-8ab0-4668-a77e-5d490d9324a9-istiod-ca-cert\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:24.455205 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:24.454850    4357 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0179edc6-8ab0-4668-a77e-5d490d9324a9-workload-certs\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:24.455205 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:24.455164    4357 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0179edc6-8ab0-4668-a77e-5d490d9324a9-workload-socket\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:24.458536 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:24.455932    4357 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0179edc6-8ab0-4668-a77e-5d490d9324a9-credential-socket\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:24.591551 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:24.556651    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0179edc6-8ab0-4668-a77e-5d490d9324a9-istio-podinfo" pod "0179edc6-8ab0-4668-a77e-5d490d9324a9" (UID: "0179edc6-8ab0-4668-a77e-5d490d9324a9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 05:45:24.591551 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:24.556750    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0179edc6-8ab0-4668-a77e-5d490d9324a9-istio-envoy" pod "0179edc6-8ab0-4668-a77e-5d490d9324a9" (UID: "0179edc6-8ab0-4668-a77e-5d490d9324a9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:24.591551 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:24.557581    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0179edc6-8ab0-4668-a77e-5d490d9324a9-kube-api-access-86gxv" pod "0179edc6-8ab0-4668-a77e-5d490d9324a9" (UID: "0179edc6-8ab0-4668-a77e-5d490d9324a9"). InnerVolumeSpecName "kube-api-access-86gxv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:24.591551 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:24.557756    4357 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86gxv\" (UniqueName: \"kubernetes.io/projected/0179edc6-8ab0-4668-a77e-5d490d9324a9-kube-api-access-86gxv\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:24.591551 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:24.557784    4357 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0179edc6-8ab0-4668-a77e-5d490d9324a9-istio-envoy\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:24.591551 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:24.557799    4357 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0179edc6-8ab0-4668-a77e-5d490d9324a9-istio-data\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:24.591551 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:24.557813    4357 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0179edc6-8ab0-4668-a77e-5d490d9324a9-istio-podinfo\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:24.591551 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:24.588795    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0179edc6-8ab0-4668-a77e-5d490d9324a9-istio-token" pod "0179edc6-8ab0-4668-a77e-5d490d9324a9" (UID: "0179edc6-8ab0-4668-a77e-5d490d9324a9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:24.753623 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:24.745557    4357 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0179edc6-8ab0-4668-a77e-5d490d9324a9-istio-token\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:24.957443 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:24.957410    4357 patch_prober.go:29] interesting pod/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Nov 04 05:45:24.957744 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:24.957695    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48" podUID="54a708a2-3b46-489d-bc33-0954c018f253" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Nov 04 05:45:25.304545 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:25.304425    4357 patch_prober.go:29] interesting pod/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Nov 04 05:45:25.304545 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:25.304484    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt" podUID="33923021-e163-4976-a8bb-f74d79c5220a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Nov 04 05:45:25.399596 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:25.396132    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5"
Nov 04 05:45:25.487541 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:25.476599    4357 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-2b14d0-6996d75467-hndgq" podUID="4c9a887b-1a65-414a-b186-7745adf36f4e" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 05:45:25.508541 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:25.491021    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5" event={"ID":"0179edc6-8ab0-4668-a77e-5d490d9324a9","Type":"ContainerDied","Data":"7320b0fad880e690c6d268f31f30c4dcc53d3d26e5e64ca26e0e532d1885cf11"}
Nov 04 05:45:25.508541 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:25.505599    4357 scope.go:122] "RemoveContainer" containerID="563efce8ce5da7b68d08e72659c363f732af8836624e5517752958816cac5fd8"
Nov 04 05:45:25.869885 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:25.869839    4357 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-f910f5/simulator-w3-f910f5-kserve-7b898c5797-pgfjz" podUID="9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": context deadline exceeded"
Nov 04 05:45:25.960208 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:25.960161    4357 patch_prober.go:29] interesting pod/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Nov 04 05:45:25.960479 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:25.960448    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48" podUID="54a708a2-3b46-489d-bc33-0954c018f253" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Nov 04 05:45:26.093591 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:26.092748    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5"]
Nov 04 05:45:26.093591 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:26.092842    4357 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-27935d/premium-w0-27935d-kserve-856d6bf896-2zx8h" podUID="f575cbaf-3226-4b7f-8dd8-341f77abb887" containerName="main" probeResult="failure" output="Get \"https://10.133.0.47:8000/ready\": context deadline exceeded"
Nov 04 05:45:26.097538 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:26.096089    4357 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-jn5r5"]
Nov 04 05:45:26.259469 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:26.259432    4357 patch_prober.go:29] interesting pod/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Nov 04 05:45:26.302460 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:26.302413    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt" podUID="33923021-e163-4976-a8bb-f74d79c5220a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Nov 04 05:45:26.724556 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:26.724505    4357 generic.go:356] "Generic (PLEG): container finished" podID="74410632-d803-4ede-89e3-3bc956968fe0" containerID="94a7c62b8d33d26af321a3ab113d03e8207f3099a0b384ece3491b59bc9dc2f9" exitCode=0
Nov 04 05:45:26.725153 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:26.725126    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs" event={"ID":"74410632-d803-4ede-89e3-3bc956968fe0","Type":"ContainerDied","Data":"94a7c62b8d33d26af321a3ab113d03e8207f3099a0b384ece3491b59bc9dc2f9"}
Nov 04 05:45:26.725308 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:26.725290    4357 scope.go:122] "RemoveContainer" containerID="5b039729140d3c8580791af55a16af1ac45e5fbea1791f2a56a83a65b0679f25"
Nov 04 05:45:26.871309 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:26.871264    4357 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-f910f5/simulator-w3-f910f5-kserve-7b898c5797-pgfjz" podUID="9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": context deadline exceeded"
Nov 04 05:45:26.872705 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:26.872680    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-f910f5/simulator-w3-f910f5-kserve-7b898c5797-pgfjz"
Nov 04 05:45:26.943549 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:26.943444    4357 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-9d808e/distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq" podUID="2dd133f2-fc05-4874-b309-cd4b235bf8e9" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 04 05:45:26.961639 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:26.958429    4357 patch_prober.go:29] interesting pod/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Nov 04 05:45:26.961639 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:26.958484    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48" podUID="54a708a2-3b46-489d-bc33-0954c018f253" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Nov 04 05:45:26.961639 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:26.959015    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-f910f5/simulator-w3-f910f5-kserve-7b898c5797-pgfjz"
Nov 04 05:45:27.056117 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.050431    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-27935d-6dffddbb9f-8k6nc"]
Nov 04 05:45:27.141313 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.141283    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs"
Nov 04 05:45:27.223196 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.222429    4357 patch_prober.go:29] interesting pod/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Nov 04 05:45:27.223196 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.222499    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt" podUID="33923021-e163-4976-a8bb-f74d79c5220a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Nov 04 05:45:27.326152 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.326110    4357 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0179edc6-8ab0-4668-a77e-5d490d9324a9" path="/var/lib/kubelet/pods/0179edc6-8ab0-4668-a77e-5d490d9324a9/volumes"
Nov 04 05:45:27.341023 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.340977    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/74410632-d803-4ede-89e3-3bc956968fe0-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74410632-d803-4ede-89e3-3bc956968fe0-istio-envoy\") pod \"74410632-d803-4ede-89e3-3bc956968fe0\" (UID: \"74410632-d803-4ede-89e3-3bc956968fe0\") "
Nov 04 05:45:27.341846 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.341817    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/74410632-d803-4ede-89e3-3bc956968fe0-istio-token\" (UniqueName: \"kubernetes.io/projected/74410632-d803-4ede-89e3-3bc956968fe0-istio-token\") pod \"74410632-d803-4ede-89e3-3bc956968fe0\" (UID: \"74410632-d803-4ede-89e3-3bc956968fe0\") "
Nov 04 05:45:27.342191 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.342167    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/74410632-d803-4ede-89e3-3bc956968fe0-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74410632-d803-4ede-89e3-3bc956968fe0-workload-certs\") pod \"74410632-d803-4ede-89e3-3bc956968fe0\" (UID: \"74410632-d803-4ede-89e3-3bc956968fe0\") "
Nov 04 05:45:27.342487 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.342462    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/74410632-d803-4ede-89e3-3bc956968fe0-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74410632-d803-4ede-89e3-3bc956968fe0-workload-socket\") pod \"74410632-d803-4ede-89e3-3bc956968fe0\" (UID: \"74410632-d803-4ede-89e3-3bc956968fe0\") "
Nov 04 05:45:27.342679 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.342660    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/74410632-d803-4ede-89e3-3bc956968fe0-kube-api-access-86psp\" (UniqueName: \"kubernetes.io/projected/74410632-d803-4ede-89e3-3bc956968fe0-kube-api-access-86psp\") pod \"74410632-d803-4ede-89e3-3bc956968fe0\" (UID: \"74410632-d803-4ede-89e3-3bc956968fe0\") "
Nov 04 05:45:27.342885 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.342869    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/74410632-d803-4ede-89e3-3bc956968fe0-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74410632-d803-4ede-89e3-3bc956968fe0-credential-socket\") pod \"74410632-d803-4ede-89e3-3bc956968fe0\" (UID: \"74410632-d803-4ede-89e3-3bc956968fe0\") "
Nov 04 05:45:27.343083 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.343067    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/74410632-d803-4ede-89e3-3bc956968fe0-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74410632-d803-4ede-89e3-3bc956968fe0-istio-podinfo\") pod \"74410632-d803-4ede-89e3-3bc956968fe0\" (UID: \"74410632-d803-4ede-89e3-3bc956968fe0\") "
Nov 04 05:45:27.343342 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.343313    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/74410632-d803-4ede-89e3-3bc956968fe0-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74410632-d803-4ede-89e3-3bc956968fe0-istiod-ca-cert\") pod \"74410632-d803-4ede-89e3-3bc956968fe0\" (UID: \"74410632-d803-4ede-89e3-3bc956968fe0\") "
Nov 04 05:45:27.343478 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.343464    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/74410632-d803-4ede-89e3-3bc956968fe0-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74410632-d803-4ede-89e3-3bc956968fe0-istio-data\") pod \"74410632-d803-4ede-89e3-3bc956968fe0\" (UID: \"74410632-d803-4ede-89e3-3bc956968fe0\") "
Nov 04 05:45:27.344634 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.344613    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74410632-d803-4ede-89e3-3bc956968fe0-istiod-ca-cert" pod "74410632-d803-4ede-89e3-3bc956968fe0" (UID: "74410632-d803-4ede-89e3-3bc956968fe0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:45:27.352569 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.347696    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74410632-d803-4ede-89e3-3bc956968fe0-istio-data" pod "74410632-d803-4ede-89e3-3bc956968fe0" (UID: "74410632-d803-4ede-89e3-3bc956968fe0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:27.352569 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.348265    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74410632-d803-4ede-89e3-3bc956968fe0-workload-certs" pod "74410632-d803-4ede-89e3-3bc956968fe0" (UID: "74410632-d803-4ede-89e3-3bc956968fe0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:27.352885 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.352865    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74410632-d803-4ede-89e3-3bc956968fe0-workload-socket" pod "74410632-d803-4ede-89e3-3bc956968fe0" (UID: "74410632-d803-4ede-89e3-3bc956968fe0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:27.377169 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.377107    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74410632-d803-4ede-89e3-3bc956968fe0-credential-socket" pod "74410632-d803-4ede-89e3-3bc956968fe0" (UID: "74410632-d803-4ede-89e3-3bc956968fe0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:27.380945 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.380889    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74410632-d803-4ede-89e3-3bc956968fe0-istio-token" pod "74410632-d803-4ede-89e3-3bc956968fe0" (UID: "74410632-d803-4ede-89e3-3bc956968fe0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:27.381223 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.381202    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74410632-d803-4ede-89e3-3bc956968fe0-kube-api-access-86psp" pod "74410632-d803-4ede-89e3-3bc956968fe0" (UID: "74410632-d803-4ede-89e3-3bc956968fe0"). InnerVolumeSpecName "kube-api-access-86psp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:27.432064 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.432024    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/74410632-d803-4ede-89e3-3bc956968fe0-istio-podinfo" pod "74410632-d803-4ede-89e3-3bc956968fe0" (UID: "74410632-d803-4ede-89e3-3bc956968fe0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 05:45:27.432340 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.432314    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74410632-d803-4ede-89e3-3bc956968fe0-istio-envoy" pod "74410632-d803-4ede-89e3-3bc956968fe0" (UID: "74410632-d803-4ede-89e3-3bc956968fe0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:27.452536 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.447397    4357 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74410632-d803-4ede-89e3-3bc956968fe0-istiod-ca-cert\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:27.452536 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.447440    4357 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74410632-d803-4ede-89e3-3bc956968fe0-istio-data\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:27.452536 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.447456    4357 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74410632-d803-4ede-89e3-3bc956968fe0-istio-envoy\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:27.452536 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.447469    4357 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74410632-d803-4ede-89e3-3bc956968fe0-istio-token\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:27.452536 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.447482    4357 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74410632-d803-4ede-89e3-3bc956968fe0-workload-certs\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:27.452536 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.447496    4357 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74410632-d803-4ede-89e3-3bc956968fe0-workload-socket\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:27.452536 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.447529    4357 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86psp\" (UniqueName: \"kubernetes.io/projected/74410632-d803-4ede-89e3-3bc956968fe0-kube-api-access-86psp\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:27.452536 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.447546    4357 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74410632-d803-4ede-89e3-3bc956968fe0-credential-socket\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:27.452536 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.447559    4357 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74410632-d803-4ede-89e3-3bc956968fe0-istio-podinfo\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:27.727251 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.727215    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-93ee4734-c57px"]
Nov 04 05:45:27.727809 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.727791    4357 cpu_manager.go:414] "containerMap: removing container" podUID="0179edc6-8ab0-4668-a77e-5d490d9324a9" containerName="istio-proxy"
Nov 04 05:45:27.727809 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.727809    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0179edc6-8ab0-4668-a77e-5d490d9324a9" containerName="istio-proxy"
Nov 04 05:45:27.727942 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.727824    4357 cpu_manager.go:414] "containerMap: removing container" podUID="a6c5f359-cad7-401a-9bd4-fc8e13b43910" containerName="main"
Nov 04 05:45:27.727942 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.727829    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a6c5f359-cad7-401a-9bd4-fc8e13b43910" containerName="main"
Nov 04 05:45:27.727942 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.727845    4357 cpu_manager.go:414] "containerMap: removing container" podUID="74410632-d803-4ede-89e3-3bc956968fe0" containerName="istio-proxy"
Nov 04 05:45:27.727942 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.727852    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="74410632-d803-4ede-89e3-3bc956968fe0" containerName="istio-proxy"
Nov 04 05:45:27.727942 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.727862    4357 cpu_manager.go:414] "containerMap: removing container" podUID="74410632-d803-4ede-89e3-3bc956968fe0" containerName="istio-proxy"
Nov 04 05:45:27.727942 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.727869    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="74410632-d803-4ede-89e3-3bc956968fe0" containerName="istio-proxy"
Nov 04 05:45:27.728146 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.727983    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="0179edc6-8ab0-4668-a77e-5d490d9324a9" containerName="istio-proxy"
Nov 04 05:45:27.728146 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.727998    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="a6c5f359-cad7-401a-9bd4-fc8e13b43910" containerName="main"
Nov 04 05:45:27.728146 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.728009    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="74410632-d803-4ede-89e3-3bc956968fe0" containerName="istio-proxy"
Nov 04 05:45:27.728146 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.728018    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="74410632-d803-4ede-89e3-3bc956968fe0" containerName="istio-proxy"
Nov 04 05:45:27.734326 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.734301    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-93ee4734-c57px"]
Nov 04 05:45:27.734444 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.734416    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-93ee4734-c57px"
Nov 04 05:45:27.806539 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.804720    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 04 05:45:27.851424 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.851383    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/635c7d18-aa04-4703-b5f5-5cc0958f5bf3-maas-api-xks-ca\") pod \"maas-api-revoke-sub-93ee4734-c57px\" (UID: \"635c7d18-aa04-4703-b5f5-5cc0958f5bf3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-93ee4734-c57px"
Nov 04 05:45:27.851652 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.851497    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rjjc\" (UniqueName: \"kubernetes.io/projected/635c7d18-aa04-4703-b5f5-5cc0958f5bf3-kube-api-access-9rjjc\") pod \"maas-api-revoke-sub-93ee4734-c57px\" (UID: \"635c7d18-aa04-4703-b5f5-5cc0958f5bf3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-93ee4734-c57px"
Nov 04 05:45:27.851652 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.851627    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/635c7d18-aa04-4703-b5f5-5cc0958f5bf3-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-93ee4734-c57px\" (UID: \"635c7d18-aa04-4703-b5f5-5cc0958f5bf3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-93ee4734-c57px"
Nov 04 05:45:27.948039 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.948000    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs" event={"ID":"74410632-d803-4ede-89e3-3bc956968fe0","Type":"ContainerDied","Data":"e472d20eb7c6f766222c731c527cf273098cbb97e72c8f100a763a8e2aabad13"}
Nov 04 05:45:27.948039 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.948038    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs"
Nov 04 05:45:27.948241 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.948075    4357 scope.go:122] "RemoveContainer" containerID="94a7c62b8d33d26af321a3ab113d03e8207f3099a0b384ece3491b59bc9dc2f9"
Nov 04 05:45:27.952444 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.952416    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rjjc\" (UniqueName: \"kubernetes.io/projected/635c7d18-aa04-4703-b5f5-5cc0958f5bf3-kube-api-access-9rjjc\") pod \"maas-api-revoke-sub-93ee4734-c57px\" (UID: \"635c7d18-aa04-4703-b5f5-5cc0958f5bf3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-93ee4734-c57px"
Nov 04 05:45:27.952571 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.952545    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/635c7d18-aa04-4703-b5f5-5cc0958f5bf3-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-93ee4734-c57px\" (UID: \"635c7d18-aa04-4703-b5f5-5cc0958f5bf3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-93ee4734-c57px"
Nov 04 05:45:27.953372 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.953348    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/635c7d18-aa04-4703-b5f5-5cc0958f5bf3-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-93ee4734-c57px\" (UID: \"635c7d18-aa04-4703-b5f5-5cc0958f5bf3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-93ee4734-c57px"
Nov 04 05:45:27.953915 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.953502    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/635c7d18-aa04-4703-b5f5-5cc0958f5bf3-maas-api-xks-ca\") pod \"maas-api-revoke-sub-93ee4734-c57px\" (UID: \"635c7d18-aa04-4703-b5f5-5cc0958f5bf3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-93ee4734-c57px"
Nov 04 05:45:27.955800 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.955774    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/635c7d18-aa04-4703-b5f5-5cc0958f5bf3-maas-api-xks-ca\") pod \"maas-api-revoke-sub-93ee4734-c57px\" (UID: \"635c7d18-aa04-4703-b5f5-5cc0958f5bf3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-93ee4734-c57px"
Nov 04 05:45:27.957170 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.957150    4357 patch_prober.go:29] interesting pod/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Nov 04 05:45:27.957238 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.957189    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48" podUID="54a708a2-3b46-489d-bc33-0954c018f253" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Nov 04 05:45:27.984581 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:27.983847    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rjjc\" (UniqueName: \"kubernetes.io/projected/635c7d18-aa04-4703-b5f5-5cc0958f5bf3-kube-api-access-9rjjc\") pod \"maas-api-revoke-sub-93ee4734-c57px\" (UID: \"635c7d18-aa04-4703-b5f5-5cc0958f5bf3\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-93ee4734-c57px"
Nov 04 05:45:28.021357 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:28.021325    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs"]
Nov 04 05:45:28.029535 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:28.029210    4357 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-bx2rs"]
Nov 04 05:45:28.052441 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:28.052414    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-93ee4734-c57px"
Nov 04 05:45:28.223550 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:28.220857    4357 patch_prober.go:29] interesting pod/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Nov 04 05:45:28.223550 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:28.220919    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt" podUID="33923021-e163-4976-a8bb-f74d79c5220a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Nov 04 05:45:28.416561 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:28.415351    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-93ee4734-c57px"]
Nov 04 05:45:28.418926 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:45:28.418895    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod635c7d18_aa04_4703_b5f5_5cc0958f5bf3.slice/crio-fb162fe428379767f1a03d47cb7b8a3d568b1287b84586579f8e00d039a12d87 WatchSource:0}: Error finding container fb162fe428379767f1a03d47cb7b8a3d568b1287b84586579f8e00d039a12d87: Status 404 returned error can't find the container with id fb162fe428379767f1a03d47cb7b8a3d568b1287b84586579f8e00d039a12d87
Nov 04 05:45:28.829551 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:28.821246    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-f910f5-58ddd75998-7rkwk"]
Nov 04 05:45:28.922909 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:28.922641    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-f910f5-668ff7855-g8p5s"]
Nov 04 05:45:28.956104 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:28.956067    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-93ee4734-c57px" event={"ID":"635c7d18-aa04-4703-b5f5-5cc0958f5bf3","Type":"ContainerStarted","Data":"fb162fe428379767f1a03d47cb7b8a3d568b1287b84586579f8e00d039a12d87"}
Nov 04 05:45:28.958657 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:28.958634    4357 patch_prober.go:29] interesting pod/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Nov 04 05:45:28.958765 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:28.958676    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48" podUID="54a708a2-3b46-489d-bc33-0954c018f253" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Nov 04 05:45:29.236606 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:29.221535    4357 patch_prober.go:29] interesting pod/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Nov 04 05:45:29.236989 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:29.236841    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt" podUID="33923021-e163-4976-a8bb-f74d79c5220a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Nov 04 05:45:29.442738 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:29.442702    4357 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="74410632-d803-4ede-89e3-3bc956968fe0" path="/var/lib/kubelet/pods/74410632-d803-4ede-89e3-3bc956968fe0/volumes"
Nov 04 05:45:29.957623 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:29.957528    4357 patch_prober.go:29] interesting pod/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Nov 04 05:45:29.957623 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:29.957591    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48" podUID="54a708a2-3b46-489d-bc33-0954c018f253" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Nov 04 05:45:29.965947 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:29.965922    4357 generic.go:356] "Generic (PLEG): container finished" podID="635c7d18-aa04-4703-b5f5-5cc0958f5bf3" containerID="07d9be8e43cc50d21e7bdccc729f5b6bd6a988020dcc0a17b8e1e981d8fa3044" exitCode=0
Nov 04 05:45:29.966056 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:29.966008    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-93ee4734-c57px" event={"ID":"635c7d18-aa04-4703-b5f5-5cc0958f5bf3","Type":"ContainerDied","Data":"07d9be8e43cc50d21e7bdccc729f5b6bd6a988020dcc0a17b8e1e981d8fa3044"}
Nov 04 05:45:30.220821 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.220740    4357 patch_prober.go:29] interesting pod/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Nov 04 05:45:30.220981 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.220809    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt" podUID="33923021-e163-4976-a8bb-f74d79c5220a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Nov 04 05:45:30.246590 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.246557    4357 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-27935d/premium-w0-27935d-kserve-856d6bf896-2zx8h" podUID="f575cbaf-3226-4b7f-8dd8-341f77abb887" containerName="main" containerID="cri-o://3db205646ce60e900b442626a51ee41e4005ddf4f2ad8d426a7a5c92245e889f" gracePeriod=45
Nov 04 05:45:30.526429 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.526400    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-27935d/premium-w0-27935d-kserve-856d6bf896-2zx8h"
Nov 04 05:45:30.536431 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.536403    4357 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-f910f5/simulator-w3-f910f5-kserve-7b898c5797-pgfjz" podUID="9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e" containerName="main" containerID="cri-o://cf2b293d4618287b19330ebf869625b210a5f751e5ba390b80404388668872d5" gracePeriod=45
Nov 04 05:45:30.567264 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.567237    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f575cbaf-3226-4b7f-8dd8-341f77abb887-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f575cbaf-3226-4b7f-8dd8-341f77abb887-model-cache\") pod \"f575cbaf-3226-4b7f-8dd8-341f77abb887\" (UID: \"f575cbaf-3226-4b7f-8dd8-341f77abb887\") "
Nov 04 05:45:30.567364 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.567282    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f575cbaf-3226-4b7f-8dd8-341f77abb887-home\" (UniqueName: \"kubernetes.io/empty-dir/f575cbaf-3226-4b7f-8dd8-341f77abb887-home\") pod \"f575cbaf-3226-4b7f-8dd8-341f77abb887\" (UID: \"f575cbaf-3226-4b7f-8dd8-341f77abb887\") "
Nov 04 05:45:30.567431 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.567380    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f575cbaf-3226-4b7f-8dd8-341f77abb887-kube-api-access-b6p82\" (UniqueName: \"kubernetes.io/projected/f575cbaf-3226-4b7f-8dd8-341f77abb887-kube-api-access-b6p82\") pod \"f575cbaf-3226-4b7f-8dd8-341f77abb887\" (UID: \"f575cbaf-3226-4b7f-8dd8-341f77abb887\") "
Nov 04 05:45:30.567555 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.567462    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f575cbaf-3226-4b7f-8dd8-341f77abb887-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f575cbaf-3226-4b7f-8dd8-341f77abb887-tmp-dir\") pod \"f575cbaf-3226-4b7f-8dd8-341f77abb887\" (UID: \"f575cbaf-3226-4b7f-8dd8-341f77abb887\") "
Nov 04 05:45:30.567555 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.567503    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f575cbaf-3226-4b7f-8dd8-341f77abb887-model-cache" pod "f575cbaf-3226-4b7f-8dd8-341f77abb887" (UID: "f575cbaf-3226-4b7f-8dd8-341f77abb887"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:30.567661 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.567540    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f575cbaf-3226-4b7f-8dd8-341f77abb887-tls-certs\" (UniqueName: \"kubernetes.io/secret/f575cbaf-3226-4b7f-8dd8-341f77abb887-tls-certs\") pod \"f575cbaf-3226-4b7f-8dd8-341f77abb887\" (UID: \"f575cbaf-3226-4b7f-8dd8-341f77abb887\") "
Nov 04 05:45:30.567661 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.567598    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f575cbaf-3226-4b7f-8dd8-341f77abb887-dshm\" (UniqueName: \"kubernetes.io/empty-dir/f575cbaf-3226-4b7f-8dd8-341f77abb887-dshm\") pod \"f575cbaf-3226-4b7f-8dd8-341f77abb887\" (UID: \"f575cbaf-3226-4b7f-8dd8-341f77abb887\") "
Nov 04 05:45:30.568284 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.568007    4357 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f575cbaf-3226-4b7f-8dd8-341f77abb887-model-cache\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:30.568785 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.568738    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f575cbaf-3226-4b7f-8dd8-341f77abb887-home" pod "f575cbaf-3226-4b7f-8dd8-341f77abb887" (UID: "f575cbaf-3226-4b7f-8dd8-341f77abb887"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:30.569169 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.569118    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f575cbaf-3226-4b7f-8dd8-341f77abb887-tmp-dir" pod "f575cbaf-3226-4b7f-8dd8-341f77abb887" (UID: "f575cbaf-3226-4b7f-8dd8-341f77abb887"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:30.570133 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.570106    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f575cbaf-3226-4b7f-8dd8-341f77abb887-tls-certs" pod "f575cbaf-3226-4b7f-8dd8-341f77abb887" (UID: "f575cbaf-3226-4b7f-8dd8-341f77abb887"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:45:30.570238 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.570214    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f575cbaf-3226-4b7f-8dd8-341f77abb887-kube-api-access-b6p82" pod "f575cbaf-3226-4b7f-8dd8-341f77abb887" (UID: "f575cbaf-3226-4b7f-8dd8-341f77abb887"). InnerVolumeSpecName "kube-api-access-b6p82". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:30.570553 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.570503    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f575cbaf-3226-4b7f-8dd8-341f77abb887-dshm" pod "f575cbaf-3226-4b7f-8dd8-341f77abb887" (UID: "f575cbaf-3226-4b7f-8dd8-341f77abb887"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:30.675031 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.670319    4357 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6p82\" (UniqueName: \"kubernetes.io/projected/f575cbaf-3226-4b7f-8dd8-341f77abb887-kube-api-access-b6p82\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:30.675031 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.670357    4357 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f575cbaf-3226-4b7f-8dd8-341f77abb887-tmp-dir\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:30.675031 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.670373    4357 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f575cbaf-3226-4b7f-8dd8-341f77abb887-tls-certs\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:30.675031 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.670386    4357 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f575cbaf-3226-4b7f-8dd8-341f77abb887-dshm\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:30.675031 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.670399    4357 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f575cbaf-3226-4b7f-8dd8-341f77abb887-home\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:30.833922 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.831981    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-f910f5/simulator-w3-f910f5-kserve-7b898c5797-pgfjz"
Nov 04 05:45:30.973741 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.973705    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e-tls-certs\" (UniqueName: \"kubernetes.io/secret/9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e-tls-certs\") pod \"9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e\" (UID: \"9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e\") "
Nov 04 05:45:30.974205 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.973769    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e-kube-api-access-h2lg7\" (UniqueName: \"kubernetes.io/projected/9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e-kube-api-access-h2lg7\") pod \"9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e\" (UID: \"9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e\") "
Nov 04 05:45:30.974205 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.973886    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e-dshm\" (UniqueName: \"kubernetes.io/empty-dir/9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e-dshm\") pod \"9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e\" (UID: \"9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e\") "
Nov 04 05:45:30.976638 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.975494    4357 generic.go:356] "Generic (PLEG): container finished" podID="f575cbaf-3226-4b7f-8dd8-341f77abb887" containerID="3db205646ce60e900b442626a51ee41e4005ddf4f2ad8d426a7a5c92245e889f" exitCode=0
Nov 04 05:45:30.976638 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.975600    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-27935d/premium-w0-27935d-kserve-856d6bf896-2zx8h" event={"ID":"f575cbaf-3226-4b7f-8dd8-341f77abb887","Type":"ContainerDied","Data":"3db205646ce60e900b442626a51ee41e4005ddf4f2ad8d426a7a5c92245e889f"}
Nov 04 05:45:30.976638 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.975640    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-27935d/premium-w0-27935d-kserve-856d6bf896-2zx8h" event={"ID":"f575cbaf-3226-4b7f-8dd8-341f77abb887","Type":"ContainerDied","Data":"72999c49b4e82057130b98364d969de3ad4890ce8f76efc37ec9d4762c2a96ae"}
Nov 04 05:45:30.976638 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.975680    4357 scope.go:122] "RemoveContainer" containerID="3db205646ce60e900b442626a51ee41e4005ddf4f2ad8d426a7a5c92245e889f"
Nov 04 05:45:30.976638 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.975805    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-27935d/premium-w0-27935d-kserve-856d6bf896-2zx8h"
Nov 04 05:45:30.979856 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.978332    4357 generic.go:356] "Generic (PLEG): container finished" podID="9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e" containerID="cf2b293d4618287b19330ebf869625b210a5f751e5ba390b80404388668872d5" exitCode=0
Nov 04 05:45:30.979856 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.978373    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-f910f5/simulator-w3-f910f5-kserve-7b898c5797-pgfjz"
Nov 04 05:45:30.979856 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.978446    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-f910f5/simulator-w3-f910f5-kserve-7b898c5797-pgfjz" event={"ID":"9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e","Type":"ContainerDied","Data":"cf2b293d4618287b19330ebf869625b210a5f751e5ba390b80404388668872d5"}
Nov 04 05:45:30.979856 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.978478    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-f910f5/simulator-w3-f910f5-kserve-7b898c5797-pgfjz" event={"ID":"9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e","Type":"ContainerDied","Data":"9a5e2d12d38606931ab36d22ed01f37541c244f9837f61135dd65718407c6d8c"}
Nov 04 05:45:30.980253 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.980167    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e-tmp-dir" pod "9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e" (UID: "9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:30.990432 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.990409    4357 scope.go:122] "RemoveContainer" containerID="3db205646ce60e900b442626a51ee41e4005ddf4f2ad8d426a7a5c92245e889f"
Nov 04 05:45:30.990833 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:45:30.990805    4357 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3db205646ce60e900b442626a51ee41e4005ddf4f2ad8d426a7a5c92245e889f\": container with ID starting with 3db205646ce60e900b442626a51ee41e4005ddf4f2ad8d426a7a5c92245e889f not found: ID does not exist" containerID="3db205646ce60e900b442626a51ee41e4005ddf4f2ad8d426a7a5c92245e889f"
Nov 04 05:45:30.990921 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.990845    4357 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3db205646ce60e900b442626a51ee41e4005ddf4f2ad8d426a7a5c92245e889f"} err="failed to get container status \"3db205646ce60e900b442626a51ee41e4005ddf4f2ad8d426a7a5c92245e889f\": rpc error: code = NotFound desc = could not find container \"3db205646ce60e900b442626a51ee41e4005ddf4f2ad8d426a7a5c92245e889f\": container with ID starting with 3db205646ce60e900b442626a51ee41e4005ddf4f2ad8d426a7a5c92245e889f not found: ID does not exist"
Nov 04 05:45:30.990921 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.990868    4357 scope.go:122] "RemoveContainer" containerID="cf2b293d4618287b19330ebf869625b210a5f751e5ba390b80404388668872d5"
Nov 04 05:45:30.991700 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.991164    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e-tmp-dir\") pod \"9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e\" (UID: \"9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e\") "
Nov 04 05:45:30.991700 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.991249    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e-home\" (UniqueName: \"kubernetes.io/empty-dir/9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e-home\") pod \"9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e\" (UID: \"9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e\") "
Nov 04 05:45:30.991700 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.991302    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e-model-cache\") pod \"9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e\" (UID: \"9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e\") "
Nov 04 05:45:30.991912 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.991804    4357 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e-tmp-dir\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:30.992059 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.992021    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e-home" pod "9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e" (UID: "9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:30.992059 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.992031    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e-model-cache" pod "9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e" (UID: "9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:30.992566 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.992382    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e-dshm" pod "9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e" (UID: "9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:30.992566 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.992508    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e-kube-api-access-h2lg7" pod "9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e" (UID: "9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e"). InnerVolumeSpecName "kube-api-access-h2lg7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:30.994860 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:30.994830    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e-tls-certs" pod "9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e" (UID: "9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:45:31.007813 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:31.007784    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-27935d/premium-w0-27935d-kserve-856d6bf896-2zx8h"]
Nov 04 05:45:31.008843 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:31.008821    4357 scope.go:122] "RemoveContainer" containerID="cf2b293d4618287b19330ebf869625b210a5f751e5ba390b80404388668872d5"
Nov 04 05:45:31.009287 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:45:31.009200    4357 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf2b293d4618287b19330ebf869625b210a5f751e5ba390b80404388668872d5\": container with ID starting with cf2b293d4618287b19330ebf869625b210a5f751e5ba390b80404388668872d5 not found: ID does not exist" containerID="cf2b293d4618287b19330ebf869625b210a5f751e5ba390b80404388668872d5"
Nov 04 05:45:31.009287 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:31.009234    4357 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf2b293d4618287b19330ebf869625b210a5f751e5ba390b80404388668872d5"} err="failed to get container status \"cf2b293d4618287b19330ebf869625b210a5f751e5ba390b80404388668872d5\": rpc error: code = NotFound desc = could not find container \"cf2b293d4618287b19330ebf869625b210a5f751e5ba390b80404388668872d5\": container with ID starting with cf2b293d4618287b19330ebf869625b210a5f751e5ba390b80404388668872d5 not found: ID does not exist"
Nov 04 05:45:31.011964 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:31.011942    4357 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-27935d/premium-w0-27935d-kserve-856d6bf896-2zx8h"]
Nov 04 05:45:31.093991 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:31.093801    4357 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e-tls-certs\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:31.093991 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:31.093838    4357 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2lg7\" (UniqueName: \"kubernetes.io/projected/9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e-kube-api-access-h2lg7\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:31.093991 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:31.093855    4357 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e-dshm\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:31.093991 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:31.093870    4357 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e-home\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:31.093991 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:31.093883    4357 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e-model-cache\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:31.127656 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:31.127634    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-93ee4734-c57px"
Nov 04 05:45:31.194530 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:31.194477    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/635c7d18-aa04-4703-b5f5-5cc0958f5bf3-kube-api-access-9rjjc\" (UniqueName: \"kubernetes.io/projected/635c7d18-aa04-4703-b5f5-5cc0958f5bf3-kube-api-access-9rjjc\") pod \"635c7d18-aa04-4703-b5f5-5cc0958f5bf3\" (UID: \"635c7d18-aa04-4703-b5f5-5cc0958f5bf3\") "
Nov 04 05:45:31.194706 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:31.194581    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/635c7d18-aa04-4703-b5f5-5cc0958f5bf3-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/635c7d18-aa04-4703-b5f5-5cc0958f5bf3-maas-api-openshift-ca\") pod \"635c7d18-aa04-4703-b5f5-5cc0958f5bf3\" (UID: \"635c7d18-aa04-4703-b5f5-5cc0958f5bf3\") "
Nov 04 05:45:31.194706 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:31.194652    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/635c7d18-aa04-4703-b5f5-5cc0958f5bf3-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/635c7d18-aa04-4703-b5f5-5cc0958f5bf3-maas-api-xks-ca\") pod \"635c7d18-aa04-4703-b5f5-5cc0958f5bf3\" (UID: \"635c7d18-aa04-4703-b5f5-5cc0958f5bf3\") "
Nov 04 05:45:31.195179 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:31.195132    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/635c7d18-aa04-4703-b5f5-5cc0958f5bf3-maas-api-openshift-ca" pod "635c7d18-aa04-4703-b5f5-5cc0958f5bf3" (UID: "635c7d18-aa04-4703-b5f5-5cc0958f5bf3"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:45:31.196990 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:31.196958    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/635c7d18-aa04-4703-b5f5-5cc0958f5bf3-kube-api-access-9rjjc" pod "635c7d18-aa04-4703-b5f5-5cc0958f5bf3" (UID: "635c7d18-aa04-4703-b5f5-5cc0958f5bf3"). InnerVolumeSpecName "kube-api-access-9rjjc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:31.198103 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:31.198076    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/635c7d18-aa04-4703-b5f5-5cc0958f5bf3-maas-api-xks-ca" pod "635c7d18-aa04-4703-b5f5-5cc0958f5bf3" (UID: "635c7d18-aa04-4703-b5f5-5cc0958f5bf3"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:45:31.278374 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:31.278337    4357 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f575cbaf-3226-4b7f-8dd8-341f77abb887" path="/var/lib/kubelet/pods/f575cbaf-3226-4b7f-8dd8-341f77abb887/volumes"
Nov 04 05:45:31.300371 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:31.299611    4357 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rjjc\" (UniqueName: \"kubernetes.io/projected/635c7d18-aa04-4703-b5f5-5cc0958f5bf3-kube-api-access-9rjjc\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:31.300371 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:31.299644    4357 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/635c7d18-aa04-4703-b5f5-5cc0958f5bf3-maas-api-openshift-ca\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:31.300371 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:31.299660    4357 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/635c7d18-aa04-4703-b5f5-5cc0958f5bf3-maas-api-xks-ca\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:31.316961 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:31.316930    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-f910f5/simulator-w3-f910f5-kserve-7b898c5797-pgfjz"]
Nov 04 05:45:31.323487 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:31.323402    4357 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-f910f5/simulator-w3-f910f5-kserve-7b898c5797-pgfjz"]
Nov 04 05:45:31.434599 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:31.434484    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt"
Nov 04 05:45:31.435311 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:31.435287    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt"
Nov 04 05:45:31.435997 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:31.435975    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt"
Nov 04 05:45:31.823543 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:31.820555    4357 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-f910f5/simulator-w3-f910f5-kserve-7b898c5797-pgfjz" podUID="9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 04 05:45:31.850660 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:31.850615    4357 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-9d808e/distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq" podUID="2dd133f2-fc05-4874-b309-cd4b235bf8e9" containerName="main" containerID="cri-o://f441e327974cbbe0748d9ec6a90f6cd1dc1d303dcd239344dc69785666df61b5" gracePeriod=45
Nov 04 05:45:31.883257 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:31.883196    4357 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-9d808e/simulator-w5-9d808e-kserve-bccd5db46-88b5x" podUID="f6f1cb38-ae78-424c-ba8a-dd470888a1b1" containerName="main" containerID="cri-o://07898a5c9ea11c0ce89bb434f8ccec8d49d69feb107397a9fde5d7f1a3d340ea" gracePeriod=45
Nov 04 05:45:31.890255 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:31.890220    4357 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-9d808e/simulator-w5-9d808e-kserve-bccd5db46-88b5x" podUID="f6f1cb38-ae78-424c-ba8a-dd470888a1b1" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": dial tcp 10.133.0.46:8000: connect: connection refused"
Nov 04 05:45:31.890803 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:31.890776    4357 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-9d808e/distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq" podUID="2dd133f2-fc05-4874-b309-cd4b235bf8e9" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": dial tcp 10.133.0.55:8000: connect: connection refused"
Nov 04 05:45:31.986971 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:31.986944    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-93ee4734-c57px"
Nov 04 05:45:31.987375 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:31.986952    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-93ee4734-c57px" event={"ID":"635c7d18-aa04-4703-b5f5-5cc0958f5bf3","Type":"ContainerDied","Data":"fb162fe428379767f1a03d47cb7b8a3d568b1287b84586579f8e00d039a12d87"}
Nov 04 05:45:31.987375 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:31.987217    4357 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fb162fe428379767f1a03d47cb7b8a3d568b1287b84586579f8e00d039a12d87"
Nov 04 05:45:31.989988 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:31.989859    4357 generic.go:356] "Generic (PLEG): container finished" podID="2dd133f2-fc05-4874-b309-cd4b235bf8e9" containerID="f441e327974cbbe0748d9ec6a90f6cd1dc1d303dcd239344dc69785666df61b5" exitCode=0
Nov 04 05:45:31.990088 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:31.989999    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-9d808e/distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq" event={"ID":"2dd133f2-fc05-4874-b309-cd4b235bf8e9","Type":"ContainerDied","Data":"f441e327974cbbe0748d9ec6a90f6cd1dc1d303dcd239344dc69785666df61b5"}
Nov 04 05:45:32.005943 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:32.005640    4357 patch_prober.go:29] interesting pod/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 04 05:45:32.005943 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:32.005688    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48" podUID="54a708a2-3b46-489d-bc33-0954c018f253" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 04 05:45:32.051463 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:32.051187    4357 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-27935d-6dffddbb9f-8k6nc" podUID="5ed67653-cc0f-4000-aa56-edd9d733b025" containerName="payload-pre-processing" containerID="cri-o://926bbda821115dc3e4fe8c35c17083b064dd5f8c0d59ce7d82e3bd159709f8b5" gracePeriod=25
Nov 04 05:45:32.188538 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:32.179459    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-9d808e/distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq"
Nov 04 05:45:32.237541 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:32.232965    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2dd133f2-fc05-4874-b309-cd4b235bf8e9-home\" (UniqueName: \"kubernetes.io/empty-dir/2dd133f2-fc05-4874-b309-cd4b235bf8e9-home\") pod \"2dd133f2-fc05-4874-b309-cd4b235bf8e9\" (UID: \"2dd133f2-fc05-4874-b309-cd4b235bf8e9\") "
Nov 04 05:45:32.237541 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:32.233032    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2dd133f2-fc05-4874-b309-cd4b235bf8e9-dshm\" (UniqueName: \"kubernetes.io/empty-dir/2dd133f2-fc05-4874-b309-cd4b235bf8e9-dshm\") pod \"2dd133f2-fc05-4874-b309-cd4b235bf8e9\" (UID: \"2dd133f2-fc05-4874-b309-cd4b235bf8e9\") "
Nov 04 05:45:32.237541 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:32.233073    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2dd133f2-fc05-4874-b309-cd4b235bf8e9-kube-api-access-8cz2m\" (UniqueName: \"kubernetes.io/projected/2dd133f2-fc05-4874-b309-cd4b235bf8e9-kube-api-access-8cz2m\") pod \"2dd133f2-fc05-4874-b309-cd4b235bf8e9\" (UID: \"2dd133f2-fc05-4874-b309-cd4b235bf8e9\") "
Nov 04 05:45:32.237541 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:32.233183    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2dd133f2-fc05-4874-b309-cd4b235bf8e9-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2dd133f2-fc05-4874-b309-cd4b235bf8e9-model-cache\") pod \"2dd133f2-fc05-4874-b309-cd4b235bf8e9\" (UID: \"2dd133f2-fc05-4874-b309-cd4b235bf8e9\") "
Nov 04 05:45:32.237541 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:32.233236    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2dd133f2-fc05-4874-b309-cd4b235bf8e9-tls-certs\" (UniqueName: \"kubernetes.io/secret/2dd133f2-fc05-4874-b309-cd4b235bf8e9-tls-certs\") pod \"2dd133f2-fc05-4874-b309-cd4b235bf8e9\" (UID: \"2dd133f2-fc05-4874-b309-cd4b235bf8e9\") "
Nov 04 05:45:32.237541 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:32.233288    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2dd133f2-fc05-4874-b309-cd4b235bf8e9-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2dd133f2-fc05-4874-b309-cd4b235bf8e9-tmp-dir\") pod \"2dd133f2-fc05-4874-b309-cd4b235bf8e9\" (UID: \"2dd133f2-fc05-4874-b309-cd4b235bf8e9\") "
Nov 04 05:45:32.237541 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:32.233907    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2dd133f2-fc05-4874-b309-cd4b235bf8e9-tmp-dir" pod "2dd133f2-fc05-4874-b309-cd4b235bf8e9" (UID: "2dd133f2-fc05-4874-b309-cd4b235bf8e9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:32.237541 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:32.236128    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2dd133f2-fc05-4874-b309-cd4b235bf8e9-home" pod "2dd133f2-fc05-4874-b309-cd4b235bf8e9" (UID: "2dd133f2-fc05-4874-b309-cd4b235bf8e9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:32.237541 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:32.236189    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2dd133f2-fc05-4874-b309-cd4b235bf8e9-model-cache" pod "2dd133f2-fc05-4874-b309-cd4b235bf8e9" (UID: "2dd133f2-fc05-4874-b309-cd4b235bf8e9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:32.239635 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:32.239334    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2dd133f2-fc05-4874-b309-cd4b235bf8e9-tls-certs" pod "2dd133f2-fc05-4874-b309-cd4b235bf8e9" (UID: "2dd133f2-fc05-4874-b309-cd4b235bf8e9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:45:32.239635 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:32.239553    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2dd133f2-fc05-4874-b309-cd4b235bf8e9-dshm" pod "2dd133f2-fc05-4874-b309-cd4b235bf8e9" (UID: "2dd133f2-fc05-4874-b309-cd4b235bf8e9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:32.239999 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:32.239914    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2dd133f2-fc05-4874-b309-cd4b235bf8e9-kube-api-access-8cz2m" pod "2dd133f2-fc05-4874-b309-cd4b235bf8e9" (UID: "2dd133f2-fc05-4874-b309-cd4b235bf8e9"). InnerVolumeSpecName "kube-api-access-8cz2m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:32.249227 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:32.249207    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-9d808e/simulator-w5-9d808e-kserve-bccd5db46-88b5x"
Nov 04 05:45:32.334451 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:32.334370    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f6f1cb38-ae78-424c-ba8a-dd470888a1b1-home\" (UniqueName: \"kubernetes.io/empty-dir/f6f1cb38-ae78-424c-ba8a-dd470888a1b1-home\") pod \"f6f1cb38-ae78-424c-ba8a-dd470888a1b1\" (UID: \"f6f1cb38-ae78-424c-ba8a-dd470888a1b1\") "
Nov 04 05:45:32.334628 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:32.334459    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f6f1cb38-ae78-424c-ba8a-dd470888a1b1-kube-api-access-p82cw\" (UniqueName: \"kubernetes.io/projected/f6f1cb38-ae78-424c-ba8a-dd470888a1b1-kube-api-access-p82cw\") pod \"f6f1cb38-ae78-424c-ba8a-dd470888a1b1\" (UID: \"f6f1cb38-ae78-424c-ba8a-dd470888a1b1\") "
Nov 04 05:45:32.334628 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:32.334578    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f6f1cb38-ae78-424c-ba8a-dd470888a1b1-tls-certs\" (UniqueName: \"kubernetes.io/secret/f6f1cb38-ae78-424c-ba8a-dd470888a1b1-tls-certs\") pod \"f6f1cb38-ae78-424c-ba8a-dd470888a1b1\" (UID: \"f6f1cb38-ae78-424c-ba8a-dd470888a1b1\") "
Nov 04 05:45:32.334755 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:32.334657    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f6f1cb38-ae78-424c-ba8a-dd470888a1b1-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6f1cb38-ae78-424c-ba8a-dd470888a1b1-model-cache\") pod \"f6f1cb38-ae78-424c-ba8a-dd470888a1b1\" (UID: \"f6f1cb38-ae78-424c-ba8a-dd470888a1b1\") "
Nov 04 05:45:32.334813 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:32.334764    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f6f1cb38-ae78-424c-ba8a-dd470888a1b1-dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6f1cb38-ae78-424c-ba8a-dd470888a1b1-dshm\") pod \"f6f1cb38-ae78-424c-ba8a-dd470888a1b1\" (UID: \"f6f1cb38-ae78-424c-ba8a-dd470888a1b1\") "
Nov 04 05:45:32.334813 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:32.334808    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f6f1cb38-ae78-424c-ba8a-dd470888a1b1-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6f1cb38-ae78-424c-ba8a-dd470888a1b1-tmp-dir\") pod \"f6f1cb38-ae78-424c-ba8a-dd470888a1b1\" (UID: \"f6f1cb38-ae78-424c-ba8a-dd470888a1b1\") "
Nov 04 05:45:32.334925 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:32.334845    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6f1cb38-ae78-424c-ba8a-dd470888a1b1-home" pod "f6f1cb38-ae78-424c-ba8a-dd470888a1b1" (UID: "f6f1cb38-ae78-424c-ba8a-dd470888a1b1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:32.335074 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:32.335044    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6f1cb38-ae78-424c-ba8a-dd470888a1b1-model-cache" pod "f6f1cb38-ae78-424c-ba8a-dd470888a1b1" (UID: "f6f1cb38-ae78-424c-ba8a-dd470888a1b1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:32.335756 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:32.335729    4357 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6f1cb38-ae78-424c-ba8a-dd470888a1b1-home\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:32.335860 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:32.335814    4357 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2dd133f2-fc05-4874-b309-cd4b235bf8e9-model-cache\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:32.335860 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:32.335853    4357 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2dd133f2-fc05-4874-b309-cd4b235bf8e9-tls-certs\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:32.335995 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:32.335855    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6f1cb38-ae78-424c-ba8a-dd470888a1b1-tmp-dir" pod "f6f1cb38-ae78-424c-ba8a-dd470888a1b1" (UID: "f6f1cb38-ae78-424c-ba8a-dd470888a1b1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:32.335995 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:32.335871    4357 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2dd133f2-fc05-4874-b309-cd4b235bf8e9-tmp-dir\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:32.335995 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:32.335886    4357 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6f1cb38-ae78-424c-ba8a-dd470888a1b1-model-cache\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:32.335995 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:32.335900    4357 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2dd133f2-fc05-4874-b309-cd4b235bf8e9-home\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:32.335995 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:32.335929    4357 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2dd133f2-fc05-4874-b309-cd4b235bf8e9-dshm\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:32.335995 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:32.335948    4357 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8cz2m\" (UniqueName: \"kubernetes.io/projected/2dd133f2-fc05-4874-b309-cd4b235bf8e9-kube-api-access-8cz2m\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:32.337553 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:32.337506    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6f1cb38-ae78-424c-ba8a-dd470888a1b1-tls-certs" pod "f6f1cb38-ae78-424c-ba8a-dd470888a1b1" (UID: "f6f1cb38-ae78-424c-ba8a-dd470888a1b1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:45:32.338612 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:32.338591    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6f1cb38-ae78-424c-ba8a-dd470888a1b1-dshm" pod "f6f1cb38-ae78-424c-ba8a-dd470888a1b1" (UID: "f6f1cb38-ae78-424c-ba8a-dd470888a1b1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:32.340582 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:32.340558    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6f1cb38-ae78-424c-ba8a-dd470888a1b1-kube-api-access-p82cw" pod "f6f1cb38-ae78-424c-ba8a-dd470888a1b1" (UID: "f6f1cb38-ae78-424c-ba8a-dd470888a1b1"). InnerVolumeSpecName "kube-api-access-p82cw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:32.437035 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:32.437003    4357 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6f1cb38-ae78-424c-ba8a-dd470888a1b1-tls-certs\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:32.437035 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:32.437032    4357 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6f1cb38-ae78-424c-ba8a-dd470888a1b1-dshm\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:32.437035 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:32.437041    4357 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6f1cb38-ae78-424c-ba8a-dd470888a1b1-tmp-dir\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:32.437261 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:32.437050    4357 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p82cw\" (UniqueName: \"kubernetes.io/projected/f6f1cb38-ae78-424c-ba8a-dd470888a1b1-kube-api-access-p82cw\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:32.814511 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:32.813923    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48"
Nov 04 05:45:32.817553 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:32.815015    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48"
Nov 04 05:45:32.819229 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:32.818700    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48"
Nov 04 05:45:33.000937 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:33.000903    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-9d808e/distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq"
Nov 04 05:45:33.001392 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:33.000939    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-9d808e/distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq" event={"ID":"2dd133f2-fc05-4874-b309-cd4b235bf8e9","Type":"ContainerDied","Data":"826927ed0a7a1bede43107da213b293cb38e0f35d738a39ca0dbdafb48240429"}
Nov 04 05:45:33.001392 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:33.000989    4357 scope.go:122] "RemoveContainer" containerID="f441e327974cbbe0748d9ec6a90f6cd1dc1d303dcd239344dc69785666df61b5"
Nov 04 05:45:33.002431 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:33.002406    4357 generic.go:356] "Generic (PLEG): container finished" podID="f6f1cb38-ae78-424c-ba8a-dd470888a1b1" containerID="07898a5c9ea11c0ce89bb434f8ccec8d49d69feb107397a9fde5d7f1a3d340ea" exitCode=0
Nov 04 05:45:33.002505 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:33.002465    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-9d808e/simulator-w5-9d808e-kserve-bccd5db46-88b5x"
Nov 04 05:45:33.002609 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:33.002496    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-9d808e/simulator-w5-9d808e-kserve-bccd5db46-88b5x" event={"ID":"f6f1cb38-ae78-424c-ba8a-dd470888a1b1","Type":"ContainerDied","Data":"07898a5c9ea11c0ce89bb434f8ccec8d49d69feb107397a9fde5d7f1a3d340ea"}
Nov 04 05:45:33.002609 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:33.002568    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-9d808e/simulator-w5-9d808e-kserve-bccd5db46-88b5x" event={"ID":"f6f1cb38-ae78-424c-ba8a-dd470888a1b1","Type":"ContainerDied","Data":"fb88a31212b2d4f18b70e2651a35ad52b8b26887043a56b5ff9c2b4956bb7c91"}
Nov 04 05:45:33.012668 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:33.012584    4357 scope.go:122] "RemoveContainer" containerID="07898a5c9ea11c0ce89bb434f8ccec8d49d69feb107397a9fde5d7f1a3d340ea"
Nov 04 05:45:33.022750 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:33.022724    4357 scope.go:122] "RemoveContainer" containerID="07898a5c9ea11c0ce89bb434f8ccec8d49d69feb107397a9fde5d7f1a3d340ea"
Nov 04 05:45:33.023007 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:45:33.022987    4357 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07898a5c9ea11c0ce89bb434f8ccec8d49d69feb107397a9fde5d7f1a3d340ea\": container with ID starting with 07898a5c9ea11c0ce89bb434f8ccec8d49d69feb107397a9fde5d7f1a3d340ea not found: ID does not exist" containerID="07898a5c9ea11c0ce89bb434f8ccec8d49d69feb107397a9fde5d7f1a3d340ea"
Nov 04 05:45:33.023084 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:33.023014    4357 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07898a5c9ea11c0ce89bb434f8ccec8d49d69feb107397a9fde5d7f1a3d340ea"} err="failed to get container status \"07898a5c9ea11c0ce89bb434f8ccec8d49d69feb107397a9fde5d7f1a3d340ea\": rpc error: code = NotFound desc = could not find container \"07898a5c9ea11c0ce89bb434f8ccec8d49d69feb107397a9fde5d7f1a3d340ea\": container with ID starting with 07898a5c9ea11c0ce89bb434f8ccec8d49d69feb107397a9fde5d7f1a3d340ea not found: ID does not exist"
Nov 04 05:45:33.027640 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:33.027619    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-9d808e/distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq"]
Nov 04 05:45:33.032322 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:33.032300    4357 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-9d808e/distinct-2-w5-9d808e-kserve-5b4fbc94c7-vhptq"]
Nov 04 05:45:33.043205 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:33.043167    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-9d808e/simulator-w5-9d808e-kserve-bccd5db46-88b5x"]
Nov 04 05:45:33.046485 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:33.046458    4357 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-9d808e/simulator-w5-9d808e-kserve-bccd5db46-88b5x"]
Nov 04 05:45:33.279642 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:33.279616    4357 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2dd133f2-fc05-4874-b309-cd4b235bf8e9" path="/var/lib/kubelet/pods/2dd133f2-fc05-4874-b309-cd4b235bf8e9/volumes"
Nov 04 05:45:33.280009 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:33.279996    4357 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e" path="/var/lib/kubelet/pods/9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e/volumes"
Nov 04 05:45:33.280358 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:33.280346    4357 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f6f1cb38-ae78-424c-ba8a-dd470888a1b1" path="/var/lib/kubelet/pods/f6f1cb38-ae78-424c-ba8a-dd470888a1b1/volumes"
Nov 04 05:45:33.822304 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:33.822267    4357 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w3-f910f5-58ddd75998-7rkwk" podUID="aaf73a4d-306e-43bd-a6b7-b3dfb2f29dee" containerName="payload-processing" containerID="cri-o://d0ac334bc29691636db49984ab82b9fbc0f4609fdf27d4f165b321e8bb953225" gracePeriod=25
Nov 04 05:45:33.923469 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:33.923436    4357 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-f910f5-668ff7855-g8p5s" podUID="6c343ea7-372f-4d66-9534-c758209541b0" containerName="payload-pre-processing" containerID="cri-o://b9b10d6504efd8555670fdd8384501f36a2030a9431bb0fc76f0f694511d6fec" gracePeriod=25
Nov 04 05:45:34.012639 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:34.012605    4357 generic.go:356] "Generic (PLEG): container finished" podID="4d2ba792-a3a6-4856-a039-08822d3c1e39" containerID="f9d7092ac5dc146a3312696dc8616e24dd6fe79788c3f22c67456e57015575aa" exitCode=137
Nov 04 05:45:34.013078 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:34.012713    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-9a0c8b-29896185-w8842" event={"ID":"4d2ba792-a3a6-4856-a039-08822d3c1e39","Type":"ContainerDied","Data":"f9d7092ac5dc146a3312696dc8616e24dd6fe79788c3f22c67456e57015575aa"}
Nov 04 05:45:34.013078 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:34.012813    4357 scope.go:122] "RemoveContainer" containerID="9d0247a0c27b9315f01fd640c49664578bd06c8261199c194be9e1800e01b170"
Nov 04 05:45:34.014953 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:34.014924    4357 generic.go:356] "Generic (PLEG): container finished" podID="aaf73a4d-306e-43bd-a6b7-b3dfb2f29dee" containerID="d0ac334bc29691636db49984ab82b9fbc0f4609fdf27d4f165b321e8bb953225" exitCode=0
Nov 04 05:45:34.015087 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:34.014999    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-f910f5-58ddd75998-7rkwk" event={"ID":"aaf73a4d-306e-43bd-a6b7-b3dfb2f29dee","Type":"ContainerDied","Data":"d0ac334bc29691636db49984ab82b9fbc0f4609fdf27d4f165b321e8bb953225"}
Nov 04 05:45:34.095321 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:34.095294    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-9a0c8b-29896185-w8842"
Nov 04 05:45:34.097200 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:34.097182    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-f910f5-58ddd75998-7rkwk"
Nov 04 05:45:34.171048 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:34.171015    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/aaf73a4d-306e-43bd-a6b7-b3dfb2f29dee-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aaf73a4d-306e-43bd-a6b7-b3dfb2f29dee-plugins-config-volume\") pod \"aaf73a4d-306e-43bd-a6b7-b3dfb2f29dee\" (UID: \"aaf73a4d-306e-43bd-a6b7-b3dfb2f29dee\") "
Nov 04 05:45:34.171216 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:34.171175    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/aaf73a4d-306e-43bd-a6b7-b3dfb2f29dee-kube-api-access-xpp4s\" (UniqueName: \"kubernetes.io/projected/aaf73a4d-306e-43bd-a6b7-b3dfb2f29dee-kube-api-access-xpp4s\") pod \"aaf73a4d-306e-43bd-a6b7-b3dfb2f29dee\" (UID: \"aaf73a4d-306e-43bd-a6b7-b3dfb2f29dee\") "
Nov 04 05:45:34.171280 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:34.171249    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4d2ba792-a3a6-4856-a039-08822d3c1e39-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d2ba792-a3a6-4856-a039-08822d3c1e39-maas-api-service-ca\") pod \"4d2ba792-a3a6-4856-a039-08822d3c1e39\" (UID: \"4d2ba792-a3a6-4856-a039-08822d3c1e39\") "
Nov 04 05:45:34.171353 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:34.171337    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4d2ba792-a3a6-4856-a039-08822d3c1e39-kube-api-access-lmsl2\" (UniqueName: \"kubernetes.io/projected/4d2ba792-a3a6-4856-a039-08822d3c1e39-kube-api-access-lmsl2\") pod \"4d2ba792-a3a6-4856-a039-08822d3c1e39\" (UID: \"4d2ba792-a3a6-4856-a039-08822d3c1e39\") "
Nov 04 05:45:34.171409 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:34.171361    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aaf73a4d-306e-43bd-a6b7-b3dfb2f29dee-plugins-config-volume" pod "aaf73a4d-306e-43bd-a6b7-b3dfb2f29dee" (UID: "aaf73a4d-306e-43bd-a6b7-b3dfb2f29dee"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:45:34.171624 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:34.171600    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d2ba792-a3a6-4856-a039-08822d3c1e39-maas-api-service-ca" pod "4d2ba792-a3a6-4856-a039-08822d3c1e39" (UID: "4d2ba792-a3a6-4856-a039-08822d3c1e39"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:45:34.171742 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:34.171726    4357 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aaf73a4d-306e-43bd-a6b7-b3dfb2f29dee-plugins-config-volume\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:34.171793 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:34.171749    4357 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d2ba792-a3a6-4856-a039-08822d3c1e39-maas-api-service-ca\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:34.173831 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:34.173812    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d2ba792-a3a6-4856-a039-08822d3c1e39-kube-api-access-lmsl2" pod "4d2ba792-a3a6-4856-a039-08822d3c1e39" (UID: "4d2ba792-a3a6-4856-a039-08822d3c1e39"). InnerVolumeSpecName "kube-api-access-lmsl2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:34.173906 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:34.173839    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aaf73a4d-306e-43bd-a6b7-b3dfb2f29dee-kube-api-access-xpp4s" pod "aaf73a4d-306e-43bd-a6b7-b3dfb2f29dee" (UID: "aaf73a4d-306e-43bd-a6b7-b3dfb2f29dee"). InnerVolumeSpecName "kube-api-access-xpp4s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:34.273218 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:34.273196    4357 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmsl2\" (UniqueName: \"kubernetes.io/projected/4d2ba792-a3a6-4856-a039-08822d3c1e39-kube-api-access-lmsl2\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:34.273218 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:34.273219    4357 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpp4s\" (UniqueName: \"kubernetes.io/projected/aaf73a4d-306e-43bd-a6b7-b3dfb2f29dee-kube-api-access-xpp4s\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:34.414704 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:34.414644    4357 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-27935d-6dffddbb9f-8k6nc" podUID="5ed67653-cc0f-4000-aa56-edd9d733b025" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 05:45:34.414849 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:34.414828    4357 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-f910f5-668ff7855-g8p5s" podUID="6c343ea7-372f-4d66-9534-c758209541b0" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 05:45:35.020767 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:35.020732    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-9a0c8b-29896185-w8842" event={"ID":"4d2ba792-a3a6-4856-a039-08822d3c1e39","Type":"ContainerDied","Data":"778f1cc706bfafb2fb914ebfb1d1099daa2254232c46526b06a45c851e782b31"}
Nov 04 05:45:35.021216 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:35.020813    4357 scope.go:122] "RemoveContainer" containerID="f9d7092ac5dc146a3312696dc8616e24dd6fe79788c3f22c67456e57015575aa"
Nov 04 05:45:35.021216 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:35.020746    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-9a0c8b-29896185-w8842"
Nov 04 05:45:35.022262 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:35.022237    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-f910f5-58ddd75998-7rkwk"
Nov 04 05:45:35.022379 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:35.022242    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-f910f5-58ddd75998-7rkwk" event={"ID":"aaf73a4d-306e-43bd-a6b7-b3dfb2f29dee","Type":"ContainerDied","Data":"5b0d91fba212c30a2879b5a134819db7b29d6132d450bb25c0d64663b05c642c"}
Nov 04 05:45:35.032652 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:35.032632    4357 scope.go:122] "RemoveContainer" containerID="d0ac334bc29691636db49984ab82b9fbc0f4609fdf27d4f165b321e8bb953225"
Nov 04 05:45:35.049547 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:35.049509    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-9a0c8b-29896185-w8842"]
Nov 04 05:45:35.056037 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:35.056013    4357 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-9a0c8b-29896185-w8842"]
Nov 04 05:45:35.066149 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:35.066129    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-f910f5-58ddd75998-7rkwk"]
Nov 04 05:45:35.072050 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:35.072029    4357 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-f910f5-58ddd75998-7rkwk"]
Nov 04 05:45:35.274345 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:35.274303    4357 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4d2ba792-a3a6-4856-a039-08822d3c1e39" path="/var/lib/kubelet/pods/4d2ba792-a3a6-4856-a039-08822d3c1e39/volumes"
Nov 04 05:45:35.274822 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:35.274802    4357 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="aaf73a4d-306e-43bd-a6b7-b3dfb2f29dee" path="/var/lib/kubelet/pods/aaf73a4d-306e-43bd-a6b7-b3dfb2f29dee/volumes"
Nov 04 05:45:35.422579 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:35.422544    4357 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-2b14d0-6996d75467-hndgq" podUID="4c9a887b-1a65-414a-b186-7745adf36f4e" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 05:45:39.478712 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:39.478679    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-9d808e-7788c7bbdd-59fzm"]
Nov 04 05:45:39.479167 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:39.478955    4357 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-9d808e-7788c7bbdd-59fzm" podUID="43beb0ed-3d03-4b8f-864e-62ba395ba26d" containerName="maas-api" containerID="cri-o://4dd2ff7406e5c3e9a5d5ba3fcd4a3cdd9064d2c80b1edf72e2619ef52b1cb01a" gracePeriod=30
Nov 04 05:45:39.652013 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:39.651986    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-2b14d0-6996d75467-hndgq"
Nov 04 05:45:39.721399 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:39.721372    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4c9a887b-1a65-414a-b186-7745adf36f4e-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c9a887b-1a65-414a-b186-7745adf36f4e-plugins-config-volume\") pod \"4c9a887b-1a65-414a-b186-7745adf36f4e\" (UID: \"4c9a887b-1a65-414a-b186-7745adf36f4e\") "
Nov 04 05:45:39.721583 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:39.721502    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4c9a887b-1a65-414a-b186-7745adf36f4e-kube-api-access-psv2z\" (UniqueName: \"kubernetes.io/projected/4c9a887b-1a65-414a-b186-7745adf36f4e-kube-api-access-psv2z\") pod \"4c9a887b-1a65-414a-b186-7745adf36f4e\" (UID: \"4c9a887b-1a65-414a-b186-7745adf36f4e\") "
Nov 04 05:45:39.721949 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:39.721749    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c9a887b-1a65-414a-b186-7745adf36f4e-plugins-config-volume" pod "4c9a887b-1a65-414a-b186-7745adf36f4e" (UID: "4c9a887b-1a65-414a-b186-7745adf36f4e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:45:39.721949 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:39.721928    4357 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c9a887b-1a65-414a-b186-7745adf36f4e-plugins-config-volume\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:39.723577 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:39.723546    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c9a887b-1a65-414a-b186-7745adf36f4e-kube-api-access-psv2z" pod "4c9a887b-1a65-414a-b186-7745adf36f4e" (UID: "4c9a887b-1a65-414a-b186-7745adf36f4e"). InnerVolumeSpecName "kube-api-access-psv2z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:39.735898 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:39.735880    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-9d808e-7788c7bbdd-59fzm"
Nov 04 05:45:39.864540 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:39.861584    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/43beb0ed-3d03-4b8f-864e-62ba395ba26d-kube-api-access-8h9ng\" (UniqueName: \"kubernetes.io/projected/43beb0ed-3d03-4b8f-864e-62ba395ba26d-kube-api-access-8h9ng\") pod \"43beb0ed-3d03-4b8f-864e-62ba395ba26d\" (UID: \"43beb0ed-3d03-4b8f-864e-62ba395ba26d\") "
Nov 04 05:45:39.864540 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:39.861779    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/43beb0ed-3d03-4b8f-864e-62ba395ba26d-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/43beb0ed-3d03-4b8f-864e-62ba395ba26d-openshift-service-ca\") pod \"43beb0ed-3d03-4b8f-864e-62ba395ba26d\" (UID: \"43beb0ed-3d03-4b8f-864e-62ba395ba26d\") "
Nov 04 05:45:39.864540 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:39.861824    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/43beb0ed-3d03-4b8f-864e-62ba395ba26d-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43beb0ed-3d03-4b8f-864e-62ba395ba26d-maas-api-tls\") pod \"43beb0ed-3d03-4b8f-864e-62ba395ba26d\" (UID: \"43beb0ed-3d03-4b8f-864e-62ba395ba26d\") "
Nov 04 05:45:39.864540 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:39.861909    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/43beb0ed-3d03-4b8f-864e-62ba395ba26d-metrics-certs\" (UniqueName: \"kubernetes.io/secret/43beb0ed-3d03-4b8f-864e-62ba395ba26d-metrics-certs\") pod \"43beb0ed-3d03-4b8f-864e-62ba395ba26d\" (UID: \"43beb0ed-3d03-4b8f-864e-62ba395ba26d\") "
Nov 04 05:45:39.864540 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:39.862316    4357 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-psv2z\" (UniqueName: \"kubernetes.io/projected/4c9a887b-1a65-414a-b186-7745adf36f4e-kube-api-access-psv2z\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:39.875553 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:39.866779    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43beb0ed-3d03-4b8f-864e-62ba395ba26d-openshift-service-ca" pod "43beb0ed-3d03-4b8f-864e-62ba395ba26d" (UID: "43beb0ed-3d03-4b8f-864e-62ba395ba26d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:45:39.875553 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:39.873856    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43beb0ed-3d03-4b8f-864e-62ba395ba26d-maas-api-tls" pod "43beb0ed-3d03-4b8f-864e-62ba395ba26d" (UID: "43beb0ed-3d03-4b8f-864e-62ba395ba26d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:45:39.898761 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:39.898668    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43beb0ed-3d03-4b8f-864e-62ba395ba26d-metrics-certs" pod "43beb0ed-3d03-4b8f-864e-62ba395ba26d" (UID: "43beb0ed-3d03-4b8f-864e-62ba395ba26d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:45:39.920017 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:39.919979    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43beb0ed-3d03-4b8f-864e-62ba395ba26d-kube-api-access-8h9ng" pod "43beb0ed-3d03-4b8f-864e-62ba395ba26d" (UID: "43beb0ed-3d03-4b8f-864e-62ba395ba26d"). InnerVolumeSpecName "kube-api-access-8h9ng". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:39.963579 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:39.963544    4357 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/43beb0ed-3d03-4b8f-864e-62ba395ba26d-openshift-service-ca\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:39.963579 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:39.963576    4357 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43beb0ed-3d03-4b8f-864e-62ba395ba26d-maas-api-tls\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:39.963579 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:39.963586    4357 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43beb0ed-3d03-4b8f-864e-62ba395ba26d-metrics-certs\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:39.963869 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:39.963595    4357 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8h9ng\" (UniqueName: \"kubernetes.io/projected/43beb0ed-3d03-4b8f-864e-62ba395ba26d-kube-api-access-8h9ng\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:40.050308 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:40.050278    4357 generic.go:356] "Generic (PLEG): container finished" podID="4c9a887b-1a65-414a-b186-7745adf36f4e" containerID="f350e9a5a8305a0ca6ee905a849ca6593341678b7b32caa2010649408125f004" exitCode=0
Nov 04 05:45:40.050495 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:40.050326    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-2b14d0-6996d75467-hndgq"
Nov 04 05:45:40.050495 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:40.050364    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-2b14d0-6996d75467-hndgq" event={"ID":"4c9a887b-1a65-414a-b186-7745adf36f4e","Type":"ContainerDied","Data":"f350e9a5a8305a0ca6ee905a849ca6593341678b7b32caa2010649408125f004"}
Nov 04 05:45:40.050495 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:40.050421    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-2b14d0-6996d75467-hndgq" event={"ID":"4c9a887b-1a65-414a-b186-7745adf36f4e","Type":"ContainerDied","Data":"6272e705a66e79c2042bc7bfdc2d6a7832d1e58082762e18e5532bf65ab780e7"}
Nov 04 05:45:40.050495 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:40.050451    4357 scope.go:122] "RemoveContainer" containerID="f350e9a5a8305a0ca6ee905a849ca6593341678b7b32caa2010649408125f004"
Nov 04 05:45:40.051775 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:40.051755    4357 generic.go:356] "Generic (PLEG): container finished" podID="43beb0ed-3d03-4b8f-864e-62ba395ba26d" containerID="4dd2ff7406e5c3e9a5d5ba3fcd4a3cdd9064d2c80b1edf72e2619ef52b1cb01a" exitCode=0
Nov 04 05:45:40.051848 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:40.051787    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-9d808e-7788c7bbdd-59fzm" event={"ID":"43beb0ed-3d03-4b8f-864e-62ba395ba26d","Type":"ContainerDied","Data":"4dd2ff7406e5c3e9a5d5ba3fcd4a3cdd9064d2c80b1edf72e2619ef52b1cb01a"}
Nov 04 05:45:40.051848 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:40.051811    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-9d808e-7788c7bbdd-59fzm"
Nov 04 05:45:40.051848 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:40.051827    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-9d808e-7788c7bbdd-59fzm" event={"ID":"43beb0ed-3d03-4b8f-864e-62ba395ba26d","Type":"ContainerDied","Data":"27e9eb9dbbf1f29cae8ce8a744aeac7aae37cd98e2eb7ed81afca94e38a840f4"}
Nov 04 05:45:40.059285 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:40.059265    4357 scope.go:122] "RemoveContainer" containerID="f350e9a5a8305a0ca6ee905a849ca6593341678b7b32caa2010649408125f004"
Nov 04 05:45:40.059635 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:45:40.059548    4357 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f350e9a5a8305a0ca6ee905a849ca6593341678b7b32caa2010649408125f004\": container with ID starting with f350e9a5a8305a0ca6ee905a849ca6593341678b7b32caa2010649408125f004 not found: ID does not exist" containerID="f350e9a5a8305a0ca6ee905a849ca6593341678b7b32caa2010649408125f004"
Nov 04 05:45:40.059635 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:40.059579    4357 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f350e9a5a8305a0ca6ee905a849ca6593341678b7b32caa2010649408125f004"} err="failed to get container status \"f350e9a5a8305a0ca6ee905a849ca6593341678b7b32caa2010649408125f004\": rpc error: code = NotFound desc = could not find container \"f350e9a5a8305a0ca6ee905a849ca6593341678b7b32caa2010649408125f004\": container with ID starting with f350e9a5a8305a0ca6ee905a849ca6593341678b7b32caa2010649408125f004 not found: ID does not exist"
Nov 04 05:45:40.059635 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:40.059596    4357 scope.go:122] "RemoveContainer" containerID="4dd2ff7406e5c3e9a5d5ba3fcd4a3cdd9064d2c80b1edf72e2619ef52b1cb01a"
Nov 04 05:45:40.068255 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:40.068240    4357 scope.go:122] "RemoveContainer" containerID="4dd2ff7406e5c3e9a5d5ba3fcd4a3cdd9064d2c80b1edf72e2619ef52b1cb01a"
Nov 04 05:45:40.068492 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:45:40.068477    4357 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4dd2ff7406e5c3e9a5d5ba3fcd4a3cdd9064d2c80b1edf72e2619ef52b1cb01a\": container with ID starting with 4dd2ff7406e5c3e9a5d5ba3fcd4a3cdd9064d2c80b1edf72e2619ef52b1cb01a not found: ID does not exist" containerID="4dd2ff7406e5c3e9a5d5ba3fcd4a3cdd9064d2c80b1edf72e2619ef52b1cb01a"
Nov 04 05:45:40.068558 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:40.068496    4357 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4dd2ff7406e5c3e9a5d5ba3fcd4a3cdd9064d2c80b1edf72e2619ef52b1cb01a"} err="failed to get container status \"4dd2ff7406e5c3e9a5d5ba3fcd4a3cdd9064d2c80b1edf72e2619ef52b1cb01a\": rpc error: code = NotFound desc = could not find container \"4dd2ff7406e5c3e9a5d5ba3fcd4a3cdd9064d2c80b1edf72e2619ef52b1cb01a\": container with ID starting with 4dd2ff7406e5c3e9a5d5ba3fcd4a3cdd9064d2c80b1edf72e2619ef52b1cb01a not found: ID does not exist"
Nov 04 05:45:40.076097 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:40.076077    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-9d808e-7788c7bbdd-59fzm"]
Nov 04 05:45:40.079796 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:40.079776    4357 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-9d808e-7788c7bbdd-59fzm"]
Nov 04 05:45:40.089051 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:40.089027    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-2b14d0-6996d75467-hndgq"]
Nov 04 05:45:40.092657 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:40.092640    4357 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-2b14d0-6996d75467-hndgq"]
Nov 04 05:45:41.273296 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:41.273266    4357 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="43beb0ed-3d03-4b8f-864e-62ba395ba26d" path="/var/lib/kubelet/pods/43beb0ed-3d03-4b8f-864e-62ba395ba26d/volumes"
Nov 04 05:45:41.273788 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:41.273771    4357 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4c9a887b-1a65-414a-b186-7745adf36f4e" path="/var/lib/kubelet/pods/4c9a887b-1a65-414a-b186-7745adf36f4e/volumes"
Nov 04 05:45:44.413613 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:44.413569    4357 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-27935d-6dffddbb9f-8k6nc" podUID="5ed67653-cc0f-4000-aa56-edd9d733b025" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 05:45:44.414796 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:44.414767    4357 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-f910f5-668ff7855-g8p5s" podUID="6c343ea7-372f-4d66-9534-c758209541b0" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 05:45:45.506273 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:45.506235    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn"]
Nov 04 05:45:45.516689 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:45.516657    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6"]
Nov 04 05:45:45.528726 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:45.517075    4357 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn" podUID="8d46061a-a82a-4a03-8200-c9ba11866b48" containerName="istio-proxy" containerID="cri-o://bb1348c0a36c99d899fa8e06318093134429bac30b0878b825e131a4315afd25" gracePeriod=30
Nov 04 05:45:45.582541 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:45.562689    4357 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6" podUID="7aa548d9-1602-4daa-8568-cd9c053f8a38" containerName="istio-proxy" containerID="cri-o://348bc2de3c5d4d4592c6257ef87b68568685eb1b468f677bb36c1c4e1b895e25" gracePeriod=30
Nov 04 05:45:46.447912 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:46.447880    4357 patch_prober.go:29] interesting pod/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 04 05:45:46.448076 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:46.447932    4357 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6" podUID="7aa548d9-1602-4daa-8568-cd9c053f8a38" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 04 05:45:47.274893 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:45:47.274819    4357 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-npgcv" containerName="extractor"
Nov 04 05:45:51.426450 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.426417    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq"]
Nov 04 05:45:51.427505 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.427481    4357 cpu_manager.go:414] "containerMap: removing container" podUID="9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e" containerName="main"
Nov 04 05:45:51.427505 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.427505    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e" containerName="main"
Nov 04 05:45:51.427693 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.427549    4357 cpu_manager.go:414] "containerMap: removing container" podUID="4d2ba792-a3a6-4856-a039-08822d3c1e39" containerName="cleanup"
Nov 04 05:45:51.427693 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.427558    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4d2ba792-a3a6-4856-a039-08822d3c1e39" containerName="cleanup"
Nov 04 05:45:51.427693 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.427576    4357 cpu_manager.go:414] "containerMap: removing container" podUID="4c9a887b-1a65-414a-b186-7745adf36f4e" containerName="payload-pre-processing"
Nov 04 05:45:51.427693 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.427584    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4c9a887b-1a65-414a-b186-7745adf36f4e" containerName="payload-pre-processing"
Nov 04 05:45:51.427693 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.427599    4357 cpu_manager.go:414] "containerMap: removing container" podUID="635c7d18-aa04-4703-b5f5-5cc0958f5bf3" containerName="revoke-keys"
Nov 04 05:45:51.427693 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.427606    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="635c7d18-aa04-4703-b5f5-5cc0958f5bf3" containerName="revoke-keys"
Nov 04 05:45:51.427693 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.427622    4357 cpu_manager.go:414] "containerMap: removing container" podUID="43beb0ed-3d03-4b8f-864e-62ba395ba26d" containerName="maas-api"
Nov 04 05:45:51.427693 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.427629    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="43beb0ed-3d03-4b8f-864e-62ba395ba26d" containerName="maas-api"
Nov 04 05:45:51.427693 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.427638    4357 cpu_manager.go:414] "containerMap: removing container" podUID="f575cbaf-3226-4b7f-8dd8-341f77abb887" containerName="main"
Nov 04 05:45:51.428328 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.427842    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f575cbaf-3226-4b7f-8dd8-341f77abb887" containerName="main"
Nov 04 05:45:51.428328 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.427857    4357 cpu_manager.go:414] "containerMap: removing container" podUID="2dd133f2-fc05-4874-b309-cd4b235bf8e9" containerName="main"
Nov 04 05:45:51.428328 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.427864    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2dd133f2-fc05-4874-b309-cd4b235bf8e9" containerName="main"
Nov 04 05:45:51.428328 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.427874    4357 cpu_manager.go:414] "containerMap: removing container" podUID="4d2ba792-a3a6-4856-a039-08822d3c1e39" containerName="cleanup"
Nov 04 05:45:51.428328 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.427881    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4d2ba792-a3a6-4856-a039-08822d3c1e39" containerName="cleanup"
Nov 04 05:45:51.428328 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.427893    4357 cpu_manager.go:414] "containerMap: removing container" podUID="aaf73a4d-306e-43bd-a6b7-b3dfb2f29dee" containerName="payload-processing"
Nov 04 05:45:51.428328 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.427900    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aaf73a4d-306e-43bd-a6b7-b3dfb2f29dee" containerName="payload-processing"
Nov 04 05:45:51.428328 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.427916    4357 cpu_manager.go:414] "containerMap: removing container" podUID="f6f1cb38-ae78-424c-ba8a-dd470888a1b1" containerName="main"
Nov 04 05:45:51.428328 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.427923    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f6f1cb38-ae78-424c-ba8a-dd470888a1b1" containerName="main"
Nov 04 05:45:51.428328 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.428024    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="635c7d18-aa04-4703-b5f5-5cc0958f5bf3" containerName="revoke-keys"
Nov 04 05:45:51.428328 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.428037    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="43beb0ed-3d03-4b8f-864e-62ba395ba26d" containerName="maas-api"
Nov 04 05:45:51.428328 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.428045    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="f575cbaf-3226-4b7f-8dd8-341f77abb887" containerName="main"
Nov 04 05:45:51.428328 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.428054    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="2dd133f2-fc05-4874-b309-cd4b235bf8e9" containerName="main"
Nov 04 05:45:51.428328 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.428063    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="4d2ba792-a3a6-4856-a039-08822d3c1e39" containerName="cleanup"
Nov 04 05:45:51.428328 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.428070    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="aaf73a4d-306e-43bd-a6b7-b3dfb2f29dee" containerName="payload-processing"
Nov 04 05:45:51.428328 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.428078    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="f6f1cb38-ae78-424c-ba8a-dd470888a1b1" containerName="main"
Nov 04 05:45:51.428328 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.428090    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="9eb4ca7b-9cff-4ac0-947a-bbfd189b4f1e" containerName="main"
Nov 04 05:45:51.428328 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.428102    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="4d2ba792-a3a6-4856-a039-08822d3c1e39" containerName="cleanup"
Nov 04 05:45:51.428328 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.428112    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="4c9a887b-1a65-414a-b186-7745adf36f4e" containerName="payload-pre-processing"
Nov 04 05:45:51.432142 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.431726    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq"
Nov 04 05:45:51.432407 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.432355    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn"
Nov 04 05:45:51.448737 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.442743    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl"]
Nov 04 05:45:51.448737 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.443355    4357 cpu_manager.go:414] "containerMap: removing container" podUID="8d46061a-a82a-4a03-8200-c9ba11866b48" containerName="istio-proxy"
Nov 04 05:45:51.448737 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.443428    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8d46061a-a82a-4a03-8200-c9ba11866b48" containerName="istio-proxy"
Nov 04 05:45:51.448737 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.443498    4357 cpu_manager.go:414] "containerMap: removing container" podUID="8d46061a-a82a-4a03-8200-c9ba11866b48" containerName="istio-proxy"
Nov 04 05:45:51.448737 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.443582    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8d46061a-a82a-4a03-8200-c9ba11866b48" containerName="istio-proxy"
Nov 04 05:45:51.448737 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.443750    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="8d46061a-a82a-4a03-8200-c9ba11866b48" containerName="istio-proxy"
Nov 04 05:45:51.449076 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.448737    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq"]
Nov 04 05:45:51.449076 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.448824    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl"
Nov 04 05:45:51.461459 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.461255    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl"]
Nov 04 05:45:51.495283 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.495236    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6"
Nov 04 05:45:51.525975 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.525951    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8d46061a-a82a-4a03-8200-c9ba11866b48-kube-api-access-xkqqh\" (UniqueName: \"kubernetes.io/projected/8d46061a-a82a-4a03-8200-c9ba11866b48-kube-api-access-xkqqh\") pod \"8d46061a-a82a-4a03-8200-c9ba11866b48\" (UID: \"8d46061a-a82a-4a03-8200-c9ba11866b48\") "
Nov 04 05:45:51.526113 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.526002    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8d46061a-a82a-4a03-8200-c9ba11866b48-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d46061a-a82a-4a03-8200-c9ba11866b48-istiod-ca-cert\") pod \"8d46061a-a82a-4a03-8200-c9ba11866b48\" (UID: \"8d46061a-a82a-4a03-8200-c9ba11866b48\") "
Nov 04 05:45:51.526113 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.526031    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8d46061a-a82a-4a03-8200-c9ba11866b48-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d46061a-a82a-4a03-8200-c9ba11866b48-istio-podinfo\") pod \"8d46061a-a82a-4a03-8200-c9ba11866b48\" (UID: \"8d46061a-a82a-4a03-8200-c9ba11866b48\") "
Nov 04 05:45:51.526113 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.526061    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8d46061a-a82a-4a03-8200-c9ba11866b48-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d46061a-a82a-4a03-8200-c9ba11866b48-istio-data\") pod \"8d46061a-a82a-4a03-8200-c9ba11866b48\" (UID: \"8d46061a-a82a-4a03-8200-c9ba11866b48\") "
Nov 04 05:45:51.526113 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.526092    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8d46061a-a82a-4a03-8200-c9ba11866b48-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d46061a-a82a-4a03-8200-c9ba11866b48-workload-socket\") pod \"8d46061a-a82a-4a03-8200-c9ba11866b48\" (UID: \"8d46061a-a82a-4a03-8200-c9ba11866b48\") "
Nov 04 05:45:51.526328 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.526145    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8d46061a-a82a-4a03-8200-c9ba11866b48-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d46061a-a82a-4a03-8200-c9ba11866b48-workload-certs\") pod \"8d46061a-a82a-4a03-8200-c9ba11866b48\" (UID: \"8d46061a-a82a-4a03-8200-c9ba11866b48\") "
Nov 04 05:45:51.526328 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.526228    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8d46061a-a82a-4a03-8200-c9ba11866b48-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d46061a-a82a-4a03-8200-c9ba11866b48-credential-socket\") pod \"8d46061a-a82a-4a03-8200-c9ba11866b48\" (UID: \"8d46061a-a82a-4a03-8200-c9ba11866b48\") "
Nov 04 05:45:51.526328 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.526322    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8d46061a-a82a-4a03-8200-c9ba11866b48-istio-token\" (UniqueName: \"kubernetes.io/projected/8d46061a-a82a-4a03-8200-c9ba11866b48-istio-token\") pod \"8d46061a-a82a-4a03-8200-c9ba11866b48\" (UID: \"8d46061a-a82a-4a03-8200-c9ba11866b48\") "
Nov 04 05:45:51.526475 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.526359    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8d46061a-a82a-4a03-8200-c9ba11866b48-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d46061a-a82a-4a03-8200-c9ba11866b48-istio-envoy\") pod \"8d46061a-a82a-4a03-8200-c9ba11866b48\" (UID: \"8d46061a-a82a-4a03-8200-c9ba11866b48\") "
Nov 04 05:45:51.526475 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.526459    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d46061a-a82a-4a03-8200-c9ba11866b48-istio-data" pod "8d46061a-a82a-4a03-8200-c9ba11866b48" (UID: "8d46061a-a82a-4a03-8200-c9ba11866b48"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:51.526598 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.526500    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14d9c974-e49a-45d5-9c95-e8b2a390a185-credential-socket\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq\" (UID: \"14d9c974-e49a-45d5-9c95-e8b2a390a185\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq"
Nov 04 05:45:51.526598 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.526566    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-credential-socket\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl\" (UID: \"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl"
Nov 04 05:45:51.526696 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.526627    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-istiod-ca-cert\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl\" (UID: \"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl"
Nov 04 05:45:51.526696 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.526660    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whrnv\" (UniqueName: \"kubernetes.io/projected/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-kube-api-access-whrnv\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl\" (UID: \"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl"
Nov 04 05:45:51.526810 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.526722    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14d9c974-e49a-45d5-9c95-e8b2a390a185-istio-data\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq\" (UID: \"14d9c974-e49a-45d5-9c95-e8b2a390a185\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq"
Nov 04 05:45:51.526810 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.526775    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwljc\" (UniqueName: \"kubernetes.io/projected/14d9c974-e49a-45d5-9c95-e8b2a390a185-kube-api-access-jwljc\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq\" (UID: \"14d9c974-e49a-45d5-9c95-e8b2a390a185\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq"
Nov 04 05:45:51.526920 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.526812    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14d9c974-e49a-45d5-9c95-e8b2a390a185-istio-podinfo\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq\" (UID: \"14d9c974-e49a-45d5-9c95-e8b2a390a185\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq"
Nov 04 05:45:51.526920 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.526813    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d46061a-a82a-4a03-8200-c9ba11866b48-credential-socket" pod "8d46061a-a82a-4a03-8200-c9ba11866b48" (UID: "8d46061a-a82a-4a03-8200-c9ba11866b48"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:51.526920 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.526838    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14d9c974-e49a-45d5-9c95-e8b2a390a185-istiod-ca-cert\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq\" (UID: \"14d9c974-e49a-45d5-9c95-e8b2a390a185\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq"
Nov 04 05:45:51.526920 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.526888    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-istio-data\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl\" (UID: \"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl"
Nov 04 05:45:51.526920 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.526897    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d46061a-a82a-4a03-8200-c9ba11866b48-istiod-ca-cert" pod "8d46061a-a82a-4a03-8200-c9ba11866b48" (UID: "8d46061a-a82a-4a03-8200-c9ba11866b48"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:45:51.527177 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.526929    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-istio-envoy\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl\" (UID: \"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl"
Nov 04 05:45:51.527177 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.526956    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14d9c974-e49a-45d5-9c95-e8b2a390a185-workload-certs\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq\" (UID: \"14d9c974-e49a-45d5-9c95-e8b2a390a185\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq"
Nov 04 05:45:51.527177 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.527011    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d46061a-a82a-4a03-8200-c9ba11866b48-workload-certs" pod "8d46061a-a82a-4a03-8200-c9ba11866b48" (UID: "8d46061a-a82a-4a03-8200-c9ba11866b48"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:51.527177 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.527146    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14d9c974-e49a-45d5-9c95-e8b2a390a185-istio-envoy\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq\" (UID: \"14d9c974-e49a-45d5-9c95-e8b2a390a185\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq"
Nov 04 05:45:51.527400 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.527186    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14d9c974-e49a-45d5-9c95-e8b2a390a185-istio-token\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq\" (UID: \"14d9c974-e49a-45d5-9c95-e8b2a390a185\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq"
Nov 04 05:45:51.527400 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.527230    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14d9c974-e49a-45d5-9c95-e8b2a390a185-workload-socket\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq\" (UID: \"14d9c974-e49a-45d5-9c95-e8b2a390a185\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq"
Nov 04 05:45:51.527400 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.527285    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-workload-certs\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl\" (UID: \"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl"
Nov 04 05:45:51.527400 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.527322    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-istio-podinfo\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl\" (UID: \"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl"
Nov 04 05:45:51.527400 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.527345    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-istio-token\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl\" (UID: \"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl"
Nov 04 05:45:51.527400 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.527388    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-workload-socket\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl\" (UID: \"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl"
Nov 04 05:45:51.527745 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.527463    4357 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d46061a-a82a-4a03-8200-c9ba11866b48-credential-socket\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:51.527745 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.527485    4357 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d46061a-a82a-4a03-8200-c9ba11866b48-istiod-ca-cert\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:51.527745 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.527500    4357 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d46061a-a82a-4a03-8200-c9ba11866b48-istio-data\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:51.527745 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.527546    4357 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d46061a-a82a-4a03-8200-c9ba11866b48-workload-certs\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:51.527962 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.527789    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d46061a-a82a-4a03-8200-c9ba11866b48-workload-socket" pod "8d46061a-a82a-4a03-8200-c9ba11866b48" (UID: "8d46061a-a82a-4a03-8200-c9ba11866b48"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:51.528575 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.528549    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d46061a-a82a-4a03-8200-c9ba11866b48-kube-api-access-xkqqh" pod "8d46061a-a82a-4a03-8200-c9ba11866b48" (UID: "8d46061a-a82a-4a03-8200-c9ba11866b48"). InnerVolumeSpecName "kube-api-access-xkqqh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:51.528809 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.528787    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8d46061a-a82a-4a03-8200-c9ba11866b48-istio-podinfo" pod "8d46061a-a82a-4a03-8200-c9ba11866b48" (UID: "8d46061a-a82a-4a03-8200-c9ba11866b48"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 05:45:51.529119 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.529095    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d46061a-a82a-4a03-8200-c9ba11866b48-istio-envoy" pod "8d46061a-a82a-4a03-8200-c9ba11866b48" (UID: "8d46061a-a82a-4a03-8200-c9ba11866b48"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:51.529475 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.529459    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d46061a-a82a-4a03-8200-c9ba11866b48-istio-token" pod "8d46061a-a82a-4a03-8200-c9ba11866b48" (UID: "8d46061a-a82a-4a03-8200-c9ba11866b48"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:51.627960 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.627935    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7aa548d9-1602-4daa-8568-cd9c053f8a38-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7aa548d9-1602-4daa-8568-cd9c053f8a38-workload-socket\") pod \"7aa548d9-1602-4daa-8568-cd9c053f8a38\" (UID: \"7aa548d9-1602-4daa-8568-cd9c053f8a38\") "
Nov 04 05:45:51.628052 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.628000    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7aa548d9-1602-4daa-8568-cd9c053f8a38-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7aa548d9-1602-4daa-8568-cd9c053f8a38-istio-envoy\") pod \"7aa548d9-1602-4daa-8568-cd9c053f8a38\" (UID: \"7aa548d9-1602-4daa-8568-cd9c053f8a38\") "
Nov 04 05:45:51.628052 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.628046    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7aa548d9-1602-4daa-8568-cd9c053f8a38-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7aa548d9-1602-4daa-8568-cd9c053f8a38-istiod-ca-cert\") pod \"7aa548d9-1602-4daa-8568-cd9c053f8a38\" (UID: \"7aa548d9-1602-4daa-8568-cd9c053f8a38\") "
Nov 04 05:45:51.628143 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.628090    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7aa548d9-1602-4daa-8568-cd9c053f8a38-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7aa548d9-1602-4daa-8568-cd9c053f8a38-istio-podinfo\") pod \"7aa548d9-1602-4daa-8568-cd9c053f8a38\" (UID: \"7aa548d9-1602-4daa-8568-cd9c053f8a38\") "
Nov 04 05:45:51.628143 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.628119    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7aa548d9-1602-4daa-8568-cd9c053f8a38-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7aa548d9-1602-4daa-8568-cd9c053f8a38-workload-certs\") pod \"7aa548d9-1602-4daa-8568-cd9c053f8a38\" (UID: \"7aa548d9-1602-4daa-8568-cd9c053f8a38\") "
Nov 04 05:45:51.628254 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.628177    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7aa548d9-1602-4daa-8568-cd9c053f8a38-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7aa548d9-1602-4daa-8568-cd9c053f8a38-credential-socket\") pod \"7aa548d9-1602-4daa-8568-cd9c053f8a38\" (UID: \"7aa548d9-1602-4daa-8568-cd9c053f8a38\") "
Nov 04 05:45:51.628254 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.628188    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7aa548d9-1602-4daa-8568-cd9c053f8a38-workload-socket" pod "7aa548d9-1602-4daa-8568-cd9c053f8a38" (UID: "7aa548d9-1602-4daa-8568-cd9c053f8a38"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:51.628254 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.628216    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7aa548d9-1602-4daa-8568-cd9c053f8a38-istio-token\" (UniqueName: \"kubernetes.io/projected/7aa548d9-1602-4daa-8568-cd9c053f8a38-istio-token\") pod \"7aa548d9-1602-4daa-8568-cd9c053f8a38\" (UID: \"7aa548d9-1602-4daa-8568-cd9c053f8a38\") "
Nov 04 05:45:51.628404 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.628255    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7aa548d9-1602-4daa-8568-cd9c053f8a38-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7aa548d9-1602-4daa-8568-cd9c053f8a38-istio-data\") pod \"7aa548d9-1602-4daa-8568-cd9c053f8a38\" (UID: \"7aa548d9-1602-4daa-8568-cd9c053f8a38\") "
Nov 04 05:45:51.628404 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.628287    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7aa548d9-1602-4daa-8568-cd9c053f8a38-kube-api-access-mp4hg\" (UniqueName: \"kubernetes.io/projected/7aa548d9-1602-4daa-8568-cd9c053f8a38-kube-api-access-mp4hg\") pod \"7aa548d9-1602-4daa-8568-cd9c053f8a38\" (UID: \"7aa548d9-1602-4daa-8568-cd9c053f8a38\") "
Nov 04 05:45:51.628547 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.628449    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7aa548d9-1602-4daa-8568-cd9c053f8a38-workload-certs" pod "7aa548d9-1602-4daa-8568-cd9c053f8a38" (UID: "7aa548d9-1602-4daa-8568-cd9c053f8a38"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:51.628547 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.628480    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwljc\" (UniqueName: \"kubernetes.io/projected/14d9c974-e49a-45d5-9c95-e8b2a390a185-kube-api-access-jwljc\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq\" (UID: \"14d9c974-e49a-45d5-9c95-e8b2a390a185\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq"
Nov 04 05:45:51.628547 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.628538    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14d9c974-e49a-45d5-9c95-e8b2a390a185-istio-podinfo\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq\" (UID: \"14d9c974-e49a-45d5-9c95-e8b2a390a185\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq"
Nov 04 05:45:51.628547 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.628511    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7aa548d9-1602-4daa-8568-cd9c053f8a38-istiod-ca-cert" pod "7aa548d9-1602-4daa-8568-cd9c053f8a38" (UID: "7aa548d9-1602-4daa-8568-cd9c053f8a38"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:45:51.628745 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.628564    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14d9c974-e49a-45d5-9c95-e8b2a390a185-istiod-ca-cert\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq\" (UID: \"14d9c974-e49a-45d5-9c95-e8b2a390a185\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq"
Nov 04 05:45:51.628745 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.628595    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-istio-data\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl\" (UID: \"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl"
Nov 04 05:45:51.628745 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.628630    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-istio-envoy\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl\" (UID: \"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl"
Nov 04 05:45:51.628745 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.628655    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14d9c974-e49a-45d5-9c95-e8b2a390a185-workload-certs\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq\" (UID: \"14d9c974-e49a-45d5-9c95-e8b2a390a185\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq"
Nov 04 05:45:51.628745 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.628693    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7aa548d9-1602-4daa-8568-cd9c053f8a38-istio-data" pod "7aa548d9-1602-4daa-8568-cd9c053f8a38" (UID: "7aa548d9-1602-4daa-8568-cd9c053f8a38"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:51.628998 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.628751    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14d9c974-e49a-45d5-9c95-e8b2a390a185-istio-envoy\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq\" (UID: \"14d9c974-e49a-45d5-9c95-e8b2a390a185\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq"
Nov 04 05:45:51.628998 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.628784    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14d9c974-e49a-45d5-9c95-e8b2a390a185-istio-token\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq\" (UID: \"14d9c974-e49a-45d5-9c95-e8b2a390a185\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq"
Nov 04 05:45:51.628998 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.628815    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14d9c974-e49a-45d5-9c95-e8b2a390a185-workload-socket\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq\" (UID: \"14d9c974-e49a-45d5-9c95-e8b2a390a185\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq"
Nov 04 05:45:51.628998 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.628867    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-workload-certs\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl\" (UID: \"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl"
Nov 04 05:45:51.628998 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.628904    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-istio-podinfo\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl\" (UID: \"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl"
Nov 04 05:45:51.628998 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.628943    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-istio-token\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl\" (UID: \"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl"
Nov 04 05:45:51.628998 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.628990    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-workload-socket\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl\" (UID: \"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl"
Nov 04 05:45:51.629360 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.629027    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14d9c974-e49a-45d5-9c95-e8b2a390a185-workload-certs\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq\" (UID: \"14d9c974-e49a-45d5-9c95-e8b2a390a185\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq"
Nov 04 05:45:51.629360 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.629278    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14d9c974-e49a-45d5-9c95-e8b2a390a185-credential-socket\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq\" (UID: \"14d9c974-e49a-45d5-9c95-e8b2a390a185\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq"
Nov 04 05:45:51.629360 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.629343    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14d9c974-e49a-45d5-9c95-e8b2a390a185-workload-socket\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq\" (UID: \"14d9c974-e49a-45d5-9c95-e8b2a390a185\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq"
Nov 04 05:45:51.631680 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.629937    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-workload-certs\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl\" (UID: \"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl"
Nov 04 05:45:51.631680 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.630395    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7aa548d9-1602-4daa-8568-cd9c053f8a38-credential-socket" pod "7aa548d9-1602-4daa-8568-cd9c053f8a38" (UID: "7aa548d9-1602-4daa-8568-cd9c053f8a38"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:51.631680 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.630697    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-istio-data\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl\" (UID: \"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl"
Nov 04 05:45:51.631680 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.631361    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14d9c974-e49a-45d5-9c95-e8b2a390a185-istiod-ca-cert\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq\" (UID: \"14d9c974-e49a-45d5-9c95-e8b2a390a185\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq"
Nov 04 05:45:51.631969 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.631946    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14d9c974-e49a-45d5-9c95-e8b2a390a185-istio-envoy\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq\" (UID: \"14d9c974-e49a-45d5-9c95-e8b2a390a185\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq"
Nov 04 05:45:51.632023 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.629032    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14d9c974-e49a-45d5-9c95-e8b2a390a185-credential-socket\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq\" (UID: \"14d9c974-e49a-45d5-9c95-e8b2a390a185\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq"
Nov 04 05:45:51.632072 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.632032    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-credential-socket\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl\" (UID: \"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl"
Nov 04 05:45:51.632124 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.632088    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-istiod-ca-cert\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl\" (UID: \"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl"
Nov 04 05:45:51.632164 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.632123    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whrnv\" (UniqueName: \"kubernetes.io/projected/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-kube-api-access-whrnv\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl\" (UID: \"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl"
Nov 04 05:45:51.632196 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.632175    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14d9c974-e49a-45d5-9c95-e8b2a390a185-istio-data\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq\" (UID: \"14d9c974-e49a-45d5-9c95-e8b2a390a185\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq"
Nov 04 05:45:51.632229 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.632198    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14d9c974-e49a-45d5-9c95-e8b2a390a185-istio-podinfo\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq\" (UID: \"14d9c974-e49a-45d5-9c95-e8b2a390a185\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq"
Nov 04 05:45:51.632262 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.632242    4357 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7aa548d9-1602-4daa-8568-cd9c053f8a38-credential-socket\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:51.632262 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.632254    4357 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7aa548d9-1602-4daa-8568-cd9c053f8a38-istio-data\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:51.632325 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.632263    4357 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d46061a-a82a-4a03-8200-c9ba11866b48-istio-token\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:51.632325 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.632273    4357 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d46061a-a82a-4a03-8200-c9ba11866b48-istio-envoy\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:51.632325 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.632283    4357 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7aa548d9-1602-4daa-8568-cd9c053f8a38-workload-socket\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:51.632325 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.632292    4357 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkqqh\" (UniqueName: \"kubernetes.io/projected/8d46061a-a82a-4a03-8200-c9ba11866b48-kube-api-access-xkqqh\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:51.632325 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.632301    4357 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d46061a-a82a-4a03-8200-c9ba11866b48-istio-podinfo\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:51.632325 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.632309    4357 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d46061a-a82a-4a03-8200-c9ba11866b48-workload-socket\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:51.632325 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.632317    4357 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7aa548d9-1602-4daa-8568-cd9c053f8a38-istiod-ca-cert\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:51.632325 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.632325    4357 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7aa548d9-1602-4daa-8568-cd9c053f8a38-workload-certs\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:51.632651 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.632609    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-istio-podinfo\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl\" (UID: \"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl"
Nov 04 05:45:51.632709 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.632699    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14d9c974-e49a-45d5-9c95-e8b2a390a185-istio-data\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq\" (UID: \"14d9c974-e49a-45d5-9c95-e8b2a390a185\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq"
Nov 04 05:45:51.632887 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.632870    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-workload-socket\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl\" (UID: \"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl"
Nov 04 05:45:51.632964 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.632926    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-istiod-ca-cert\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl\" (UID: \"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl"
Nov 04 05:45:51.633109 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.633087    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-credential-socket\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl\" (UID: \"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl"
Nov 04 05:45:51.634078 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.633945    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7aa548d9-1602-4daa-8568-cd9c053f8a38-istio-token" pod "7aa548d9-1602-4daa-8568-cd9c053f8a38" (UID: "7aa548d9-1602-4daa-8568-cd9c053f8a38"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:51.634078 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.633981    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7aa548d9-1602-4daa-8568-cd9c053f8a38-istio-envoy" pod "7aa548d9-1602-4daa-8568-cd9c053f8a38" (UID: "7aa548d9-1602-4daa-8568-cd9c053f8a38"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:51.634078 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.634023    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7aa548d9-1602-4daa-8568-cd9c053f8a38-kube-api-access-mp4hg" pod "7aa548d9-1602-4daa-8568-cd9c053f8a38" (UID: "7aa548d9-1602-4daa-8568-cd9c053f8a38"). InnerVolumeSpecName "kube-api-access-mp4hg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:51.634078 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.634070    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7aa548d9-1602-4daa-8568-cd9c053f8a38-istio-podinfo" pod "7aa548d9-1602-4daa-8568-cd9c053f8a38" (UID: "7aa548d9-1602-4daa-8568-cd9c053f8a38"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 05:45:51.634284 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.634213    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-istio-envoy\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl\" (UID: \"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl"
Nov 04 05:45:51.639147 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.639123    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14d9c974-e49a-45d5-9c95-e8b2a390a185-istio-token\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq\" (UID: \"14d9c974-e49a-45d5-9c95-e8b2a390a185\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq"
Nov 04 05:45:51.642612 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.642586    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwljc\" (UniqueName: \"kubernetes.io/projected/14d9c974-e49a-45d5-9c95-e8b2a390a185-kube-api-access-jwljc\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq\" (UID: \"14d9c974-e49a-45d5-9c95-e8b2a390a185\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq"
Nov 04 05:45:51.645606 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.645587    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whrnv\" (UniqueName: \"kubernetes.io/projected/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-kube-api-access-whrnv\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl\" (UID: \"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl"
Nov 04 05:45:51.647872 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.647851    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-istio-token\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl\" (UID: \"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl"
Nov 04 05:45:51.689653 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.689622    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4"]
Nov 04 05:45:51.690024 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.690002    4357 cpu_manager.go:414] "containerMap: removing container" podUID="7aa548d9-1602-4daa-8568-cd9c053f8a38" containerName="istio-proxy"
Nov 04 05:45:51.690024 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.690016    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7aa548d9-1602-4daa-8568-cd9c053f8a38" containerName="istio-proxy"
Nov 04 05:45:51.691558 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.690935    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="8d46061a-a82a-4a03-8200-c9ba11866b48" containerName="istio-proxy"
Nov 04 05:45:51.691558 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.690966    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="7aa548d9-1602-4daa-8568-cd9c053f8a38" containerName="istio-proxy"
Nov 04 05:45:51.698013 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.697474    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4"
Nov 04 05:45:51.713346 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.713312    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4"]
Nov 04 05:45:51.733975 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.733955    4357 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7aa548d9-1602-4daa-8568-cd9c053f8a38-istio-podinfo\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:51.733975 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.733977    4357 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7aa548d9-1602-4daa-8568-cd9c053f8a38-istio-token\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:51.734113 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.733988    4357 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mp4hg\" (UniqueName: \"kubernetes.io/projected/7aa548d9-1602-4daa-8568-cd9c053f8a38-kube-api-access-mp4hg\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:51.734113 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.733998    4357 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7aa548d9-1602-4daa-8568-cd9c053f8a38-istio-envoy\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:51.762811 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.762792    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq"
Nov 04 05:45:51.777807 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.777780    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl"
Nov 04 05:45:51.836222 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.836121    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a1d76cc-d277-460b-9d2e-19e465e93008-istio-data\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4\" (UID: \"7a1d76cc-d277-460b-9d2e-19e465e93008\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4"
Nov 04 05:45:51.836222 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.836197    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a1d76cc-d277-460b-9d2e-19e465e93008-workload-certs\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4\" (UID: \"7a1d76cc-d277-460b-9d2e-19e465e93008\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4"
Nov 04 05:45:51.836425 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.836324    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a1d76cc-d277-460b-9d2e-19e465e93008-istio-envoy\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4\" (UID: \"7a1d76cc-d277-460b-9d2e-19e465e93008\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4"
Nov 04 05:45:51.836425 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.836375    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a1d76cc-d277-460b-9d2e-19e465e93008-workload-socket\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4\" (UID: \"7a1d76cc-d277-460b-9d2e-19e465e93008\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4"
Nov 04 05:45:51.836557 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.836434    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a1d76cc-d277-460b-9d2e-19e465e93008-istiod-ca-cert\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4\" (UID: \"7a1d76cc-d277-460b-9d2e-19e465e93008\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4"
Nov 04 05:45:51.836557 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.836494    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a1d76cc-d277-460b-9d2e-19e465e93008-credential-socket\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4\" (UID: \"7a1d76cc-d277-460b-9d2e-19e465e93008\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4"
Nov 04 05:45:51.836678 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.836558    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a1d76cc-d277-460b-9d2e-19e465e93008-istio-token\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4\" (UID: \"7a1d76cc-d277-460b-9d2e-19e465e93008\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4"
Nov 04 05:45:51.836678 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.836588    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq4w2\" (UniqueName: \"kubernetes.io/projected/7a1d76cc-d277-460b-9d2e-19e465e93008-kube-api-access-mq4w2\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4\" (UID: \"7a1d76cc-d277-460b-9d2e-19e465e93008\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4"
Nov 04 05:45:51.836678 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.836617    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a1d76cc-d277-460b-9d2e-19e465e93008-istio-podinfo\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4\" (UID: \"7a1d76cc-d277-460b-9d2e-19e465e93008\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4"
Nov 04 05:45:51.937964 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.937929    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a1d76cc-d277-460b-9d2e-19e465e93008-istio-data\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4\" (UID: \"7a1d76cc-d277-460b-9d2e-19e465e93008\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4"
Nov 04 05:45:51.938075 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.937977    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a1d76cc-d277-460b-9d2e-19e465e93008-workload-certs\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4\" (UID: \"7a1d76cc-d277-460b-9d2e-19e465e93008\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4"
Nov 04 05:45:51.938075 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.938035    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a1d76cc-d277-460b-9d2e-19e465e93008-istio-envoy\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4\" (UID: \"7a1d76cc-d277-460b-9d2e-19e465e93008\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4"
Nov 04 05:45:51.938075 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.938064    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a1d76cc-d277-460b-9d2e-19e465e93008-workload-socket\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4\" (UID: \"7a1d76cc-d277-460b-9d2e-19e465e93008\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4"
Nov 04 05:45:51.938192 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.938117    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a1d76cc-d277-460b-9d2e-19e465e93008-istiod-ca-cert\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4\" (UID: \"7a1d76cc-d277-460b-9d2e-19e465e93008\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4"
Nov 04 05:45:51.938192 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.938171    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a1d76cc-d277-460b-9d2e-19e465e93008-credential-socket\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4\" (UID: \"7a1d76cc-d277-460b-9d2e-19e465e93008\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4"
Nov 04 05:45:51.938277 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.938213    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a1d76cc-d277-460b-9d2e-19e465e93008-istio-token\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4\" (UID: \"7a1d76cc-d277-460b-9d2e-19e465e93008\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4"
Nov 04 05:45:51.938277 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.938254    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq4w2\" (UniqueName: \"kubernetes.io/projected/7a1d76cc-d277-460b-9d2e-19e465e93008-kube-api-access-mq4w2\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4\" (UID: \"7a1d76cc-d277-460b-9d2e-19e465e93008\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4"
Nov 04 05:45:51.938385 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.938353    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a1d76cc-d277-460b-9d2e-19e465e93008-istio-data\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4\" (UID: \"7a1d76cc-d277-460b-9d2e-19e465e93008\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4"
Nov 04 05:45:51.938424 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.938397    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a1d76cc-d277-460b-9d2e-19e465e93008-istio-podinfo\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4\" (UID: \"7a1d76cc-d277-460b-9d2e-19e465e93008\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4"
Nov 04 05:45:51.938458 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.938422    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a1d76cc-d277-460b-9d2e-19e465e93008-workload-certs\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4\" (UID: \"7a1d76cc-d277-460b-9d2e-19e465e93008\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4"
Nov 04 05:45:51.938584 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.938562    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a1d76cc-d277-460b-9d2e-19e465e93008-workload-socket\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4\" (UID: \"7a1d76cc-d277-460b-9d2e-19e465e93008\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4"
Nov 04 05:45:51.938803 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.938780    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a1d76cc-d277-460b-9d2e-19e465e93008-credential-socket\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4\" (UID: \"7a1d76cc-d277-460b-9d2e-19e465e93008\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4"
Nov 04 05:45:51.938993 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.938975    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a1d76cc-d277-460b-9d2e-19e465e93008-istiod-ca-cert\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4\" (UID: \"7a1d76cc-d277-460b-9d2e-19e465e93008\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4"
Nov 04 05:45:51.940138 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.940116    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a1d76cc-d277-460b-9d2e-19e465e93008-istio-envoy\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4\" (UID: \"7a1d76cc-d277-460b-9d2e-19e465e93008\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4"
Nov 04 05:45:51.940777 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.940735    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a1d76cc-d277-460b-9d2e-19e465e93008-istio-podinfo\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4\" (UID: \"7a1d76cc-d277-460b-9d2e-19e465e93008\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4"
Nov 04 05:45:51.947594 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.947568    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a1d76cc-d277-460b-9d2e-19e465e93008-istio-token\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4\" (UID: \"7a1d76cc-d277-460b-9d2e-19e465e93008\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4"
Nov 04 05:45:51.947678 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:51.947614    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq4w2\" (UniqueName: \"kubernetes.io/projected/7a1d76cc-d277-460b-9d2e-19e465e93008-kube-api-access-mq4w2\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4\" (UID: \"7a1d76cc-d277-460b-9d2e-19e465e93008\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4"
Nov 04 05:45:52.036099 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:52.035756    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4"
Nov 04 05:45:52.067798 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:52.067734    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq"]
Nov 04 05:45:52.076554 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:52.076527    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl"]
Nov 04 05:45:52.121875 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:52.121846    4357 generic.go:356] "Generic (PLEG): container finished" podID="8d46061a-a82a-4a03-8200-c9ba11866b48" containerID="bb1348c0a36c99d899fa8e06318093134429bac30b0878b825e131a4315afd25" exitCode=0
Nov 04 05:45:52.122009 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:52.121922    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn"
Nov 04 05:45:52.122009 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:52.121933    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn" event={"ID":"8d46061a-a82a-4a03-8200-c9ba11866b48","Type":"ContainerDied","Data":"bb1348c0a36c99d899fa8e06318093134429bac30b0878b825e131a4315afd25"}
Nov 04 05:45:52.122009 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:52.121994    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn" event={"ID":"8d46061a-a82a-4a03-8200-c9ba11866b48","Type":"ContainerDied","Data":"e39494b6d5c613767bec1aa3058e9d87ea67f66a7fd424b4e277f2a35c654572"}
Nov 04 05:45:52.122177 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:52.122024    4357 scope.go:122] "RemoveContainer" containerID="bb1348c0a36c99d899fa8e06318093134429bac30b0878b825e131a4315afd25"
Nov 04 05:45:52.123921 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:52.123897    4357 generic.go:356] "Generic (PLEG): container finished" podID="7aa548d9-1602-4daa-8568-cd9c053f8a38" containerID="348bc2de3c5d4d4592c6257ef87b68568685eb1b468f677bb36c1c4e1b895e25" exitCode=0
Nov 04 05:45:52.124023 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:52.123950    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6" event={"ID":"7aa548d9-1602-4daa-8568-cd9c053f8a38","Type":"ContainerDied","Data":"348bc2de3c5d4d4592c6257ef87b68568685eb1b468f677bb36c1c4e1b895e25"}
Nov 04 05:45:52.124023 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:52.123961    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6"
Nov 04 05:45:52.124023 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:52.123990    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6" event={"ID":"7aa548d9-1602-4daa-8568-cd9c053f8a38","Type":"ContainerDied","Data":"4da0047230d5f3daa1eb9000cb2f4c3d5a1112731cf3684df7934149ce527ed1"}
Nov 04 05:45:52.140545 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:45:52.136032    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14d9c974_e49a_45d5_9c95_e8b2a390a185.slice/crio-8e668eb8eebd85349afc2ab35c4882cae16933d7f0e6fa3c438dd01f81f8616b WatchSource:0}: Error finding container 8e668eb8eebd85349afc2ab35c4882cae16933d7f0e6fa3c438dd01f81f8616b: Status 404 returned error can't find the container with id 8e668eb8eebd85349afc2ab35c4882cae16933d7f0e6fa3c438dd01f81f8616b
Nov 04 05:45:52.140545 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:45:52.136344    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3aabb5c_cdeb_4afe_8785_d5bf5d82266a.slice/crio-537ffbf6fde5a2f9d070563532dffe629abf88a1be5489876c91fc30eae06051 WatchSource:0}: Error finding container 537ffbf6fde5a2f9d070563532dffe629abf88a1be5489876c91fc30eae06051: Status 404 returned error can't find the container with id 537ffbf6fde5a2f9d070563532dffe629abf88a1be5489876c91fc30eae06051
Nov 04 05:45:52.146037 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:52.146018    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn"]
Nov 04 05:45:52.149693 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:52.149671    4357 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-r5zxn"]
Nov 04 05:45:52.159028 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:52.158290    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:45:52.159028 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:52.158368    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:45:52.159028 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:52.158407    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:45:52.160117 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:52.160087    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:45:52.160211 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:52.160163    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:45:52.160211 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:52.160202    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:45:52.164614 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:52.160587    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6"]
Nov 04 05:45:52.169272 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:52.169252    4357 scope.go:122] "RemoveContainer" containerID="d3d03b75ec9f0e1bb3370abcc7369cf1a332e54c722fad8798f0b29b496e9e0c"
Nov 04 05:45:52.174188 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:52.174164    4357 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-xt6h6"]
Nov 04 05:45:52.180314 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:52.180294    4357 scope.go:122] "RemoveContainer" containerID="bb1348c0a36c99d899fa8e06318093134429bac30b0878b825e131a4315afd25"
Nov 04 05:45:52.181724 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:45:52.181688    4357 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb1348c0a36c99d899fa8e06318093134429bac30b0878b825e131a4315afd25\": container with ID starting with bb1348c0a36c99d899fa8e06318093134429bac30b0878b825e131a4315afd25 not found: ID does not exist" containerID="bb1348c0a36c99d899fa8e06318093134429bac30b0878b825e131a4315afd25"
Nov 04 05:45:52.181809 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:52.181729    4357 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb1348c0a36c99d899fa8e06318093134429bac30b0878b825e131a4315afd25"} err="failed to get container status \"bb1348c0a36c99d899fa8e06318093134429bac30b0878b825e131a4315afd25\": rpc error: code = NotFound desc = could not find container \"bb1348c0a36c99d899fa8e06318093134429bac30b0878b825e131a4315afd25\": container with ID starting with bb1348c0a36c99d899fa8e06318093134429bac30b0878b825e131a4315afd25 not found: ID does not exist"
Nov 04 05:45:52.181809 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:52.181791    4357 scope.go:122] "RemoveContainer" containerID="d3d03b75ec9f0e1bb3370abcc7369cf1a332e54c722fad8798f0b29b496e9e0c"
Nov 04 05:45:52.182119 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:45:52.182095    4357 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3d03b75ec9f0e1bb3370abcc7369cf1a332e54c722fad8798f0b29b496e9e0c\": container with ID starting with d3d03b75ec9f0e1bb3370abcc7369cf1a332e54c722fad8798f0b29b496e9e0c not found: ID does not exist" containerID="d3d03b75ec9f0e1bb3370abcc7369cf1a332e54c722fad8798f0b29b496e9e0c"
Nov 04 05:45:52.182214 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:52.182129    4357 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3d03b75ec9f0e1bb3370abcc7369cf1a332e54c722fad8798f0b29b496e9e0c"} err="failed to get container status \"d3d03b75ec9f0e1bb3370abcc7369cf1a332e54c722fad8798f0b29b496e9e0c\": rpc error: code = NotFound desc = could not find container \"d3d03b75ec9f0e1bb3370abcc7369cf1a332e54c722fad8798f0b29b496e9e0c\": container with ID starting with d3d03b75ec9f0e1bb3370abcc7369cf1a332e54c722fad8798f0b29b496e9e0c not found: ID does not exist"
Nov 04 05:45:52.182214 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:52.182151    4357 scope.go:122] "RemoveContainer" containerID="348bc2de3c5d4d4592c6257ef87b68568685eb1b468f677bb36c1c4e1b895e25"
Nov 04 05:45:52.198954 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:52.198917    4357 scope.go:122] "RemoveContainer" containerID="348bc2de3c5d4d4592c6257ef87b68568685eb1b468f677bb36c1c4e1b895e25"
Nov 04 05:45:52.200102 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:45:52.200076    4357 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"348bc2de3c5d4d4592c6257ef87b68568685eb1b468f677bb36c1c4e1b895e25\": container with ID starting with 348bc2de3c5d4d4592c6257ef87b68568685eb1b468f677bb36c1c4e1b895e25 not found: ID does not exist" containerID="348bc2de3c5d4d4592c6257ef87b68568685eb1b468f677bb36c1c4e1b895e25"
Nov 04 05:45:52.200298 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:52.200271    4357 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"348bc2de3c5d4d4592c6257ef87b68568685eb1b468f677bb36c1c4e1b895e25"} err="failed to get container status \"348bc2de3c5d4d4592c6257ef87b68568685eb1b468f677bb36c1c4e1b895e25\": rpc error: code = NotFound desc = could not find container \"348bc2de3c5d4d4592c6257ef87b68568685eb1b468f677bb36c1c4e1b895e25\": container with ID starting with 348bc2de3c5d4d4592c6257ef87b68568685eb1b468f677bb36c1c4e1b895e25 not found: ID does not exist"
Nov 04 05:45:52.369838 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:52.369111    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:45:52.369838 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:52.369225    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:45:52.369838 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:52.369268    4357 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 05:45:52.372548 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:52.372347    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4"]
Nov 04 05:45:52.469413 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:52.469387    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-27935d-6dffddbb9f-8k6nc"
Nov 04 05:45:52.596390 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:52.566224    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5ed67653-cc0f-4000-aa56-edd9d733b025-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ed67653-cc0f-4000-aa56-edd9d733b025-plugins-config-volume\") pod \"5ed67653-cc0f-4000-aa56-edd9d733b025\" (UID: \"5ed67653-cc0f-4000-aa56-edd9d733b025\") "
Nov 04 05:45:52.596390 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:52.566293    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5ed67653-cc0f-4000-aa56-edd9d733b025-kube-api-access-jq2ff\" (UniqueName: \"kubernetes.io/projected/5ed67653-cc0f-4000-aa56-edd9d733b025-kube-api-access-jq2ff\") pod \"5ed67653-cc0f-4000-aa56-edd9d733b025\" (UID: \"5ed67653-cc0f-4000-aa56-edd9d733b025\") "
Nov 04 05:45:52.596390 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:52.579980    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ed67653-cc0f-4000-aa56-edd9d733b025-plugins-config-volume" pod "5ed67653-cc0f-4000-aa56-edd9d733b025" (UID: "5ed67653-cc0f-4000-aa56-edd9d733b025"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:45:52.621475 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:52.621386    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ed67653-cc0f-4000-aa56-edd9d733b025-kube-api-access-jq2ff" pod "5ed67653-cc0f-4000-aa56-edd9d733b025" (UID: "5ed67653-cc0f-4000-aa56-edd9d733b025"). InnerVolumeSpecName "kube-api-access-jq2ff". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:52.667649 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:52.667615    4357 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ed67653-cc0f-4000-aa56-edd9d733b025-plugins-config-volume\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:52.667839 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:52.667825    4357 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jq2ff\" (UniqueName: \"kubernetes.io/projected/5ed67653-cc0f-4000-aa56-edd9d733b025-kube-api-access-jq2ff\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:53.387540 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:53.382769    4357 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7aa548d9-1602-4daa-8568-cd9c053f8a38" path="/var/lib/kubelet/pods/7aa548d9-1602-4daa-8568-cd9c053f8a38/volumes"
Nov 04 05:45:53.387540 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:53.383445    4357 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8d46061a-a82a-4a03-8200-c9ba11866b48" path="/var/lib/kubelet/pods/8d46061a-a82a-4a03-8200-c9ba11866b48/volumes"
Nov 04 05:45:53.556784 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:53.556745    4357 generic.go:356] "Generic (PLEG): container finished" podID="5ed67653-cc0f-4000-aa56-edd9d733b025" containerID="926bbda821115dc3e4fe8c35c17083b064dd5f8c0d59ce7d82e3bd159709f8b5" exitCode=0
Nov 04 05:45:53.557152 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:53.556815    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-27935d-6dffddbb9f-8k6nc" event={"ID":"5ed67653-cc0f-4000-aa56-edd9d733b025","Type":"ContainerDied","Data":"926bbda821115dc3e4fe8c35c17083b064dd5f8c0d59ce7d82e3bd159709f8b5"}
Nov 04 05:45:53.557152 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:53.556873    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-27935d-6dffddbb9f-8k6nc" event={"ID":"5ed67653-cc0f-4000-aa56-edd9d733b025","Type":"ContainerDied","Data":"4e6887d2fe64cff6e22e6d203e994da166835bd077ba7fd9e57809275df7133c"}
Nov 04 05:45:53.557152 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:53.556908    4357 scope.go:122] "RemoveContainer" containerID="926bbda821115dc3e4fe8c35c17083b064dd5f8c0d59ce7d82e3bd159709f8b5"
Nov 04 05:45:53.557152 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:53.557006    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-27935d-6dffddbb9f-8k6nc"
Nov 04 05:45:53.586538 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:53.584510    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq" event={"ID":"14d9c974-e49a-45d5-9c95-e8b2a390a185","Type":"ContainerStarted","Data":"6d2abbb209920509e0a025168acdfe49f1b3f71410dbff52fd0a33d839b4b51b"}
Nov 04 05:45:53.586538 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:53.584594    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq" event={"ID":"14d9c974-e49a-45d5-9c95-e8b2a390a185","Type":"ContainerStarted","Data":"8e668eb8eebd85349afc2ab35c4882cae16933d7f0e6fa3c438dd01f81f8616b"}
Nov 04 05:45:53.631824 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:53.631767    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq" podStartSLOduration=2.631746821 podStartE2EDuration="2.631746821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:45:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:45:53.622295307 +0000 UTC m=+1040.490958878" watchObservedRunningTime="2026-11-04 05:45:53.631746821 +0000 UTC m=+1040.500410395"
Nov 04 05:45:53.642676 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:53.642591    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-27935d-6dffddbb9f-8k6nc"]
Nov 04 05:45:53.646324 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:53.646295    4357 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-27935d-6dffddbb9f-8k6nc"]
Nov 04 05:45:53.648922 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:53.648891    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4" event={"ID":"7a1d76cc-d277-460b-9d2e-19e465e93008","Type":"ContainerStarted","Data":"fd637f770374c8996f2d851cbc053ebd0b7f4f5d0a72b6e82bdd2d62041cbfdd"}
Nov 04 05:45:53.649128 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:53.649111    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4" event={"ID":"7a1d76cc-d277-460b-9d2e-19e465e93008","Type":"ContainerStarted","Data":"54aab8f954e7c1b7dcb500eddd7a63fe3b81d0237808966626205bb8afdbd271"}
Nov 04 05:45:53.652488 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:53.652457    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl" event={"ID":"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a","Type":"ContainerStarted","Data":"16d52235cde4e37494afe36960c3f765dce48b449f378a6b686ab6227ffefdf4"}
Nov 04 05:45:53.652782 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:53.652688    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl" event={"ID":"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a","Type":"ContainerStarted","Data":"537ffbf6fde5a2f9d070563532dffe629abf88a1be5489876c91fc30eae06051"}
Nov 04 05:45:53.654558 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:53.654543    4357 scope.go:122] "RemoveContainer" containerID="926bbda821115dc3e4fe8c35c17083b064dd5f8c0d59ce7d82e3bd159709f8b5"
Nov 04 05:45:53.655411 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:45:53.655377    4357 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"926bbda821115dc3e4fe8c35c17083b064dd5f8c0d59ce7d82e3bd159709f8b5\": container with ID starting with 926bbda821115dc3e4fe8c35c17083b064dd5f8c0d59ce7d82e3bd159709f8b5 not found: ID does not exist" containerID="926bbda821115dc3e4fe8c35c17083b064dd5f8c0d59ce7d82e3bd159709f8b5"
Nov 04 05:45:53.655496 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:53.655409    4357 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"926bbda821115dc3e4fe8c35c17083b064dd5f8c0d59ce7d82e3bd159709f8b5"} err="failed to get container status \"926bbda821115dc3e4fe8c35c17083b064dd5f8c0d59ce7d82e3bd159709f8b5\": rpc error: code = NotFound desc = could not find container \"926bbda821115dc3e4fe8c35c17083b064dd5f8c0d59ce7d82e3bd159709f8b5\": container with ID starting with 926bbda821115dc3e4fe8c35c17083b064dd5f8c0d59ce7d82e3bd159709f8b5 not found: ID does not exist"
Nov 04 05:45:53.723549 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:53.719382    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4" podStartSLOduration=2.7193641250000002 podStartE2EDuration="2.719364125s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:45:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:45:53.702633613 +0000 UTC m=+1040.571297199" watchObservedRunningTime="2026-11-04 05:45:53.719364125 +0000 UTC m=+1040.588027693"
Nov 04 05:45:53.778554 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:53.772001    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq"
Nov 04 05:45:53.778554 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:53.775155    4357 patch_prober.go:29] interesting pod/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Nov 04 05:45:53.778554 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:53.775208    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq" podUID="14d9c974-e49a-45d5-9c95-e8b2a390a185" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Nov 04 05:45:53.778554 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:53.778167    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl"
Nov 04 05:45:53.801551 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:53.787057    4357 patch_prober.go:29] interesting pod/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Nov 04 05:45:53.801551 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:53.787127    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl" podUID="f3aabb5c-cdeb-4afe-8785-d5bf5d82266a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Nov 04 05:45:54.049714 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:54.037715    4357 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4"
Nov 04 05:45:54.049714 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:54.039647    4357 patch_prober.go:29] interesting pod/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Nov 04 05:45:54.049714 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:54.039717    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4" podUID="7a1d76cc-d277-460b-9d2e-19e465e93008" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Nov 04 05:45:54.778564 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:54.775400    4357 patch_prober.go:29] interesting pod/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Nov 04 05:45:54.778564 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:54.775455    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq" podUID="14d9c974-e49a-45d5-9c95-e8b2a390a185" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Nov 04 05:45:54.779350 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:54.779324    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-f910f5-668ff7855-g8p5s"
Nov 04 05:45:54.784321 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:54.784287    4357 patch_prober.go:29] interesting pod/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Nov 04 05:45:54.784478 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:54.784457    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl" podUID="f3aabb5c-cdeb-4afe-8785-d5bf5d82266a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Nov 04 05:45:54.791391 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:54.791367    4357 generic.go:356] "Generic (PLEG): container finished" podID="6c343ea7-372f-4d66-9534-c758209541b0" containerID="b9b10d6504efd8555670fdd8384501f36a2030a9431bb0fc76f0f694511d6fec" exitCode=0
Nov 04 05:45:54.792476 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:54.792451    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-f910f5-668ff7855-g8p5s" event={"ID":"6c343ea7-372f-4d66-9534-c758209541b0","Type":"ContainerDied","Data":"b9b10d6504efd8555670fdd8384501f36a2030a9431bb0fc76f0f694511d6fec"}
Nov 04 05:45:54.792685 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:54.792665    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-f910f5-668ff7855-g8p5s" event={"ID":"6c343ea7-372f-4d66-9534-c758209541b0","Type":"ContainerDied","Data":"2d72826b2a1918f5f08405883ae1b010f64e14c9653109bfb11b51753b50da85"}
Nov 04 05:45:54.792830 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:54.792817    4357 scope.go:122] "RemoveContainer" containerID="b9b10d6504efd8555670fdd8384501f36a2030a9431bb0fc76f0f694511d6fec"
Nov 04 05:45:54.851921 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:54.850172    4357 scope.go:122] "RemoveContainer" containerID="b9b10d6504efd8555670fdd8384501f36a2030a9431bb0fc76f0f694511d6fec"
Nov 04 05:45:54.855165 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:54.855114    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl" podStartSLOduration=3.85509646 podStartE2EDuration="3.85509646s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:45:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:45:53.752173371 +0000 UTC m=+1040.620836988" watchObservedRunningTime="2026-11-04 05:45:54.85509646 +0000 UTC m=+1041.723760035"
Nov 04 05:45:54.858280 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:45:54.858254    4357 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9b10d6504efd8555670fdd8384501f36a2030a9431bb0fc76f0f694511d6fec\": container with ID starting with b9b10d6504efd8555670fdd8384501f36a2030a9431bb0fc76f0f694511d6fec not found: ID does not exist" containerID="b9b10d6504efd8555670fdd8384501f36a2030a9431bb0fc76f0f694511d6fec"
Nov 04 05:45:54.858378 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:54.858291    4357 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9b10d6504efd8555670fdd8384501f36a2030a9431bb0fc76f0f694511d6fec"} err="failed to get container status \"b9b10d6504efd8555670fdd8384501f36a2030a9431bb0fc76f0f694511d6fec\": rpc error: code = NotFound desc = could not find container \"b9b10d6504efd8555670fdd8384501f36a2030a9431bb0fc76f0f694511d6fec\": container with ID starting with b9b10d6504efd8555670fdd8384501f36a2030a9431bb0fc76f0f694511d6fec not found: ID does not exist"
Nov 04 05:45:54.888945 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:54.888911    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6c343ea7-372f-4d66-9534-c758209541b0-kube-api-access-nrhxf\" (UniqueName: \"kubernetes.io/projected/6c343ea7-372f-4d66-9534-c758209541b0-kube-api-access-nrhxf\") pod \"6c343ea7-372f-4d66-9534-c758209541b0\" (UID: \"6c343ea7-372f-4d66-9534-c758209541b0\") "
Nov 04 05:45:54.911537 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:54.889190    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6c343ea7-372f-4d66-9534-c758209541b0-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c343ea7-372f-4d66-9534-c758209541b0-plugins-config-volume\") pod \"6c343ea7-372f-4d66-9534-c758209541b0\" (UID: \"6c343ea7-372f-4d66-9534-c758209541b0\") "
Nov 04 05:45:54.928912 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:54.928864    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c343ea7-372f-4d66-9534-c758209541b0-kube-api-access-nrhxf" pod "6c343ea7-372f-4d66-9534-c758209541b0" (UID: "6c343ea7-372f-4d66-9534-c758209541b0"). InnerVolumeSpecName "kube-api-access-nrhxf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:54.934618 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:54.930726    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c343ea7-372f-4d66-9534-c758209541b0-plugins-config-volume" pod "6c343ea7-372f-4d66-9534-c758209541b0" (UID: "6c343ea7-372f-4d66-9534-c758209541b0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:45:55.023556 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:55.021268    4357 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrhxf\" (UniqueName: \"kubernetes.io/projected/6c343ea7-372f-4d66-9534-c758209541b0-kube-api-access-nrhxf\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:55.023796 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:55.023774    4357 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c343ea7-372f-4d66-9534-c758209541b0-plugins-config-volume\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:55.037476 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:55.036957    4357 patch_prober.go:29] interesting pod/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Nov 04 05:45:55.037476 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:55.037030    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4" podUID="7a1d76cc-d277-460b-9d2e-19e465e93008" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Nov 04 05:45:55.355566 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:55.355223    4357 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5ed67653-cc0f-4000-aa56-edd9d733b025" path="/var/lib/kubelet/pods/5ed67653-cc0f-4000-aa56-edd9d733b025/volumes"
Nov 04 05:45:55.457078 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:55.457039    4357 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-f910f5-668ff7855-g8p5s" podUID="6c343ea7-372f-4d66-9534-c758209541b0" containerName="payload-pre-processing" probeResult="failure" output="timeout: failed to connect service \"10.133.0.35:50052\" within 1s: context deadline exceeded"
Nov 04 05:45:55.457254 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:55.457122    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-f910f5-668ff7855-g8p5s"
Nov 04 05:45:55.457254 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:45:55.457148    4357 logging.go:55] [core] [Channel #407 SubChannel #408]grpc: addrConn.createTransport failed to connect to {Addr: "10.133.0.35:50052", ServerName: "10.133.0.35:50052", BalancerAttributes: {"<%!p(pickfirstleaf.managedByPickfirstKeyType={})>": "<%!p(bool=true)>" }}. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.133.0.35:50052: operation was canceled"
Nov 04 05:45:55.768542 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:55.763853    4357 patch_prober.go:29] interesting pod/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Nov 04 05:45:55.768542 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:55.763914    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq" podUID="14d9c974-e49a-45d5-9c95-e8b2a390a185" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Nov 04 05:45:55.798539 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:55.797945    4357 patch_prober.go:29] interesting pod/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Nov 04 05:45:55.798539 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:55.798028    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl" podUID="f3aabb5c-cdeb-4afe-8785-d5bf5d82266a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Nov 04 05:45:55.837544 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:55.834369    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-f910f5-668ff7855-g8p5s"
Nov 04 05:45:55.870001 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:55.869626    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-f910f5-668ff7855-g8p5s"]
Nov 04 05:45:55.914541 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:55.874428    4357 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-f910f5-668ff7855-g8p5s"]
Nov 04 05:45:56.039615 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:56.037904    4357 patch_prober.go:29] interesting pod/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Nov 04 05:45:56.039615 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:56.037965    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4" podUID="7a1d76cc-d277-460b-9d2e-19e465e93008" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Nov 04 05:45:56.771540 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:56.767935    4357 patch_prober.go:29] interesting pod/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Nov 04 05:45:56.771540 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:56.768013    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq" podUID="14d9c974-e49a-45d5-9c95-e8b2a390a185" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Nov 04 05:45:56.791540 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:56.781485    4357 patch_prober.go:29] interesting pod/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Nov 04 05:45:56.791540 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:56.781555    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl" podUID="f3aabb5c-cdeb-4afe-8785-d5bf5d82266a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Nov 04 05:45:57.037008 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:57.036919    4357 patch_prober.go:29] interesting pod/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Nov 04 05:45:57.037008 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:57.036984    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4" podUID="7a1d76cc-d277-460b-9d2e-19e465e93008" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Nov 04 05:45:57.307591 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:57.305669    4357 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6c343ea7-372f-4d66-9534-c758209541b0" path="/var/lib/kubelet/pods/6c343ea7-372f-4d66-9534-c758209541b0/volumes"
Nov 04 05:45:57.582626 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:57.578949    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48"]
Nov 04 05:45:57.582626 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:57.579211    4357 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48" podUID="54a708a2-3b46-489d-bc33-0954c018f253" containerName="istio-proxy" containerID="cri-o://cd16634b8c4907d667a0341e7c494aef4c97d3b1755aba1ced2bedee797eefbd" gracePeriod=30
Nov 04 05:45:57.653554 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:57.615569    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph"]
Nov 04 05:45:57.653554 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:57.615837    4357 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph" podUID="283c52c3-ef70-4c20-9862-02ce8f496e47" containerName="istio-proxy" containerID="cri-o://f9b30df84ec3c4d41b55aaa8a4685adf1b92d23b733ef859e7272ab928a7d854" gracePeriod=30
Nov 04 05:45:57.659547 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:57.658428    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4"]
Nov 04 05:45:57.659547 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:57.658891    4357 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4" podUID="7a1d76cc-d277-460b-9d2e-19e465e93008" containerName="istio-proxy" containerID="cri-o://fd637f770374c8996f2d851cbc053ebd0b7f4f5d0a72b6e82bdd2d62041cbfdd" gracePeriod=30
Nov 04 05:45:57.846815 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:57.793727    4357 patch_prober.go:29] interesting pod/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Nov 04 05:45:57.846815 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:57.793790    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq" podUID="14d9c974-e49a-45d5-9c95-e8b2a390a185" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Nov 04 05:45:57.846815 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:57.810793    4357 patch_prober.go:29] interesting pod/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Nov 04 05:45:57.846815 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:57.810849    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl" podUID="f3aabb5c-cdeb-4afe-8785-d5bf5d82266a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Nov 04 05:45:57.846815 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:57.845193    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb"]
Nov 04 05:45:57.846815 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:57.845430    4357 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb" podUID="9e96333d-b91c-4a31-80d0-369af77f5eb8" containerName="istio-proxy" containerID="cri-o://a736664a68b278b227e1536e0da094db32ad532b6039f39c027dba56786f6c48" gracePeriod=30
Nov 04 05:45:57.897885 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:57.897849    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt"]
Nov 04 05:45:57.898508 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:57.898433    4357 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt" podUID="33923021-e163-4976-a8bb-f74d79c5220a" containerName="istio-proxy" containerID="cri-o://bc78e40bb5c04f94d1c4b10a5755b837245cc0528b224a8f17baa41e51966da9" gracePeriod=30
Nov 04 05:45:58.767920 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:58.767881    4357 patch_prober.go:29] interesting pod/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Nov 04 05:45:58.790635 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:58.790589    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq" podUID="14d9c974-e49a-45d5-9c95-e8b2a390a185" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Nov 04 05:45:58.790865 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:58.779875    4357 patch_prober.go:29] interesting pod/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Nov 04 05:45:58.790987 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:58.790967    4357 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl" podUID="f3aabb5c-cdeb-4afe-8785-d5bf5d82266a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Nov 04 05:45:58.952786 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:58.952755    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl"]
Nov 04 05:45:58.953281 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:58.953250    4357 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl" podUID="f3aabb5c-cdeb-4afe-8785-d5bf5d82266a" containerName="istio-proxy" containerID="cri-o://16d52235cde4e37494afe36960c3f765dce48b449f378a6b686ab6227ffefdf4" gracePeriod=30
Nov 04 05:45:58.957442 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:58.957413    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q"]
Nov 04 05:45:58.957568 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:58.957467    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq"]
Nov 04 05:45:58.957645 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:58.957603    4357 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq" podUID="14d9c974-e49a-45d5-9c95-e8b2a390a185" containerName="istio-proxy" containerID="cri-o://6d2abbb209920509e0a025168acdfe49f1b3f71410dbff52fd0a33d839b4b51b" gracePeriod=30
Nov 04 05:45:58.957797 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:58.957778    4357 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q" podUID="43dd698a-4caf-4a7d-8dc3-dfe458da5c68" containerName="istio-proxy" containerID="cri-o://8e61e417f55a556154f58480608b2d3b32895136182ebbcd93755e184fa2c96a" gracePeriod=30
Nov 04 05:45:59.834887 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:59.834851    4357 patch_prober.go:29] interesting pod/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 04 05:45:59.835275 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:45:59.834912    4357 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph" podUID="283c52c3-ef70-4c20-9862-02ce8f496e47" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 04 05:46:00.284530 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:00.284490    4357 patch_prober.go:29] interesting pod/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 04 05:46:00.284667 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:00.284569    4357 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb" podUID="9e96333d-b91c-4a31-80d0-369af77f5eb8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 04 05:46:01.437231 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:01.437196    4357 patch_prober.go:29] interesting pod/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Nov 04 05:46:01.437607 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:01.437251    4357 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt" podUID="33923021-e163-4976-a8bb-f74d79c5220a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 04 05:46:02.816007 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:02.815978    4357 patch_prober.go:29] interesting pod/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Nov 04 05:46:02.816347 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:02.816028    4357 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48" podUID="54a708a2-3b46-489d-bc33-0954c018f253" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Nov 04 05:46:02.909176 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:02.909154    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph"
Nov 04 05:46:02.953460 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:02.953429    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/283c52c3-ef70-4c20-9862-02ce8f496e47-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/283c52c3-ef70-4c20-9862-02ce8f496e47-istiod-ca-cert\") pod \"283c52c3-ef70-4c20-9862-02ce8f496e47\" (UID: \"283c52c3-ef70-4c20-9862-02ce8f496e47\") "
Nov 04 05:46:02.953624 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:02.953482    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/283c52c3-ef70-4c20-9862-02ce8f496e47-istio-token\" (UniqueName: \"kubernetes.io/projected/283c52c3-ef70-4c20-9862-02ce8f496e47-istio-token\") pod \"283c52c3-ef70-4c20-9862-02ce8f496e47\" (UID: \"283c52c3-ef70-4c20-9862-02ce8f496e47\") "
Nov 04 05:46:02.953624 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:02.953546    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/283c52c3-ef70-4c20-9862-02ce8f496e47-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/283c52c3-ef70-4c20-9862-02ce8f496e47-workload-certs\") pod \"283c52c3-ef70-4c20-9862-02ce8f496e47\" (UID: \"283c52c3-ef70-4c20-9862-02ce8f496e47\") "
Nov 04 05:46:02.953624 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:02.953576    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/283c52c3-ef70-4c20-9862-02ce8f496e47-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/283c52c3-ef70-4c20-9862-02ce8f496e47-istio-podinfo\") pod \"283c52c3-ef70-4c20-9862-02ce8f496e47\" (UID: \"283c52c3-ef70-4c20-9862-02ce8f496e47\") "
Nov 04 05:46:02.953796 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:02.953651    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/283c52c3-ef70-4c20-9862-02ce8f496e47-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/283c52c3-ef70-4c20-9862-02ce8f496e47-workload-socket\") pod \"283c52c3-ef70-4c20-9862-02ce8f496e47\" (UID: \"283c52c3-ef70-4c20-9862-02ce8f496e47\") "
Nov 04 05:46:02.953796 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:02.953695    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/283c52c3-ef70-4c20-9862-02ce8f496e47-kube-api-access-jnvv6\" (UniqueName: \"kubernetes.io/projected/283c52c3-ef70-4c20-9862-02ce8f496e47-kube-api-access-jnvv6\") pod \"283c52c3-ef70-4c20-9862-02ce8f496e47\" (UID: \"283c52c3-ef70-4c20-9862-02ce8f496e47\") "
Nov 04 05:46:02.953796 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:02.953738    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/283c52c3-ef70-4c20-9862-02ce8f496e47-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/283c52c3-ef70-4c20-9862-02ce8f496e47-credential-socket\") pod \"283c52c3-ef70-4c20-9862-02ce8f496e47\" (UID: \"283c52c3-ef70-4c20-9862-02ce8f496e47\") "
Nov 04 05:46:02.954034 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:02.953813    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/283c52c3-ef70-4c20-9862-02ce8f496e47-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/283c52c3-ef70-4c20-9862-02ce8f496e47-istio-data\") pod \"283c52c3-ef70-4c20-9862-02ce8f496e47\" (UID: \"283c52c3-ef70-4c20-9862-02ce8f496e47\") "
Nov 04 05:46:02.954034 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:02.953825    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/283c52c3-ef70-4c20-9862-02ce8f496e47-workload-certs" pod "283c52c3-ef70-4c20-9862-02ce8f496e47" (UID: "283c52c3-ef70-4c20-9862-02ce8f496e47"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:02.954034 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:02.953859    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/283c52c3-ef70-4c20-9862-02ce8f496e47-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/283c52c3-ef70-4c20-9862-02ce8f496e47-istio-envoy\") pod \"283c52c3-ef70-4c20-9862-02ce8f496e47\" (UID: \"283c52c3-ef70-4c20-9862-02ce8f496e47\") "
Nov 04 05:46:02.954034 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:02.953966    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/283c52c3-ef70-4c20-9862-02ce8f496e47-workload-socket" pod "283c52c3-ef70-4c20-9862-02ce8f496e47" (UID: "283c52c3-ef70-4c20-9862-02ce8f496e47"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:02.954245 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:02.954094    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/283c52c3-ef70-4c20-9862-02ce8f496e47-credential-socket" pod "283c52c3-ef70-4c20-9862-02ce8f496e47" (UID: "283c52c3-ef70-4c20-9862-02ce8f496e47"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:02.954245 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:02.954109    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/283c52c3-ef70-4c20-9862-02ce8f496e47-istio-data" pod "283c52c3-ef70-4c20-9862-02ce8f496e47" (UID: "283c52c3-ef70-4c20-9862-02ce8f496e47"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:02.954356 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:02.954298    4357 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/283c52c3-ef70-4c20-9862-02ce8f496e47-workload-certs\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:02.954356 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:02.954351    4357 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/283c52c3-ef70-4c20-9862-02ce8f496e47-workload-socket\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:02.954462 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:02.954367    4357 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/283c52c3-ef70-4c20-9862-02ce8f496e47-credential-socket\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:02.954462 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:02.954381    4357 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/283c52c3-ef70-4c20-9862-02ce8f496e47-istio-data\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:02.954725 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:02.954683    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/283c52c3-ef70-4c20-9862-02ce8f496e47-istiod-ca-cert" pod "283c52c3-ef70-4c20-9862-02ce8f496e47" (UID: "283c52c3-ef70-4c20-9862-02ce8f496e47"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:46:02.956495 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:02.956468    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/283c52c3-ef70-4c20-9862-02ce8f496e47-kube-api-access-jnvv6" pod "283c52c3-ef70-4c20-9862-02ce8f496e47" (UID: "283c52c3-ef70-4c20-9862-02ce8f496e47"). InnerVolumeSpecName "kube-api-access-jnvv6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:46:02.956622 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:02.956576    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/283c52c3-ef70-4c20-9862-02ce8f496e47-istio-envoy" pod "283c52c3-ef70-4c20-9862-02ce8f496e47" (UID: "283c52c3-ef70-4c20-9862-02ce8f496e47"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:02.956762 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:02.956741    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/283c52c3-ef70-4c20-9862-02ce8f496e47-istio-token" pod "283c52c3-ef70-4c20-9862-02ce8f496e47" (UID: "283c52c3-ef70-4c20-9862-02ce8f496e47"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:46:02.956850 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:02.956798    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/283c52c3-ef70-4c20-9862-02ce8f496e47-istio-podinfo" pod "283c52c3-ef70-4c20-9862-02ce8f496e47" (UID: "283c52c3-ef70-4c20-9862-02ce8f496e47"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 05:46:02.980725 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:02.980700    4357 generic.go:356] "Generic (PLEG): container finished" podID="283c52c3-ef70-4c20-9862-02ce8f496e47" containerID="f9b30df84ec3c4d41b55aaa8a4685adf1b92d23b733ef859e7272ab928a7d854" exitCode=0
Nov 04 05:46:02.980871 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:02.980743    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph"
Nov 04 05:46:02.980871 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:02.980782    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph" event={"ID":"283c52c3-ef70-4c20-9862-02ce8f496e47","Type":"ContainerDied","Data":"f9b30df84ec3c4d41b55aaa8a4685adf1b92d23b733ef859e7272ab928a7d854"}
Nov 04 05:46:02.980871 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:02.980845    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph" event={"ID":"283c52c3-ef70-4c20-9862-02ce8f496e47","Type":"ContainerDied","Data":"25fbb4f9268d3313d742a278bed98d26996af3120607e96bdca17e71b246294b"}
Nov 04 05:46:02.981022 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:02.980879    4357 scope.go:122] "RemoveContainer" containerID="f9b30df84ec3c4d41b55aaa8a4685adf1b92d23b733ef859e7272ab928a7d854"
Nov 04 05:46:02.982872 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:02.982846    4357 generic.go:356] "Generic (PLEG): container finished" podID="9e96333d-b91c-4a31-80d0-369af77f5eb8" containerID="a736664a68b278b227e1536e0da094db32ad532b6039f39c027dba56786f6c48" exitCode=0
Nov 04 05:46:02.982999 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:02.982950    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb" event={"ID":"9e96333d-b91c-4a31-80d0-369af77f5eb8","Type":"ContainerDied","Data":"a736664a68b278b227e1536e0da094db32ad532b6039f39c027dba56786f6c48"}
Nov 04 05:46:02.984721 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:02.984696    4357 generic.go:356] "Generic (PLEG): container finished" podID="54a708a2-3b46-489d-bc33-0954c018f253" containerID="cd16634b8c4907d667a0341e7c494aef4c97d3b1755aba1ced2bedee797eefbd" exitCode=0
Nov 04 05:46:02.984876 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:02.984735    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48" event={"ID":"54a708a2-3b46-489d-bc33-0954c018f253","Type":"ContainerDied","Data":"cd16634b8c4907d667a0341e7c494aef4c97d3b1755aba1ced2bedee797eefbd"}
Nov 04 05:46:02.991158 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:02.991139    4357 scope.go:122] "RemoveContainer" containerID="f9b30df84ec3c4d41b55aaa8a4685adf1b92d23b733ef859e7272ab928a7d854"
Nov 04 05:46:02.991481 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:46:02.991458    4357 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9b30df84ec3c4d41b55aaa8a4685adf1b92d23b733ef859e7272ab928a7d854\": container with ID starting with f9b30df84ec3c4d41b55aaa8a4685adf1b92d23b733ef859e7272ab928a7d854 not found: ID does not exist" containerID="f9b30df84ec3c4d41b55aaa8a4685adf1b92d23b733ef859e7272ab928a7d854"
Nov 04 05:46:02.991557 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:02.991493    4357 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9b30df84ec3c4d41b55aaa8a4685adf1b92d23b733ef859e7272ab928a7d854"} err="failed to get container status \"f9b30df84ec3c4d41b55aaa8a4685adf1b92d23b733ef859e7272ab928a7d854\": rpc error: code = NotFound desc = could not find container \"f9b30df84ec3c4d41b55aaa8a4685adf1b92d23b733ef859e7272ab928a7d854\": container with ID starting with f9b30df84ec3c4d41b55aaa8a4685adf1b92d23b733ef859e7272ab928a7d854 not found: ID does not exist"
Nov 04 05:46:03.003878 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.003856    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph"]
Nov 04 05:46:03.010101 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.010076    4357 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-n96ph"]
Nov 04 05:46:03.056003 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.055971    4357 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/283c52c3-ef70-4c20-9862-02ce8f496e47-istio-envoy\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.056003 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.056001    4357 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/283c52c3-ef70-4c20-9862-02ce8f496e47-istiod-ca-cert\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.056403 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.056013    4357 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/283c52c3-ef70-4c20-9862-02ce8f496e47-istio-token\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.056403 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.056022    4357 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/283c52c3-ef70-4c20-9862-02ce8f496e47-istio-podinfo\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.056403 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.056032    4357 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnvv6\" (UniqueName: \"kubernetes.io/projected/283c52c3-ef70-4c20-9862-02ce8f496e47-kube-api-access-jnvv6\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.073088 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.073058    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb"
Nov 04 05:46:03.156973 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.156904    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9e96333d-b91c-4a31-80d0-369af77f5eb8-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e96333d-b91c-4a31-80d0-369af77f5eb8-credential-socket\") pod \"9e96333d-b91c-4a31-80d0-369af77f5eb8\" (UID: \"9e96333d-b91c-4a31-80d0-369af77f5eb8\") "
Nov 04 05:46:03.156973 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.156939    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9e96333d-b91c-4a31-80d0-369af77f5eb8-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e96333d-b91c-4a31-80d0-369af77f5eb8-istio-envoy\") pod \"9e96333d-b91c-4a31-80d0-369af77f5eb8\" (UID: \"9e96333d-b91c-4a31-80d0-369af77f5eb8\") "
Nov 04 05:46:03.156973 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.156973    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9e96333d-b91c-4a31-80d0-369af77f5eb8-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e96333d-b91c-4a31-80d0-369af77f5eb8-workload-socket\") pod \"9e96333d-b91c-4a31-80d0-369af77f5eb8\" (UID: \"9e96333d-b91c-4a31-80d0-369af77f5eb8\") "
Nov 04 05:46:03.157244 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.157042    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9e96333d-b91c-4a31-80d0-369af77f5eb8-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e96333d-b91c-4a31-80d0-369af77f5eb8-workload-certs\") pod \"9e96333d-b91c-4a31-80d0-369af77f5eb8\" (UID: \"9e96333d-b91c-4a31-80d0-369af77f5eb8\") "
Nov 04 05:46:03.157244 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.157093    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9e96333d-b91c-4a31-80d0-369af77f5eb8-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e96333d-b91c-4a31-80d0-369af77f5eb8-istio-podinfo\") pod \"9e96333d-b91c-4a31-80d0-369af77f5eb8\" (UID: \"9e96333d-b91c-4a31-80d0-369af77f5eb8\") "
Nov 04 05:46:03.157244 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.157118    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9e96333d-b91c-4a31-80d0-369af77f5eb8-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e96333d-b91c-4a31-80d0-369af77f5eb8-istio-data\") pod \"9e96333d-b91c-4a31-80d0-369af77f5eb8\" (UID: \"9e96333d-b91c-4a31-80d0-369af77f5eb8\") "
Nov 04 05:46:03.157244 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.157150    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9e96333d-b91c-4a31-80d0-369af77f5eb8-kube-api-access-l5kfd\" (UniqueName: \"kubernetes.io/projected/9e96333d-b91c-4a31-80d0-369af77f5eb8-kube-api-access-l5kfd\") pod \"9e96333d-b91c-4a31-80d0-369af77f5eb8\" (UID: \"9e96333d-b91c-4a31-80d0-369af77f5eb8\") "
Nov 04 05:46:03.157244 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.157187    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e96333d-b91c-4a31-80d0-369af77f5eb8-credential-socket" pod "9e96333d-b91c-4a31-80d0-369af77f5eb8" (UID: "9e96333d-b91c-4a31-80d0-369af77f5eb8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:03.157244 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.157203    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9e96333d-b91c-4a31-80d0-369af77f5eb8-istio-token\" (UniqueName: \"kubernetes.io/projected/9e96333d-b91c-4a31-80d0-369af77f5eb8-istio-token\") pod \"9e96333d-b91c-4a31-80d0-369af77f5eb8\" (UID: \"9e96333d-b91c-4a31-80d0-369af77f5eb8\") "
Nov 04 05:46:03.157572 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.157249    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9e96333d-b91c-4a31-80d0-369af77f5eb8-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e96333d-b91c-4a31-80d0-369af77f5eb8-istiod-ca-cert\") pod \"9e96333d-b91c-4a31-80d0-369af77f5eb8\" (UID: \"9e96333d-b91c-4a31-80d0-369af77f5eb8\") "
Nov 04 05:46:03.157572 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.157311    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e96333d-b91c-4a31-80d0-369af77f5eb8-workload-socket" pod "9e96333d-b91c-4a31-80d0-369af77f5eb8" (UID: "9e96333d-b91c-4a31-80d0-369af77f5eb8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:03.157572 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.157403    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e96333d-b91c-4a31-80d0-369af77f5eb8-istio-data" pod "9e96333d-b91c-4a31-80d0-369af77f5eb8" (UID: "9e96333d-b91c-4a31-80d0-369af77f5eb8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:03.157741 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.157663    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e96333d-b91c-4a31-80d0-369af77f5eb8-workload-certs" pod "9e96333d-b91c-4a31-80d0-369af77f5eb8" (UID: "9e96333d-b91c-4a31-80d0-369af77f5eb8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:03.157741 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.157726    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e96333d-b91c-4a31-80d0-369af77f5eb8-istiod-ca-cert" pod "9e96333d-b91c-4a31-80d0-369af77f5eb8" (UID: "9e96333d-b91c-4a31-80d0-369af77f5eb8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:46:03.157843 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.157773    4357 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e96333d-b91c-4a31-80d0-369af77f5eb8-workload-certs\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.157843 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.157793    4357 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e96333d-b91c-4a31-80d0-369af77f5eb8-istio-data\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.157843 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.157809    4357 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e96333d-b91c-4a31-80d0-369af77f5eb8-credential-socket\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.157843 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.157838    4357 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e96333d-b91c-4a31-80d0-369af77f5eb8-workload-socket\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.159196 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.159172    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e96333d-b91c-4a31-80d0-369af77f5eb8-istio-envoy" pod "9e96333d-b91c-4a31-80d0-369af77f5eb8" (UID: "9e96333d-b91c-4a31-80d0-369af77f5eb8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:03.159409 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.159377    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e96333d-b91c-4a31-80d0-369af77f5eb8-kube-api-access-l5kfd" pod "9e96333d-b91c-4a31-80d0-369af77f5eb8" (UID: "9e96333d-b91c-4a31-80d0-369af77f5eb8"). InnerVolumeSpecName "kube-api-access-l5kfd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:46:03.159731 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.159712    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9e96333d-b91c-4a31-80d0-369af77f5eb8-istio-podinfo" pod "9e96333d-b91c-4a31-80d0-369af77f5eb8" (UID: "9e96333d-b91c-4a31-80d0-369af77f5eb8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 05:46:03.159793 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.159779    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e96333d-b91c-4a31-80d0-369af77f5eb8-istio-token" pod "9e96333d-b91c-4a31-80d0-369af77f5eb8" (UID: "9e96333d-b91c-4a31-80d0-369af77f5eb8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:46:03.224576 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.224551    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48"
Nov 04 05:46:03.258449 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.258421    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/54a708a2-3b46-489d-bc33-0954c018f253-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54a708a2-3b46-489d-bc33-0954c018f253-workload-socket\") pod \"54a708a2-3b46-489d-bc33-0954c018f253\" (UID: \"54a708a2-3b46-489d-bc33-0954c018f253\") "
Nov 04 05:46:03.258588 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.258495    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/54a708a2-3b46-489d-bc33-0954c018f253-kube-api-access-8rfkc\" (UniqueName: \"kubernetes.io/projected/54a708a2-3b46-489d-bc33-0954c018f253-kube-api-access-8rfkc\") pod \"54a708a2-3b46-489d-bc33-0954c018f253\" (UID: \"54a708a2-3b46-489d-bc33-0954c018f253\") "
Nov 04 05:46:03.258588 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.258562    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/54a708a2-3b46-489d-bc33-0954c018f253-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54a708a2-3b46-489d-bc33-0954c018f253-istio-data\") pod \"54a708a2-3b46-489d-bc33-0954c018f253\" (UID: \"54a708a2-3b46-489d-bc33-0954c018f253\") "
Nov 04 05:46:03.258716 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.258594    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/54a708a2-3b46-489d-bc33-0954c018f253-istio-token\" (UniqueName: \"kubernetes.io/projected/54a708a2-3b46-489d-bc33-0954c018f253-istio-token\") pod \"54a708a2-3b46-489d-bc33-0954c018f253\" (UID: \"54a708a2-3b46-489d-bc33-0954c018f253\") "
Nov 04 05:46:03.258716 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.258674    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/54a708a2-3b46-489d-bc33-0954c018f253-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54a708a2-3b46-489d-bc33-0954c018f253-istio-podinfo\") pod \"54a708a2-3b46-489d-bc33-0954c018f253\" (UID: \"54a708a2-3b46-489d-bc33-0954c018f253\") "
Nov 04 05:46:03.258716 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.258677    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54a708a2-3b46-489d-bc33-0954c018f253-workload-socket" pod "54a708a2-3b46-489d-bc33-0954c018f253" (UID: "54a708a2-3b46-489d-bc33-0954c018f253"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:03.258876 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.258764    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/54a708a2-3b46-489d-bc33-0954c018f253-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54a708a2-3b46-489d-bc33-0954c018f253-istio-envoy\") pod \"54a708a2-3b46-489d-bc33-0954c018f253\" (UID: \"54a708a2-3b46-489d-bc33-0954c018f253\") "
Nov 04 05:46:03.258876 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.258801    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/54a708a2-3b46-489d-bc33-0954c018f253-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54a708a2-3b46-489d-bc33-0954c018f253-istiod-ca-cert\") pod \"54a708a2-3b46-489d-bc33-0954c018f253\" (UID: \"54a708a2-3b46-489d-bc33-0954c018f253\") "
Nov 04 05:46:03.258876 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.258824    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54a708a2-3b46-489d-bc33-0954c018f253-istio-data" pod "54a708a2-3b46-489d-bc33-0954c018f253" (UID: "54a708a2-3b46-489d-bc33-0954c018f253"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:03.258876 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.258834    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/54a708a2-3b46-489d-bc33-0954c018f253-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54a708a2-3b46-489d-bc33-0954c018f253-workload-certs\") pod \"54a708a2-3b46-489d-bc33-0954c018f253\" (UID: \"54a708a2-3b46-489d-bc33-0954c018f253\") "
Nov 04 05:46:03.259057 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.258902    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/54a708a2-3b46-489d-bc33-0954c018f253-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54a708a2-3b46-489d-bc33-0954c018f253-credential-socket\") pod \"54a708a2-3b46-489d-bc33-0954c018f253\" (UID: \"54a708a2-3b46-489d-bc33-0954c018f253\") "
Nov 04 05:46:03.259182 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.259159    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54a708a2-3b46-489d-bc33-0954c018f253-workload-certs" pod "54a708a2-3b46-489d-bc33-0954c018f253" (UID: "54a708a2-3b46-489d-bc33-0954c018f253"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:03.259182 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.259168    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54a708a2-3b46-489d-bc33-0954c018f253-istiod-ca-cert" pod "54a708a2-3b46-489d-bc33-0954c018f253" (UID: "54a708a2-3b46-489d-bc33-0954c018f253"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:46:03.259397 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.259290    4357 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e96333d-b91c-4a31-80d0-369af77f5eb8-istiod-ca-cert\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.259397 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.259348    4357 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e96333d-b91c-4a31-80d0-369af77f5eb8-istio-envoy\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.259397 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.259364    4357 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54a708a2-3b46-489d-bc33-0954c018f253-istiod-ca-cert\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.259397 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.259378    4357 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54a708a2-3b46-489d-bc33-0954c018f253-workload-certs\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.259397 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.259395    4357 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54a708a2-3b46-489d-bc33-0954c018f253-workload-socket\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.259791 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.259423    4357 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e96333d-b91c-4a31-80d0-369af77f5eb8-istio-podinfo\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.259791 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.259438    4357 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5kfd\" (UniqueName: \"kubernetes.io/projected/9e96333d-b91c-4a31-80d0-369af77f5eb8-kube-api-access-l5kfd\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.259791 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.259452    4357 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54a708a2-3b46-489d-bc33-0954c018f253-istio-data\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.259791 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.259377    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54a708a2-3b46-489d-bc33-0954c018f253-credential-socket" pod "54a708a2-3b46-489d-bc33-0954c018f253" (UID: "54a708a2-3b46-489d-bc33-0954c018f253"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:03.259791 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.259466    4357 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e96333d-b91c-4a31-80d0-369af77f5eb8-istio-token\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.260804 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.260780    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54a708a2-3b46-489d-bc33-0954c018f253-istio-envoy" pod "54a708a2-3b46-489d-bc33-0954c018f253" (UID: "54a708a2-3b46-489d-bc33-0954c018f253"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:03.260897 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.260806    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54a708a2-3b46-489d-bc33-0954c018f253-kube-api-access-8rfkc" pod "54a708a2-3b46-489d-bc33-0954c018f253" (UID: "54a708a2-3b46-489d-bc33-0954c018f253"). InnerVolumeSpecName "kube-api-access-8rfkc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:46:03.261121 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.261105    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/54a708a2-3b46-489d-bc33-0954c018f253-istio-podinfo" pod "54a708a2-3b46-489d-bc33-0954c018f253" (UID: "54a708a2-3b46-489d-bc33-0954c018f253"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 05:46:03.261196 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.261119    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54a708a2-3b46-489d-bc33-0954c018f253-istio-token" pod "54a708a2-3b46-489d-bc33-0954c018f253" (UID: "54a708a2-3b46-489d-bc33-0954c018f253"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:46:03.285693 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.285664    4357 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="283c52c3-ef70-4c20-9862-02ce8f496e47" path="/var/lib/kubelet/pods/283c52c3-ef70-4c20-9862-02ce8f496e47/volumes"
Nov 04 05:46:03.360570 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.360548    4357 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rfkc\" (UniqueName: \"kubernetes.io/projected/54a708a2-3b46-489d-bc33-0954c018f253-kube-api-access-8rfkc\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.360570 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.360571    4357 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54a708a2-3b46-489d-bc33-0954c018f253-istio-token\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.360716 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.360581    4357 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54a708a2-3b46-489d-bc33-0954c018f253-istio-podinfo\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.360716 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.360589    4357 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54a708a2-3b46-489d-bc33-0954c018f253-istio-envoy\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.360716 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.360598    4357 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54a708a2-3b46-489d-bc33-0954c018f253-credential-socket\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.729655 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.729634    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt"
Nov 04 05:46:03.763863 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.763834    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/33923021-e163-4976-a8bb-f74d79c5220a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33923021-e163-4976-a8bb-f74d79c5220a-workload-socket\") pod \"33923021-e163-4976-a8bb-f74d79c5220a\" (UID: \"33923021-e163-4976-a8bb-f74d79c5220a\") "
Nov 04 05:46:03.763999 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.763925    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/33923021-e163-4976-a8bb-f74d79c5220a-kube-api-access-dbdkj\" (UniqueName: \"kubernetes.io/projected/33923021-e163-4976-a8bb-f74d79c5220a-kube-api-access-dbdkj\") pod \"33923021-e163-4976-a8bb-f74d79c5220a\" (UID: \"33923021-e163-4976-a8bb-f74d79c5220a\") "
Nov 04 05:46:03.763999 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.763967    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/33923021-e163-4976-a8bb-f74d79c5220a-istio-token\" (UniqueName: \"kubernetes.io/projected/33923021-e163-4976-a8bb-f74d79c5220a-istio-token\") pod \"33923021-e163-4976-a8bb-f74d79c5220a\" (UID: \"33923021-e163-4976-a8bb-f74d79c5220a\") "
Nov 04 05:46:03.764114 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.764002    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/33923021-e163-4976-a8bb-f74d79c5220a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33923021-e163-4976-a8bb-f74d79c5220a-istio-envoy\") pod \"33923021-e163-4976-a8bb-f74d79c5220a\" (UID: \"33923021-e163-4976-a8bb-f74d79c5220a\") "
Nov 04 05:46:03.764114 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.764043    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/33923021-e163-4976-a8bb-f74d79c5220a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33923021-e163-4976-a8bb-f74d79c5220a-istio-data\") pod \"33923021-e163-4976-a8bb-f74d79c5220a\" (UID: \"33923021-e163-4976-a8bb-f74d79c5220a\") "
Nov 04 05:46:03.764114 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.764070    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/33923021-e163-4976-a8bb-f74d79c5220a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33923021-e163-4976-a8bb-f74d79c5220a-credential-socket\") pod \"33923021-e163-4976-a8bb-f74d79c5220a\" (UID: \"33923021-e163-4976-a8bb-f74d79c5220a\") "
Nov 04 05:46:03.764114 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.764091    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33923021-e163-4976-a8bb-f74d79c5220a-workload-socket" pod "33923021-e163-4976-a8bb-f74d79c5220a" (UID: "33923021-e163-4976-a8bb-f74d79c5220a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:03.764114 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.764097    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/33923021-e163-4976-a8bb-f74d79c5220a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33923021-e163-4976-a8bb-f74d79c5220a-istiod-ca-cert\") pod \"33923021-e163-4976-a8bb-f74d79c5220a\" (UID: \"33923021-e163-4976-a8bb-f74d79c5220a\") "
Nov 04 05:46:03.764414 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.764182    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/33923021-e163-4976-a8bb-f74d79c5220a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33923021-e163-4976-a8bb-f74d79c5220a-workload-certs\") pod \"33923021-e163-4976-a8bb-f74d79c5220a\" (UID: \"33923021-e163-4976-a8bb-f74d79c5220a\") "
Nov 04 05:46:03.764414 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.764237    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/33923021-e163-4976-a8bb-f74d79c5220a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33923021-e163-4976-a8bb-f74d79c5220a-istio-podinfo\") pod \"33923021-e163-4976-a8bb-f74d79c5220a\" (UID: \"33923021-e163-4976-a8bb-f74d79c5220a\") "
Nov 04 05:46:03.764779 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.764668    4357 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33923021-e163-4976-a8bb-f74d79c5220a-workload-socket\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.764779 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.764688    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33923021-e163-4976-a8bb-f74d79c5220a-istiod-ca-cert" pod "33923021-e163-4976-a8bb-f74d79c5220a" (UID: "33923021-e163-4976-a8bb-f74d79c5220a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:46:03.764923 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.764700    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33923021-e163-4976-a8bb-f74d79c5220a-istio-data" pod "33923021-e163-4976-a8bb-f74d79c5220a" (UID: "33923021-e163-4976-a8bb-f74d79c5220a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:03.764923 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.764771    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33923021-e163-4976-a8bb-f74d79c5220a-workload-certs" pod "33923021-e163-4976-a8bb-f74d79c5220a" (UID: "33923021-e163-4976-a8bb-f74d79c5220a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:03.764923 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.764869    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33923021-e163-4976-a8bb-f74d79c5220a-credential-socket" pod "33923021-e163-4976-a8bb-f74d79c5220a" (UID: "33923021-e163-4976-a8bb-f74d79c5220a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:03.766140 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.766118    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33923021-e163-4976-a8bb-f74d79c5220a-kube-api-access-dbdkj" pod "33923021-e163-4976-a8bb-f74d79c5220a" (UID: "33923021-e163-4976-a8bb-f74d79c5220a"). InnerVolumeSpecName "kube-api-access-dbdkj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:46:03.766587 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.766559    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33923021-e163-4976-a8bb-f74d79c5220a-istio-token" pod "33923021-e163-4976-a8bb-f74d79c5220a" (UID: "33923021-e163-4976-a8bb-f74d79c5220a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:46:03.766683 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.766652    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/33923021-e163-4976-a8bb-f74d79c5220a-istio-podinfo" pod "33923021-e163-4976-a8bb-f74d79c5220a" (UID: "33923021-e163-4976-a8bb-f74d79c5220a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 05:46:03.766868 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.766844    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33923021-e163-4976-a8bb-f74d79c5220a-istio-envoy" pod "33923021-e163-4976-a8bb-f74d79c5220a" (UID: "33923021-e163-4976-a8bb-f74d79c5220a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:03.865609 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.865559    4357 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbdkj\" (UniqueName: \"kubernetes.io/projected/33923021-e163-4976-a8bb-f74d79c5220a-kube-api-access-dbdkj\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.865609 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.865582    4357 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33923021-e163-4976-a8bb-f74d79c5220a-istio-token\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.865609 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.865591    4357 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33923021-e163-4976-a8bb-f74d79c5220a-istio-envoy\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.865609 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.865600    4357 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33923021-e163-4976-a8bb-f74d79c5220a-istio-data\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.865609 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.865608    4357 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33923021-e163-4976-a8bb-f74d79c5220a-credential-socket\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.866000 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.865617    4357 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33923021-e163-4976-a8bb-f74d79c5220a-istiod-ca-cert\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.866000 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.865625    4357 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33923021-e163-4976-a8bb-f74d79c5220a-workload-certs\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.866000 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.865634    4357 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33923021-e163-4976-a8bb-f74d79c5220a-istio-podinfo\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.990170 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.990138    4357 generic.go:356] "Generic (PLEG): container finished" podID="33923021-e163-4976-a8bb-f74d79c5220a" containerID="bc78e40bb5c04f94d1c4b10a5755b837245cc0528b224a8f17baa41e51966da9" exitCode=0
Nov 04 05:46:03.990284 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.990190    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt"
Nov 04 05:46:03.990284 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.990227    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt" event={"ID":"33923021-e163-4976-a8bb-f74d79c5220a","Type":"ContainerDied","Data":"bc78e40bb5c04f94d1c4b10a5755b837245cc0528b224a8f17baa41e51966da9"}
Nov 04 05:46:03.990284 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.990275    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt" event={"ID":"33923021-e163-4976-a8bb-f74d79c5220a","Type":"ContainerDied","Data":"bcb2a78642044610c33dd55bde1416e90050580ad6bb627ee8d199a704816d90"}
Nov 04 05:46:03.990435 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.990300    4357 scope.go:122] "RemoveContainer" containerID="bc78e40bb5c04f94d1c4b10a5755b837245cc0528b224a8f17baa41e51966da9"
Nov 04 05:46:03.991580 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.991546    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb" event={"ID":"9e96333d-b91c-4a31-80d0-369af77f5eb8","Type":"ContainerDied","Data":"9385c24c62f7a25a657de3a3960840b04f964107c96c84c4724e8449d4bb7c70"}
Nov 04 05:46:03.991580 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.991573    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb"
Nov 04 05:46:03.993268 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.993018    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48" event={"ID":"54a708a2-3b46-489d-bc33-0954c018f253","Type":"ContainerDied","Data":"e9c9d07557e910125deea3753f777a88e140cc8a4b107a92a91b1cbc4b79a8fa"}
Nov 04 05:46:03.993268 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.993055    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48"
Nov 04 05:46:03.999448 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.999432    4357 scope.go:122] "RemoveContainer" containerID="bc78e40bb5c04f94d1c4b10a5755b837245cc0528b224a8f17baa41e51966da9"
Nov 04 05:46:03.999733 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:46:03.999713    4357 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc78e40bb5c04f94d1c4b10a5755b837245cc0528b224a8f17baa41e51966da9\": container with ID starting with bc78e40bb5c04f94d1c4b10a5755b837245cc0528b224a8f17baa41e51966da9 not found: ID does not exist" containerID="bc78e40bb5c04f94d1c4b10a5755b837245cc0528b224a8f17baa41e51966da9"
Nov 04 05:46:03.999791 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.999741    4357 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc78e40bb5c04f94d1c4b10a5755b837245cc0528b224a8f17baa41e51966da9"} err="failed to get container status \"bc78e40bb5c04f94d1c4b10a5755b837245cc0528b224a8f17baa41e51966da9\": rpc error: code = NotFound desc = could not find container \"bc78e40bb5c04f94d1c4b10a5755b837245cc0528b224a8f17baa41e51966da9\": container with ID starting with bc78e40bb5c04f94d1c4b10a5755b837245cc0528b224a8f17baa41e51966da9 not found: ID does not exist"
Nov 04 05:46:03.999791 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:03.999756    4357 scope.go:122] "RemoveContainer" containerID="a736664a68b278b227e1536e0da094db32ad532b6039f39c027dba56786f6c48"
Nov 04 05:46:04.007395 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.007380    4357 scope.go:122] "RemoveContainer" containerID="cd16634b8c4907d667a0341e7c494aef4c97d3b1755aba1ced2bedee797eefbd"
Nov 04 05:46:04.017456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.017435    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb"]
Nov 04 05:46:04.022198 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.022176    4357 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-5plfb"]
Nov 04 05:46:04.031649 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.031629    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48"]
Nov 04 05:46:04.035747 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.035729    4357 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-k2r48"]
Nov 04 05:46:04.044895 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.044876    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt"]
Nov 04 05:46:04.050006 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.049986    4357 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-f6dnt"]
Nov 04 05:46:04.214423 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.214400    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q"
Nov 04 05:46:04.267388 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.267362    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-workload-certs\") pod \"43dd698a-4caf-4a7d-8dc3-dfe458da5c68\" (UID: \"43dd698a-4caf-4a7d-8dc3-dfe458da5c68\") "
Nov 04 05:46:04.267545 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.267409    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-istiod-ca-cert\") pod \"43dd698a-4caf-4a7d-8dc3-dfe458da5c68\" (UID: \"43dd698a-4caf-4a7d-8dc3-dfe458da5c68\") "
Nov 04 05:46:04.267545 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.267433    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-istio-token\" (UniqueName: \"kubernetes.io/projected/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-istio-token\") pod \"43dd698a-4caf-4a7d-8dc3-dfe458da5c68\" (UID: \"43dd698a-4caf-4a7d-8dc3-dfe458da5c68\") "
Nov 04 05:46:04.267545 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.267459    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-istio-data\") pod \"43dd698a-4caf-4a7d-8dc3-dfe458da5c68\" (UID: \"43dd698a-4caf-4a7d-8dc3-dfe458da5c68\") "
Nov 04 05:46:04.267545 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.267541    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-kube-api-access-vh9m2\" (UniqueName: \"kubernetes.io/projected/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-kube-api-access-vh9m2\") pod \"43dd698a-4caf-4a7d-8dc3-dfe458da5c68\" (UID: \"43dd698a-4caf-4a7d-8dc3-dfe458da5c68\") "
Nov 04 05:46:04.267829 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.267601    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-credential-socket\") pod \"43dd698a-4caf-4a7d-8dc3-dfe458da5c68\" (UID: \"43dd698a-4caf-4a7d-8dc3-dfe458da5c68\") "
Nov 04 05:46:04.267829 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.267636    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-istio-podinfo\") pod \"43dd698a-4caf-4a7d-8dc3-dfe458da5c68\" (UID: \"43dd698a-4caf-4a7d-8dc3-dfe458da5c68\") "
Nov 04 05:46:04.267829 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.267680    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-workload-certs" pod "43dd698a-4caf-4a7d-8dc3-dfe458da5c68" (UID: "43dd698a-4caf-4a7d-8dc3-dfe458da5c68"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:04.267829 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.267695    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-workload-socket\") pod \"43dd698a-4caf-4a7d-8dc3-dfe458da5c68\" (UID: \"43dd698a-4caf-4a7d-8dc3-dfe458da5c68\") "
Nov 04 05:46:04.267829 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.267750    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-istio-envoy\") pod \"43dd698a-4caf-4a7d-8dc3-dfe458da5c68\" (UID: \"43dd698a-4caf-4a7d-8dc3-dfe458da5c68\") "
Nov 04 05:46:04.267829 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.267781    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-istio-data" pod "43dd698a-4caf-4a7d-8dc3-dfe458da5c68" (UID: "43dd698a-4caf-4a7d-8dc3-dfe458da5c68"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:04.267829 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.267816    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-istiod-ca-cert" pod "43dd698a-4caf-4a7d-8dc3-dfe458da5c68" (UID: "43dd698a-4caf-4a7d-8dc3-dfe458da5c68"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:46:04.268165 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.267906    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-credential-socket" pod "43dd698a-4caf-4a7d-8dc3-dfe458da5c68" (UID: "43dd698a-4caf-4a7d-8dc3-dfe458da5c68"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:04.268165 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.268106    4357 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-workload-certs\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:04.268165 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.268125    4357 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-istiod-ca-cert\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:04.268165 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.268135    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-workload-socket" pod "43dd698a-4caf-4a7d-8dc3-dfe458da5c68" (UID: "43dd698a-4caf-4a7d-8dc3-dfe458da5c68"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:04.268165 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.268141    4357 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-istio-data\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:04.268417 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.268185    4357 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-credential-socket\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:04.269878 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.269851    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-istio-token" pod "43dd698a-4caf-4a7d-8dc3-dfe458da5c68" (UID: "43dd698a-4caf-4a7d-8dc3-dfe458da5c68"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:46:04.269974 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.269926    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-istio-podinfo" pod "43dd698a-4caf-4a7d-8dc3-dfe458da5c68" (UID: "43dd698a-4caf-4a7d-8dc3-dfe458da5c68"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 05:46:04.270184 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.270170    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-istio-envoy" pod "43dd698a-4caf-4a7d-8dc3-dfe458da5c68" (UID: "43dd698a-4caf-4a7d-8dc3-dfe458da5c68"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:04.270231 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.270201    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-kube-api-access-vh9m2" pod "43dd698a-4caf-4a7d-8dc3-dfe458da5c68" (UID: "43dd698a-4caf-4a7d-8dc3-dfe458da5c68"). InnerVolumeSpecName "kube-api-access-vh9m2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:46:04.368768 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.368739    4357 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-istio-podinfo\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:04.368768 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.368764    4357 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-workload-socket\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:04.368890 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.368779    4357 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-istio-envoy\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:04.368890 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.368792    4357 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-istio-token\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:04.368890 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.368807    4357 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vh9m2\" (UniqueName: \"kubernetes.io/projected/43dd698a-4caf-4a7d-8dc3-dfe458da5c68-kube-api-access-vh9m2\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:04.879798 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.879775    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq"
Nov 04 05:46:04.909703 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.909677    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl"
Nov 04 05:46:04.976216 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.976187    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-workload-certs\") pod \"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a\" (UID: \"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a\") "
Nov 04 05:46:04.976361 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.976237    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/14d9c974-e49a-45d5-9c95-e8b2a390a185-istio-token\" (UniqueName: \"kubernetes.io/projected/14d9c974-e49a-45d5-9c95-e8b2a390a185-istio-token\") pod \"14d9c974-e49a-45d5-9c95-e8b2a390a185\" (UID: \"14d9c974-e49a-45d5-9c95-e8b2a390a185\") "
Nov 04 05:46:04.976361 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.976262    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/14d9c974-e49a-45d5-9c95-e8b2a390a185-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14d9c974-e49a-45d5-9c95-e8b2a390a185-credential-socket\") pod \"14d9c974-e49a-45d5-9c95-e8b2a390a185\" (UID: \"14d9c974-e49a-45d5-9c95-e8b2a390a185\") "
Nov 04 05:46:04.976361 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.976292    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-istio-token\" (UniqueName: \"kubernetes.io/projected/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-istio-token\") pod \"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a\" (UID: \"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a\") "
Nov 04 05:46:04.976361 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.976327    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-istio-podinfo\") pod \"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a\" (UID: \"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a\") "
Nov 04 05:46:04.976602 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.976370    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-istiod-ca-cert\") pod \"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a\" (UID: \"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a\") "
Nov 04 05:46:04.976602 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.976403    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/14d9c974-e49a-45d5-9c95-e8b2a390a185-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14d9c974-e49a-45d5-9c95-e8b2a390a185-istio-envoy\") pod \"14d9c974-e49a-45d5-9c95-e8b2a390a185\" (UID: \"14d9c974-e49a-45d5-9c95-e8b2a390a185\") "
Nov 04 05:46:04.976602 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.976439    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-workload-socket\") pod \"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a\" (UID: \"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a\") "
Nov 04 05:46:04.976602 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.976479    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/14d9c974-e49a-45d5-9c95-e8b2a390a185-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14d9c974-e49a-45d5-9c95-e8b2a390a185-workload-socket\") pod \"14d9c974-e49a-45d5-9c95-e8b2a390a185\" (UID: \"14d9c974-e49a-45d5-9c95-e8b2a390a185\") "
Nov 04 05:46:04.976602 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.976483    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-workload-certs" pod "f3aabb5c-cdeb-4afe-8785-d5bf5d82266a" (UID: "f3aabb5c-cdeb-4afe-8785-d5bf5d82266a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:04.976602 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.976529    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/14d9c974-e49a-45d5-9c95-e8b2a390a185-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14d9c974-e49a-45d5-9c95-e8b2a390a185-istio-data\") pod \"14d9c974-e49a-45d5-9c95-e8b2a390a185\" (UID: \"14d9c974-e49a-45d5-9c95-e8b2a390a185\") "
Nov 04 05:46:04.976602 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.976555    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-istio-envoy\") pod \"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a\" (UID: \"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a\") "
Nov 04 05:46:04.976602 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.976589    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-istio-data\") pod \"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a\" (UID: \"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a\") "
Nov 04 05:46:04.977091 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.976617    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14d9c974-e49a-45d5-9c95-e8b2a390a185-credential-socket" pod "14d9c974-e49a-45d5-9c95-e8b2a390a185" (UID: "14d9c974-e49a-45d5-9c95-e8b2a390a185"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:04.977091 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.976638    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-kube-api-access-whrnv\" (UniqueName: \"kubernetes.io/projected/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-kube-api-access-whrnv\") pod \"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a\" (UID: \"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a\") "
Nov 04 05:46:04.977091 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.976675    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/14d9c974-e49a-45d5-9c95-e8b2a390a185-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14d9c974-e49a-45d5-9c95-e8b2a390a185-istio-podinfo\") pod \"14d9c974-e49a-45d5-9c95-e8b2a390a185\" (UID: \"14d9c974-e49a-45d5-9c95-e8b2a390a185\") "
Nov 04 05:46:04.977091 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.976734    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/14d9c974-e49a-45d5-9c95-e8b2a390a185-kube-api-access-jwljc\" (UniqueName: \"kubernetes.io/projected/14d9c974-e49a-45d5-9c95-e8b2a390a185-kube-api-access-jwljc\") pod \"14d9c974-e49a-45d5-9c95-e8b2a390a185\" (UID: \"14d9c974-e49a-45d5-9c95-e8b2a390a185\") "
Nov 04 05:46:04.977091 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.976780    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14d9c974-e49a-45d5-9c95-e8b2a390a185-istio-data" pod "14d9c974-e49a-45d5-9c95-e8b2a390a185" (UID: "14d9c974-e49a-45d5-9c95-e8b2a390a185"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:04.977091 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.976797    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/14d9c974-e49a-45d5-9c95-e8b2a390a185-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14d9c974-e49a-45d5-9c95-e8b2a390a185-workload-certs\") pod \"14d9c974-e49a-45d5-9c95-e8b2a390a185\" (UID: \"14d9c974-e49a-45d5-9c95-e8b2a390a185\") "
Nov 04 05:46:04.977091 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.976827    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/14d9c974-e49a-45d5-9c95-e8b2a390a185-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14d9c974-e49a-45d5-9c95-e8b2a390a185-istiod-ca-cert\") pod \"14d9c974-e49a-45d5-9c95-e8b2a390a185\" (UID: \"14d9c974-e49a-45d5-9c95-e8b2a390a185\") "
Nov 04 05:46:04.977091 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.976866    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-credential-socket\") pod \"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a\" (UID: \"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a\") "
Nov 04 05:46:04.977091 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.976958    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-workload-socket" pod "f3aabb5c-cdeb-4afe-8785-d5bf5d82266a" (UID: "f3aabb5c-cdeb-4afe-8785-d5bf5d82266a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:04.977586 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.977109    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14d9c974-e49a-45d5-9c95-e8b2a390a185-workload-socket" pod "14d9c974-e49a-45d5-9c95-e8b2a390a185" (UID: "14d9c974-e49a-45d5-9c95-e8b2a390a185"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:04.977586 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.977272    4357 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-workload-certs\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:04.977586 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.977292    4357 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14d9c974-e49a-45d5-9c95-e8b2a390a185-credential-socket\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:04.977586 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.977308    4357 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-workload-socket\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:04.977586 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.977323    4357 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14d9c974-e49a-45d5-9c95-e8b2a390a185-workload-socket\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:04.977586 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.977337    4357 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14d9c974-e49a-45d5-9c95-e8b2a390a185-istio-data\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:04.977887 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.977676    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14d9c974-e49a-45d5-9c95-e8b2a390a185-istiod-ca-cert" pod "14d9c974-e49a-45d5-9c95-e8b2a390a185" (UID: "14d9c974-e49a-45d5-9c95-e8b2a390a185"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:46:04.977887 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.977873    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14d9c974-e49a-45d5-9c95-e8b2a390a185-workload-certs" pod "14d9c974-e49a-45d5-9c95-e8b2a390a185" (UID: "14d9c974-e49a-45d5-9c95-e8b2a390a185"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:04.978049 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.978030    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-credential-socket" pod "f3aabb5c-cdeb-4afe-8785-d5bf5d82266a" (UID: "f3aabb5c-cdeb-4afe-8785-d5bf5d82266a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:04.978300 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.978280    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-istiod-ca-cert" pod "f3aabb5c-cdeb-4afe-8785-d5bf5d82266a" (UID: "f3aabb5c-cdeb-4afe-8785-d5bf5d82266a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:46:04.978501 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.978482    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-istio-data" pod "f3aabb5c-cdeb-4afe-8785-d5bf5d82266a" (UID: "f3aabb5c-cdeb-4afe-8785-d5bf5d82266a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:04.980159 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.980131    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14d9c974-e49a-45d5-9c95-e8b2a390a185-istio-envoy" pod "14d9c974-e49a-45d5-9c95-e8b2a390a185" (UID: "14d9c974-e49a-45d5-9c95-e8b2a390a185"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:04.980266 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.980214    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-istio-podinfo" pod "f3aabb5c-cdeb-4afe-8785-d5bf5d82266a" (UID: "f3aabb5c-cdeb-4afe-8785-d5bf5d82266a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 05:46:04.980266 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.980227    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-istio-envoy" pod "f3aabb5c-cdeb-4afe-8785-d5bf5d82266a" (UID: "f3aabb5c-cdeb-4afe-8785-d5bf5d82266a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:04.980266 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.980240    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14d9c974-e49a-45d5-9c95-e8b2a390a185-istio-token" pod "14d9c974-e49a-45d5-9c95-e8b2a390a185" (UID: "14d9c974-e49a-45d5-9c95-e8b2a390a185"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:46:04.980484 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.980464    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/14d9c974-e49a-45d5-9c95-e8b2a390a185-istio-podinfo" pod "14d9c974-e49a-45d5-9c95-e8b2a390a185" (UID: "14d9c974-e49a-45d5-9c95-e8b2a390a185"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 05:46:04.980690 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.980672    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14d9c974-e49a-45d5-9c95-e8b2a390a185-kube-api-access-jwljc" pod "14d9c974-e49a-45d5-9c95-e8b2a390a185" (UID: "14d9c974-e49a-45d5-9c95-e8b2a390a185"). InnerVolumeSpecName "kube-api-access-jwljc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:46:04.981657 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.981637    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-istio-token" pod "f3aabb5c-cdeb-4afe-8785-d5bf5d82266a" (UID: "f3aabb5c-cdeb-4afe-8785-d5bf5d82266a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:46:04.981722 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:04.981685    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-kube-api-access-whrnv" pod "f3aabb5c-cdeb-4afe-8785-d5bf5d82266a" (UID: "f3aabb5c-cdeb-4afe-8785-d5bf5d82266a"). InnerVolumeSpecName "kube-api-access-whrnv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:46:05.003993 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.003974    4357 generic.go:356] "Generic (PLEG): container finished" podID="43dd698a-4caf-4a7d-8dc3-dfe458da5c68" containerID="8e61e417f55a556154f58480608b2d3b32895136182ebbcd93755e184fa2c96a" exitCode=0
Nov 04 05:46:05.004069 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.004020    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q"
Nov 04 05:46:05.004125 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.004057    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q" event={"ID":"43dd698a-4caf-4a7d-8dc3-dfe458da5c68","Type":"ContainerDied","Data":"8e61e417f55a556154f58480608b2d3b32895136182ebbcd93755e184fa2c96a"}
Nov 04 05:46:05.004125 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.004115    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q" event={"ID":"43dd698a-4caf-4a7d-8dc3-dfe458da5c68","Type":"ContainerDied","Data":"2f25c2585f625129d0f584f4df6f11288e3af286a7b29e1ae5ee75b1baaf4cf5"}
Nov 04 05:46:05.004192 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.004145    4357 scope.go:122] "RemoveContainer" containerID="8e61e417f55a556154f58480608b2d3b32895136182ebbcd93755e184fa2c96a"
Nov 04 05:46:05.006388 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.006368    4357 generic.go:356] "Generic (PLEG): container finished" podID="14d9c974-e49a-45d5-9c95-e8b2a390a185" containerID="6d2abbb209920509e0a025168acdfe49f1b3f71410dbff52fd0a33d839b4b51b" exitCode=0
Nov 04 05:46:05.006472 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.006417    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq"
Nov 04 05:46:05.006472 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.006456    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq" event={"ID":"14d9c974-e49a-45d5-9c95-e8b2a390a185","Type":"ContainerDied","Data":"6d2abbb209920509e0a025168acdfe49f1b3f71410dbff52fd0a33d839b4b51b"}
Nov 04 05:46:05.006612 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.006507    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq" event={"ID":"14d9c974-e49a-45d5-9c95-e8b2a390a185","Type":"ContainerDied","Data":"8e668eb8eebd85349afc2ab35c4882cae16933d7f0e6fa3c438dd01f81f8616b"}
Nov 04 05:46:05.007067 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.007048    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4"
Nov 04 05:46:05.010443 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.010421    4357 generic.go:356] "Generic (PLEG): container finished" podID="7a1d76cc-d277-460b-9d2e-19e465e93008" containerID="fd637f770374c8996f2d851cbc053ebd0b7f4f5d0a72b6e82bdd2d62041cbfdd" exitCode=0
Nov 04 05:46:05.010534 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.010461    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4"
Nov 04 05:46:05.010534 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.010495    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4" event={"ID":"7a1d76cc-d277-460b-9d2e-19e465e93008","Type":"ContainerDied","Data":"fd637f770374c8996f2d851cbc053ebd0b7f4f5d0a72b6e82bdd2d62041cbfdd"}
Nov 04 05:46:05.010645 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.010565    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4" event={"ID":"7a1d76cc-d277-460b-9d2e-19e465e93008","Type":"ContainerDied","Data":"54aab8f954e7c1b7dcb500eddd7a63fe3b81d0237808966626205bb8afdbd271"}
Nov 04 05:46:05.011918 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.011895    4357 generic.go:356] "Generic (PLEG): container finished" podID="f3aabb5c-cdeb-4afe-8785-d5bf5d82266a" containerID="16d52235cde4e37494afe36960c3f765dce48b449f378a6b686ab6227ffefdf4" exitCode=0
Nov 04 05:46:05.012022 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.011932    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl" event={"ID":"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a","Type":"ContainerDied","Data":"16d52235cde4e37494afe36960c3f765dce48b449f378a6b686ab6227ffefdf4"}
Nov 04 05:46:05.012022 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.011970    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl" event={"ID":"f3aabb5c-cdeb-4afe-8785-d5bf5d82266a","Type":"ContainerDied","Data":"537ffbf6fde5a2f9d070563532dffe629abf88a1be5489876c91fc30eae06051"}
Nov 04 05:46:05.012022 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.011936    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl"
Nov 04 05:46:05.013932 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.013839    4357 scope.go:122] "RemoveContainer" containerID="9417792dab7e151685ef78d5bdae42d766555fffd8006b814ddc386077cebf9b"
Nov 04 05:46:05.022734 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.022710    4357 scope.go:122] "RemoveContainer" containerID="8e61e417f55a556154f58480608b2d3b32895136182ebbcd93755e184fa2c96a"
Nov 04 05:46:05.022975 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:46:05.022956    4357 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e61e417f55a556154f58480608b2d3b32895136182ebbcd93755e184fa2c96a\": container with ID starting with 8e61e417f55a556154f58480608b2d3b32895136182ebbcd93755e184fa2c96a not found: ID does not exist" containerID="8e61e417f55a556154f58480608b2d3b32895136182ebbcd93755e184fa2c96a"
Nov 04 05:46:05.023019 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.022982    4357 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e61e417f55a556154f58480608b2d3b32895136182ebbcd93755e184fa2c96a"} err="failed to get container status \"8e61e417f55a556154f58480608b2d3b32895136182ebbcd93755e184fa2c96a\": rpc error: code = NotFound desc = could not find container \"8e61e417f55a556154f58480608b2d3b32895136182ebbcd93755e184fa2c96a\": container with ID starting with 8e61e417f55a556154f58480608b2d3b32895136182ebbcd93755e184fa2c96a not found: ID does not exist"
Nov 04 05:46:05.023019 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.022998    4357 scope.go:122] "RemoveContainer" containerID="9417792dab7e151685ef78d5bdae42d766555fffd8006b814ddc386077cebf9b"
Nov 04 05:46:05.023215 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:46:05.023201    4357 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9417792dab7e151685ef78d5bdae42d766555fffd8006b814ddc386077cebf9b\": container with ID starting with 9417792dab7e151685ef78d5bdae42d766555fffd8006b814ddc386077cebf9b not found: ID does not exist" containerID="9417792dab7e151685ef78d5bdae42d766555fffd8006b814ddc386077cebf9b"
Nov 04 05:46:05.023251 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.023218    4357 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9417792dab7e151685ef78d5bdae42d766555fffd8006b814ddc386077cebf9b"} err="failed to get container status \"9417792dab7e151685ef78d5bdae42d766555fffd8006b814ddc386077cebf9b\": rpc error: code = NotFound desc = could not find container \"9417792dab7e151685ef78d5bdae42d766555fffd8006b814ddc386077cebf9b\": container with ID starting with 9417792dab7e151685ef78d5bdae42d766555fffd8006b814ddc386077cebf9b not found: ID does not exist"
Nov 04 05:46:05.023251 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.023229    4357 scope.go:122] "RemoveContainer" containerID="6d2abbb209920509e0a025168acdfe49f1b3f71410dbff52fd0a33d839b4b51b"
Nov 04 05:46:05.032450 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.032431    4357 scope.go:122] "RemoveContainer" containerID="6d2abbb209920509e0a025168acdfe49f1b3f71410dbff52fd0a33d839b4b51b"
Nov 04 05:46:05.032726 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:46:05.032706    4357 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d2abbb209920509e0a025168acdfe49f1b3f71410dbff52fd0a33d839b4b51b\": container with ID starting with 6d2abbb209920509e0a025168acdfe49f1b3f71410dbff52fd0a33d839b4b51b not found: ID does not exist" containerID="6d2abbb209920509e0a025168acdfe49f1b3f71410dbff52fd0a33d839b4b51b"
Nov 04 05:46:05.032810 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.032736    4357 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d2abbb209920509e0a025168acdfe49f1b3f71410dbff52fd0a33d839b4b51b"} err="failed to get container status \"6d2abbb209920509e0a025168acdfe49f1b3f71410dbff52fd0a33d839b4b51b\": rpc error: code = NotFound desc = could not find container \"6d2abbb209920509e0a025168acdfe49f1b3f71410dbff52fd0a33d839b4b51b\": container with ID starting with 6d2abbb209920509e0a025168acdfe49f1b3f71410dbff52fd0a33d839b4b51b not found: ID does not exist"
Nov 04 05:46:05.032810 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.032760    4357 scope.go:122] "RemoveContainer" containerID="fd637f770374c8996f2d851cbc053ebd0b7f4f5d0a72b6e82bdd2d62041cbfdd"
Nov 04 05:46:05.040775 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.040756    4357 scope.go:122] "RemoveContainer" containerID="fd637f770374c8996f2d851cbc053ebd0b7f4f5d0a72b6e82bdd2d62041cbfdd"
Nov 04 05:46:05.041043 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:46:05.041024    4357 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd637f770374c8996f2d851cbc053ebd0b7f4f5d0a72b6e82bdd2d62041cbfdd\": container with ID starting with fd637f770374c8996f2d851cbc053ebd0b7f4f5d0a72b6e82bdd2d62041cbfdd not found: ID does not exist" containerID="fd637f770374c8996f2d851cbc053ebd0b7f4f5d0a72b6e82bdd2d62041cbfdd"
Nov 04 05:46:05.041116 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.041050    4357 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd637f770374c8996f2d851cbc053ebd0b7f4f5d0a72b6e82bdd2d62041cbfdd"} err="failed to get container status \"fd637f770374c8996f2d851cbc053ebd0b7f4f5d0a72b6e82bdd2d62041cbfdd\": rpc error: code = NotFound desc = could not find container \"fd637f770374c8996f2d851cbc053ebd0b7f4f5d0a72b6e82bdd2d62041cbfdd\": container with ID starting with fd637f770374c8996f2d851cbc053ebd0b7f4f5d0a72b6e82bdd2d62041cbfdd not found: ID does not exist"
Nov 04 05:46:05.041116 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.041064    4357 scope.go:122] "RemoveContainer" containerID="16d52235cde4e37494afe36960c3f765dce48b449f378a6b686ab6227ffefdf4"
Nov 04 05:46:05.042239 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.042220    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q"]
Nov 04 05:46:05.046917 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.046893    4357 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-f446q"]
Nov 04 05:46:05.049165 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.049145    4357 scope.go:122] "RemoveContainer" containerID="16d52235cde4e37494afe36960c3f765dce48b449f378a6b686ab6227ffefdf4"
Nov 04 05:46:05.049453 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:46:05.049429    4357 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16d52235cde4e37494afe36960c3f765dce48b449f378a6b686ab6227ffefdf4\": container with ID starting with 16d52235cde4e37494afe36960c3f765dce48b449f378a6b686ab6227ffefdf4 not found: ID does not exist" containerID="16d52235cde4e37494afe36960c3f765dce48b449f378a6b686ab6227ffefdf4"
Nov 04 05:46:05.049551 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.049460    4357 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16d52235cde4e37494afe36960c3f765dce48b449f378a6b686ab6227ffefdf4"} err="failed to get container status \"16d52235cde4e37494afe36960c3f765dce48b449f378a6b686ab6227ffefdf4\": rpc error: code = NotFound desc = could not find container \"16d52235cde4e37494afe36960c3f765dce48b449f378a6b686ab6227ffefdf4\": container with ID starting with 16d52235cde4e37494afe36960c3f765dce48b449f378a6b686ab6227ffefdf4 not found: ID does not exist"
Nov 04 05:46:05.058733 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.058706    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl"]
Nov 04 05:46:05.069077 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.069056    4357 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-rrgwl"]
Nov 04 05:46:05.078098 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.078076    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7a1d76cc-d277-460b-9d2e-19e465e93008-istio-token\" (UniqueName: \"kubernetes.io/projected/7a1d76cc-d277-460b-9d2e-19e465e93008-istio-token\") pod \"7a1d76cc-d277-460b-9d2e-19e465e93008\" (UID: \"7a1d76cc-d277-460b-9d2e-19e465e93008\") "
Nov 04 05:46:05.078222 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.078124    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7a1d76cc-d277-460b-9d2e-19e465e93008-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a1d76cc-d277-460b-9d2e-19e465e93008-istio-podinfo\") pod \"7a1d76cc-d277-460b-9d2e-19e465e93008\" (UID: \"7a1d76cc-d277-460b-9d2e-19e465e93008\") "
Nov 04 05:46:05.078222 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.078173    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7a1d76cc-d277-460b-9d2e-19e465e93008-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a1d76cc-d277-460b-9d2e-19e465e93008-workload-certs\") pod \"7a1d76cc-d277-460b-9d2e-19e465e93008\" (UID: \"7a1d76cc-d277-460b-9d2e-19e465e93008\") "
Nov 04 05:46:05.078222 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.078212    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7a1d76cc-d277-460b-9d2e-19e465e93008-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a1d76cc-d277-460b-9d2e-19e465e93008-istiod-ca-cert\") pod \"7a1d76cc-d277-460b-9d2e-19e465e93008\" (UID: \"7a1d76cc-d277-460b-9d2e-19e465e93008\") "
Nov 04 05:46:05.079085 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.078553    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a1d76cc-d277-460b-9d2e-19e465e93008-workload-certs" pod "7a1d76cc-d277-460b-9d2e-19e465e93008" (UID: "7a1d76cc-d277-460b-9d2e-19e465e93008"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:05.079085 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.079047    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a1d76cc-d277-460b-9d2e-19e465e93008-istiod-ca-cert" pod "7a1d76cc-d277-460b-9d2e-19e465e93008" (UID: "7a1d76cc-d277-460b-9d2e-19e465e93008"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:46:05.079232 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.078257    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7a1d76cc-d277-460b-9d2e-19e465e93008-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a1d76cc-d277-460b-9d2e-19e465e93008-istio-envoy\") pod \"7a1d76cc-d277-460b-9d2e-19e465e93008\" (UID: \"7a1d76cc-d277-460b-9d2e-19e465e93008\") "
Nov 04 05:46:05.079232 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.079154    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7a1d76cc-d277-460b-9d2e-19e465e93008-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a1d76cc-d277-460b-9d2e-19e465e93008-istio-data\") pod \"7a1d76cc-d277-460b-9d2e-19e465e93008\" (UID: \"7a1d76cc-d277-460b-9d2e-19e465e93008\") "
Nov 04 05:46:05.079232 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.079185    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7a1d76cc-d277-460b-9d2e-19e465e93008-kube-api-access-mq4w2\" (UniqueName: \"kubernetes.io/projected/7a1d76cc-d277-460b-9d2e-19e465e93008-kube-api-access-mq4w2\") pod \"7a1d76cc-d277-460b-9d2e-19e465e93008\" (UID: \"7a1d76cc-d277-460b-9d2e-19e465e93008\") "
Nov 04 05:46:05.079232 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.079203    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7a1d76cc-d277-460b-9d2e-19e465e93008-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a1d76cc-d277-460b-9d2e-19e465e93008-credential-socket\") pod \"7a1d76cc-d277-460b-9d2e-19e465e93008\" (UID: \"7a1d76cc-d277-460b-9d2e-19e465e93008\") "
Nov 04 05:46:05.079510 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.079479    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a1d76cc-d277-460b-9d2e-19e465e93008-istio-data" pod "7a1d76cc-d277-460b-9d2e-19e465e93008" (UID: "7a1d76cc-d277-460b-9d2e-19e465e93008"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:05.079592 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.079513    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a1d76cc-d277-460b-9d2e-19e465e93008-credential-socket" pod "7a1d76cc-d277-460b-9d2e-19e465e93008" (UID: "7a1d76cc-d277-460b-9d2e-19e465e93008"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:05.079592 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.079560    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7a1d76cc-d277-460b-9d2e-19e465e93008-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a1d76cc-d277-460b-9d2e-19e465e93008-workload-socket\") pod \"7a1d76cc-d277-460b-9d2e-19e465e93008\" (UID: \"7a1d76cc-d277-460b-9d2e-19e465e93008\") "
Nov 04 05:46:05.079790 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.079762    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a1d76cc-d277-460b-9d2e-19e465e93008-workload-socket" pod "7a1d76cc-d277-460b-9d2e-19e465e93008" (UID: "7a1d76cc-d277-460b-9d2e-19e465e93008"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:05.079920 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.079901    4357 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a1d76cc-d277-460b-9d2e-19e465e93008-workload-socket\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:05.079979 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.079929    4357 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-istio-token\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:05.079979 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.079946    4357 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-istio-podinfo\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:05.079979 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.079962    4357 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-istiod-ca-cert\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:05.079979 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.079976    4357 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14d9c974-e49a-45d5-9c95-e8b2a390a185-istio-envoy\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:05.080112 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.079991    4357 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-istio-envoy\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:05.080112 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.080005    4357 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-istio-data\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:05.080112 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.080017    4357 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a1d76cc-d277-460b-9d2e-19e465e93008-workload-certs\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:05.080112 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.080030    4357 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whrnv\" (UniqueName: \"kubernetes.io/projected/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-kube-api-access-whrnv\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:05.080112 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.080046    4357 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14d9c974-e49a-45d5-9c95-e8b2a390a185-istio-podinfo\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:05.080112 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.080059    4357 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a1d76cc-d277-460b-9d2e-19e465e93008-istiod-ca-cert\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:05.080112 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.080074    4357 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwljc\" (UniqueName: \"kubernetes.io/projected/14d9c974-e49a-45d5-9c95-e8b2a390a185-kube-api-access-jwljc\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:05.080112 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.080087    4357 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14d9c974-e49a-45d5-9c95-e8b2a390a185-workload-certs\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:05.080112 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.080102    4357 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14d9c974-e49a-45d5-9c95-e8b2a390a185-istiod-ca-cert\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:05.080410 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.080116    4357 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a-credential-socket\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:05.080410 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.080132    4357 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a1d76cc-d277-460b-9d2e-19e465e93008-istio-data\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:05.080410 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.080146    4357 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a1d76cc-d277-460b-9d2e-19e465e93008-credential-socket\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:05.080410 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.080159    4357 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14d9c974-e49a-45d5-9c95-e8b2a390a185-istio-token\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:05.080742 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.080724    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a1d76cc-d277-460b-9d2e-19e465e93008-istio-token" pod "7a1d76cc-d277-460b-9d2e-19e465e93008" (UID: "7a1d76cc-d277-460b-9d2e-19e465e93008"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:46:05.080893 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.080876    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a1d76cc-d277-460b-9d2e-19e465e93008-istio-envoy" pod "7a1d76cc-d277-460b-9d2e-19e465e93008" (UID: "7a1d76cc-d277-460b-9d2e-19e465e93008"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:05.081042 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.081020    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7a1d76cc-d277-460b-9d2e-19e465e93008-istio-podinfo" pod "7a1d76cc-d277-460b-9d2e-19e465e93008" (UID: "7a1d76cc-d277-460b-9d2e-19e465e93008"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 05:46:05.081283 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.081267    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a1d76cc-d277-460b-9d2e-19e465e93008-kube-api-access-mq4w2" pod "7a1d76cc-d277-460b-9d2e-19e465e93008" (UID: "7a1d76cc-d277-460b-9d2e-19e465e93008"). InnerVolumeSpecName "kube-api-access-mq4w2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:46:05.081326 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.081307    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq"]
Nov 04 05:46:05.084426 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.084406    4357 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-8rxnq"]
Nov 04 05:46:05.181346 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.181296    4357 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a1d76cc-d277-460b-9d2e-19e465e93008-istio-envoy\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:05.181346 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.181320    4357 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mq4w2\" (UniqueName: \"kubernetes.io/projected/7a1d76cc-d277-460b-9d2e-19e465e93008-kube-api-access-mq4w2\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:05.181346 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.181330    4357 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a1d76cc-d277-460b-9d2e-19e465e93008-istio-token\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:05.181346 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.181339    4357 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a1d76cc-d277-460b-9d2e-19e465e93008-istio-podinfo\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:05.272916 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.272893    4357 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="14d9c974-e49a-45d5-9c95-e8b2a390a185" path="/var/lib/kubelet/pods/14d9c974-e49a-45d5-9c95-e8b2a390a185/volumes"
Nov 04 05:46:05.273315 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.273302    4357 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="33923021-e163-4976-a8bb-f74d79c5220a" path="/var/lib/kubelet/pods/33923021-e163-4976-a8bb-f74d79c5220a/volumes"
Nov 04 05:46:05.273712 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.273700    4357 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="43dd698a-4caf-4a7d-8dc3-dfe458da5c68" path="/var/lib/kubelet/pods/43dd698a-4caf-4a7d-8dc3-dfe458da5c68/volumes"
Nov 04 05:46:05.274399 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.274385    4357 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="54a708a2-3b46-489d-bc33-0954c018f253" path="/var/lib/kubelet/pods/54a708a2-3b46-489d-bc33-0954c018f253/volumes"
Nov 04 05:46:05.274822 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.274809    4357 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9e96333d-b91c-4a31-80d0-369af77f5eb8" path="/var/lib/kubelet/pods/9e96333d-b91c-4a31-80d0-369af77f5eb8/volumes"
Nov 04 05:46:05.275194 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.275183    4357 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f3aabb5c-cdeb-4afe-8785-d5bf5d82266a" path="/var/lib/kubelet/pods/f3aabb5c-cdeb-4afe-8785-d5bf5d82266a/volumes"
Nov 04 05:46:05.332850 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.326587    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4"]
Nov 04 05:46:05.332850 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:05.330760    4357 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-jfwv4"]
Nov 04 05:46:07.273405 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:07.273367    4357 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7a1d76cc-d277-460b-9d2e-19e465e93008" path="/var/lib/kubelet/pods/7a1d76cc-d277-460b-9d2e-19e465e93008/volumes"
Nov 04 05:46:12.103205 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:12.103179    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-6b45cd5c6c-k5lhs_cc3a3e4b-9cff-4764-bed8-6f6a9fe7c40e/manager/0.log"
Nov 04 05:46:15.338357 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:15.338329    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-40e8492f-z5ngh_4b7ef80e-f057-4971-8b8b-c857784012bf/revoke-keys/0.log"
Nov 04 05:46:15.870125 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:15.870095    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-93ee4734-c57px_635c7d18-aa04-4703-b5f5-5cc0958f5bf3/revoke-keys/0.log"
Nov 04 05:46:16.575722 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:16.575697    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-b83493ec-k54hm_cda24186-2be0-4f65-95bf-451172f238fa/revoke-keys/0.log"
Nov 04 05:46:17.274242 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:46:17.274210    4357 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-npgcv" containerName="extractor"
Nov 04 05:46:22.046719 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:22.046687    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-64lvc_bbda0ee3-ad65-4d05-bc9e-6006bcf7f084/discovery/0.log"
Nov 04 05:46:22.406456 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:22.406381    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5488c58ff5-924cz_ca5cdd56-1893-43c5-a34f-5662919b23a8/kube-auth-proxy/0.log"
Nov 04 05:46:23.115229 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:23.115202    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-694db55c87-4l7f4_7d011c75-4c48-46b9-920b-d7fa63ecdc3a/istio-proxy/0.log"
Nov 04 05:46:23.474239 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:23.474173    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-694db55c87-6x6f8_de916aeb-4496-4195-9c41-07b2c92f3bd7/istio-proxy/0.log"
Nov 04 05:46:23.822393 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:23.822363    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-694db55c87-f2ws7_23621eda-9b88-47e0-ba15-d45035dd4b3e/istio-proxy/0.log"
Nov 04 05:46:26.387828 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:26.387799    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7b998b79d9-r4mf8_65c94d62-9401-47be-b57d-abe4f26b0075/main/0.log"
Nov 04 05:46:27.074903 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:27.074879    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_echo-simulator-kserve-64b6f8f96c-wnssk_7b398f61-5bce-4f2e-8302-dc73748baa37/main/0.log"
Nov 04 05:46:27.252023 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:27.252000    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc_20e1b7ee-3e36-4762-ad6e-5df2ce114a94/main/0.log"
Nov 04 05:46:27.428214 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:27.428154    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp_56e89fbc-a03a-41fb-889e-4d96335c66f5/main/0.log"
Nov 04 05:46:37.506870 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:37.506844    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-6b45cd5c6c-k5lhs_cc3a3e4b-9cff-4764-bed8-6f6a9fe7c40e/manager/0.log"
Nov 04 05:46:40.097873 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:40.097838    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-40e8492f-z5ngh_4b7ef80e-f057-4971-8b8b-c857784012bf/revoke-keys/0.log"
Nov 04 05:46:40.578528 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:40.578502    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-93ee4734-c57px_635c7d18-aa04-4703-b5f5-5cc0958f5bf3/revoke-keys/0.log"
Nov 04 05:46:41.275580 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:41.275550    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-b83493ec-k54hm_cda24186-2be0-4f65-95bf-451172f238fa/revoke-keys/0.log"
Nov 04 05:46:44.969661 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:44.969628    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-64lvc_bbda0ee3-ad65-4d05-bc9e-6006bcf7f084/discovery/0.log"
Nov 04 05:46:45.360183 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:45.360158    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5488c58ff5-924cz_ca5cdd56-1893-43c5-a34f-5662919b23a8/kube-auth-proxy/0.log"
Nov 04 05:46:45.930821 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:45.930787    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-694db55c87-4l7f4_7d011c75-4c48-46b9-920b-d7fa63ecdc3a/istio-proxy/0.log"
Nov 04 05:46:46.338762 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:46.338727    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-694db55c87-6x6f8_de916aeb-4496-4195-9c41-07b2c92f3bd7/istio-proxy/0.log"
Nov 04 05:46:46.695205 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:46.695147    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-694db55c87-f2ws7_23621eda-9b88-47e0-ba15-d45035dd4b3e/istio-proxy/0.log"
Nov 04 05:46:47.275055 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:46:47.275019    4357 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-npgcv" containerName="extractor"
Nov 04 05:46:48.625370 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:48.625339    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7b998b79d9-r4mf8_65c94d62-9401-47be-b57d-abe4f26b0075/main/0.log"
Nov 04 05:46:49.384341 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:49.384311    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_echo-simulator-kserve-64b6f8f96c-wnssk_7b398f61-5bce-4f2e-8302-dc73748baa37/main/0.log"
Nov 04 05:46:49.571358 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:49.571332    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-84b4ff656c-sgnhc_20e1b7ee-3e36-4762-ad6e-5df2ce114a94/main/0.log"
Nov 04 05:46:49.731599 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:46:49.731529    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5f5c4b459f-49dvp_56e89fbc-a03a-41fb-889e-4d96335c66f5/main/0.log"
Nov 04 05:47:17.274678 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:47:17.274602    4357 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-npgcv" containerName="extractor"
Nov 04 05:47:47.274910 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:47:47.274876    4357 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-npgcv" containerName="extractor"
Nov 04 05:47:52.235336 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.235306    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-z96kl/must-gather-nh8x2"]
Nov 04 05:47:52.235717 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.235639    4357 cpu_manager.go:414] "containerMap: removing container" podUID="5ed67653-cc0f-4000-aa56-edd9d733b025" containerName="payload-pre-processing"
Nov 04 05:47:52.235717 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.235651    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5ed67653-cc0f-4000-aa56-edd9d733b025" containerName="payload-pre-processing"
Nov 04 05:47:52.235717 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.235666    4357 cpu_manager.go:414] "containerMap: removing container" podUID="43dd698a-4caf-4a7d-8dc3-dfe458da5c68" containerName="istio-proxy"
Nov 04 05:47:52.235717 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.235671    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="43dd698a-4caf-4a7d-8dc3-dfe458da5c68" containerName="istio-proxy"
Nov 04 05:47:52.235717 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.235684    4357 cpu_manager.go:414] "containerMap: removing container" podUID="9e96333d-b91c-4a31-80d0-369af77f5eb8" containerName="istio-proxy"
Nov 04 05:47:52.235717 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.235688    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9e96333d-b91c-4a31-80d0-369af77f5eb8" containerName="istio-proxy"
Nov 04 05:47:52.235717 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.235695    4357 cpu_manager.go:414] "containerMap: removing container" podUID="6c343ea7-372f-4d66-9534-c758209541b0" containerName="payload-pre-processing"
Nov 04 05:47:52.235717 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.235700    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6c343ea7-372f-4d66-9534-c758209541b0" containerName="payload-pre-processing"
Nov 04 05:47:52.235717 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.235707    4357 cpu_manager.go:414] "containerMap: removing container" podUID="f3aabb5c-cdeb-4afe-8785-d5bf5d82266a" containerName="istio-proxy"
Nov 04 05:47:52.235717 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.235712    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f3aabb5c-cdeb-4afe-8785-d5bf5d82266a" containerName="istio-proxy"
Nov 04 05:47:52.235717 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.235718    4357 cpu_manager.go:414] "containerMap: removing container" podUID="54a708a2-3b46-489d-bc33-0954c018f253" containerName="istio-proxy"
Nov 04 05:47:52.235717 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.235722    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="54a708a2-3b46-489d-bc33-0954c018f253" containerName="istio-proxy"
Nov 04 05:47:52.236074 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.235729    4357 cpu_manager.go:414] "containerMap: removing container" podUID="43dd698a-4caf-4a7d-8dc3-dfe458da5c68" containerName="istio-proxy"
Nov 04 05:47:52.236074 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.235734    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="43dd698a-4caf-4a7d-8dc3-dfe458da5c68" containerName="istio-proxy"
Nov 04 05:47:52.236074 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.235742    4357 cpu_manager.go:414] "containerMap: removing container" podUID="7a1d76cc-d277-460b-9d2e-19e465e93008" containerName="istio-proxy"
Nov 04 05:47:52.236074 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.235746    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7a1d76cc-d277-460b-9d2e-19e465e93008" containerName="istio-proxy"
Nov 04 05:47:52.236074 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.235754    4357 cpu_manager.go:414] "containerMap: removing container" podUID="33923021-e163-4976-a8bb-f74d79c5220a" containerName="istio-proxy"
Nov 04 05:47:52.236074 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.235758    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="33923021-e163-4976-a8bb-f74d79c5220a" containerName="istio-proxy"
Nov 04 05:47:52.236074 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.235763    4357 cpu_manager.go:414] "containerMap: removing container" podUID="14d9c974-e49a-45d5-9c95-e8b2a390a185" containerName="istio-proxy"
Nov 04 05:47:52.236074 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.235767    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="14d9c974-e49a-45d5-9c95-e8b2a390a185" containerName="istio-proxy"
Nov 04 05:47:52.236074 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.235777    4357 cpu_manager.go:414] "containerMap: removing container" podUID="283c52c3-ef70-4c20-9862-02ce8f496e47" containerName="istio-proxy"
Nov 04 05:47:52.236074 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.235781    4357 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="283c52c3-ef70-4c20-9862-02ce8f496e47" containerName="istio-proxy"
Nov 04 05:47:52.236074 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.235827    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="283c52c3-ef70-4c20-9862-02ce8f496e47" containerName="istio-proxy"
Nov 04 05:47:52.236074 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.235834    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="5ed67653-cc0f-4000-aa56-edd9d733b025" containerName="payload-pre-processing"
Nov 04 05:47:52.236074 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.235840    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="43dd698a-4caf-4a7d-8dc3-dfe458da5c68" containerName="istio-proxy"
Nov 04 05:47:52.236074 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.235846    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="9e96333d-b91c-4a31-80d0-369af77f5eb8" containerName="istio-proxy"
Nov 04 05:47:52.236074 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.235853    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="6c343ea7-372f-4d66-9534-c758209541b0" containerName="payload-pre-processing"
Nov 04 05:47:52.236074 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.235859    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="f3aabb5c-cdeb-4afe-8785-d5bf5d82266a" containerName="istio-proxy"
Nov 04 05:47:52.236074 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.235864    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="54a708a2-3b46-489d-bc33-0954c018f253" containerName="istio-proxy"
Nov 04 05:47:52.236074 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.235869    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="7a1d76cc-d277-460b-9d2e-19e465e93008" containerName="istio-proxy"
Nov 04 05:47:52.236074 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.235875    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="33923021-e163-4976-a8bb-f74d79c5220a" containerName="istio-proxy"
Nov 04 05:47:52.236074 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.235879    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="14d9c974-e49a-45d5-9c95-e8b2a390a185" containerName="istio-proxy"
Nov 04 05:47:52.236074 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.235977    4357 memory_manager.go:365] "RemoveStaleState removing state" podUID="43dd698a-4caf-4a7d-8dc3-dfe458da5c68" containerName="istio-proxy"
Nov 04 05:47:52.238759 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.238744    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z96kl/must-gather-nh8x2"
Nov 04 05:47:52.245414 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.245389    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z96kl\"/\"kube-root-ca.crt\""
Nov 04 05:47:52.245556 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.245466    4357 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z96kl\"/\"openshift-service-ca.crt\""
Nov 04 05:47:52.246675 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.246611    4357 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-z96kl\"/\"default-dockercfg-8kdm5\""
Nov 04 05:47:52.248544 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.248509    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z96kl/must-gather-nh8x2"]
Nov 04 05:47:52.395135 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.390034    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qhgf\" (UniqueName: \"kubernetes.io/projected/c877b245-1245-4f1f-a85c-facea7251654-kube-api-access-5qhgf\") pod \"must-gather-nh8x2\" (UID: \"c877b245-1245-4f1f-a85c-facea7251654\") " pod="openshift-must-gather-z96kl/must-gather-nh8x2"
Nov 04 05:47:52.395135 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.390162    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c877b245-1245-4f1f-a85c-facea7251654-must-gather-output\") pod \"must-gather-nh8x2\" (UID: \"c877b245-1245-4f1f-a85c-facea7251654\") " pod="openshift-must-gather-z96kl/must-gather-nh8x2"
Nov 04 05:47:52.491016 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.490944    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qhgf\" (UniqueName: \"kubernetes.io/projected/c877b245-1245-4f1f-a85c-facea7251654-kube-api-access-5qhgf\") pod \"must-gather-nh8x2\" (UID: \"c877b245-1245-4f1f-a85c-facea7251654\") " pod="openshift-must-gather-z96kl/must-gather-nh8x2"
Nov 04 05:47:52.491016 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.491000    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c877b245-1245-4f1f-a85c-facea7251654-must-gather-output\") pod \"must-gather-nh8x2\" (UID: \"c877b245-1245-4f1f-a85c-facea7251654\") " pod="openshift-must-gather-z96kl/must-gather-nh8x2"
Nov 04 05:47:52.491282 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.491265    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c877b245-1245-4f1f-a85c-facea7251654-must-gather-output\") pod \"must-gather-nh8x2\" (UID: \"c877b245-1245-4f1f-a85c-facea7251654\") " pod="openshift-must-gather-z96kl/must-gather-nh8x2"
Nov 04 05:47:52.498943 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.498912    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qhgf\" (UniqueName: \"kubernetes.io/projected/c877b245-1245-4f1f-a85c-facea7251654-kube-api-access-5qhgf\") pod \"must-gather-nh8x2\" (UID: \"c877b245-1245-4f1f-a85c-facea7251654\") " pod="openshift-must-gather-z96kl/must-gather-nh8x2"
Nov 04 05:47:52.552646 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.552615    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z96kl/must-gather-nh8x2"
Nov 04 05:47:52.820602 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.820543    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z96kl/must-gather-nh8x2"]
Nov 04 05:47:52.822819 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:47:52.822790    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc877b245_1245_4f1f_a85c_facea7251654.slice/crio-66da0a2b04be9c7fa6841ce701a84d54aa32760b8f7a54f78291602c73867432 WatchSource:0}: Error finding container 66da0a2b04be9c7fa6841ce701a84d54aa32760b8f7a54f78291602c73867432: Status 404 returned error can't find the container with id 66da0a2b04be9c7fa6841ce701a84d54aa32760b8f7a54f78291602c73867432
Nov 04 05:47:52.824648 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:52.824633    4357 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 05:47:53.480462 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:53.480428    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z96kl/must-gather-nh8x2" event={"ID":"c877b245-1245-4f1f-a85c-facea7251654","Type":"ContainerStarted","Data":"66da0a2b04be9c7fa6841ce701a84d54aa32760b8f7a54f78291602c73867432"}
Nov 04 05:47:54.489035 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:54.489001    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z96kl/must-gather-nh8x2" event={"ID":"c877b245-1245-4f1f-a85c-facea7251654","Type":"ContainerStarted","Data":"deb21db4407544221ac5a5ca9ca115aeec053a48434fa83bc86e1c10d15c6f58"}
Nov 04 05:47:54.489035 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:54.489042    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z96kl/must-gather-nh8x2" event={"ID":"c877b245-1245-4f1f-a85c-facea7251654","Type":"ContainerStarted","Data":"0f5309122b77564dd9f937f7414d754d8f96b5b28c1202df4f35d5f1a2ae85b3"}
Nov 04 05:47:54.506508 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:54.506463    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-z96kl/must-gather-nh8x2" podStartSLOduration=1.791503241 podStartE2EDuration="2.506447833s" totalImagesPullingTime="714.944592ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:47:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:47:54.505061969 +0000 UTC m=+1161.373725538" watchObservedRunningTime="2026-11-04 05:47:54.506447833 +0000 UTC m=+1161.375111405"
Nov 04 05:47:55.218537 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:55.218501    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8fwjr_b9aa45f3-1a47-489d-ba9d-76cbe630b283/global-pull-secret-syncer/0.log"
Nov 04 05:47:55.423933 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:55.423903    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bwn4l_abfc6e5f-914e-4a19-8fd3-c8a844377da3/konnectivity-agent/0.log"
Nov 04 05:47:55.495907 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:47:55.495830    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-170.us-east-2.compute.internal_49c578da98535d8878f600c872b7f09a/haproxy/0.log"
Nov 04 05:48:04.276964 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:04.276931    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mzslf_45a62b3f-7826-4234-8bc4-8f3aaeaac2da/node-exporter/0.log"
Nov 04 05:48:04.299668 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:04.299644    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mzslf_45a62b3f-7826-4234-8bc4-8f3aaeaac2da/kube-rbac-proxy/0.log"
Nov 04 05:48:04.334225 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:04.334201    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mzslf_45a62b3f-7826-4234-8bc4-8f3aaeaac2da/init-textfile/0.log"
Nov 04 05:48:04.389752 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:04.389714    4357 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-z96kl/perf-node-gather-daemonset-sghj7"]
Nov 04 05:48:04.394942 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:04.394918    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z96kl/perf-node-gather-daemonset-sghj7"
Nov 04 05:48:04.404945 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:04.404917    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z96kl/perf-node-gather-daemonset-sghj7"]
Nov 04 05:48:04.524813 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:04.524781    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3276284b-c519-4bc9-a03b-ca50fb09e416-lib-modules\") pod \"perf-node-gather-daemonset-sghj7\" (UID: \"3276284b-c519-4bc9-a03b-ca50fb09e416\") " pod="openshift-must-gather-z96kl/perf-node-gather-daemonset-sghj7"
Nov 04 05:48:04.525017 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:04.524823    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8tz5\" (UniqueName: \"kubernetes.io/projected/3276284b-c519-4bc9-a03b-ca50fb09e416-kube-api-access-k8tz5\") pod \"perf-node-gather-daemonset-sghj7\" (UID: \"3276284b-c519-4bc9-a03b-ca50fb09e416\") " pod="openshift-must-gather-z96kl/perf-node-gather-daemonset-sghj7"
Nov 04 05:48:04.525017 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:04.524852    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3276284b-c519-4bc9-a03b-ca50fb09e416-sys\") pod \"perf-node-gather-daemonset-sghj7\" (UID: \"3276284b-c519-4bc9-a03b-ca50fb09e416\") " pod="openshift-must-gather-z96kl/perf-node-gather-daemonset-sghj7"
Nov 04 05:48:04.525017 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:04.524947    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3276284b-c519-4bc9-a03b-ca50fb09e416-podres\") pod \"perf-node-gather-daemonset-sghj7\" (UID: \"3276284b-c519-4bc9-a03b-ca50fb09e416\") " pod="openshift-must-gather-z96kl/perf-node-gather-daemonset-sghj7"
Nov 04 05:48:04.525201 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:04.525085    4357 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3276284b-c519-4bc9-a03b-ca50fb09e416-proc\") pod \"perf-node-gather-daemonset-sghj7\" (UID: \"3276284b-c519-4bc9-a03b-ca50fb09e416\") " pod="openshift-must-gather-z96kl/perf-node-gather-daemonset-sghj7"
Nov 04 05:48:04.628258 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:04.628168    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3276284b-c519-4bc9-a03b-ca50fb09e416-proc\") pod \"perf-node-gather-daemonset-sghj7\" (UID: \"3276284b-c519-4bc9-a03b-ca50fb09e416\") " pod="openshift-must-gather-z96kl/perf-node-gather-daemonset-sghj7"
Nov 04 05:48:04.628258 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:04.628241    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3276284b-c519-4bc9-a03b-ca50fb09e416-lib-modules\") pod \"perf-node-gather-daemonset-sghj7\" (UID: \"3276284b-c519-4bc9-a03b-ca50fb09e416\") " pod="openshift-must-gather-z96kl/perf-node-gather-daemonset-sghj7"
Nov 04 05:48:04.628490 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:04.628274    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8tz5\" (UniqueName: \"kubernetes.io/projected/3276284b-c519-4bc9-a03b-ca50fb09e416-kube-api-access-k8tz5\") pod \"perf-node-gather-daemonset-sghj7\" (UID: \"3276284b-c519-4bc9-a03b-ca50fb09e416\") " pod="openshift-must-gather-z96kl/perf-node-gather-daemonset-sghj7"
Nov 04 05:48:04.628490 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:04.628284    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3276284b-c519-4bc9-a03b-ca50fb09e416-proc\") pod \"perf-node-gather-daemonset-sghj7\" (UID: \"3276284b-c519-4bc9-a03b-ca50fb09e416\") " pod="openshift-must-gather-z96kl/perf-node-gather-daemonset-sghj7"
Nov 04 05:48:04.628490 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:04.628302    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3276284b-c519-4bc9-a03b-ca50fb09e416-sys\") pod \"perf-node-gather-daemonset-sghj7\" (UID: \"3276284b-c519-4bc9-a03b-ca50fb09e416\") " pod="openshift-must-gather-z96kl/perf-node-gather-daemonset-sghj7"
Nov 04 05:48:04.628490 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:04.628344    4357 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3276284b-c519-4bc9-a03b-ca50fb09e416-podres\") pod \"perf-node-gather-daemonset-sghj7\" (UID: \"3276284b-c519-4bc9-a03b-ca50fb09e416\") " pod="openshift-must-gather-z96kl/perf-node-gather-daemonset-sghj7"
Nov 04 05:48:04.628490 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:04.628367    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3276284b-c519-4bc9-a03b-ca50fb09e416-sys\") pod \"perf-node-gather-daemonset-sghj7\" (UID: \"3276284b-c519-4bc9-a03b-ca50fb09e416\") " pod="openshift-must-gather-z96kl/perf-node-gather-daemonset-sghj7"
Nov 04 05:48:04.628772 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:04.628500    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3276284b-c519-4bc9-a03b-ca50fb09e416-lib-modules\") pod \"perf-node-gather-daemonset-sghj7\" (UID: \"3276284b-c519-4bc9-a03b-ca50fb09e416\") " pod="openshift-must-gather-z96kl/perf-node-gather-daemonset-sghj7"
Nov 04 05:48:04.628772 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:04.628534    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3276284b-c519-4bc9-a03b-ca50fb09e416-podres\") pod \"perf-node-gather-daemonset-sghj7\" (UID: \"3276284b-c519-4bc9-a03b-ca50fb09e416\") " pod="openshift-must-gather-z96kl/perf-node-gather-daemonset-sghj7"
Nov 04 05:48:04.632388 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:04.632361    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-vqhd7_a5603583-e3d5-4988-82be-318b4ea43904/prometheus-operator/0.log"
Nov 04 05:48:04.636382 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:04.636355    4357 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8tz5\" (UniqueName: \"kubernetes.io/projected/3276284b-c519-4bc9-a03b-ca50fb09e416-kube-api-access-k8tz5\") pod \"perf-node-gather-daemonset-sghj7\" (UID: \"3276284b-c519-4bc9-a03b-ca50fb09e416\") " pod="openshift-must-gather-z96kl/perf-node-gather-daemonset-sghj7"
Nov 04 05:48:04.667341 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:04.667317    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-vqhd7_a5603583-e3d5-4988-82be-318b4ea43904/kube-rbac-proxy/0.log"
Nov 04 05:48:04.693961 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:04.693874    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6489d8bf89-kwfv6_fd7c3d1d-397d-4280-bc90-40bf34af6424/prometheus-operator-admission-webhook/0.log"
Nov 04 05:48:04.711538 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:04.711325    4357 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z96kl/perf-node-gather-daemonset-sghj7"
Nov 04 05:48:04.722980 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:04.722958    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6667f598b5-jzm79_6d7b8054-8d1a-4180-ac57-cf95873f8a58/telemeter-client/0.log"
Nov 04 05:48:04.745348 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:04.745323    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6667f598b5-jzm79_6d7b8054-8d1a-4180-ac57-cf95873f8a58/reload/0.log"
Nov 04 05:48:04.774144 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:04.774081    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6667f598b5-jzm79_6d7b8054-8d1a-4180-ac57-cf95873f8a58/kube-rbac-proxy/0.log"
Nov 04 05:48:04.993223 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:04.993199    4357 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z96kl/perf-node-gather-daemonset-sghj7"]
Nov 04 05:48:04.996011 ip-10-0-133-170 kubenswrapper[4357]: W1104 05:48:04.995972    4357 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3276284b_c519_4bc9_a03b_ca50fb09e416.slice/crio-ba11eea2ab721599e713dc9f97cb356054cc6d50e219431652392e30250d1801 WatchSource:0}: Error finding container ba11eea2ab721599e713dc9f97cb356054cc6d50e219431652392e30250d1801: Status 404 returned error can't find the container with id ba11eea2ab721599e713dc9f97cb356054cc6d50e219431652392e30250d1801
Nov 04 05:48:05.584939 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:05.584893    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z96kl/perf-node-gather-daemonset-sghj7" event={"ID":"3276284b-c519-4bc9-a03b-ca50fb09e416","Type":"ContainerStarted","Data":"1eb3effc04b3754597c07d92d0776354bd6a400529b208b551270e063c65ca0c"}
Nov 04 05:48:05.585417 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:05.584957    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z96kl/perf-node-gather-daemonset-sghj7" event={"ID":"3276284b-c519-4bc9-a03b-ca50fb09e416","Type":"ContainerStarted","Data":"ba11eea2ab721599e713dc9f97cb356054cc6d50e219431652392e30250d1801"}
Nov 04 05:48:05.585789 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:05.585768    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-z96kl/perf-node-gather-daemonset-sghj7"
Nov 04 05:48:05.606315 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:05.606253    4357 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-z96kl/perf-node-gather-daemonset-sghj7" podStartSLOduration=1.606234492 podStartE2EDuration="1.606234492s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:48:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:48:05.600391999 +0000 UTC m=+1172.469055571" watchObservedRunningTime="2026-11-04 05:48:05.606234492 +0000 UTC m=+1172.474898064"
Nov 04 05:48:07.237480 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:07.237452    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6cdb876fbd-vmgnf_2a27f89d-eef9-472c-a84e-ae1f0ee30827/console/0.log"
Nov 04 05:48:07.269090 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:07.269053    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6dd789c8b7-twk8j_f85457d7-1779-477b-8f2d-e9d4b7ac6c3c/download-server/0.log"
Nov 04 05:48:08.984137 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:08.984107    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pwfdh_141ed76b-593a-4efb-a0b2-0e9c95258451/dns/0.log"
Nov 04 05:48:09.007986 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:09.007944    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pwfdh_141ed76b-593a-4efb-a0b2-0e9c95258451/kube-rbac-proxy/0.log"
Nov 04 05:48:09.057112 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:09.057084    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x7zft_5510018c-1e4d-4009-bc56-2152f7703f7a/dns-node-resolver/0.log"
Nov 04 05:48:09.187494 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:09.187453    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7"]
Nov 04 05:48:09.187748 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:09.187717    4357 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7" podUID="23621eda-9b88-47e0-ba15-d45035dd4b3e" containerName="istio-proxy" containerID="cri-o://19515dd92077612b2ce66ff2ce59428f262cb29c2223a56fdbe619263721f578" gracePeriod=30
Nov 04 05:48:09.651120 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:09.651088    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5d6d44dc4-bfpvx_7fa6dfd0-336b-4bf6-a288-08eebb4b8897/registry/0.log"
Nov 04 05:48:09.722869 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:09.722839    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s2tjx_02758cc7-baf6-44d1-baa6-87438b8376a2/node-ca/0.log"
Nov 04 05:48:11.324941 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:11.324786    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-64lvc_bbda0ee3-ad65-4d05-bc9e-6006bcf7f084/discovery/0.log"
Nov 04 05:48:11.389136 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:11.389104    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5488c58ff5-924cz_ca5cdd56-1893-43c5-a34f-5662919b23a8/kube-auth-proxy/0.log"
Nov 04 05:48:11.527221 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:11.527184    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-694db55c87-4l7f4_7d011c75-4c48-46b9-920b-d7fa63ecdc3a/istio-proxy/0.log"
Nov 04 05:48:11.603542 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:11.603463    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-694db55c87-6x6f8_de916aeb-4496-4195-9c41-07b2c92f3bd7/istio-proxy/0.log"
Nov 04 05:48:11.665804 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:11.665773    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-694db55c87-f2ws7_23621eda-9b88-47e0-ba15-d45035dd4b3e/istio-proxy/0.log"
Nov 04 05:48:12.607978 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:12.607946    4357 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-z96kl/perf-node-gather-daemonset-sghj7"
Nov 04 05:48:12.904078 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:12.904013    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-p27dv_0b1d0f07-5908-48f3-90ab-6f569e452b04/serve-healthcheck-canary/0.log"
Nov 04 05:48:13.491890 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:13.491859    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-npgcv_c610835f-ae53-45a1-868d-573b7e07524c/kube-rbac-proxy/0.log"
Nov 04 05:48:13.514370 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:13.514343    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-npgcv_c610835f-ae53-45a1-868d-573b7e07524c/exporter/0.log"
Nov 04 05:48:13.540089 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:13.539615    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-npgcv_c610835f-ae53-45a1-868d-573b7e07524c/extractor/0.log"
Nov 04 05:48:14.506390 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:14.506156    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7"
Nov 04 05:48:14.561877 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:14.561843    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/23621eda-9b88-47e0-ba15-d45035dd4b3e-istio-token\" (UniqueName: \"kubernetes.io/projected/23621eda-9b88-47e0-ba15-d45035dd4b3e-istio-token\") pod \"23621eda-9b88-47e0-ba15-d45035dd4b3e\" (UID: \"23621eda-9b88-47e0-ba15-d45035dd4b3e\") "
Nov 04 05:48:14.562062 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:14.561910    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/23621eda-9b88-47e0-ba15-d45035dd4b3e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23621eda-9b88-47e0-ba15-d45035dd4b3e-istiod-ca-cert\") pod \"23621eda-9b88-47e0-ba15-d45035dd4b3e\" (UID: \"23621eda-9b88-47e0-ba15-d45035dd4b3e\") "
Nov 04 05:48:14.562062 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:14.561934    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/23621eda-9b88-47e0-ba15-d45035dd4b3e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23621eda-9b88-47e0-ba15-d45035dd4b3e-workload-socket\") pod \"23621eda-9b88-47e0-ba15-d45035dd4b3e\" (UID: \"23621eda-9b88-47e0-ba15-d45035dd4b3e\") "
Nov 04 05:48:14.562062 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:14.561962    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/23621eda-9b88-47e0-ba15-d45035dd4b3e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23621eda-9b88-47e0-ba15-d45035dd4b3e-istio-podinfo\") pod \"23621eda-9b88-47e0-ba15-d45035dd4b3e\" (UID: \"23621eda-9b88-47e0-ba15-d45035dd4b3e\") "
Nov 04 05:48:14.562062 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:14.561991    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/23621eda-9b88-47e0-ba15-d45035dd4b3e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23621eda-9b88-47e0-ba15-d45035dd4b3e-credential-socket\") pod \"23621eda-9b88-47e0-ba15-d45035dd4b3e\" (UID: \"23621eda-9b88-47e0-ba15-d45035dd4b3e\") "
Nov 04 05:48:14.562062 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:14.562013    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/23621eda-9b88-47e0-ba15-d45035dd4b3e-kube-api-access-xm8k6\" (UniqueName: \"kubernetes.io/projected/23621eda-9b88-47e0-ba15-d45035dd4b3e-kube-api-access-xm8k6\") pod \"23621eda-9b88-47e0-ba15-d45035dd4b3e\" (UID: \"23621eda-9b88-47e0-ba15-d45035dd4b3e\") "
Nov 04 05:48:14.562062 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:14.562060    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/23621eda-9b88-47e0-ba15-d45035dd4b3e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23621eda-9b88-47e0-ba15-d45035dd4b3e-istio-data\") pod \"23621eda-9b88-47e0-ba15-d45035dd4b3e\" (UID: \"23621eda-9b88-47e0-ba15-d45035dd4b3e\") "
Nov 04 05:48:14.562389 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:14.562094    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/23621eda-9b88-47e0-ba15-d45035dd4b3e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23621eda-9b88-47e0-ba15-d45035dd4b3e-istio-envoy\") pod \"23621eda-9b88-47e0-ba15-d45035dd4b3e\" (UID: \"23621eda-9b88-47e0-ba15-d45035dd4b3e\") "
Nov 04 05:48:14.562389 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:14.562129    4357 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/23621eda-9b88-47e0-ba15-d45035dd4b3e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23621eda-9b88-47e0-ba15-d45035dd4b3e-workload-certs\") pod \"23621eda-9b88-47e0-ba15-d45035dd4b3e\" (UID: \"23621eda-9b88-47e0-ba15-d45035dd4b3e\") "
Nov 04 05:48:14.562565 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:14.562542    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23621eda-9b88-47e0-ba15-d45035dd4b3e-workload-certs" pod "23621eda-9b88-47e0-ba15-d45035dd4b3e" (UID: "23621eda-9b88-47e0-ba15-d45035dd4b3e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:48:14.563169 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:14.563065    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23621eda-9b88-47e0-ba15-d45035dd4b3e-workload-socket" pod "23621eda-9b88-47e0-ba15-d45035dd4b3e" (UID: "23621eda-9b88-47e0-ba15-d45035dd4b3e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:48:14.563169 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:14.563087    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23621eda-9b88-47e0-ba15-d45035dd4b3e-credential-socket" pod "23621eda-9b88-47e0-ba15-d45035dd4b3e" (UID: "23621eda-9b88-47e0-ba15-d45035dd4b3e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:48:14.563325 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:14.563276    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23621eda-9b88-47e0-ba15-d45035dd4b3e-istiod-ca-cert" pod "23621eda-9b88-47e0-ba15-d45035dd4b3e" (UID: "23621eda-9b88-47e0-ba15-d45035dd4b3e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:48:14.563499 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:14.563477    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23621eda-9b88-47e0-ba15-d45035dd4b3e-istio-data" pod "23621eda-9b88-47e0-ba15-d45035dd4b3e" (UID: "23621eda-9b88-47e0-ba15-d45035dd4b3e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:48:14.566227 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:14.566191    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23621eda-9b88-47e0-ba15-d45035dd4b3e-istio-token" pod "23621eda-9b88-47e0-ba15-d45035dd4b3e" (UID: "23621eda-9b88-47e0-ba15-d45035dd4b3e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:48:14.566493 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:14.566404    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/23621eda-9b88-47e0-ba15-d45035dd4b3e-istio-podinfo" pod "23621eda-9b88-47e0-ba15-d45035dd4b3e" (UID: "23621eda-9b88-47e0-ba15-d45035dd4b3e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 05:48:14.566493 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:14.566463    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23621eda-9b88-47e0-ba15-d45035dd4b3e-istio-envoy" pod "23621eda-9b88-47e0-ba15-d45035dd4b3e" (UID: "23621eda-9b88-47e0-ba15-d45035dd4b3e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:48:14.572967 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:14.572863    4357 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23621eda-9b88-47e0-ba15-d45035dd4b3e-kube-api-access-xm8k6" pod "23621eda-9b88-47e0-ba15-d45035dd4b3e" (UID: "23621eda-9b88-47e0-ba15-d45035dd4b3e"). InnerVolumeSpecName "kube-api-access-xm8k6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:48:14.647602 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:14.647560    4357 generic.go:356] "Generic (PLEG): container finished" podID="23621eda-9b88-47e0-ba15-d45035dd4b3e" containerID="19515dd92077612b2ce66ff2ce59428f262cb29c2223a56fdbe619263721f578" exitCode=0
Nov 04 05:48:14.647796 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:14.647655    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7" event={"ID":"23621eda-9b88-47e0-ba15-d45035dd4b3e","Type":"ContainerDied","Data":"19515dd92077612b2ce66ff2ce59428f262cb29c2223a56fdbe619263721f578"}
Nov 04 05:48:14.647796 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:14.647713    4357 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7" event={"ID":"23621eda-9b88-47e0-ba15-d45035dd4b3e","Type":"ContainerDied","Data":"27dda2dfe9b0978908750fd81a650688f269575ea9bbc7c4db801f9c76549491"}
Nov 04 05:48:14.647796 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:14.647743    4357 scope.go:122] "RemoveContainer" containerID="19515dd92077612b2ce66ff2ce59428f262cb29c2223a56fdbe619263721f578"
Nov 04 05:48:14.647917 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:14.647903    4357 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7"
Nov 04 05:48:14.660719 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:14.660469    4357 scope.go:122] "RemoveContainer" containerID="19515dd92077612b2ce66ff2ce59428f262cb29c2223a56fdbe619263721f578"
Nov 04 05:48:14.661278 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:48:14.661075    4357 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19515dd92077612b2ce66ff2ce59428f262cb29c2223a56fdbe619263721f578\": container with ID starting with 19515dd92077612b2ce66ff2ce59428f262cb29c2223a56fdbe619263721f578 not found: ID does not exist" containerID="19515dd92077612b2ce66ff2ce59428f262cb29c2223a56fdbe619263721f578"
Nov 04 05:48:14.661278 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:14.661113    4357 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19515dd92077612b2ce66ff2ce59428f262cb29c2223a56fdbe619263721f578"} err="failed to get container status \"19515dd92077612b2ce66ff2ce59428f262cb29c2223a56fdbe619263721f578\": rpc error: code = NotFound desc = could not find container \"19515dd92077612b2ce66ff2ce59428f262cb29c2223a56fdbe619263721f578\": container with ID starting with 19515dd92077612b2ce66ff2ce59428f262cb29c2223a56fdbe619263721f578 not found: ID does not exist"
Nov 04 05:48:14.662896 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:14.662874    4357 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23621eda-9b88-47e0-ba15-d45035dd4b3e-workload-certs\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:48:14.663009 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:14.662899    4357 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23621eda-9b88-47e0-ba15-d45035dd4b3e-istio-token\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:48:14.663009 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:14.662914    4357 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23621eda-9b88-47e0-ba15-d45035dd4b3e-istiod-ca-cert\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:48:14.663009 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:14.662927    4357 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23621eda-9b88-47e0-ba15-d45035dd4b3e-workload-socket\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:48:14.663009 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:14.662941    4357 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23621eda-9b88-47e0-ba15-d45035dd4b3e-istio-podinfo\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:48:14.663009 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:14.662953    4357 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23621eda-9b88-47e0-ba15-d45035dd4b3e-credential-socket\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:48:14.663009 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:14.662968    4357 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xm8k6\" (UniqueName: \"kubernetes.io/projected/23621eda-9b88-47e0-ba15-d45035dd4b3e-kube-api-access-xm8k6\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:48:14.663009 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:14.662982    4357 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23621eda-9b88-47e0-ba15-d45035dd4b3e-istio-data\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:48:14.663009 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:14.662994    4357 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23621eda-9b88-47e0-ba15-d45035dd4b3e-istio-envoy\") on node \"ip-10-0-133-170.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:48:14.678553 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:14.677642    4357 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7"]
Nov 04 05:48:14.681675 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:14.681655    4357 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-f2ws7"]
Nov 04 05:48:15.282811 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:15.282771    4357 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="23621eda-9b88-47e0-ba15-d45035dd4b3e" path="/var/lib/kubelet/pods/23621eda-9b88-47e0-ba15-d45035dd4b3e/volumes"
Nov 04 05:48:15.418541 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:15.418493    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-64lvc_bbda0ee3-ad65-4d05-bc9e-6006bcf7f084/discovery/0.log"
Nov 04 05:48:15.468271 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:15.468241    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5488c58ff5-924cz_ca5cdd56-1893-43c5-a34f-5662919b23a8/kube-auth-proxy/0.log"
Nov 04 05:48:15.526664 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:15.526632    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-694db55c87-4l7f4_7d011c75-4c48-46b9-920b-d7fa63ecdc3a/istio-proxy/0.log"
Nov 04 05:48:15.564309 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:15.564197    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-694db55c87-6x6f8_de916aeb-4496-4195-9c41-07b2c92f3bd7/istio-proxy/0.log"
Nov 04 05:48:16.515836 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:16.515804    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-56cd9ffd8-s4ckx_12872dd6-2073-44d4-9b3a-df0195f4a33d/manager/0.log"
Nov 04 05:48:16.557305 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:16.557046    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-56cd9ffd8-s4ckx_12872dd6-2073-44d4-9b3a-df0195f4a33d/copy-manifests/0.log"
Nov 04 05:48:17.287047 ip-10-0-133-170 kubenswrapper[4357]: E1104 05:48:17.287010    4357 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-npgcv" containerName="extractor"
Nov 04 05:48:17.837044 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:17.837012    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-controller-manager-5897477d49-fj2zh_f6de1b43-d06d-44b4-bd63-e31f73436c1c/manager/0.log"
Nov 04 05:48:18.010189 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:18.010152    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-64lvc_bbda0ee3-ad65-4d05-bc9e-6006bcf7f084/discovery/0.log"
Nov 04 05:48:18.062954 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:18.062927    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5488c58ff5-924cz_ca5cdd56-1893-43c5-a34f-5662919b23a8/kube-auth-proxy/0.log"
Nov 04 05:48:18.114873 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:18.114766    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-694db55c87-4l7f4_7d011c75-4c48-46b9-920b-d7fa63ecdc3a/istio-proxy/0.log"
Nov 04 05:48:18.146313 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:18.146278    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-694db55c87-6x6f8_de916aeb-4496-4195-9c41-07b2c92f3bd7/istio-proxy/0.log"
Nov 04 05:48:18.480838 ip-10-0-133-170 kubenswrapper[4357]: I1104 05:48:18.480775    4357 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-6b45cd5c6c-k5lhs_cc3a3e4b-9cff-4764-bed8-6f6a9fe7c40e/manager/0.log"