Jul 09 21:50:52.539344 ip-10-0-141-101 systemd[1]: Starting Kubernetes Kubelet...
Jul 09 21:50:53.001768 ip-10-0-141-101 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 21:50:53.001768 ip-10-0-141-101 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 09 21:50:53.001768 ip-10-0-141-101 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 21:50:53.001768 ip-10-0-141-101 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 09 21:50:53.001768 ip-10-0-141-101 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 21:50:53.001768 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:52.998003    2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 09 21:50:53.006119 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002107    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 21:50:53.006119 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002119    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 21:50:53.006119 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002123    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 21:50:53.006119 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002127    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 21:50:53.006119 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002131    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 21:50:53.006119 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002134    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 21:50:53.006119 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002137    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 21:50:53.006119 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002139    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 21:50:53.006119 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002142    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 21:50:53.006119 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002145    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 21:50:53.006119 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002148    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 21:50:53.006119 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002151    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 21:50:53.006119 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002154    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 21:50:53.006119 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002156    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 21:50:53.006119 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002159    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 21:50:53.006119 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002162    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 21:50:53.006119 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002166    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 21:50:53.006119 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002168    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 21:50:53.006119 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002171    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 21:50:53.006119 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002174    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 21:50:53.012357 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002176    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 21:50:53.012357 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002179    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 21:50:53.012357 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002181    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 21:50:53.012357 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002189    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 21:50:53.012357 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002192    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 21:50:53.012357 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002196    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 21:50:53.012357 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002199    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 21:50:53.012357 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002201    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 21:50:53.012357 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002204    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 21:50:53.012357 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002206    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 21:50:53.012357 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002209    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 21:50:53.012357 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002211    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 21:50:53.012357 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002214    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 21:50:53.012357 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002217    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 21:50:53.012357 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002220    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 21:50:53.012357 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002223    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 21:50:53.012357 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002226    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 21:50:53.012357 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002228    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 21:50:53.012357 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002231    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 21:50:53.012357 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002233    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 21:50:53.016678 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002236    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 21:50:53.016678 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002239    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 21:50:53.016678 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002241    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 21:50:53.016678 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002243    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 21:50:53.016678 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002246    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 21:50:53.016678 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002248    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 21:50:53.016678 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002251    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 21:50:53.016678 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002253    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 21:50:53.016678 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002256    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 21:50:53.016678 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002258    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 21:50:53.016678 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002261    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 21:50:53.016678 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002263    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 21:50:53.016678 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002265    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 21:50:53.016678 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002268    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 21:50:53.016678 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002270    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 21:50:53.016678 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002273    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 21:50:53.016678 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002276    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 21:50:53.016678 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002278    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 21:50:53.016678 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002281    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 21:50:53.016678 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002284    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 21:50:53.023627 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002287    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 21:50:53.023627 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002290    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 21:50:53.023627 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002293    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 21:50:53.023627 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002295    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 21:50:53.023627 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002298    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 21:50:53.023627 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002301    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 21:50:53.023627 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002303    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 21:50:53.023627 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002306    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 21:50:53.023627 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002309    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 21:50:53.023627 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002311    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 21:50:53.023627 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002314    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 21:50:53.023627 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002317    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 21:50:53.023627 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002320    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 21:50:53.023627 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002322    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 21:50:53.023627 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002326    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 21:50:53.023627 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002328    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 21:50:53.023627 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002331    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 21:50:53.023627 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002333    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 21:50:53.023627 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002336    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 21:50:53.023627 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002340    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 21:50:53.028062 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002342    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 21:50:53.028062 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002345    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 21:50:53.028062 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002350    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 21:50:53.028062 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002354    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 21:50:53.028062 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002356    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 21:50:53.028062 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002359    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 21:50:53.028062 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002361    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 21:50:53.028062 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002364    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 21:50:53.028062 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002366    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 21:50:53.028062 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002369    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 21:50:53.028062 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002373    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 21:50:53.028062 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002377    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 21:50:53.028062 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002381    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 21:50:53.028062 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002384    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 21:50:53.028062 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002387    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 21:50:53.028062 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002390    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 21:50:53.028062 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002393    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 21:50:53.028062 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002395    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 21:50:53.028062 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.002398    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 21:50:53.134148 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003107    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 21:50:53.134148 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003114    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 21:50:53.134148 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003117    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 21:50:53.134148 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003120    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 21:50:53.134148 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003123    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 21:50:53.134148 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003128    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 21:50:53.134148 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003132    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 21:50:53.134148 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003136    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 21:50:53.134148 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003138    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 21:50:53.134148 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003141    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 21:50:53.134148 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003144    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 21:50:53.134148 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003147    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 21:50:53.134148 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003149    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 21:50:53.134148 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003152    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 21:50:53.134148 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003155    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 21:50:53.134148 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003157    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 21:50:53.134148 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003160    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 21:50:53.134148 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003163    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 21:50:53.134148 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003165    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 21:50:53.134148 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003168    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 21:50:53.069183 ip-10-0-141-101 systemd[1]: Started Kubernetes Kubelet.
Jul 09 21:50:53.153217 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003171    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 21:50:53.153217 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003174    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 21:50:53.153217 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003176    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 21:50:53.153217 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003179    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 21:50:53.153217 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003181    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 21:50:53.153217 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003185    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 21:50:53.153217 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003188    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 21:50:53.153217 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003190    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 21:50:53.153217 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003193    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 21:50:53.153217 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003196    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 21:50:53.153217 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003200    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 21:50:53.153217 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003203    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 21:50:53.153217 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003206    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 21:50:53.153217 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003208    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 21:50:53.153217 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003211    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 21:50:53.153217 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003213    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 21:50:53.153217 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003216    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 21:50:53.153217 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003219    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 21:50:53.153217 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003222    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 21:50:53.156064 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003225    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 21:50:53.156064 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003227    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 21:50:53.156064 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003230    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 21:50:53.156064 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003233    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 21:50:53.156064 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003236    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 21:50:53.156064 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003238    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 21:50:53.156064 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003241    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 21:50:53.156064 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003244    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 21:50:53.156064 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003247    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 21:50:53.156064 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003249    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 21:50:53.156064 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003252    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 21:50:53.156064 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003254    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 21:50:53.156064 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003258    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 21:50:53.156064 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003260    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 21:50:53.156064 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003263    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 21:50:53.156064 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003265    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 21:50:53.156064 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003268    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 21:50:53.156064 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003270    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 21:50:53.156064 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003274    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 21:50:53.163142 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003277    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 21:50:53.163142 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003279    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 21:50:53.163142 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003282    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 21:50:53.163142 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003285    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 21:50:53.163142 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003289    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 21:50:53.163142 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003294    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 21:50:53.163142 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003297    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 21:50:53.163142 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003300    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 21:50:53.163142 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003303    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 21:50:53.163142 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003305    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 21:50:53.163142 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003308    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 21:50:53.163142 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003310    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 21:50:53.163142 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003313    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 21:50:53.163142 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003316    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 21:50:53.163142 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003319    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 21:50:53.163142 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003321    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 21:50:53.163142 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003324    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 21:50:53.163142 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003327    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 21:50:53.163142 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003329    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 21:50:53.163142 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003332    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 21:50:53.166596 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003334    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 21:50:53.166596 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003337    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 21:50:53.166596 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003339    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 21:50:53.166596 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003342    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 21:50:53.166596 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003346    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 21:50:53.166596 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003349    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 21:50:53.166596 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003352    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 21:50:53.166596 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003355    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 21:50:53.166596 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003358    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 21:50:53.166596 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003361    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 21:50:53.166596 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003365    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 21:50:53.166596 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003368    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 21:50:53.166596 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003370    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 21:50:53.166596 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003374    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 21:50:53.166596 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003376    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 21:50:53.166596 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003379    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 21:50:53.166596 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003390    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 21:50:53.166596 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003394    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 21:50:53.166596 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003397    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 21:50:53.166596 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003399    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 21:50:53.174088 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003403    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 21:50:53.174088 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003787    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 21:50:53.174088 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003792    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 21:50:53.174088 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003794    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 21:50:53.174088 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003797    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 21:50:53.174088 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003802    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 21:50:53.174088 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003806    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 21:50:53.174088 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003810    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 21:50:53.174088 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003812    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 21:50:53.174088 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003815    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 21:50:53.174088 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003818    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 21:50:53.174088 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003821    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 21:50:53.174088 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003823    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 21:50:53.174088 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003826    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 21:50:53.174088 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003828    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 21:50:53.174088 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003831    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 21:50:53.174088 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003834    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 21:50:53.174088 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003836    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 21:50:53.174088 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003838    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 21:50:53.178714 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003841    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 21:50:53.178714 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003844    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 21:50:53.178714 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003846    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 21:50:53.178714 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003849    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 21:50:53.178714 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003851    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 21:50:53.178714 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003854    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 21:50:53.178714 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003856    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 21:50:53.178714 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003859    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 21:50:53.178714 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003861    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 21:50:53.178714 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003868    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 21:50:53.178714 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003871    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 21:50:53.178714 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003874    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 21:50:53.178714 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003877    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 21:50:53.178714 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003880    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 21:50:53.178714 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003882    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 21:50:53.178714 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003885    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 21:50:53.178714 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003887    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 21:50:53.178714 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003890    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 21:50:53.178714 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003893    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 21:50:53.178714 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003896    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 21:50:53.179441 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003899    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 21:50:53.179441 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003902    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 21:50:53.179441 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003904    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 21:50:53.179441 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003908    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 21:50:53.179441 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003911    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 21:50:53.179441 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003913    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 21:50:53.179441 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003916    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 21:50:53.179441 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003918    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 21:50:53.179441 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003920    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 21:50:53.179441 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003923    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 21:50:53.179441 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003925    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 21:50:53.179441 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003928    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 21:50:53.179441 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003930    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 21:50:53.179441 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003933    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 21:50:53.179441 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003936    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 21:50:53.179441 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003938    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 21:50:53.179441 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003941    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 21:50:53.179441 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003943    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 21:50:53.179441 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003946    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 21:50:53.180207 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003948    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 21:50:53.180207 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003950    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 21:50:53.180207 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003971    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 21:50:53.180207 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003974    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 21:50:53.180207 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003976    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 21:50:53.180207 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003979    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 21:50:53.180207 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003982    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 21:50:53.180207 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003985    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 21:50:53.180207 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003988    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 21:50:53.180207 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003990    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 21:50:53.180207 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003993    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 21:50:53.180207 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003995    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 21:50:53.180207 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.003998    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 21:50:53.180207 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004001    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 21:50:53.180207 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004004    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 21:50:53.180207 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004007    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 21:50:53.180207 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004009    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 21:50:53.180207 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004012    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 21:50:53.180207 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004014    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 21:50:53.180207 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004017    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 21:50:53.180951 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004020    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 21:50:53.180951 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004022    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 21:50:53.180951 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004025    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 21:50:53.180951 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004027    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 21:50:53.180951 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004031    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 21:50:53.180951 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004034    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 21:50:53.180951 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004037    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 21:50:53.180951 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004040    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 21:50:53.180951 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004043    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 21:50:53.180951 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004046    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 21:50:53.180951 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004049    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 21:50:53.180951 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004051    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 21:50:53.180951 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004054    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 21:50:53.180951 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004056    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 21:50:53.180951 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004060    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 21:50:53.180951 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004063    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 21:50:53.180951 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004065    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 21:50:53.180951 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004068    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 21:50:53.180951 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004070    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 21:50:53.337925 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004073    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 21:50:53.337925 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004076    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 21:50:53.337925 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004079    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 21:50:53.337925 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004154    2576 flags.go:64] FLAG: --address="0.0.0.0"
Jul 09 21:50:53.337925 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004170    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 09 21:50:53.337925 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004179    2576 flags.go:64] FLAG: --anonymous-auth="true"
Jul 09 21:50:53.337925 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004185    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 09 21:50:53.337925 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004192    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 09 21:50:53.337925 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004198    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 09 21:50:53.337925 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004203    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 09 21:50:53.337925 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004207    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 09 21:50:53.337925 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004210    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 09 21:50:53.337925 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004213    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 09 21:50:53.337925 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004217    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 09 21:50:53.337925 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004222    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 09 21:50:53.337925 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004225    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 09 21:50:53.337925 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004228    2576 flags.go:64] FLAG: --cgroup-root=""
Jul 09 21:50:53.337925 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004231    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 09 21:50:53.337925 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004234    2576 flags.go:64] FLAG: --client-ca-file=""
Jul 09 21:50:53.337925 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004237    2576 flags.go:64] FLAG: --cloud-provider="external"
Jul 09 21:50:53.337925 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004240    2576 flags.go:64] FLAG: --cluster-dns="[]"
Jul 09 21:50:53.337925 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004246    2576 flags.go:64] FLAG: --cluster-domain=""
Jul 09 21:50:53.337925 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004249    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 09 21:50:53.339068 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004252    2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 09 21:50:53.339068 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004255    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 09 21:50:53.339068 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004258    2576 flags.go:64] FLAG: --container-log-max-files="5"
Jul 09 21:50:53.339068 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004262    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 09 21:50:53.339068 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004266    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 09 21:50:53.339068 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004270    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 09 21:50:53.339068 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004274    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 09 21:50:53.339068 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004277    2576 flags.go:64] FLAG: --contention-profiling="false"
Jul 09 21:50:53.339068 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004280    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 09 21:50:53.339068 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004283    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 09 21:50:53.339068 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004286    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 09 21:50:53.339068 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004289    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 09 21:50:53.339068 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004293    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 09 21:50:53.339068 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004296    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 09 21:50:53.339068 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004299    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 09 21:50:53.339068 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004302    2576 flags.go:64] FLAG: --enable-load-reader="false"
Jul 09 21:50:53.339068 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004305    2576 flags.go:64] FLAG: --enable-server="true"
Jul 09 21:50:53.339068 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004308    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 09 21:50:53.339068 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004312    2576 flags.go:64] FLAG: --event-burst="100"
Jul 09 21:50:53.339068 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004316    2576 flags.go:64] FLAG: --event-qps="50"
Jul 09 21:50:53.339068 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004319    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 09 21:50:53.339068 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004321    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 09 21:50:53.339068 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004324    2576 flags.go:64] FLAG: --eviction-hard=""
Jul 09 21:50:53.339068 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004329    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 09 21:50:53.339821 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004332    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 09 21:50:53.339821 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004335    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 09 21:50:53.339821 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004338    2576 flags.go:64] FLAG: --eviction-soft=""
Jul 09 21:50:53.339821 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004341    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 09 21:50:53.339821 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004344    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 09 21:50:53.339821 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004347    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 09 21:50:53.339821 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004350    2576 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 09 21:50:53.339821 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004353    2576 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 09 21:50:53.339821 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004356    2576 flags.go:64] FLAG: --fail-swap-on="true"
Jul 09 21:50:53.339821 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004359    2576 flags.go:64] FLAG: --feature-gates=""
Jul 09 21:50:53.339821 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004363    2576 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 09 21:50:53.339821 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004366    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 09 21:50:53.339821 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004371    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 09 21:50:53.339821 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004374    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 09 21:50:53.339821 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004377    2576 flags.go:64] FLAG: --healthz-port="10248"
Jul 09 21:50:53.339821 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004380    2576 flags.go:64] FLAG: --help="false"
Jul 09 21:50:53.339821 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004382    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-141-101.ec2.internal"
Jul 09 21:50:53.339821 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004386    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 09 21:50:53.339821 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004389    2576 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 09 21:50:53.339821 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004391    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 09 21:50:53.339821 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004395    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 09 21:50:53.339821 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004398    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 09 21:50:53.339821 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004401    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 09 21:50:53.339821 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004404    2576 flags.go:64] FLAG: --image-service-endpoint=""
Jul 09 21:50:53.341351 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004406    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 09 21:50:53.341351 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004409    2576 flags.go:64] FLAG: --kube-api-burst="100"
Jul 09 21:50:53.341351 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004412    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 09 21:50:53.341351 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004415    2576 flags.go:64] FLAG: --kube-api-qps="50"
Jul 09 21:50:53.341351 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004418    2576 flags.go:64] FLAG: --kube-reserved=""
Jul 09 21:50:53.341351 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004421    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 09 21:50:53.341351 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004424    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 09 21:50:53.341351 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004429    2576 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 09 21:50:53.341351 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004432    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 09 21:50:53.341351 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004435    2576 flags.go:64] FLAG: --lock-file=""
Jul 09 21:50:53.341351 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004438    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 09 21:50:53.341351 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004440    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 09 21:50:53.341351 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004443    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 09 21:50:53.341351 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004448    2576 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 09 21:50:53.341351 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004451    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 09 21:50:53.341351 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004454    2576 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 09 21:50:53.341351 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004457    2576 flags.go:64] FLAG: --logging-format="text"
Jul 09 21:50:53.341351 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004459    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 09 21:50:53.341351 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004463    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 09 21:50:53.341351 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004465    2576 flags.go:64] FLAG: --manifest-url=""
Jul 09 21:50:53.341351 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004470    2576 flags.go:64] FLAG: --manifest-url-header=""
Jul 09 21:50:53.341351 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004474    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 09 21:50:53.341351 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004477    2576 flags.go:64] FLAG: --max-open-files="1000000"
Jul 09 21:50:53.341351 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004481    2576 flags.go:64] FLAG: --max-pods="110"
Jul 09 21:50:53.341351 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004484    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 09 21:50:53.342090 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004487    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 09 21:50:53.342090 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004490    2576 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 09 21:50:53.342090 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004493    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 09 21:50:53.342090 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004496    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 09 21:50:53.342090 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004499    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 09 21:50:53.342090 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004502    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 09 21:50:53.342090 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004509    2576 flags.go:64] FLAG: --node-status-max-images="50"
Jul 09 21:50:53.342090 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004512    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 09 21:50:53.342090 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004515    2576 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 09 21:50:53.342090 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004518    2576 flags.go:64] FLAG: --pod-cidr=""
Jul 09 21:50:53.342090 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004528    2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 09 21:50:53.342090 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004534    2576 flags.go:64] FLAG: --pod-manifest-path=""
Jul 09 21:50:53.342090 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004536    2576 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 09 21:50:53.342090 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004539    2576 flags.go:64] FLAG: --pods-per-core="0"
Jul 09 21:50:53.342090 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004544    2576 flags.go:64] FLAG: --port="10250"
Jul 09 21:50:53.342090 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004547    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 09 21:50:53.342090 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004550    2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-038aeac8dc3dd4f7f"
Jul 09 21:50:53.342090 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004553    2576 flags.go:64] FLAG: --qos-reserved=""
Jul 09 21:50:53.342090 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004556    2576 flags.go:64] FLAG: --read-only-port="10255"
Jul 09 21:50:53.342090 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004559    2576 flags.go:64] FLAG: --register-node="true"
Jul 09 21:50:53.342090 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004562    2576 flags.go:64] FLAG: --register-with-taints=""
Jul 09 21:50:53.342090 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004565    2576 flags.go:64] FLAG: --registry-burst="10"
Jul 09 21:50:53.342090 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004568    2576 flags.go:64] FLAG: --registry-qps="5"
Jul 09 21:50:53.342090 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004571    2576 flags.go:64] FLAG: --reserved-cpus=""
Jul 09 21:50:53.342846 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004573    2576 flags.go:64] FLAG: --reserved-memory=""
Jul 09 21:50:53.342846 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004577    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 09 21:50:53.342846 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004580    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 09 21:50:53.342846 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004583    2576 flags.go:64] FLAG: --rotate-certificates="false"
Jul 09 21:50:53.342846 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004588    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 09 21:50:53.342846 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004590    2576 flags.go:64] FLAG: --runonce="false"
Jul 09 21:50:53.342846 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004593    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 09 21:50:53.342846 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004596    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 09 21:50:53.342846 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004599    2576 flags.go:64] FLAG: --seccomp-default="false"
Jul 09 21:50:53.342846 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004602    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 09 21:50:53.342846 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004605    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 09 21:50:53.342846 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004608    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 09 21:50:53.342846 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004611    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 09 21:50:53.342846 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004614    2576 flags.go:64] FLAG: --storage-driver-password="root"
Jul 09 21:50:53.342846 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004617    2576 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 09 21:50:53.342846 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004620    2576 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 09 21:50:53.342846 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004623    2576 flags.go:64] FLAG: --storage-driver-user="root"
Jul 09 21:50:53.342846 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004626    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 09 21:50:53.342846 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004629    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 09 21:50:53.342846 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004632    2576 flags.go:64] FLAG: --system-cgroups=""
Jul 09 21:50:53.342846 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004635    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 09 21:50:53.342846 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004640    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 09 21:50:53.342846 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004644    2576 flags.go:64] FLAG: --tls-cert-file=""
Jul 09 21:50:53.342846 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004647    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 09 21:50:53.342846 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004652    2576 flags.go:64] FLAG: --tls-min-version=""
Jul 09 21:50:53.344352 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004654    2576 flags.go:64] FLAG: --tls-private-key-file=""
Jul 09 21:50:53.344352 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004657    2576 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 09 21:50:53.344352 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004660    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 09 21:50:53.344352 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004663    2576 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 09 21:50:53.344352 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004666    2576 flags.go:64] FLAG: --v="2"
Jul 09 21:50:53.344352 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004670    2576 flags.go:64] FLAG: --version="false"
Jul 09 21:50:53.344352 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004674    2576 flags.go:64] FLAG: --vmodule=""
Jul 09 21:50:53.344352 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004678    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 09 21:50:53.344352 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.004681    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 09 21:50:53.344352 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004802    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 21:50:53.344352 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004805    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 21:50:53.344352 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004809    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 21:50:53.344352 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004813    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 21:50:53.344352 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004816    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 21:50:53.344352 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004818    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 21:50:53.344352 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004821    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 21:50:53.344352 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004824    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 21:50:53.344352 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004826    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 21:50:53.344352 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004829    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 21:50:53.344352 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004831    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 21:50:53.344352 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004834    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 21:50:53.344352 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004837    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 21:50:53.345108 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004839    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 21:50:53.345108 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004842    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 21:50:53.345108 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004844    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 21:50:53.345108 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004847    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 21:50:53.345108 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004849    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 21:50:53.345108 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004853    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 21:50:53.345108 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004855    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 21:50:53.345108 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004862    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 21:50:53.345108 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004865    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 21:50:53.345108 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004868    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 21:50:53.345108 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004871    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 21:50:53.345108 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004873    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 21:50:53.345108 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004876    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 21:50:53.345108 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004879    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 21:50:53.345108 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004882    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 21:50:53.345108 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004885    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 21:50:53.345108 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004887    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 21:50:53.345108 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004890    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 21:50:53.345108 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004892    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 21:50:53.346249 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004895    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 21:50:53.346249 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004897    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 21:50:53.346249 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004901    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 21:50:53.346249 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004904    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 21:50:53.346249 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004906    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 21:50:53.346249 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004909    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 21:50:53.346249 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004912    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 21:50:53.346249 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004914    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 21:50:53.346249 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004917    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 21:50:53.346249 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004919    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 21:50:53.346249 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004922    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 21:50:53.346249 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004924    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 21:50:53.346249 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004927    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 21:50:53.346249 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004930    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 21:50:53.346249 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004932    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 21:50:53.346249 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004935    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 21:50:53.346249 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004937    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 21:50:53.346249 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004940    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 21:50:53.346249 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004942    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 21:50:53.346249 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004945    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 21:50:53.347005 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004950    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 21:50:53.347005 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004968    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 21:50:53.347005 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004971    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 21:50:53.347005 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004973    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 21:50:53.347005 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004977    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 21:50:53.347005 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004981    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 21:50:53.347005 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004984    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 21:50:53.347005 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004988    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 21:50:53.347005 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004990    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 21:50:53.347005 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004993    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 21:50:53.347005 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004996    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 21:50:53.347005 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.004999    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 21:50:53.347005 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.005002    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 21:50:53.347005 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.005005    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 21:50:53.347005 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.005009    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 21:50:53.347005 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.005011    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 21:50:53.347005 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.005014    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 21:50:53.347005 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.005016    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 21:50:53.347005 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.005019    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 21:50:53.348146 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.005021    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 21:50:53.348146 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.005024    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 21:50:53.348146 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.005027    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 21:50:53.348146 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.005029    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 21:50:53.348146 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.005032    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 21:50:53.348146 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.005034    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 21:50:53.348146 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.005037    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 21:50:53.348146 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.005040    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 21:50:53.348146 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.005042    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 21:50:53.348146 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.005044    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 21:50:53.348146 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.005047    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 21:50:53.348146 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.005049    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 21:50:53.348146 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.005052    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 21:50:53.348146 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.005057    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 21:50:53.348146 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.005060    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 21:50:53.348146 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.005063    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 21:50:53.348146 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.005067    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 21:50:53.348146 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.005070    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 21:50:53.348146 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.005072    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 21:50:53.348146 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.005075    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 21:50:53.348880 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.005077    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 21:50:53.348880 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.005080    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 21:50:53.348880 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.005082    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 21:50:53.348880 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.005085    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 21:50:53.348880 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.005087    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 21:50:53.348880 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.005089    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 21:50:53.348880 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.005092    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 21:50:53.348880 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.005096    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 21:50:53.348880 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.005874    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 21:50:53.348880 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.013239    2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 09 21:50:53.348880 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.013255    2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 09 21:50:53.348880 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.013268    2576 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 09 21:50:53.348880 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.013273    2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 09 21:50:53.348880 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013338    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 21:50:53.350396 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013343    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 21:50:53.350396 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013347    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 21:50:53.350396 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013350    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 21:50:53.350396 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013353    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 21:50:53.350396 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013356    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 21:50:53.350396 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013359    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 21:50:53.350396 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013362    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 21:50:53.350396 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013364    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 21:50:53.350396 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013367    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 21:50:53.350396 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013370    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 21:50:53.350396 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013372    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 21:50:53.350396 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013376    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 21:50:53.350396 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013379    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 21:50:53.350396 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013381    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 21:50:53.350396 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013384    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 21:50:53.350396 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013387    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 21:50:53.350396 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013390    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 21:50:53.350396 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013396    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 21:50:53.350396 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013399    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 21:50:53.351160 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013402    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 21:50:53.351160 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013404    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 21:50:53.351160 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013407    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 21:50:53.351160 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013409    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 21:50:53.351160 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013412    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 21:50:53.351160 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013415    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 21:50:53.351160 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013418    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 21:50:53.351160 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013421    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 21:50:53.351160 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013424    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 21:50:53.351160 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013427    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 21:50:53.351160 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013430    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 21:50:53.351160 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013432    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 21:50:53.351160 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013435    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 21:50:53.351160 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013437    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 21:50:53.351160 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013440    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 21:50:53.351160 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013442    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 21:50:53.351160 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013445    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 21:50:53.351160 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013449    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 21:50:53.351160 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013452    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 21:50:53.351160 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013457    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 21:50:53.352304 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013461    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 21:50:53.352304 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013464    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 21:50:53.352304 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013467    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 21:50:53.352304 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013470    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 21:50:53.352304 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013472    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 21:50:53.352304 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013494    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 21:50:53.352304 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013497    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 21:50:53.352304 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013499    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 21:50:53.352304 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013502    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 21:50:53.352304 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013505    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 21:50:53.352304 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013507    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 21:50:53.352304 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013510    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 21:50:53.352304 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013512    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 21:50:53.352304 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013516    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 21:50:53.352304 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013518    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 21:50:53.352304 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013521    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 21:50:53.352304 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013523    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 21:50:53.352304 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013526    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 21:50:53.352304 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013529    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 21:50:53.352304 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013532    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 21:50:53.353049 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013534    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 21:50:53.353049 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013538    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 21:50:53.353049 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013542    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 21:50:53.353049 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013545    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 21:50:53.353049 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013548    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 21:50:53.353049 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013551    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 21:50:53.353049 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013554    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 21:50:53.353049 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013558    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 21:50:53.353049 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013561    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 21:50:53.353049 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013564    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 21:50:53.353049 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013567    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 21:50:53.353049 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013570    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 21:50:53.353049 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013572    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 21:50:53.353049 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013575    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 21:50:53.353049 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013578    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 21:50:53.353049 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013581    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 21:50:53.353049 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013584    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 21:50:53.353049 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013586    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 21:50:53.353049 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013595    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 21:50:53.354177 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013598    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 21:50:53.354177 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013603    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 21:50:53.354177 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013606    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 21:50:53.354177 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013609    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 21:50:53.354177 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013611    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 21:50:53.354177 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013614    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 21:50:53.354177 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013617    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 21:50:53.354177 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013619    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 21:50:53.354177 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013622    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 21:50:53.354177 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013624    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 21:50:53.354177 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013627    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 21:50:53.354177 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013630    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 21:50:53.354177 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013633    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 21:50:53.354177 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013635    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 21:50:53.354177 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013639    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 21:50:53.354177 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013642    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 21:50:53.354177 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013645    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 21:50:53.354177 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013648    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 21:50:53.354177 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013650    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 21:50:53.354924 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013653    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 21:50:53.354924 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.013658    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 21:50:53.354924 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013815    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 21:50:53.354924 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013820    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 21:50:53.354924 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013823    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 21:50:53.354924 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013826    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 21:50:53.354924 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013829    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 21:50:53.354924 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013832    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 21:50:53.354924 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013834    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 21:50:53.354924 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013837    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 21:50:53.354924 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013839    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 21:50:53.354924 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013842    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 21:50:53.354924 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013844    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 21:50:53.354924 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013853    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 21:50:53.354924 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013858    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 21:50:53.356421 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013862    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 21:50:53.356421 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013866    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 21:50:53.356421 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013868    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 21:50:53.356421 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013871    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 21:50:53.356421 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013873    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 21:50:53.356421 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013876    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 21:50:53.356421 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013878    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 21:50:53.356421 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013881    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 21:50:53.356421 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013883    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 21:50:53.356421 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013886    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 21:50:53.356421 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013889    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 21:50:53.356421 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013891    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 21:50:53.356421 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013894    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 21:50:53.356421 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013899    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 21:50:53.356421 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013901    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 21:50:53.356421 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013905    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 21:50:53.356421 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013908    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 21:50:53.356421 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013911    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 21:50:53.356421 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013914    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 21:50:53.357183 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013917    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 21:50:53.357183 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013920    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 21:50:53.357183 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013923    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 21:50:53.357183 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013926    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 21:50:53.357183 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013928    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 21:50:53.357183 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013931    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 21:50:53.357183 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013933    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 21:50:53.357183 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013936    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 21:50:53.357183 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013938    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 21:50:53.357183 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013941    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 21:50:53.357183 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013944    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 21:50:53.357183 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013946    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 21:50:53.357183 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013973    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 21:50:53.357183 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013977    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 21:50:53.357183 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013980    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 21:50:53.357183 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013983    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 21:50:53.357183 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013985    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 21:50:53.357183 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013988    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 21:50:53.357183 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013990    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 21:50:53.357183 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013993    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 21:50:53.359441 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013995    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 21:50:53.359441 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.013998    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 21:50:53.359441 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.014001    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 21:50:53.359441 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.014003    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 21:50:53.359441 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.014006    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 21:50:53.359441 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.014008    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 21:50:53.359441 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.014019    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 21:50:53.359441 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.014021    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 21:50:53.359441 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.014024    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 21:50:53.359441 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.014026    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 21:50:53.359441 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.014029    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 21:50:53.359441 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.014031    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 21:50:53.359441 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.014034    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 21:50:53.359441 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.014036    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 21:50:53.359441 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.014039    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 21:50:53.359441 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.014041    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 21:50:53.359441 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.014044    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 21:50:53.359441 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.014046    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 21:50:53.359441 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.014049    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 21:50:53.359441 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.014051    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 21:50:53.360196 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.014054    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 21:50:53.360196 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.014056    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 21:50:53.360196 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.014060    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 21:50:53.360196 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.014063    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 21:50:53.360196 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.014068    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 21:50:53.360196 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.014076    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 21:50:53.360196 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.014079    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 21:50:53.360196 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.014082    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 21:50:53.360196 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.014085    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 21:50:53.360196 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.014088    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 21:50:53.360196 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.014090    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 21:50:53.360196 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.014093    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 21:50:53.360196 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.014096    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 21:50:53.360196 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.014098    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 21:50:53.360196 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.014100    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 21:50:53.360196 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.014103    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 21:50:53.360196 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.014106    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 21:50:53.360196 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.014108    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 21:50:53.360196 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.014112    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 21:50:53.360196 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.014115    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 21:50:53.361735 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.014117    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 21:50:53.361735 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.014120    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 21:50:53.361735 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.014122    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 21:50:53.361735 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.014125    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 21:50:53.361735 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.014128    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 21:50:53.361735 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.014130    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 21:50:53.361735 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:53.014132    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 21:50:53.361735 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.014137    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 21:50:53.361735 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.014272    2576 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 09 21:50:53.361735 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.016621    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 09 21:50:53.361735 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.018373    2576 server.go:1019] "Starting client certificate rotation"
Jul 09 21:50:53.361735 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.018485    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 21:50:53.361735 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.018526    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 21:50:53.361735 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.021316    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 21:50:53.362490 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.023973    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 21:50:53.362490 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.033915    2576 log.go:25] "Validated CRI v1 runtime API"
Jul 09 21:50:53.362490 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.037305    2576 log.go:25] "Validated CRI v1 image API"
Jul 09 21:50:53.362490 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.038136    2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 09 21:50:53.362490 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.040685    2576 fs.go:135] Filesystem UUIDs: map[533004ff-db07-425b-843c-bab2d7efcfd3:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 fbc22b32-67b6-407d-bde9-d9afb40cf7cd:/dev/nvme0n1p3]
Jul 09 21:50:53.362490 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.040700    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 09 21:50:53.363268 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.046616    2576 manager.go:216] Machine: {Timestamp:2026-07-09 21:50:53.0461384 +0000 UTC m=+0.377638469 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102646 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec221e8fd2bb16657d9d7504d2b84b4b SystemUUID:ec221e8f-d2bb-1665-7d9d-7504d2b84b4b BootID:27217047-ff56-451f-ba33-a25524e01d97 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:47:95:07:16:b9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:47:95:07:16:b9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:92:34:d7:f1:98:c4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 09 21:50:53.363268 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.046723    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 09 21:50:53.363268 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.046800    2576 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 09 21:50:53.363268 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.049461    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 21:50:53.363268 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.050051    2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 09 21:50:53.363268 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.050074    2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-101.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 09 21:50:53.363268 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.050889    2576 topology_manager.go:138] "Creating topology manager with none policy"
Jul 09 21:50:53.363268 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.050899    2576 container_manager_linux.go:309] "Creating device plugin manager"
Jul 09 21:50:53.363268 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.050907    2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 21:50:53.363268 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.050919    2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 21:50:53.363268 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.052741    2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 09 21:50:53.363268 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.056338    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 21:50:53.363268 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.056458    2576 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 09 21:50:53.363268 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.056484    2576 kubelet.go:486] "Attempting to sync node with API server"
Jul 09 21:50:53.363268 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.056494    2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 09 21:50:53.363268 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.056507    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 09 21:50:53.363268 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.056517    2576 kubelet.go:398] "Adding apiserver pod source"
Jul 09 21:50:53.365928 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.056526    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 09 21:50:53.365928 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.056836    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 21:50:53.365928 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.056851    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 21:50:53.365928 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.060710    2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 09 21:50:53.365928 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.063442    2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 09 21:50:53.365928 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.063471    2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 09 21:50:53.365928 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.064855    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 09 21:50:53.365928 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.064868    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 09 21:50:53.365928 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.064876    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 09 21:50:53.365928 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.064888    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 09 21:50:53.365928 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.064901    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 09 21:50:53.365928 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.064910    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 09 21:50:53.365928 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.064919    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 09 21:50:53.365928 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.064924    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 09 21:50:53.365928 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.064930    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 09 21:50:53.365928 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.064936    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 09 21:50:53.365928 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.064948    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 09 21:50:53.365928 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.064966    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 09 21:50:53.365928 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.064987    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 09 21:50:53.365928 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.064995    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 09 21:50:53.365928 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:53.068041    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-101.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 09 21:50:53.365928 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:53.068118    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 09 21:50:53.365928 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.068292    2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-101.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 09 21:50:53.365928 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.068323    2576 server.go:1268] "Started kubelet"
Jul 09 21:50:53.365928 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.068444    2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 09 21:50:53.365928 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.068474    2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 09 21:50:53.365928 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.068517    2576 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 09 21:50:53.365928 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.074648    2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 09 21:50:53.365928 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.076582    2576 server.go:310] "Adding debug handlers to kubelet server"
Jul 09 21:50:53.365928 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:53.078371    2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 09 21:50:53.365928 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:53.078164    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-101.ec2.internal.18c0bd8a0d7f4973  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-101.ec2.internal,UID:ip-10-0-141-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-101.ec2.internal,},FirstTimestamp:2026-07-09 21:50:53.068298611 +0000 UTC m=+0.399798680,LastTimestamp:2026-07-09 21:50:53.068298611 +0000 UTC m=+0.399798680,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-101.ec2.internal,}"
Jul 09 21:50:53.365928 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.083364    2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 09 21:50:53.365928 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.083391    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 09 21:50:53.365928 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:53.083471    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-101.ec2.internal\" not found"
Jul 09 21:50:53.365928 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.084093    2576 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 09 21:50:53.365928 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.084110    2576 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 09 21:50:53.365928 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.084119    2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 09 21:50:53.365928 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.084215    2576 reconstruct.go:97] "Volume reconstruction finished"
Jul 09 21:50:53.365928 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.084233    2576 reconciler.go:29] "Reconciler: start to sync state"
Jul 09 21:50:53.365928 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.084286    2576 factory.go:55] Registering systemd factory
Jul 09 21:50:53.365928 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.084321    2576 factory.go:223] Registration of the systemd container factory successfully
Jul 09 21:50:53.367402 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.084534    2576 factory.go:153] Registering CRI-O factory
Jul 09 21:50:53.367402 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.084546    2576 factory.go:223] Registration of the crio container factory successfully
Jul 09 21:50:53.367402 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.084588    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 09 21:50:53.367402 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.084606    2576 factory.go:103] Registering Raw factory
Jul 09 21:50:53.367402 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.084617    2576 manager.go:1196] Started watching for new ooms in manager
Jul 09 21:50:53.367402 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.085545    2576 manager.go:349] Starting recovery of all containers
Jul 09 21:50:53.367402 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:53.087475    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 09 21:50:53.367402 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:53.087527    2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-101.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 09 21:50:53.367402 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.091007    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 09 21:50:53.367402 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.096404    2576 manager.go:354] Recovery completed
Jul 09 21:50:53.367402 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.097085    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rg9r8"
Jul 09 21:50:53.367402 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.101620    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 21:50:53.367402 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.104611    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rg9r8"
Jul 09 21:50:53.367402 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.104766    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 21:50:53.367402 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.104799    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 21:50:53.367402 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.104810    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasSufficientPID"
Jul 09 21:50:53.367402 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.105844    2576 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 09 21:50:53.367402 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.105862    2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 09 21:50:53.367402 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.105887    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 21:50:53.367402 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.105937    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 21:50:53.367402 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:53.106859    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-101.ec2.internal.18c0bd8a0fabf050  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-101.ec2.internal,UID:ip-10-0-141-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-101.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-101.ec2.internal,},FirstTimestamp:2026-07-09 21:50:53.104779344 +0000 UTC m=+0.436279413,LastTimestamp:2026-07-09 21:50:53.104779344 +0000 UTC m=+0.436279413,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-101.ec2.internal,}"
Jul 09 21:50:53.367402 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.107301    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 21:50:53.367402 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.107328    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 21:50:53.367402 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.107343    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasSufficientPID"
Jul 09 21:50:53.367402 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.108173    2576 policy_none.go:49] "None policy: Start"
Jul 09 21:50:53.367402 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.108201    2576 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 09 21:50:53.367402 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.108216    2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 09 21:50:53.367402 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.109132    2576 policy_none.go:47] "Start"
Jul 09 21:50:53.367402 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:53.184237    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-101.ec2.internal\" not found"
Jul 09 21:50:53.367402 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.193828    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 09 21:50:53.367402 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.193862    2576 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 09 21:50:53.367402 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.193884    2576 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 09 21:50:53.367402 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:53.193915    2576 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Jul 09 21:50:53.367402 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.196692    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 21:50:53.367402 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.196984    2576 manager.go:337] "Starting Device Plugin manager"
Jul 09 21:50:53.367402 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:53.197023    2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 09 21:50:53.367402 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.197035    2576 server.go:87] "Starting device plugin registration server"
Jul 09 21:50:53.367402 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.197305    2576 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 09 21:50:53.367402 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.197316    2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 09 21:50:53.367402 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.197453    2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 09 21:50:53.369292 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.197531    2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 09 21:50:53.369292 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.197540    2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 09 21:50:53.369292 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:53.198589    2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 09 21:50:53.369292 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:53.198639    2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-101.ec2.internal\" not found"
Jul 09 21:50:53.369292 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:53.293802    2576 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-101.ec2.internal\" not found" node="ip-10-0-141-101.ec2.internal"
Jul 09 21:50:53.369292 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.293998    2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-101.ec2.internal"]
Jul 09 21:50:53.369292 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.294058    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 21:50:53.369292 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.295055    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 21:50:53.369292 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.295084    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 21:50:53.369292 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.295095    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasSufficientPID"
Jul 09 21:50:53.369292 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.298215    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 21:50:53.369292 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.299043    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 21:50:53.369292 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.299069    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 21:50:53.369292 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.299079    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasSufficientPID"
Jul 09 21:50:53.369292 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.299098    2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-101.ec2.internal"
Jul 09 21:50:53.369292 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.307310    2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-101.ec2.internal"
Jul 09 21:50:53.369292 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:53.307328    2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-101.ec2.internal\": node \"ip-10-0-141-101.ec2.internal\" not found"
Jul 09 21:50:53.369292 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:53.330061    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-101.ec2.internal\" not found"
Jul 09 21:50:53.369292 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.335192    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 21:50:53.369292 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.335304    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal"
Jul 09 21:50:53.369292 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.335335    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 21:50:53.369292 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.336101    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 21:50:53.369292 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.336125    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 21:50:53.369292 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.336129    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 21:50:53.369292 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.336136    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasSufficientPID"
Jul 09 21:50:53.369292 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.336149    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 21:50:53.369292 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.336159    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasSufficientPID"
Jul 09 21:50:53.369292 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.337276    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-101.ec2.internal"
Jul 09 21:50:53.369292 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.337295    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 21:50:53.369292 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.338037    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 21:50:53.369292 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.338065    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 21:50:53.369292 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.338080    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeHasSufficientPID"
Jul 09 21:50:53.471878 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:53.430759    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-101.ec2.internal\" not found"
Jul 09 21:50:53.487537 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.485300    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/91fa6d5fff63c7ad729649847f11496f-config\") pod \"kube-apiserver-proxy-ip-10-0-141-101.ec2.internal\" (UID: \"91fa6d5fff63c7ad729649847f11496f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-101.ec2.internal"
Jul 09 21:50:53.487537 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.485328    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9b04859f560db6d117b4ad45ac0045f2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal\" (UID: \"9b04859f560db6d117b4ad45ac0045f2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal"
Jul 09 21:50:53.487537 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.485363    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b04859f560db6d117b4ad45ac0045f2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal\" (UID: \"9b04859f560db6d117b4ad45ac0045f2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal"
Jul 09 21:50:53.583852 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:53.531711    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-101.ec2.internal\" not found"
Jul 09 21:50:53.586768 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.586322    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/91fa6d5fff63c7ad729649847f11496f-config\") pod \"kube-apiserver-proxy-ip-10-0-141-101.ec2.internal\" (UID: \"91fa6d5fff63c7ad729649847f11496f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-101.ec2.internal"
Jul 09 21:50:53.586768 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.586351    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9b04859f560db6d117b4ad45ac0045f2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal\" (UID: \"9b04859f560db6d117b4ad45ac0045f2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal"
Jul 09 21:50:53.586768 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.586375    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b04859f560db6d117b4ad45ac0045f2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal\" (UID: \"9b04859f560db6d117b4ad45ac0045f2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal"
Jul 09 21:50:53.586768 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.586427    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/91fa6d5fff63c7ad729649847f11496f-config\") pod \"kube-apiserver-proxy-ip-10-0-141-101.ec2.internal\" (UID: \"91fa6d5fff63c7ad729649847f11496f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-101.ec2.internal"
Jul 09 21:50:53.586768 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.586454    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9b04859f560db6d117b4ad45ac0045f2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal\" (UID: \"9b04859f560db6d117b4ad45ac0045f2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal"
Jul 09 21:50:53.586768 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.586431    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b04859f560db6d117b4ad45ac0045f2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal\" (UID: \"9b04859f560db6d117b4ad45ac0045f2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal"
Jul 09 21:50:53.704166 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:53.632161    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-101.ec2.internal\" not found"
Jul 09 21:50:53.819552 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:53.732666    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-101.ec2.internal\" not found"
Jul 09 21:50:53.924089 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:53.833399    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-101.ec2.internal\" not found"
Jul 09 21:50:53.934088 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:53.934067    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-101.ec2.internal\" not found"
Jul 09 21:50:53.992902 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:53.992870    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-101.ec2.internal\" not found" node="ip-10-0-141-101.ec2.internal"
Jul 09 21:50:53.995837 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:53.995817    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal"
Jul 09 21:50:53.997739 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:53.997715    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-101.ec2.internal\" not found" node="ip-10-0-141-101.ec2.internal"
Jul 09 21:50:54.001260 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:54.001241    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-101.ec2.internal"
Jul 09 21:50:54.017181 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:54.017153    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 09 21:50:54.017575 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:54.017284    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 21:50:54.034870 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:54.034837    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-101.ec2.internal\" not found"
Jul 09 21:50:54.107306 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:54.107256    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 21:45:53 +0000 UTC" deadline="2028-04-16 02:46:51.863187504 +0000 UTC"
Jul 09 21:50:54.107306 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:54.107297    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15508h55m57.75589433s"
Jul 09 21:50:54.136185 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:54.136136    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-101.ec2.internal\" not found"
Jul 09 21:50:54.223887 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:54.223795    2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 21:50:54.237045 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:54.237007    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-101.ec2.internal\" not found"
Jul 09 21:50:54.285622 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:54.285590    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 21:50:54.340964 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:54.340932    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-101.ec2.internal\" not found"
Jul 09 21:50:54.441240 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:54.441199    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-101.ec2.internal\" not found"
Jul 09 21:50:54.541809 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:54.541726    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-101.ec2.internal\" not found"
Jul 09 21:50:54.610332 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:54.610304    2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 21:50:54.683950 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:54.683907    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal"
Jul 09 21:50:54.698604 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:54.698579    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 21:50:54.699849 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:54.699833    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-101.ec2.internal"
Jul 09 21:50:54.708760 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:54.708738    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 21:50:54.736474 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:54.736433    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91fa6d5fff63c7ad729649847f11496f.slice/crio-a5386264910e2975a765ac4fd205bb396c5b1782e05a07d128c3f949021a1669 WatchSource:0}: Error finding container a5386264910e2975a765ac4fd205bb396c5b1782e05a07d128c3f949021a1669: Status 404 returned error can't find the container with id a5386264910e2975a765ac4fd205bb396c5b1782e05a07d128c3f949021a1669
Jul 09 21:50:54.741429 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:54.741393    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 21:50:54.749965 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:54.749940    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b04859f560db6d117b4ad45ac0045f2.slice/crio-6cfeb0d3d1b7766a5ddaa2ba8ed520c3aa31472f4c6cc87d006cfcbd89ab41aa WatchSource:0}: Error finding container 6cfeb0d3d1b7766a5ddaa2ba8ed520c3aa31472f4c6cc87d006cfcbd89ab41aa: Status 404 returned error can't find the container with id 6cfeb0d3d1b7766a5ddaa2ba8ed520c3aa31472f4c6cc87d006cfcbd89ab41aa
Jul 09 21:50:55.057451 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.057413    2576 apiserver.go:52] "Watching apiserver"
Jul 09 21:50:55.066055 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.066030    2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 09 21:50:55.067060 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.067035    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-qngdz","openshift-multus/multus-additional-cni-plugins-7tq48","openshift-ovn-kubernetes/ovnkube-node-27vrn","kube-system/kube-apiserver-proxy-ip-10-0-141-101.ec2.internal","openshift-cluster-node-tuning-operator/tuned-t97wx","openshift-dns/node-resolver-fvncf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal","openshift-multus/multus-hv6qq","openshift-multus/network-metrics-daemon-l49xl","openshift-network-diagnostics/network-check-target-gpncs","openshift-network-operator/iptables-alerter-wl4xh","kube-system/global-pull-secret-syncer-fjm26","kube-system/konnectivity-agent-fxmvw","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwd8h"]
Jul 09 21:50:55.069986 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.069953    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fxmvw"
Jul 09 21:50:55.072241 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.072224    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7tq48"
Jul 09 21:50:55.072683 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.072657    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 09 21:50:55.072683 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.072661    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 09 21:50:55.072844 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.072769    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9vgl5\""
Jul 09 21:50:55.074715 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.074694    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 09 21:50:55.074833 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.074803    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 09 21:50:55.074941 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.074917    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.075021 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.074922    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 09 21:50:55.075021 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.075015    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 09 21:50:55.075362 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.075239    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-k4bhg\""
Jul 09 21:50:55.075469 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.075451    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 09 21:50:55.077309 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.077289    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 09 21:50:55.077309 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.077297    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qngdz"
Jul 09 21:50:55.077472 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.077456    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 09 21:50:55.077472 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.077469    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 09 21:50:55.077779 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.077760    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 09 21:50:55.078197 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.077908    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 09 21:50:55.078197 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.077990    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wtdk7\""
Jul 09 21:50:55.078836 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.078821    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 09 21:50:55.079761 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.079743    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-t97wx"
Jul 09 21:50:55.079879 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.079862    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4p4v6\""
Jul 09 21:50:55.079949 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.079901    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 09 21:50:55.080089 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.080016    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 09 21:50:55.080089 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.079862    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 09 21:50:55.082200 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.082180    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 09 21:50:55.082288 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.082199    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5w9t4\""
Jul 09 21:50:55.082344 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.082303    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 09 21:50:55.082403 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.082380    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fvncf"
Jul 09 21:50:55.083866 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.083852    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 09 21:50:55.084685 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.084662    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-h5925\""
Jul 09 21:50:55.084829 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.084667    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 09 21:50:55.084896 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.084828    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwd8h"
Jul 09 21:50:55.085130 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.085113    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 09 21:50:55.088110 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.087756    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mzb2r\""
Jul 09 21:50:55.088110 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.087902    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 09 21:50:55.088110 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.087916    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 09 21:50:55.088110 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.088014    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.088364 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.088187    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 09 21:50:55.091228 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.091210    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l49xl"
Jul 09 21:50:55.091308 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:55.091287    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l49xl" podUID="b99eef2e-6748-4460-bd07-1f99729b663c"
Jul 09 21:50:55.093533 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.093515    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 09 21:50:55.093627 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.093536    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fpzfs\""
Jul 09 21:50:55.093773 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.093758    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gpncs"
Jul 09 21:50:55.093860 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:55.093839    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gpncs" podUID="daa318c8-a79e-4833-8022-26e9db42aaa9"
Jul 09 21:50:55.095502 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.095478    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/10510741-9c12-4044-ac11-97958aa1fc35-host-slash\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.095567 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.095518    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10510741-9c12-4044-ac11-97958aa1fc35-host-run-ovn-kubernetes\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.095567 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.095544    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/01708989-c414-4c1b-9886-4d47eb929be1-etc-sysconfig\") pod \"tuned-t97wx\" (UID: \"01708989-c414-4c1b-9886-4d47eb929be1\") " pod="openshift-cluster-node-tuning-operator/tuned-t97wx"
Jul 09 21:50:55.095636 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.095584    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10510741-9c12-4044-ac11-97958aa1fc35-etc-openvswitch\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.095670 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.095645    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f26b1dbc-6be7-4c4c-9d63-a5d7a676680a-device-dir\") pod \"aws-ebs-csi-driver-node-kwd8h\" (UID: \"f26b1dbc-6be7-4c4c-9d63-a5d7a676680a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwd8h"
Jul 09 21:50:55.095701 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.095684    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bc33c68c-1261-400d-991e-308f24c9210b-os-release\") pod \"multus-additional-cni-plugins-7tq48\" (UID: \"bc33c68c-1261-400d-991e-308f24c9210b\") " pod="openshift-multus/multus-additional-cni-plugins-7tq48"
Jul 09 21:50:55.095760 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.095738    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bc33c68c-1261-400d-991e-308f24c9210b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7tq48\" (UID: \"bc33c68c-1261-400d-991e-308f24c9210b\") " pod="openshift-multus/multus-additional-cni-plugins-7tq48"
Jul 09 21:50:55.095798 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.095778    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/10510741-9c12-4044-ac11-97958aa1fc35-host-cni-netd\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.095828 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.095804    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01708989-c414-4c1b-9886-4d47eb929be1-etc-kubernetes\") pod \"tuned-t97wx\" (UID: \"01708989-c414-4c1b-9886-4d47eb929be1\") " pod="openshift-cluster-node-tuning-operator/tuned-t97wx"
Jul 09 21:50:55.095863 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.095842    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f26b1dbc-6be7-4c4c-9d63-a5d7a676680a-registration-dir\") pod \"aws-ebs-csi-driver-node-kwd8h\" (UID: \"f26b1dbc-6be7-4c4c-9d63-a5d7a676680a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwd8h"
Jul 09 21:50:55.095897 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.095870    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/31a02e15-5a13-4e04-a0ba-8e5667bd9420-host\") pod \"node-ca-qngdz\" (UID: \"31a02e15-5a13-4e04-a0ba-8e5667bd9420\") " pod="openshift-image-registry/node-ca-qngdz"
Jul 09 21:50:55.095930 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.095898    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m565z\" (UniqueName: \"kubernetes.io/projected/bc33c68c-1261-400d-991e-308f24c9210b-kube-api-access-m565z\") pod \"multus-additional-cni-plugins-7tq48\" (UID: \"bc33c68c-1261-400d-991e-308f24c9210b\") " pod="openshift-multus/multus-additional-cni-plugins-7tq48"
Jul 09 21:50:55.095930 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.095923    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10510741-9c12-4044-ac11-97958aa1fc35-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.095999 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.095939    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01708989-c414-4c1b-9886-4d47eb929be1-sys\") pod \"tuned-t97wx\" (UID: \"01708989-c414-4c1b-9886-4d47eb929be1\") " pod="openshift-cluster-node-tuning-operator/tuned-t97wx"
Jul 09 21:50:55.095999 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.095974    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/01708989-c414-4c1b-9886-4d47eb929be1-host\") pod \"tuned-t97wx\" (UID: \"01708989-c414-4c1b-9886-4d47eb929be1\") " pod="openshift-cluster-node-tuning-operator/tuned-t97wx"
Jul 09 21:50:55.095999 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.095992    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01708989-c414-4c1b-9886-4d47eb929be1-tmp\") pod \"tuned-t97wx\" (UID: \"01708989-c414-4c1b-9886-4d47eb929be1\") " pod="openshift-cluster-node-tuning-operator/tuned-t97wx"
Jul 09 21:50:55.096117 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.096007    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/06b11cb1-4d06-48b8-a010-c79c999bfec2-agent-certs\") pod \"konnectivity-agent-fxmvw\" (UID: \"06b11cb1-4d06-48b8-a010-c79c999bfec2\") " pod="kube-system/konnectivity-agent-fxmvw"
Jul 09 21:50:55.096117 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.096031    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bc33c68c-1261-400d-991e-308f24c9210b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7tq48\" (UID: \"bc33c68c-1261-400d-991e-308f24c9210b\") " pod="openshift-multus/multus-additional-cni-plugins-7tq48"
Jul 09 21:50:55.096117 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.096066    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/10510741-9c12-4044-ac11-97958aa1fc35-host-cni-bin\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.096117 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.096086    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f26b1dbc-6be7-4c4c-9d63-a5d7a676680a-sys-fs\") pod \"aws-ebs-csi-driver-node-kwd8h\" (UID: \"f26b1dbc-6be7-4c4c-9d63-a5d7a676680a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwd8h"
Jul 09 21:50:55.096117 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.096104    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10510741-9c12-4044-ac11-97958aa1fc35-run-openvswitch\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.096268 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.096135    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bbj4\" (UniqueName: \"kubernetes.io/projected/7130e58c-a513-4666-8938-c16760ff494c-kube-api-access-5bbj4\") pod \"node-resolver-fvncf\" (UID: \"7130e58c-a513-4666-8938-c16760ff494c\") " pod="openshift-dns/node-resolver-fvncf"
Jul 09 21:50:55.096268 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.096163    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/10510741-9c12-4044-ac11-97958aa1fc35-host-run-netns\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.096268 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.096182    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/10510741-9c12-4044-ac11-97958aa1fc35-log-socket\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.096268 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.096197    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/01708989-c414-4c1b-9886-4d47eb929be1-etc-systemd\") pod \"tuned-t97wx\" (UID: \"01708989-c414-4c1b-9886-4d47eb929be1\") " pod="openshift-cluster-node-tuning-operator/tuned-t97wx"
Jul 09 21:50:55.096268 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.096221    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f26b1dbc-6be7-4c4c-9d63-a5d7a676680a-socket-dir\") pod \"aws-ebs-csi-driver-node-kwd8h\" (UID: \"f26b1dbc-6be7-4c4c-9d63-a5d7a676680a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwd8h"
Jul 09 21:50:55.096268 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.096236    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/10510741-9c12-4044-ac11-97958aa1fc35-ovnkube-config\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.096268 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.096253    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bc33c68c-1261-400d-991e-308f24c9210b-cnibin\") pod \"multus-additional-cni-plugins-7tq48\" (UID: \"bc33c68c-1261-400d-991e-308f24c9210b\") " pod="openshift-multus/multus-additional-cni-plugins-7tq48"
Jul 09 21:50:55.096523 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.096269    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/10510741-9c12-4044-ac11-97958aa1fc35-run-systemd\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.096523 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.096294    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10510741-9c12-4044-ac11-97958aa1fc35-var-lib-openvswitch\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.096523 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.096342    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/10510741-9c12-4044-ac11-97958aa1fc35-run-ovn\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.096523 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.096370    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wl4xh"
Jul 09 21:50:55.096523 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.096372    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/01708989-c414-4c1b-9886-4d47eb929be1-run\") pod \"tuned-t97wx\" (UID: \"01708989-c414-4c1b-9886-4d47eb929be1\") " pod="openshift-cluster-node-tuning-operator/tuned-t97wx"
Jul 09 21:50:55.096523 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.096403    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f26b1dbc-6be7-4c4c-9d63-a5d7a676680a-etc-selinux\") pod \"aws-ebs-csi-driver-node-kwd8h\" (UID: \"f26b1dbc-6be7-4c4c-9d63-a5d7a676680a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwd8h"
Jul 09 21:50:55.096523 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.096423    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bc33c68c-1261-400d-991e-308f24c9210b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7tq48\" (UID: \"bc33c68c-1261-400d-991e-308f24c9210b\") " pod="openshift-multus/multus-additional-cni-plugins-7tq48"
Jul 09 21:50:55.096523 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.096442    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/10510741-9c12-4044-ac11-97958aa1fc35-node-log\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.096523 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.096517    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/01708989-c414-4c1b-9886-4d47eb929be1-etc-sysctl-conf\") pod \"tuned-t97wx\" (UID: \"01708989-c414-4c1b-9886-4d47eb929be1\") " pod="openshift-cluster-node-tuning-operator/tuned-t97wx"
Jul 09 21:50:55.096954 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.096543    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z282\" (UniqueName: \"kubernetes.io/projected/f26b1dbc-6be7-4c4c-9d63-a5d7a676680a-kube-api-access-6z282\") pod \"aws-ebs-csi-driver-node-kwd8h\" (UID: \"f26b1dbc-6be7-4c4c-9d63-a5d7a676680a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwd8h"
Jul 09 21:50:55.096954 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.096603    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/01708989-c414-4c1b-9886-4d47eb929be1-lib-modules\") pod \"tuned-t97wx\" (UID: \"01708989-c414-4c1b-9886-4d47eb929be1\") " pod="openshift-cluster-node-tuning-operator/tuned-t97wx"
Jul 09 21:50:55.096954 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.096621    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt9k6\" (UniqueName: \"kubernetes.io/projected/31a02e15-5a13-4e04-a0ba-8e5667bd9420-kube-api-access-tt9k6\") pod \"node-ca-qngdz\" (UID: \"31a02e15-5a13-4e04-a0ba-8e5667bd9420\") " pod="openshift-image-registry/node-ca-qngdz"
Jul 09 21:50:55.096954 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.096639    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7130e58c-a513-4666-8938-c16760ff494c-hosts-file\") pod \"node-resolver-fvncf\" (UID: \"7130e58c-a513-4666-8938-c16760ff494c\") " pod="openshift-dns/node-resolver-fvncf"
Jul 09 21:50:55.096954 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.096681    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/10510741-9c12-4044-ac11-97958aa1fc35-host-kubelet\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.096954 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.096713    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/10510741-9c12-4044-ac11-97958aa1fc35-systemd-units\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.096954 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.096741    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/10510741-9c12-4044-ac11-97958aa1fc35-ovnkube-script-lib\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.096954 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.096767    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/01708989-c414-4c1b-9886-4d47eb929be1-etc-modprobe-d\") pod \"tuned-t97wx\" (UID: \"01708989-c414-4c1b-9886-4d47eb929be1\") " pod="openshift-cluster-node-tuning-operator/tuned-t97wx"
Jul 09 21:50:55.096954 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.096791    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/01708989-c414-4c1b-9886-4d47eb929be1-etc-tuned\") pod \"tuned-t97wx\" (UID: \"01708989-c414-4c1b-9886-4d47eb929be1\") " pod="openshift-cluster-node-tuning-operator/tuned-t97wx"
Jul 09 21:50:55.096954 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.096820    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc33c68c-1261-400d-991e-308f24c9210b-system-cni-dir\") pod \"multus-additional-cni-plugins-7tq48\" (UID: \"bc33c68c-1261-400d-991e-308f24c9210b\") " pod="openshift-multus/multus-additional-cni-plugins-7tq48"
Jul 09 21:50:55.096954 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.096868    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/10510741-9c12-4044-ac11-97958aa1fc35-ovn-node-metrics-cert\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.096954 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.096890    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7130e58c-a513-4666-8938-c16760ff494c-tmp-dir\") pod \"node-resolver-fvncf\" (UID: \"7130e58c-a513-4666-8938-c16760ff494c\") " pod="openshift-dns/node-resolver-fvncf"
Jul 09 21:50:55.096954 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.096931    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/06b11cb1-4d06-48b8-a010-c79c999bfec2-konnectivity-ca\") pod \"konnectivity-agent-fxmvw\" (UID: \"06b11cb1-4d06-48b8-a010-c79c999bfec2\") " pod="kube-system/konnectivity-agent-fxmvw"
Jul 09 21:50:55.097425 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.096981    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/10510741-9c12-4044-ac11-97958aa1fc35-env-overrides\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.097425 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.097009    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/01708989-c414-4c1b-9886-4d47eb929be1-etc-sysctl-d\") pod \"tuned-t97wx\" (UID: \"01708989-c414-4c1b-9886-4d47eb929be1\") " pod="openshift-cluster-node-tuning-operator/tuned-t97wx"
Jul 09 21:50:55.097425 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.097026    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01708989-c414-4c1b-9886-4d47eb929be1-var-lib-kubelet\") pod \"tuned-t97wx\" (UID: \"01708989-c414-4c1b-9886-4d47eb929be1\") " pod="openshift-cluster-node-tuning-operator/tuned-t97wx"
Jul 09 21:50:55.097425 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.097095    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/31a02e15-5a13-4e04-a0ba-8e5667bd9420-serviceca\") pod \"node-ca-qngdz\" (UID: \"31a02e15-5a13-4e04-a0ba-8e5667bd9420\") " pod="openshift-image-registry/node-ca-qngdz"
Jul 09 21:50:55.097425 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.097124    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f26b1dbc-6be7-4c4c-9d63-a5d7a676680a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kwd8h\" (UID: \"f26b1dbc-6be7-4c4c-9d63-a5d7a676680a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwd8h"
Jul 09 21:50:55.097425 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.097152    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bc33c68c-1261-400d-991e-308f24c9210b-cni-binary-copy\") pod \"multus-additional-cni-plugins-7tq48\" (UID: \"bc33c68c-1261-400d-991e-308f24c9210b\") " pod="openshift-multus/multus-additional-cni-plugins-7tq48"
Jul 09 21:50:55.097425 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.097176    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8k9v\" (UniqueName: \"kubernetes.io/projected/10510741-9c12-4044-ac11-97958aa1fc35-kube-api-access-b8k9v\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.097425 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.097227    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mjtq\" (UniqueName: \"kubernetes.io/projected/01708989-c414-4c1b-9886-4d47eb929be1-kube-api-access-7mjtq\") pod \"tuned-t97wx\" (UID: \"01708989-c414-4c1b-9886-4d47eb929be1\") " pod="openshift-cluster-node-tuning-operator/tuned-t97wx"
Jul 09 21:50:55.099294 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.099257    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 09 21:50:55.099385 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.099316    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjm26"
Jul 09 21:50:55.099428 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:55.099381    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjm26" podUID="442ba0c0-0b9e-4918-b8a6-c93618456a92"
Jul 09 21:50:55.099619 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.099601    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5sg5g\""
Jul 09 21:50:55.099682 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.099618    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 09 21:50:55.099786 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.099769    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 09 21:50:55.102284 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.102267    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 21:50:55.123941 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.123918    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vdxjk"
Jul 09 21:50:55.132613 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.132591    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vdxjk"
Jul 09 21:50:55.185080 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.185052    2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 09 21:50:55.197449 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.197398    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bc33c68c-1261-400d-991e-308f24c9210b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7tq48\" (UID: \"bc33c68c-1261-400d-991e-308f24c9210b\") " pod="openshift-multus/multus-additional-cni-plugins-7tq48"
Jul 09 21:50:55.197449 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.197445    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/10510741-9c12-4044-ac11-97958aa1fc35-host-cni-bin\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.197719 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.197471    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f26b1dbc-6be7-4c4c-9d63-a5d7a676680a-sys-fs\") pod \"aws-ebs-csi-driver-node-kwd8h\" (UID: \"f26b1dbc-6be7-4c4c-9d63-a5d7a676680a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwd8h"
Jul 09 21:50:55.197719 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.197500    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/442ba0c0-0b9e-4918-b8a6-c93618456a92-dbus\") pod \"global-pull-secret-syncer-fjm26\" (UID: \"442ba0c0-0b9e-4918-b8a6-c93618456a92\") " pod="kube-system/global-pull-secret-syncer-fjm26"
Jul 09 21:50:55.197719 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.197526    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-host-var-lib-cni-bin\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.197719 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.197550    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/152b4cf8-f137-4a3c-bc4b-de033cc018b8-host-slash\") pod \"iptables-alerter-wl4xh\" (UID: \"152b4cf8-f137-4a3c-bc4b-de033cc018b8\") " pod="openshift-network-operator/iptables-alerter-wl4xh"
Jul 09 21:50:55.197719 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.197569    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/10510741-9c12-4044-ac11-97958aa1fc35-host-cni-bin\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.197719 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.197589    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10510741-9c12-4044-ac11-97958aa1fc35-run-openvswitch\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.197719 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.197616    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bbj4\" (UniqueName: \"kubernetes.io/projected/7130e58c-a513-4666-8938-c16760ff494c-kube-api-access-5bbj4\") pod \"node-resolver-fvncf\" (UID: \"7130e58c-a513-4666-8938-c16760ff494c\") " pod="openshift-dns/node-resolver-fvncf"
Jul 09 21:50:55.197719 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.197623    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f26b1dbc-6be7-4c4c-9d63-a5d7a676680a-sys-fs\") pod \"aws-ebs-csi-driver-node-kwd8h\" (UID: \"f26b1dbc-6be7-4c4c-9d63-a5d7a676680a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwd8h"
Jul 09 21:50:55.197719 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.197647    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10510741-9c12-4044-ac11-97958aa1fc35-run-openvswitch\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.197719 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.197676    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bc33c68c-1261-400d-991e-308f24c9210b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7tq48\" (UID: \"bc33c68c-1261-400d-991e-308f24c9210b\") " pod="openshift-multus/multus-additional-cni-plugins-7tq48"
Jul 09 21:50:55.197719 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.197689    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/442ba0c0-0b9e-4918-b8a6-c93618456a92-original-pull-secret\") pod \"global-pull-secret-syncer-fjm26\" (UID: \"442ba0c0-0b9e-4918-b8a6-c93618456a92\") " pod="kube-system/global-pull-secret-syncer-fjm26"
Jul 09 21:50:55.198329 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.197742    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/10510741-9c12-4044-ac11-97958aa1fc35-host-run-netns\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.198329 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.197808    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/10510741-9c12-4044-ac11-97958aa1fc35-host-run-netns\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.198329 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.197821    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/10510741-9c12-4044-ac11-97958aa1fc35-log-socket\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.198329 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.197859    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/01708989-c414-4c1b-9886-4d47eb929be1-etc-systemd\") pod \"tuned-t97wx\" (UID: \"01708989-c414-4c1b-9886-4d47eb929be1\") " pod="openshift-cluster-node-tuning-operator/tuned-t97wx"
Jul 09 21:50:55.198329 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.197862    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/10510741-9c12-4044-ac11-97958aa1fc35-log-socket\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.198329 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.197885    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f26b1dbc-6be7-4c4c-9d63-a5d7a676680a-socket-dir\") pod \"aws-ebs-csi-driver-node-kwd8h\" (UID: \"f26b1dbc-6be7-4c4c-9d63-a5d7a676680a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwd8h"
Jul 09 21:50:55.198329 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.197907    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/10510741-9c12-4044-ac11-97958aa1fc35-ovnkube-config\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.198329 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.197936    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bc33c68c-1261-400d-991e-308f24c9210b-cnibin\") pod \"multus-additional-cni-plugins-7tq48\" (UID: \"bc33c68c-1261-400d-991e-308f24c9210b\") " pod="openshift-multus/multus-additional-cni-plugins-7tq48"
Jul 09 21:50:55.198329 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.197961    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/10510741-9c12-4044-ac11-97958aa1fc35-run-systemd\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.198329 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.197990    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/01708989-c414-4c1b-9886-4d47eb929be1-etc-systemd\") pod \"tuned-t97wx\" (UID: \"01708989-c414-4c1b-9886-4d47eb929be1\") " pod="openshift-cluster-node-tuning-operator/tuned-t97wx"
Jul 09 21:50:55.198329 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.198002    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10510741-9c12-4044-ac11-97958aa1fc35-var-lib-openvswitch\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.198329 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.198037    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/10510741-9c12-4044-ac11-97958aa1fc35-run-ovn\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.198329 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.198040    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bc33c68c-1261-400d-991e-308f24c9210b-cnibin\") pod \"multus-additional-cni-plugins-7tq48\" (UID: \"bc33c68c-1261-400d-991e-308f24c9210b\") " pod="openshift-multus/multus-additional-cni-plugins-7tq48"
Jul 09 21:50:55.198329 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.198059    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/01708989-c414-4c1b-9886-4d47eb929be1-run\") pod \"tuned-t97wx\" (UID: \"01708989-c414-4c1b-9886-4d47eb929be1\") " pod="openshift-cluster-node-tuning-operator/tuned-t97wx"
Jul 09 21:50:55.198329 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.198049    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10510741-9c12-4044-ac11-97958aa1fc35-var-lib-openvswitch\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.198329 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.198082    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f26b1dbc-6be7-4c4c-9d63-a5d7a676680a-etc-selinux\") pod \"aws-ebs-csi-driver-node-kwd8h\" (UID: \"f26b1dbc-6be7-4c4c-9d63-a5d7a676680a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwd8h"
Jul 09 21:50:55.198329 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.198087    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f26b1dbc-6be7-4c4c-9d63-a5d7a676680a-socket-dir\") pod \"aws-ebs-csi-driver-node-kwd8h\" (UID: \"f26b1dbc-6be7-4c4c-9d63-a5d7a676680a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwd8h"
Jul 09 21:50:55.199162 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.198111    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/442ba0c0-0b9e-4918-b8a6-c93618456a92-kubelet-config\") pod \"global-pull-secret-syncer-fjm26\" (UID: \"442ba0c0-0b9e-4918-b8a6-c93618456a92\") " pod="kube-system/global-pull-secret-syncer-fjm26"
Jul 09 21:50:55.199162 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.198122    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/10510741-9c12-4044-ac11-97958aa1fc35-run-ovn\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.199162 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.198141    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bc33c68c-1261-400d-991e-308f24c9210b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7tq48\" (UID: \"bc33c68c-1261-400d-991e-308f24c9210b\") " pod="openshift-multus/multus-additional-cni-plugins-7tq48"
Jul 09 21:50:55.199162 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.198166    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/10510741-9c12-4044-ac11-97958aa1fc35-run-systemd\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.199162 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.198168    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/10510741-9c12-4044-ac11-97958aa1fc35-node-log\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.199162 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.198198    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/01708989-c414-4c1b-9886-4d47eb929be1-etc-sysctl-conf\") pod \"tuned-t97wx\" (UID: \"01708989-c414-4c1b-9886-4d47eb929be1\") " pod="openshift-cluster-node-tuning-operator/tuned-t97wx"
Jul 09 21:50:55.199162 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.198204    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/10510741-9c12-4044-ac11-97958aa1fc35-node-log\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.199162 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.198221    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z282\" (UniqueName: \"kubernetes.io/projected/f26b1dbc-6be7-4c4c-9d63-a5d7a676680a-kube-api-access-6z282\") pod \"aws-ebs-csi-driver-node-kwd8h\" (UID: \"f26b1dbc-6be7-4c4c-9d63-a5d7a676680a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwd8h"
Jul 09 21:50:55.199162 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.198219    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal" event={"ID":"9b04859f560db6d117b4ad45ac0045f2","Type":"ContainerStarted","Data":"6cfeb0d3d1b7766a5ddaa2ba8ed520c3aa31472f4c6cc87d006cfcbd89ab41aa"}
Jul 09 21:50:55.199162 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.198246    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/01708989-c414-4c1b-9886-4d47eb929be1-run\") pod \"tuned-t97wx\" (UID: \"01708989-c414-4c1b-9886-4d47eb929be1\") " pod="openshift-cluster-node-tuning-operator/tuned-t97wx"
Jul 09 21:50:55.199162 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.198248    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-os-release\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.199162 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.198299    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f26b1dbc-6be7-4c4c-9d63-a5d7a676680a-etc-selinux\") pod \"aws-ebs-csi-driver-node-kwd8h\" (UID: \"f26b1dbc-6be7-4c4c-9d63-a5d7a676680a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwd8h"
Jul 09 21:50:55.199162 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.198318    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/01708989-c414-4c1b-9886-4d47eb929be1-lib-modules\") pod \"tuned-t97wx\" (UID: \"01708989-c414-4c1b-9886-4d47eb929be1\") " pod="openshift-cluster-node-tuning-operator/tuned-t97wx"
Jul 09 21:50:55.199162 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.198352    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-host-run-k8s-cni-cncf-io\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.199162 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.198380    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt9k6\" (UniqueName: \"kubernetes.io/projected/31a02e15-5a13-4e04-a0ba-8e5667bd9420-kube-api-access-tt9k6\") pod \"node-ca-qngdz\" (UID: \"31a02e15-5a13-4e04-a0ba-8e5667bd9420\") " pod="openshift-image-registry/node-ca-qngdz"
Jul 09 21:50:55.199162 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.198387    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/01708989-c414-4c1b-9886-4d47eb929be1-etc-sysctl-conf\") pod \"tuned-t97wx\" (UID: \"01708989-c414-4c1b-9886-4d47eb929be1\") " pod="openshift-cluster-node-tuning-operator/tuned-t97wx"
Jul 09 21:50:55.199162 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.198404    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-etc-kubernetes\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.199919 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.198420    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/01708989-c414-4c1b-9886-4d47eb929be1-lib-modules\") pod \"tuned-t97wx\" (UID: \"01708989-c414-4c1b-9886-4d47eb929be1\") " pod="openshift-cluster-node-tuning-operator/tuned-t97wx"
Jul 09 21:50:55.199919 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.198431    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kj6w\" (UniqueName: \"kubernetes.io/projected/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-kube-api-access-2kj6w\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.199919 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.198483    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7130e58c-a513-4666-8938-c16760ff494c-hosts-file\") pod \"node-resolver-fvncf\" (UID: \"7130e58c-a513-4666-8938-c16760ff494c\") " pod="openshift-dns/node-resolver-fvncf"
Jul 09 21:50:55.199919 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.198561    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/10510741-9c12-4044-ac11-97958aa1fc35-ovnkube-config\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.199919 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.198628    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/10510741-9c12-4044-ac11-97958aa1fc35-host-kubelet\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.199919 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.198643    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7130e58c-a513-4666-8938-c16760ff494c-hosts-file\") pod \"node-resolver-fvncf\" (UID: \"7130e58c-a513-4666-8938-c16760ff494c\") " pod="openshift-dns/node-resolver-fvncf"
Jul 09 21:50:55.199919 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.198659    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/10510741-9c12-4044-ac11-97958aa1fc35-systemd-units\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.199919 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.198668    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/10510741-9c12-4044-ac11-97958aa1fc35-host-kubelet\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.199919 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.198686    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/10510741-9c12-4044-ac11-97958aa1fc35-ovnkube-script-lib\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.199919 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.198713    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/01708989-c414-4c1b-9886-4d47eb929be1-etc-modprobe-d\") pod \"tuned-t97wx\" (UID: \"01708989-c414-4c1b-9886-4d47eb929be1\") " pod="openshift-cluster-node-tuning-operator/tuned-t97wx"
Jul 09 21:50:55.199919 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.198738    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/01708989-c414-4c1b-9886-4d47eb929be1-etc-tuned\") pod \"tuned-t97wx\" (UID: \"01708989-c414-4c1b-9886-4d47eb929be1\") " pod="openshift-cluster-node-tuning-operator/tuned-t97wx"
Jul 09 21:50:55.199919 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.198770    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-host-run-multus-certs\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.199919 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.198798    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc33c68c-1261-400d-991e-308f24c9210b-system-cni-dir\") pod \"multus-additional-cni-plugins-7tq48\" (UID: \"bc33c68c-1261-400d-991e-308f24c9210b\") " pod="openshift-multus/multus-additional-cni-plugins-7tq48"
Jul 09 21:50:55.199919 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.198811    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bc33c68c-1261-400d-991e-308f24c9210b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7tq48\" (UID: \"bc33c68c-1261-400d-991e-308f24c9210b\") " pod="openshift-multus/multus-additional-cni-plugins-7tq48"
Jul 09 21:50:55.199919 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.198825    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/10510741-9c12-4044-ac11-97958aa1fc35-ovn-node-metrics-cert\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.199919 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.198830    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/01708989-c414-4c1b-9886-4d47eb929be1-etc-modprobe-d\") pod \"tuned-t97wx\" (UID: \"01708989-c414-4c1b-9886-4d47eb929be1\") " pod="openshift-cluster-node-tuning-operator/tuned-t97wx"
Jul 09 21:50:55.199919 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.198850    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7130e58c-a513-4666-8938-c16760ff494c-tmp-dir\") pod \"node-resolver-fvncf\" (UID: \"7130e58c-a513-4666-8938-c16760ff494c\") " pod="openshift-dns/node-resolver-fvncf"
Jul 09 21:50:55.200735 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.198716    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/10510741-9c12-4044-ac11-97958aa1fc35-systemd-units\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.200735 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.198871    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc33c68c-1261-400d-991e-308f24c9210b-system-cni-dir\") pod \"multus-additional-cni-plugins-7tq48\" (UID: \"bc33c68c-1261-400d-991e-308f24c9210b\") " pod="openshift-multus/multus-additional-cni-plugins-7tq48"
Jul 09 21:50:55.200735 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.198878    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/06b11cb1-4d06-48b8-a010-c79c999bfec2-konnectivity-ca\") pod \"konnectivity-agent-fxmvw\" (UID: \"06b11cb1-4d06-48b8-a010-c79c999bfec2\") " pod="kube-system/konnectivity-agent-fxmvw"
Jul 09 21:50:55.200735 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.198903    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b99eef2e-6748-4460-bd07-1f99729b663c-metrics-certs\") pod \"network-metrics-daemon-l49xl\" (UID: \"b99eef2e-6748-4460-bd07-1f99729b663c\") " pod="openshift-multus/network-metrics-daemon-l49xl"
Jul 09 21:50:55.200735 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.198925    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-multus-cni-dir\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.200735 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.198985    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-cni-binary-copy\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.200735 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.199041    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-multus-daemon-config\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.200735 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.199072    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/10510741-9c12-4044-ac11-97958aa1fc35-env-overrides\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.200735 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.199090    2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 09 21:50:55.200735 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.199099    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/01708989-c414-4c1b-9886-4d47eb929be1-etc-sysctl-d\") pod \"tuned-t97wx\" (UID: \"01708989-c414-4c1b-9886-4d47eb929be1\") " pod="openshift-cluster-node-tuning-operator/tuned-t97wx"
Jul 09 21:50:55.200735 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.199127    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01708989-c414-4c1b-9886-4d47eb929be1-var-lib-kubelet\") pod \"tuned-t97wx\" (UID: \"01708989-c414-4c1b-9886-4d47eb929be1\") " pod="openshift-cluster-node-tuning-operator/tuned-t97wx"
Jul 09 21:50:55.200735 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.199152    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/31a02e15-5a13-4e04-a0ba-8e5667bd9420-serviceca\") pod \"node-ca-qngdz\" (UID: \"31a02e15-5a13-4e04-a0ba-8e5667bd9420\") " pod="openshift-image-registry/node-ca-qngdz"
Jul 09 21:50:55.200735 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.199177    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f26b1dbc-6be7-4c4c-9d63-a5d7a676680a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kwd8h\" (UID: \"f26b1dbc-6be7-4c4c-9d63-a5d7a676680a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwd8h"
Jul 09 21:50:55.200735 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.199202    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bc33c68c-1261-400d-991e-308f24c9210b-cni-binary-copy\") pod \"multus-additional-cni-plugins-7tq48\" (UID: \"bc33c68c-1261-400d-991e-308f24c9210b\") " pod="openshift-multus/multus-additional-cni-plugins-7tq48"
Jul 09 21:50:55.200735 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.199205    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7130e58c-a513-4666-8938-c16760ff494c-tmp-dir\") pod \"node-resolver-fvncf\" (UID: \"7130e58c-a513-4666-8938-c16760ff494c\") " pod="openshift-dns/node-resolver-fvncf"
Jul 09 21:50:55.200735 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.199228    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8k9v\" (UniqueName: \"kubernetes.io/projected/10510741-9c12-4044-ac11-97958aa1fc35-kube-api-access-b8k9v\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.200735 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.199281    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/10510741-9c12-4044-ac11-97958aa1fc35-ovnkube-script-lib\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.201621 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.199292    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mjtq\" (UniqueName: \"kubernetes.io/projected/01708989-c414-4c1b-9886-4d47eb929be1-kube-api-access-7mjtq\") pod \"tuned-t97wx\" (UID: \"01708989-c414-4c1b-9886-4d47eb929be1\") " pod="openshift-cluster-node-tuning-operator/tuned-t97wx"
Jul 09 21:50:55.201621 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.199319    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-cnibin\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.201621 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.199361    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-multus-socket-dir-parent\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.201621 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.199389    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/01708989-c414-4c1b-9886-4d47eb929be1-etc-sysctl-d\") pod \"tuned-t97wx\" (UID: \"01708989-c414-4c1b-9886-4d47eb929be1\") " pod="openshift-cluster-node-tuning-operator/tuned-t97wx"
Jul 09 21:50:55.201621 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.199391    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vdft\" (UniqueName: \"kubernetes.io/projected/daa318c8-a79e-4833-8022-26e9db42aaa9-kube-api-access-7vdft\") pod \"network-check-target-gpncs\" (UID: \"daa318c8-a79e-4833-8022-26e9db42aaa9\") " pod="openshift-network-diagnostics/network-check-target-gpncs"
Jul 09 21:50:55.201621 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.199430    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/10510741-9c12-4044-ac11-97958aa1fc35-host-slash\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.201621 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.199458    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10510741-9c12-4044-ac11-97958aa1fc35-host-run-ovn-kubernetes\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.201621 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.199500    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/01708989-c414-4c1b-9886-4d47eb929be1-etc-sysconfig\") pod \"tuned-t97wx\" (UID: \"01708989-c414-4c1b-9886-4d47eb929be1\") " pod="openshift-cluster-node-tuning-operator/tuned-t97wx"
Jul 09 21:50:55.201621 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.199511    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/06b11cb1-4d06-48b8-a010-c79c999bfec2-konnectivity-ca\") pod \"konnectivity-agent-fxmvw\" (UID: \"06b11cb1-4d06-48b8-a010-c79c999bfec2\") " pod="kube-system/konnectivity-agent-fxmvw"
Jul 09 21:50:55.201621 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.199528    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-host-var-lib-cni-multus\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.201621 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.199555    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-host-var-lib-kubelet\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.201621 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.199580    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-hostroot\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.201621 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.199605    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcvk5\" (UniqueName: \"kubernetes.io/projected/152b4cf8-f137-4a3c-bc4b-de033cc018b8-kube-api-access-mcvk5\") pod \"iptables-alerter-wl4xh\" (UID: \"152b4cf8-f137-4a3c-bc4b-de033cc018b8\") " pod="openshift-network-operator/iptables-alerter-wl4xh"
Jul 09 21:50:55.201621 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.199605    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/10510741-9c12-4044-ac11-97958aa1fc35-env-overrides\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.201621 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.199650    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/31a02e15-5a13-4e04-a0ba-8e5667bd9420-serviceca\") pod \"node-ca-qngdz\" (UID: \"31a02e15-5a13-4e04-a0ba-8e5667bd9420\") " pod="openshift-image-registry/node-ca-qngdz"
Jul 09 21:50:55.201621 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.199647    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10510741-9c12-4044-ac11-97958aa1fc35-etc-openvswitch\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.201621 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.199678    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f26b1dbc-6be7-4c4c-9d63-a5d7a676680a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kwd8h\" (UID: \"f26b1dbc-6be7-4c4c-9d63-a5d7a676680a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwd8h"
Jul 09 21:50:55.202499 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.199714    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01708989-c414-4c1b-9886-4d47eb929be1-var-lib-kubelet\") pod \"tuned-t97wx\" (UID: \"01708989-c414-4c1b-9886-4d47eb929be1\") " pod="openshift-cluster-node-tuning-operator/tuned-t97wx"
Jul 09 21:50:55.202499 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.199746    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/10510741-9c12-4044-ac11-97958aa1fc35-host-slash\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.202499 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.199732    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f26b1dbc-6be7-4c4c-9d63-a5d7a676680a-device-dir\") pod \"aws-ebs-csi-driver-node-kwd8h\" (UID: \"f26b1dbc-6be7-4c4c-9d63-a5d7a676680a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwd8h"
Jul 09 21:50:55.202499 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.199784    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-host-run-netns\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.202499 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.199811    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-multus-conf-dir\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.202499 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.199817    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f26b1dbc-6be7-4c4c-9d63-a5d7a676680a-device-dir\") pod \"aws-ebs-csi-driver-node-kwd8h\" (UID: \"f26b1dbc-6be7-4c4c-9d63-a5d7a676680a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwd8h"
Jul 09 21:50:55.202499 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.199842    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bc33c68c-1261-400d-991e-308f24c9210b-os-release\") pod \"multus-additional-cni-plugins-7tq48\" (UID: \"bc33c68c-1261-400d-991e-308f24c9210b\") " pod="openshift-multus/multus-additional-cni-plugins-7tq48"
Jul 09 21:50:55.202499 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.199880    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bc33c68c-1261-400d-991e-308f24c9210b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7tq48\" (UID: \"bc33c68c-1261-400d-991e-308f24c9210b\") " pod="openshift-multus/multus-additional-cni-plugins-7tq48"
Jul 09 21:50:55.202499 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.199909    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bc33c68c-1261-400d-991e-308f24c9210b-os-release\") pod \"multus-additional-cni-plugins-7tq48\" (UID: \"bc33c68c-1261-400d-991e-308f24c9210b\") " pod="openshift-multus/multus-additional-cni-plugins-7tq48"
Jul 09 21:50:55.202499 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.199926    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/10510741-9c12-4044-ac11-97958aa1fc35-host-cni-netd\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.202499 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.199953    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01708989-c414-4c1b-9886-4d47eb929be1-etc-kubernetes\") pod \"tuned-t97wx\" (UID: \"01708989-c414-4c1b-9886-4d47eb929be1\") " pod="openshift-cluster-node-tuning-operator/tuned-t97wx"
Jul 09 21:50:55.202499 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.200002    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10510741-9c12-4044-ac11-97958aa1fc35-host-run-ovn-kubernetes\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.202499 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.200060    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/10510741-9c12-4044-ac11-97958aa1fc35-etc-openvswitch\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.202499 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.200005    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f26b1dbc-6be7-4c4c-9d63-a5d7a676680a-registration-dir\") pod \"aws-ebs-csi-driver-node-kwd8h\" (UID: \"f26b1dbc-6be7-4c4c-9d63-a5d7a676680a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwd8h"
Jul 09 21:50:55.202499 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.200106    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-system-cni-dir\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.202499 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.200142    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f26b1dbc-6be7-4c4c-9d63-a5d7a676680a-registration-dir\") pod \"aws-ebs-csi-driver-node-kwd8h\" (UID: \"f26b1dbc-6be7-4c4c-9d63-a5d7a676680a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwd8h"
Jul 09 21:50:55.202499 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.200152    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/152b4cf8-f137-4a3c-bc4b-de033cc018b8-iptables-alerter-script\") pod \"iptables-alerter-wl4xh\" (UID: \"152b4cf8-f137-4a3c-bc4b-de033cc018b8\") " pod="openshift-network-operator/iptables-alerter-wl4xh"
Jul 09 21:50:55.203179 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.200181    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/31a02e15-5a13-4e04-a0ba-8e5667bd9420-host\") pod \"node-ca-qngdz\" (UID: \"31a02e15-5a13-4e04-a0ba-8e5667bd9420\") " pod="openshift-image-registry/node-ca-qngdz"
Jul 09 21:50:55.203179 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.200187    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bc33c68c-1261-400d-991e-308f24c9210b-cni-binary-copy\") pod \"multus-additional-cni-plugins-7tq48\" (UID: \"bc33c68c-1261-400d-991e-308f24c9210b\") " pod="openshift-multus/multus-additional-cni-plugins-7tq48"
Jul 09 21:50:55.203179 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.200210    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m565z\" (UniqueName: \"kubernetes.io/projected/bc33c68c-1261-400d-991e-308f24c9210b-kube-api-access-m565z\") pod \"multus-additional-cni-plugins-7tq48\" (UID: \"bc33c68c-1261-400d-991e-308f24c9210b\") " pod="openshift-multus/multus-additional-cni-plugins-7tq48"
Jul 09 21:50:55.203179 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.200259    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10510741-9c12-4044-ac11-97958aa1fc35-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.203179 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.200287    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01708989-c414-4c1b-9886-4d47eb929be1-sys\") pod \"tuned-t97wx\" (UID: \"01708989-c414-4c1b-9886-4d47eb929be1\") " pod="openshift-cluster-node-tuning-operator/tuned-t97wx"
Jul 09 21:50:55.203179 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.200300    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-101.ec2.internal" event={"ID":"91fa6d5fff63c7ad729649847f11496f","Type":"ContainerStarted","Data":"a5386264910e2975a765ac4fd205bb396c5b1782e05a07d128c3f949021a1669"}
Jul 09 21:50:55.203179 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.200328    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/01708989-c414-4c1b-9886-4d47eb929be1-host\") pod \"tuned-t97wx\" (UID: \"01708989-c414-4c1b-9886-4d47eb929be1\") " pod="openshift-cluster-node-tuning-operator/tuned-t97wx"
Jul 09 21:50:55.203179 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.200215    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01708989-c414-4c1b-9886-4d47eb929be1-etc-kubernetes\") pod \"tuned-t97wx\" (UID: \"01708989-c414-4c1b-9886-4d47eb929be1\") " pod="openshift-cluster-node-tuning-operator/tuned-t97wx"
Jul 09 21:50:55.203179 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.200261    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/01708989-c414-4c1b-9886-4d47eb929be1-etc-sysconfig\") pod \"tuned-t97wx\" (UID: \"01708989-c414-4c1b-9886-4d47eb929be1\") " pod="openshift-cluster-node-tuning-operator/tuned-t97wx"
Jul 09 21:50:55.203179 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.200344    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/31a02e15-5a13-4e04-a0ba-8e5667bd9420-host\") pod \"node-ca-qngdz\" (UID: \"31a02e15-5a13-4e04-a0ba-8e5667bd9420\") " pod="openshift-image-registry/node-ca-qngdz"
Jul 09 21:50:55.203179 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.200367    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01708989-c414-4c1b-9886-4d47eb929be1-tmp\") pod \"tuned-t97wx\" (UID: \"01708989-c414-4c1b-9886-4d47eb929be1\") " pod="openshift-cluster-node-tuning-operator/tuned-t97wx"
Jul 09 21:50:55.203179 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.200396    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01708989-c414-4c1b-9886-4d47eb929be1-sys\") pod \"tuned-t97wx\" (UID: \"01708989-c414-4c1b-9886-4d47eb929be1\") " pod="openshift-cluster-node-tuning-operator/tuned-t97wx"
Jul 09 21:50:55.203179 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.200396    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/06b11cb1-4d06-48b8-a010-c79c999bfec2-agent-certs\") pod \"konnectivity-agent-fxmvw\" (UID: \"06b11cb1-4d06-48b8-a010-c79c999bfec2\") " pod="kube-system/konnectivity-agent-fxmvw"
Jul 09 21:50:55.203179 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.200423    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/01708989-c414-4c1b-9886-4d47eb929be1-host\") pod \"tuned-t97wx\" (UID: \"01708989-c414-4c1b-9886-4d47eb929be1\") " pod="openshift-cluster-node-tuning-operator/tuned-t97wx"
Jul 09 21:50:55.203179 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.200441    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m9vv\" (UniqueName: \"kubernetes.io/projected/b99eef2e-6748-4460-bd07-1f99729b663c-kube-api-access-9m9vv\") pod \"network-metrics-daemon-l49xl\" (UID: \"b99eef2e-6748-4460-bd07-1f99729b663c\") " pod="openshift-multus/network-metrics-daemon-l49xl"
Jul 09 21:50:55.203179 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.200541    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bc33c68c-1261-400d-991e-308f24c9210b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7tq48\" (UID: \"bc33c68c-1261-400d-991e-308f24c9210b\") " pod="openshift-multus/multus-additional-cni-plugins-7tq48"
Jul 09 21:50:55.203179 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.200586    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10510741-9c12-4044-ac11-97958aa1fc35-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.203671 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.200610    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/10510741-9c12-4044-ac11-97958aa1fc35-host-cni-netd\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.203671 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.202885    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/01708989-c414-4c1b-9886-4d47eb929be1-etc-tuned\") pod \"tuned-t97wx\" (UID: \"01708989-c414-4c1b-9886-4d47eb929be1\") " pod="openshift-cluster-node-tuning-operator/tuned-t97wx"
Jul 09 21:50:55.203671 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.202994    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01708989-c414-4c1b-9886-4d47eb929be1-tmp\") pod \"tuned-t97wx\" (UID: \"01708989-c414-4c1b-9886-4d47eb929be1\") " pod="openshift-cluster-node-tuning-operator/tuned-t97wx"
Jul 09 21:50:55.203671 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.203106    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/10510741-9c12-4044-ac11-97958aa1fc35-ovn-node-metrics-cert\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.203671 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.203213    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/06b11cb1-4d06-48b8-a010-c79c999bfec2-agent-certs\") pod \"konnectivity-agent-fxmvw\" (UID: \"06b11cb1-4d06-48b8-a010-c79c999bfec2\") " pod="kube-system/konnectivity-agent-fxmvw"
Jul 09 21:50:55.207554 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.207523    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt9k6\" (UniqueName: \"kubernetes.io/projected/31a02e15-5a13-4e04-a0ba-8e5667bd9420-kube-api-access-tt9k6\") pod \"node-ca-qngdz\" (UID: \"31a02e15-5a13-4e04-a0ba-8e5667bd9420\") " pod="openshift-image-registry/node-ca-qngdz"
Jul 09 21:50:55.207669 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.207552    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bbj4\" (UniqueName: \"kubernetes.io/projected/7130e58c-a513-4666-8938-c16760ff494c-kube-api-access-5bbj4\") pod \"node-resolver-fvncf\" (UID: \"7130e58c-a513-4666-8938-c16760ff494c\") " pod="openshift-dns/node-resolver-fvncf"
Jul 09 21:50:55.207669 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.207616    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z282\" (UniqueName: \"kubernetes.io/projected/f26b1dbc-6be7-4c4c-9d63-a5d7a676680a-kube-api-access-6z282\") pod \"aws-ebs-csi-driver-node-kwd8h\" (UID: \"f26b1dbc-6be7-4c4c-9d63-a5d7a676680a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwd8h"
Jul 09 21:50:55.208179 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.208162    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8k9v\" (UniqueName: \"kubernetes.io/projected/10510741-9c12-4044-ac11-97958aa1fc35-kube-api-access-b8k9v\") pod \"ovnkube-node-27vrn\" (UID: \"10510741-9c12-4044-ac11-97958aa1fc35\") " pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.214014 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.213985    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m565z\" (UniqueName: \"kubernetes.io/projected/bc33c68c-1261-400d-991e-308f24c9210b-kube-api-access-m565z\") pod \"multus-additional-cni-plugins-7tq48\" (UID: \"bc33c68c-1261-400d-991e-308f24c9210b\") " pod="openshift-multus/multus-additional-cni-plugins-7tq48"
Jul 09 21:50:55.214120 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.214025    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mjtq\" (UniqueName: \"kubernetes.io/projected/01708989-c414-4c1b-9886-4d47eb929be1-kube-api-access-7mjtq\") pod \"tuned-t97wx\" (UID: \"01708989-c414-4c1b-9886-4d47eb929be1\") " pod="openshift-cluster-node-tuning-operator/tuned-t97wx"
Jul 09 21:50:55.286447 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.286419    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 21:50:55.302068 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.302033    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/442ba0c0-0b9e-4918-b8a6-c93618456a92-kubelet-config\") pod \"global-pull-secret-syncer-fjm26\" (UID: \"442ba0c0-0b9e-4918-b8a6-c93618456a92\") " pod="kube-system/global-pull-secret-syncer-fjm26"
Jul 09 21:50:55.302215 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.302084    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-os-release\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.302215 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.302160    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-host-run-k8s-cni-cncf-io\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.302215 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.302177    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-etc-kubernetes\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.302215 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.302183    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/442ba0c0-0b9e-4918-b8a6-c93618456a92-kubelet-config\") pod \"global-pull-secret-syncer-fjm26\" (UID: \"442ba0c0-0b9e-4918-b8a6-c93618456a92\") " pod="kube-system/global-pull-secret-syncer-fjm26"
Jul 09 21:50:55.302402 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.302209    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kj6w\" (UniqueName: \"kubernetes.io/projected/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-kube-api-access-2kj6w\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.302402 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.302250    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-host-run-multus-certs\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.302402 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.302242    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-host-run-k8s-cni-cncf-io\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.302402 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.302222    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-etc-kubernetes\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.302402 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.302274    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b99eef2e-6748-4460-bd07-1f99729b663c-metrics-certs\") pod \"network-metrics-daemon-l49xl\" (UID: \"b99eef2e-6748-4460-bd07-1f99729b663c\") " pod="openshift-multus/network-metrics-daemon-l49xl"
Jul 09 21:50:55.302402 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.302291    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-os-release\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.302402 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.302347    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-multus-cni-dir\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.302402 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.302376    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-cni-binary-copy\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.302402 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:55.302402    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 21:50:55.302923 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.302413    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-multus-daemon-config\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.302923 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.302422    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-host-run-multus-certs\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.302923 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.302452    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-cnibin\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.302923 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:55.302494    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b99eef2e-6748-4460-bd07-1f99729b663c-metrics-certs podName:b99eef2e-6748-4460-bd07-1f99729b663c nodeName:}" failed. No retries permitted until 2026-07-09 21:50:55.802467693 +0000 UTC m=+3.133967774 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b99eef2e-6748-4460-bd07-1f99729b663c-metrics-certs") pod "network-metrics-daemon-l49xl" (UID: "b99eef2e-6748-4460-bd07-1f99729b663c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 21:50:55.302923 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.302517    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-multus-cni-dir\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.302923 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.302517    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-multus-socket-dir-parent\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.302923 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.302519    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-cnibin\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.302923 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.302565    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vdft\" (UniqueName: \"kubernetes.io/projected/daa318c8-a79e-4833-8022-26e9db42aaa9-kube-api-access-7vdft\") pod \"network-check-target-gpncs\" (UID: \"daa318c8-a79e-4833-8022-26e9db42aaa9\") " pod="openshift-network-diagnostics/network-check-target-gpncs"
Jul 09 21:50:55.302923 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.302588    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-multus-socket-dir-parent\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.302923 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.302599    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-host-var-lib-cni-multus\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.302923 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.302639    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-host-var-lib-kubelet\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.302923 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.302664    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-hostroot\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.302923 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.302690    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcvk5\" (UniqueName: \"kubernetes.io/projected/152b4cf8-f137-4a3c-bc4b-de033cc018b8-kube-api-access-mcvk5\") pod \"iptables-alerter-wl4xh\" (UID: \"152b4cf8-f137-4a3c-bc4b-de033cc018b8\") " pod="openshift-network-operator/iptables-alerter-wl4xh"
Jul 09 21:50:55.302923 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.302709    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-host-var-lib-kubelet\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.302923 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.302707    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-host-var-lib-cni-multus\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.302923 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.302728    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-host-run-netns\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.302923 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.302744    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-hostroot\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.303533 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.302766    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-host-run-netns\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.303533 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.302760    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-multus-conf-dir\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.303533 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.302835    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-system-cni-dir\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.303533 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.302858    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-multus-conf-dir\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.303533 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.302881    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/152b4cf8-f137-4a3c-bc4b-de033cc018b8-iptables-alerter-script\") pod \"iptables-alerter-wl4xh\" (UID: \"152b4cf8-f137-4a3c-bc4b-de033cc018b8\") " pod="openshift-network-operator/iptables-alerter-wl4xh"
Jul 09 21:50:55.303533 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.302898    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-system-cni-dir\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.303533 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.302918    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m9vv\" (UniqueName: \"kubernetes.io/projected/b99eef2e-6748-4460-bd07-1f99729b663c-kube-api-access-9m9vv\") pod \"network-metrics-daemon-l49xl\" (UID: \"b99eef2e-6748-4460-bd07-1f99729b663c\") " pod="openshift-multus/network-metrics-daemon-l49xl"
Jul 09 21:50:55.303533 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.302957    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/442ba0c0-0b9e-4918-b8a6-c93618456a92-dbus\") pod \"global-pull-secret-syncer-fjm26\" (UID: \"442ba0c0-0b9e-4918-b8a6-c93618456a92\") " pod="kube-system/global-pull-secret-syncer-fjm26"
Jul 09 21:50:55.303533 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.303018    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/442ba0c0-0b9e-4918-b8a6-c93618456a92-dbus\") pod \"global-pull-secret-syncer-fjm26\" (UID: \"442ba0c0-0b9e-4918-b8a6-c93618456a92\") " pod="kube-system/global-pull-secret-syncer-fjm26"
Jul 09 21:50:55.303533 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.303052    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-host-var-lib-cni-bin\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.303533 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.303080    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/152b4cf8-f137-4a3c-bc4b-de033cc018b8-host-slash\") pod \"iptables-alerter-wl4xh\" (UID: \"152b4cf8-f137-4a3c-bc4b-de033cc018b8\") " pod="openshift-network-operator/iptables-alerter-wl4xh"
Jul 09 21:50:55.303533 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.303110    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/442ba0c0-0b9e-4918-b8a6-c93618456a92-original-pull-secret\") pod \"global-pull-secret-syncer-fjm26\" (UID: \"442ba0c0-0b9e-4918-b8a6-c93618456a92\") " pod="kube-system/global-pull-secret-syncer-fjm26"
Jul 09 21:50:55.303533 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.303145    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-multus-daemon-config\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.303533 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.303167    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-host-var-lib-cni-bin\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.303533 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.303189    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/152b4cf8-f137-4a3c-bc4b-de033cc018b8-host-slash\") pod \"iptables-alerter-wl4xh\" (UID: \"152b4cf8-f137-4a3c-bc4b-de033cc018b8\") " pod="openshift-network-operator/iptables-alerter-wl4xh"
Jul 09 21:50:55.303533 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:55.303196    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 21:50:55.303533 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.303224    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-cni-binary-copy\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.304059 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:55.303289    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/442ba0c0-0b9e-4918-b8a6-c93618456a92-original-pull-secret podName:442ba0c0-0b9e-4918-b8a6-c93618456a92 nodeName:}" failed. No retries permitted until 2026-07-09 21:50:55.803271616 +0000 UTC m=+3.134771688 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/442ba0c0-0b9e-4918-b8a6-c93618456a92-original-pull-secret") pod "global-pull-secret-syncer-fjm26" (UID: "442ba0c0-0b9e-4918-b8a6-c93618456a92") : object "kube-system"/"original-pull-secret" not registered
Jul 09 21:50:55.304059 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.303460    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/152b4cf8-f137-4a3c-bc4b-de033cc018b8-iptables-alerter-script\") pod \"iptables-alerter-wl4xh\" (UID: \"152b4cf8-f137-4a3c-bc4b-de033cc018b8\") " pod="openshift-network-operator/iptables-alerter-wl4xh"
Jul 09 21:50:55.309348 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:55.309286    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 21:50:55.309348 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:55.309311    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 21:50:55.309348 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:55.309325    2576 projected.go:196] Error preparing data for projected volume kube-api-access-7vdft for pod openshift-network-diagnostics/network-check-target-gpncs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 21:50:55.309531 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:55.309381    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/daa318c8-a79e-4833-8022-26e9db42aaa9-kube-api-access-7vdft podName:daa318c8-a79e-4833-8022-26e9db42aaa9 nodeName:}" failed. No retries permitted until 2026-07-09 21:50:55.809368104 +0000 UTC m=+3.140868162 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7vdft" (UniqueName: "kubernetes.io/projected/daa318c8-a79e-4833-8022-26e9db42aaa9-kube-api-access-7vdft") pod "network-check-target-gpncs" (UID: "daa318c8-a79e-4833-8022-26e9db42aaa9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 21:50:55.311436 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.311406    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kj6w\" (UniqueName: \"kubernetes.io/projected/469ca9e2-ec48-4e51-83e0-e1daa87df6d9-kube-api-access-2kj6w\") pod \"multus-hv6qq\" (UID: \"469ca9e2-ec48-4e51-83e0-e1daa87df6d9\") " pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.311831 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.311802    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcvk5\" (UniqueName: \"kubernetes.io/projected/152b4cf8-f137-4a3c-bc4b-de033cc018b8-kube-api-access-mcvk5\") pod \"iptables-alerter-wl4xh\" (UID: \"152b4cf8-f137-4a3c-bc4b-de033cc018b8\") " pod="openshift-network-operator/iptables-alerter-wl4xh"
Jul 09 21:50:55.311933 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.311915    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m9vv\" (UniqueName: \"kubernetes.io/projected/b99eef2e-6748-4460-bd07-1f99729b663c-kube-api-access-9m9vv\") pod \"network-metrics-daemon-l49xl\" (UID: \"b99eef2e-6748-4460-bd07-1f99729b663c\") " pod="openshift-multus/network-metrics-daemon-l49xl"
Jul 09 21:50:55.381523 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.381474    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fxmvw"
Jul 09 21:50:55.387294 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.387256    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7tq48"
Jul 09 21:50:55.392552 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:55.392527    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06b11cb1_4d06_48b8_a010_c79c999bfec2.slice/crio-279ad4dff0aed07de9927c63b22bc91df8d719f8b9792515ad2d08758b784966 WatchSource:0}: Error finding container 279ad4dff0aed07de9927c63b22bc91df8d719f8b9792515ad2d08758b784966: Status 404 returned error can't find the container with id 279ad4dff0aed07de9927c63b22bc91df8d719f8b9792515ad2d08758b784966
Jul 09 21:50:55.397466 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.397439    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:50:55.398942 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:55.398913    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc33c68c_1261_400d_991e_308f24c9210b.slice/crio-be10797911def46278dd8bedffb9ee72624a6d78fb50d206f77dba21272c35c5 WatchSource:0}: Error finding container be10797911def46278dd8bedffb9ee72624a6d78fb50d206f77dba21272c35c5: Status 404 returned error can't find the container with id be10797911def46278dd8bedffb9ee72624a6d78fb50d206f77dba21272c35c5
Jul 09 21:50:55.402887 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.402848    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qngdz"
Jul 09 21:50:55.408235 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.408212    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-t97wx"
Jul 09 21:50:55.409351 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:55.409303    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10510741_9c12_4044_ac11_97958aa1fc35.slice/crio-86e5dc2561542c1f1b4efa981f6adb23e75ac9c41c95276aaca818c44df316c4 WatchSource:0}: Error finding container 86e5dc2561542c1f1b4efa981f6adb23e75ac9c41c95276aaca818c44df316c4: Status 404 returned error can't find the container with id 86e5dc2561542c1f1b4efa981f6adb23e75ac9c41c95276aaca818c44df316c4
Jul 09 21:50:55.414708 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.414685    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fvncf"
Jul 09 21:50:55.419449 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:55.419402    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31a02e15_5a13_4e04_a0ba_8e5667bd9420.slice/crio-e63cd44e3aec359b4866c9f0f9c1e2c75964ac5684cb63f6add9f8cfbc498f21 WatchSource:0}: Error finding container e63cd44e3aec359b4866c9f0f9c1e2c75964ac5684cb63f6add9f8cfbc498f21: Status 404 returned error can't find the container with id e63cd44e3aec359b4866c9f0f9c1e2c75964ac5684cb63f6add9f8cfbc498f21
Jul 09 21:50:55.421794 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.421590    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwd8h"
Jul 09 21:50:55.426920 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.426580    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hv6qq"
Jul 09 21:50:55.430354 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:55.430201    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7130e58c_a513_4666_8938_c16760ff494c.slice/crio-6025a58183003519af78dedb245360f3de5142b18458157866cbbcb123fd9585 WatchSource:0}: Error finding container 6025a58183003519af78dedb245360f3de5142b18458157866cbbcb123fd9585: Status 404 returned error can't find the container with id 6025a58183003519af78dedb245360f3de5142b18458157866cbbcb123fd9585
Jul 09 21:50:55.431055 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:55.430623    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01708989_c414_4c1b_9886_4d47eb929be1.slice/crio-579e4b76a766f0131d0256401d50a1d6cc9bbb33c4ed1c9b36900a50c9285184 WatchSource:0}: Error finding container 579e4b76a766f0131d0256401d50a1d6cc9bbb33c4ed1c9b36900a50c9285184: Status 404 returned error can't find the container with id 579e4b76a766f0131d0256401d50a1d6cc9bbb33c4ed1c9b36900a50c9285184
Jul 09 21:50:55.432507 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.431871    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wl4xh"
Jul 09 21:50:55.447080 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:55.447012    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod469ca9e2_ec48_4e51_83e0_e1daa87df6d9.slice/crio-3e5e6873544bb0323264d429a008be1cb0ce07545d0251ce21b7dbdf73d046a3 WatchSource:0}: Error finding container 3e5e6873544bb0323264d429a008be1cb0ce07545d0251ce21b7dbdf73d046a3: Status 404 returned error can't find the container with id 3e5e6873544bb0323264d429a008be1cb0ce07545d0251ce21b7dbdf73d046a3
Jul 09 21:50:55.450834 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:55.450589    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf26b1dbc_6be7_4c4c_9d63_a5d7a676680a.slice/crio-d7b762e9986b409f2ac7a3368e0f56e1898581fedf673f992b510c4917991942 WatchSource:0}: Error finding container d7b762e9986b409f2ac7a3368e0f56e1898581fedf673f992b510c4917991942: Status 404 returned error can't find the container with id d7b762e9986b409f2ac7a3368e0f56e1898581fedf673f992b510c4917991942
Jul 09 21:50:55.457864 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:50:55.457828    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod152b4cf8_f137_4a3c_bc4b_de033cc018b8.slice/crio-4a025b9f8fbec71254486fe7b7a544256a5866e9918eeba55bb8eab38f710d52 WatchSource:0}: Error finding container 4a025b9f8fbec71254486fe7b7a544256a5866e9918eeba55bb8eab38f710d52: Status 404 returned error can't find the container with id 4a025b9f8fbec71254486fe7b7a544256a5866e9918eeba55bb8eab38f710d52
Jul 09 21:50:55.807296 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.807199    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b99eef2e-6748-4460-bd07-1f99729b663c-metrics-certs\") pod \"network-metrics-daemon-l49xl\" (UID: \"b99eef2e-6748-4460-bd07-1f99729b663c\") " pod="openshift-multus/network-metrics-daemon-l49xl"
Jul 09 21:50:55.807296 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.807289    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/442ba0c0-0b9e-4918-b8a6-c93618456a92-original-pull-secret\") pod \"global-pull-secret-syncer-fjm26\" (UID: \"442ba0c0-0b9e-4918-b8a6-c93618456a92\") " pod="kube-system/global-pull-secret-syncer-fjm26"
Jul 09 21:50:55.807519 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:55.807392    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 21:50:55.807519 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:55.807412    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 21:50:55.807519 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:55.807476    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b99eef2e-6748-4460-bd07-1f99729b663c-metrics-certs podName:b99eef2e-6748-4460-bd07-1f99729b663c nodeName:}" failed. No retries permitted until 2026-07-09 21:50:56.807453455 +0000 UTC m=+4.138953527 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b99eef2e-6748-4460-bd07-1f99729b663c-metrics-certs") pod "network-metrics-daemon-l49xl" (UID: "b99eef2e-6748-4460-bd07-1f99729b663c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 21:50:55.807661 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:55.807564    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/442ba0c0-0b9e-4918-b8a6-c93618456a92-original-pull-secret podName:442ba0c0-0b9e-4918-b8a6-c93618456a92 nodeName:}" failed. No retries permitted until 2026-07-09 21:50:56.807546355 +0000 UTC m=+4.139046431 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/442ba0c0-0b9e-4918-b8a6-c93618456a92-original-pull-secret") pod "global-pull-secret-syncer-fjm26" (UID: "442ba0c0-0b9e-4918-b8a6-c93618456a92") : object "kube-system"/"original-pull-secret" not registered
Jul 09 21:50:55.908136 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:55.908095    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vdft\" (UniqueName: \"kubernetes.io/projected/daa318c8-a79e-4833-8022-26e9db42aaa9-kube-api-access-7vdft\") pod \"network-check-target-gpncs\" (UID: \"daa318c8-a79e-4833-8022-26e9db42aaa9\") " pod="openshift-network-diagnostics/network-check-target-gpncs"
Jul 09 21:50:55.908347 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:55.908324    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 21:50:55.908347 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:55.908346    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 21:50:55.908525 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:55.908361    2576 projected.go:196] Error preparing data for projected volume kube-api-access-7vdft for pod openshift-network-diagnostics/network-check-target-gpncs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 21:50:55.908525 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:55.908425    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/daa318c8-a79e-4833-8022-26e9db42aaa9-kube-api-access-7vdft podName:daa318c8-a79e-4833-8022-26e9db42aaa9 nodeName:}" failed. No retries permitted until 2026-07-09 21:50:56.90840532 +0000 UTC m=+4.239905396 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7vdft" (UniqueName: "kubernetes.io/projected/daa318c8-a79e-4833-8022-26e9db42aaa9-kube-api-access-7vdft") pod "network-check-target-gpncs" (UID: "daa318c8-a79e-4833-8022-26e9db42aaa9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 21:50:56.136390 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:56.136271    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 21:45:55 +0000 UTC" deadline="2027-12-08 11:13:37.823071744 +0000 UTC"
Jul 09 21:50:56.136390 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:56.136343    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12397h22m41.686733421s"
Jul 09 21:50:56.195125 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:56.195091    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjm26"
Jul 09 21:50:56.195294 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:56.195230    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjm26" podUID="442ba0c0-0b9e-4918-b8a6-c93618456a92"
Jul 09 21:50:56.224076 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:56.224019    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hv6qq" event={"ID":"469ca9e2-ec48-4e51-83e0-e1daa87df6d9","Type":"ContainerStarted","Data":"3e5e6873544bb0323264d429a008be1cb0ce07545d0251ce21b7dbdf73d046a3"}
Jul 09 21:50:56.232123 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:56.232083    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7tq48" event={"ID":"bc33c68c-1261-400d-991e-308f24c9210b","Type":"ContainerStarted","Data":"be10797911def46278dd8bedffb9ee72624a6d78fb50d206f77dba21272c35c5"}
Jul 09 21:50:56.248887 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:56.248842    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fxmvw" event={"ID":"06b11cb1-4d06-48b8-a010-c79c999bfec2","Type":"ContainerStarted","Data":"279ad4dff0aed07de9927c63b22bc91df8d719f8b9792515ad2d08758b784966"}
Jul 09 21:50:56.250934 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:56.250899    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wl4xh" event={"ID":"152b4cf8-f137-4a3c-bc4b-de033cc018b8","Type":"ContainerStarted","Data":"4a025b9f8fbec71254486fe7b7a544256a5866e9918eeba55bb8eab38f710d52"}
Jul 09 21:50:56.257829 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:56.257795    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwd8h" event={"ID":"f26b1dbc-6be7-4c4c-9d63-a5d7a676680a","Type":"ContainerStarted","Data":"d7b762e9986b409f2ac7a3368e0f56e1898581fedf673f992b510c4917991942"}
Jul 09 21:50:56.262638 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:56.262561    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-t97wx" event={"ID":"01708989-c414-4c1b-9886-4d47eb929be1","Type":"ContainerStarted","Data":"579e4b76a766f0131d0256401d50a1d6cc9bbb33c4ed1c9b36900a50c9285184"}
Jul 09 21:50:56.266263 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:56.266167    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fvncf" event={"ID":"7130e58c-a513-4666-8938-c16760ff494c","Type":"ContainerStarted","Data":"6025a58183003519af78dedb245360f3de5142b18458157866cbbcb123fd9585"}
Jul 09 21:50:56.276349 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:56.276314    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qngdz" event={"ID":"31a02e15-5a13-4e04-a0ba-8e5667bd9420","Type":"ContainerStarted","Data":"e63cd44e3aec359b4866c9f0f9c1e2c75964ac5684cb63f6add9f8cfbc498f21"}
Jul 09 21:50:56.284401 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:56.284358    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27vrn" event={"ID":"10510741-9c12-4044-ac11-97958aa1fc35","Type":"ContainerStarted","Data":"86e5dc2561542c1f1b4efa981f6adb23e75ac9c41c95276aaca818c44df316c4"}
Jul 09 21:50:56.816348 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:56.816303    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b99eef2e-6748-4460-bd07-1f99729b663c-metrics-certs\") pod \"network-metrics-daemon-l49xl\" (UID: \"b99eef2e-6748-4460-bd07-1f99729b663c\") " pod="openshift-multus/network-metrics-daemon-l49xl"
Jul 09 21:50:56.816560 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:56.816415    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/442ba0c0-0b9e-4918-b8a6-c93618456a92-original-pull-secret\") pod \"global-pull-secret-syncer-fjm26\" (UID: \"442ba0c0-0b9e-4918-b8a6-c93618456a92\") " pod="kube-system/global-pull-secret-syncer-fjm26"
Jul 09 21:50:56.816637 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:56.816594    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 21:50:56.816694 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:56.816671    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/442ba0c0-0b9e-4918-b8a6-c93618456a92-original-pull-secret podName:442ba0c0-0b9e-4918-b8a6-c93618456a92 nodeName:}" failed. No retries permitted until 2026-07-09 21:50:58.816648012 +0000 UTC m=+6.148148088 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/442ba0c0-0b9e-4918-b8a6-c93618456a92-original-pull-secret") pod "global-pull-secret-syncer-fjm26" (UID: "442ba0c0-0b9e-4918-b8a6-c93618456a92") : object "kube-system"/"original-pull-secret" not registered
Jul 09 21:50:56.816765 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:56.816741    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 21:50:56.816821 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:56.816781    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b99eef2e-6748-4460-bd07-1f99729b663c-metrics-certs podName:b99eef2e-6748-4460-bd07-1f99729b663c nodeName:}" failed. No retries permitted until 2026-07-09 21:50:58.816766568 +0000 UTC m=+6.148266641 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b99eef2e-6748-4460-bd07-1f99729b663c-metrics-certs") pod "network-metrics-daemon-l49xl" (UID: "b99eef2e-6748-4460-bd07-1f99729b663c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 21:50:56.917081 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:56.917030    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vdft\" (UniqueName: \"kubernetes.io/projected/daa318c8-a79e-4833-8022-26e9db42aaa9-kube-api-access-7vdft\") pod \"network-check-target-gpncs\" (UID: \"daa318c8-a79e-4833-8022-26e9db42aaa9\") " pod="openshift-network-diagnostics/network-check-target-gpncs"
Jul 09 21:50:56.917282 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:56.917202    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 21:50:56.917282 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:56.917240    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 21:50:56.917282 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:56.917255    2576 projected.go:196] Error preparing data for projected volume kube-api-access-7vdft for pod openshift-network-diagnostics/network-check-target-gpncs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 21:50:56.917456 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:56.917321    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/daa318c8-a79e-4833-8022-26e9db42aaa9-kube-api-access-7vdft podName:daa318c8-a79e-4833-8022-26e9db42aaa9 nodeName:}" failed. No retries permitted until 2026-07-09 21:50:58.91730041 +0000 UTC m=+6.248800472 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7vdft" (UniqueName: "kubernetes.io/projected/daa318c8-a79e-4833-8022-26e9db42aaa9-kube-api-access-7vdft") pod "network-check-target-gpncs" (UID: "daa318c8-a79e-4833-8022-26e9db42aaa9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 21:50:57.136682 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:57.136564    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 21:45:55 +0000 UTC" deadline="2028-02-03 15:10:46.747549183 +0000 UTC"
Jul 09 21:50:57.136682 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:57.136629    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13769h19m49.61092744s"
Jul 09 21:50:57.195668 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:57.195142    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gpncs"
Jul 09 21:50:57.195668 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:57.195275    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gpncs" podUID="daa318c8-a79e-4833-8022-26e9db42aaa9"
Jul 09 21:50:57.196217 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:57.196041    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l49xl"
Jul 09 21:50:57.196217 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:57.196169    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l49xl" podUID="b99eef2e-6748-4460-bd07-1f99729b663c"
Jul 09 21:50:58.194725 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:58.194636    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjm26"
Jul 09 21:50:58.195390 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:58.194784    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjm26" podUID="442ba0c0-0b9e-4918-b8a6-c93618456a92"
Jul 09 21:50:58.832519 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:58.832482    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b99eef2e-6748-4460-bd07-1f99729b663c-metrics-certs\") pod \"network-metrics-daemon-l49xl\" (UID: \"b99eef2e-6748-4460-bd07-1f99729b663c\") " pod="openshift-multus/network-metrics-daemon-l49xl"
Jul 09 21:50:58.832682 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:58.832577    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/442ba0c0-0b9e-4918-b8a6-c93618456a92-original-pull-secret\") pod \"global-pull-secret-syncer-fjm26\" (UID: \"442ba0c0-0b9e-4918-b8a6-c93618456a92\") " pod="kube-system/global-pull-secret-syncer-fjm26"
Jul 09 21:50:58.832752 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:58.832730    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 21:50:58.832813 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:58.832795    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/442ba0c0-0b9e-4918-b8a6-c93618456a92-original-pull-secret podName:442ba0c0-0b9e-4918-b8a6-c93618456a92 nodeName:}" failed. No retries permitted until 2026-07-09 21:51:02.832776997 +0000 UTC m=+10.164277066 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/442ba0c0-0b9e-4918-b8a6-c93618456a92-original-pull-secret") pod "global-pull-secret-syncer-fjm26" (UID: "442ba0c0-0b9e-4918-b8a6-c93618456a92") : object "kube-system"/"original-pull-secret" not registered
Jul 09 21:50:58.833250 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:58.833228    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 21:50:58.833331 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:58.833288    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b99eef2e-6748-4460-bd07-1f99729b663c-metrics-certs podName:b99eef2e-6748-4460-bd07-1f99729b663c nodeName:}" failed. No retries permitted until 2026-07-09 21:51:02.833272382 +0000 UTC m=+10.164772451 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b99eef2e-6748-4460-bd07-1f99729b663c-metrics-certs") pod "network-metrics-daemon-l49xl" (UID: "b99eef2e-6748-4460-bd07-1f99729b663c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 21:50:58.933303 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:58.933268    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vdft\" (UniqueName: \"kubernetes.io/projected/daa318c8-a79e-4833-8022-26e9db42aaa9-kube-api-access-7vdft\") pod \"network-check-target-gpncs\" (UID: \"daa318c8-a79e-4833-8022-26e9db42aaa9\") " pod="openshift-network-diagnostics/network-check-target-gpncs"
Jul 09 21:50:58.933494 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:58.933473    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 21:50:58.933568 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:58.933499    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 21:50:58.933568 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:58.933514    2576 projected.go:196] Error preparing data for projected volume kube-api-access-7vdft for pod openshift-network-diagnostics/network-check-target-gpncs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 21:50:58.933670 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:58.933576    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/daa318c8-a79e-4833-8022-26e9db42aaa9-kube-api-access-7vdft podName:daa318c8-a79e-4833-8022-26e9db42aaa9 nodeName:}" failed. No retries permitted until 2026-07-09 21:51:02.933558622 +0000 UTC m=+10.265058682 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7vdft" (UniqueName: "kubernetes.io/projected/daa318c8-a79e-4833-8022-26e9db42aaa9-kube-api-access-7vdft") pod "network-check-target-gpncs" (UID: "daa318c8-a79e-4833-8022-26e9db42aaa9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 21:50:59.195070 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:59.194988    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gpncs"
Jul 09 21:50:59.195070 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:50:59.195044    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l49xl"
Jul 09 21:50:59.195597 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:59.195114    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gpncs" podUID="daa318c8-a79e-4833-8022-26e9db42aaa9"
Jul 09 21:50:59.195597 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:50:59.195317    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l49xl" podUID="b99eef2e-6748-4460-bd07-1f99729b663c"
Jul 09 21:51:00.194614 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:00.194514    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjm26"
Jul 09 21:51:00.195210 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:00.194778    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjm26" podUID="442ba0c0-0b9e-4918-b8a6-c93618456a92"
Jul 09 21:51:01.194853 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:01.194795    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gpncs"
Jul 09 21:51:01.195074 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:01.194931    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gpncs" podUID="daa318c8-a79e-4833-8022-26e9db42aaa9"
Jul 09 21:51:01.195254 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:01.195224    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l49xl"
Jul 09 21:51:01.195652 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:01.195355    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l49xl" podUID="b99eef2e-6748-4460-bd07-1f99729b663c"
Jul 09 21:51:02.194937 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:02.194898    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjm26"
Jul 09 21:51:02.195156 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:02.195044    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjm26" podUID="442ba0c0-0b9e-4918-b8a6-c93618456a92"
Jul 09 21:51:02.862692 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:02.862656    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b99eef2e-6748-4460-bd07-1f99729b663c-metrics-certs\") pod \"network-metrics-daemon-l49xl\" (UID: \"b99eef2e-6748-4460-bd07-1f99729b663c\") " pod="openshift-multus/network-metrics-daemon-l49xl"
Jul 09 21:51:02.863186 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:02.862744    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/442ba0c0-0b9e-4918-b8a6-c93618456a92-original-pull-secret\") pod \"global-pull-secret-syncer-fjm26\" (UID: \"442ba0c0-0b9e-4918-b8a6-c93618456a92\") " pod="kube-system/global-pull-secret-syncer-fjm26"
Jul 09 21:51:02.863186 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:02.862806    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 21:51:02.863186 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:02.862824    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 21:51:02.863186 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:02.862871    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/442ba0c0-0b9e-4918-b8a6-c93618456a92-original-pull-secret podName:442ba0c0-0b9e-4918-b8a6-c93618456a92 nodeName:}" failed. No retries permitted until 2026-07-09 21:51:10.862854158 +0000 UTC m=+18.194354215 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/442ba0c0-0b9e-4918-b8a6-c93618456a92-original-pull-secret") pod "global-pull-secret-syncer-fjm26" (UID: "442ba0c0-0b9e-4918-b8a6-c93618456a92") : object "kube-system"/"original-pull-secret" not registered
Jul 09 21:51:02.863186 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:02.862890    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b99eef2e-6748-4460-bd07-1f99729b663c-metrics-certs podName:b99eef2e-6748-4460-bd07-1f99729b663c nodeName:}" failed. No retries permitted until 2026-07-09 21:51:10.862880137 +0000 UTC m=+18.194380199 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b99eef2e-6748-4460-bd07-1f99729b663c-metrics-certs") pod "network-metrics-daemon-l49xl" (UID: "b99eef2e-6748-4460-bd07-1f99729b663c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 21:51:02.963458 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:02.963397    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vdft\" (UniqueName: \"kubernetes.io/projected/daa318c8-a79e-4833-8022-26e9db42aaa9-kube-api-access-7vdft\") pod \"network-check-target-gpncs\" (UID: \"daa318c8-a79e-4833-8022-26e9db42aaa9\") " pod="openshift-network-diagnostics/network-check-target-gpncs"
Jul 09 21:51:02.963639 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:02.963616    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 21:51:02.963710 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:02.963647    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 21:51:02.963710 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:02.963662    2576 projected.go:196] Error preparing data for projected volume kube-api-access-7vdft for pod openshift-network-diagnostics/network-check-target-gpncs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 21:51:02.963808 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:02.963732    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/daa318c8-a79e-4833-8022-26e9db42aaa9-kube-api-access-7vdft podName:daa318c8-a79e-4833-8022-26e9db42aaa9 nodeName:}" failed. No retries permitted until 2026-07-09 21:51:10.963712065 +0000 UTC m=+18.295212131 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7vdft" (UniqueName: "kubernetes.io/projected/daa318c8-a79e-4833-8022-26e9db42aaa9-kube-api-access-7vdft") pod "network-check-target-gpncs" (UID: "daa318c8-a79e-4833-8022-26e9db42aaa9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 21:51:03.195862 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:03.195196    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gpncs"
Jul 09 21:51:03.195862 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:03.195308    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gpncs" podUID="daa318c8-a79e-4833-8022-26e9db42aaa9"
Jul 09 21:51:03.195862 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:03.195663    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l49xl"
Jul 09 21:51:03.195862 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:03.195766    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l49xl" podUID="b99eef2e-6748-4460-bd07-1f99729b663c"
Jul 09 21:51:04.194569 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:04.194526    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjm26"
Jul 09 21:51:04.194995 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:04.194664    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjm26" podUID="442ba0c0-0b9e-4918-b8a6-c93618456a92"
Jul 09 21:51:05.195387 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:05.194829    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l49xl"
Jul 09 21:51:05.195387 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:05.194830    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gpncs"
Jul 09 21:51:05.195387 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:05.195004    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l49xl" podUID="b99eef2e-6748-4460-bd07-1f99729b663c"
Jul 09 21:51:05.195387 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:05.195068    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gpncs" podUID="daa318c8-a79e-4833-8022-26e9db42aaa9"
Jul 09 21:51:06.194461 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:06.194423    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjm26"
Jul 09 21:51:06.194644 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:06.194559    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjm26" podUID="442ba0c0-0b9e-4918-b8a6-c93618456a92"
Jul 09 21:51:07.194664 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:07.194631    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gpncs"
Jul 09 21:51:07.195091 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:07.194740    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gpncs" podUID="daa318c8-a79e-4833-8022-26e9db42aaa9"
Jul 09 21:51:07.195091 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:07.194631    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l49xl"
Jul 09 21:51:07.195200 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:07.195103    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l49xl" podUID="b99eef2e-6748-4460-bd07-1f99729b663c"
Jul 09 21:51:08.194274 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:08.194238    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjm26"
Jul 09 21:51:08.194447 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:08.194364    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjm26" podUID="442ba0c0-0b9e-4918-b8a6-c93618456a92"
Jul 09 21:51:09.194210 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:09.194164    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l49xl"
Jul 09 21:51:09.194210 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:09.194177    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gpncs"
Jul 09 21:51:09.194697 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:09.194290    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l49xl" podUID="b99eef2e-6748-4460-bd07-1f99729b663c"
Jul 09 21:51:09.194697 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:09.194416    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gpncs" podUID="daa318c8-a79e-4833-8022-26e9db42aaa9"
Jul 09 21:51:10.194286 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:10.194251    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjm26"
Jul 09 21:51:10.194688 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:10.194363    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjm26" podUID="442ba0c0-0b9e-4918-b8a6-c93618456a92"
Jul 09 21:51:10.924843 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:10.924762    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b99eef2e-6748-4460-bd07-1f99729b663c-metrics-certs\") pod \"network-metrics-daemon-l49xl\" (UID: \"b99eef2e-6748-4460-bd07-1f99729b663c\") " pod="openshift-multus/network-metrics-daemon-l49xl"
Jul 09 21:51:10.925058 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:10.924851    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/442ba0c0-0b9e-4918-b8a6-c93618456a92-original-pull-secret\") pod \"global-pull-secret-syncer-fjm26\" (UID: \"442ba0c0-0b9e-4918-b8a6-c93618456a92\") " pod="kube-system/global-pull-secret-syncer-fjm26"
Jul 09 21:51:10.925058 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:10.924919    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 21:51:10.925058 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:10.924988    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b99eef2e-6748-4460-bd07-1f99729b663c-metrics-certs podName:b99eef2e-6748-4460-bd07-1f99729b663c nodeName:}" failed. No retries permitted until 2026-07-09 21:51:26.92496988 +0000 UTC m=+34.256469949 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b99eef2e-6748-4460-bd07-1f99729b663c-metrics-certs") pod "network-metrics-daemon-l49xl" (UID: "b99eef2e-6748-4460-bd07-1f99729b663c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 21:51:10.925058 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:10.924984    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 21:51:10.925058 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:10.925045    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/442ba0c0-0b9e-4918-b8a6-c93618456a92-original-pull-secret podName:442ba0c0-0b9e-4918-b8a6-c93618456a92 nodeName:}" failed. No retries permitted until 2026-07-09 21:51:26.925028909 +0000 UTC m=+34.256528985 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/442ba0c0-0b9e-4918-b8a6-c93618456a92-original-pull-secret") pod "global-pull-secret-syncer-fjm26" (UID: "442ba0c0-0b9e-4918-b8a6-c93618456a92") : object "kube-system"/"original-pull-secret" not registered
Jul 09 21:51:11.025853 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:11.025820    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vdft\" (UniqueName: \"kubernetes.io/projected/daa318c8-a79e-4833-8022-26e9db42aaa9-kube-api-access-7vdft\") pod \"network-check-target-gpncs\" (UID: \"daa318c8-a79e-4833-8022-26e9db42aaa9\") " pod="openshift-network-diagnostics/network-check-target-gpncs"
Jul 09 21:51:11.026034 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:11.025949    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 21:51:11.026034 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:11.025985    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 21:51:11.026034 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:11.025996    2576 projected.go:196] Error preparing data for projected volume kube-api-access-7vdft for pod openshift-network-diagnostics/network-check-target-gpncs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 21:51:11.026153 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:11.026054    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/daa318c8-a79e-4833-8022-26e9db42aaa9-kube-api-access-7vdft podName:daa318c8-a79e-4833-8022-26e9db42aaa9 nodeName:}" failed. No retries permitted until 2026-07-09 21:51:27.026035937 +0000 UTC m=+34.357536009 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7vdft" (UniqueName: "kubernetes.io/projected/daa318c8-a79e-4833-8022-26e9db42aaa9-kube-api-access-7vdft") pod "network-check-target-gpncs" (UID: "daa318c8-a79e-4833-8022-26e9db42aaa9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 21:51:11.194446 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:11.194372    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l49xl"
Jul 09 21:51:11.194848 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:11.194481    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l49xl" podUID="b99eef2e-6748-4460-bd07-1f99729b663c"
Jul 09 21:51:11.194848 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:11.194548    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gpncs"
Jul 09 21:51:11.194848 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:11.194666    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gpncs" podUID="daa318c8-a79e-4833-8022-26e9db42aaa9"
Jul 09 21:51:12.194845 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:12.194815    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjm26"
Jul 09 21:51:12.195252 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:12.194934    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjm26" podUID="442ba0c0-0b9e-4918-b8a6-c93618456a92"
Jul 09 21:51:13.195690 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:13.195619    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l49xl"
Jul 09 21:51:13.196194 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:13.195749    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l49xl" podUID="b99eef2e-6748-4460-bd07-1f99729b663c"
Jul 09 21:51:13.196194 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:13.195761    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gpncs"
Jul 09 21:51:13.196194 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:13.195887    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gpncs" podUID="daa318c8-a79e-4833-8022-26e9db42aaa9"
Jul 09 21:51:14.194598 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:14.194557    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjm26"
Jul 09 21:51:14.194773 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:14.194668    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjm26" podUID="442ba0c0-0b9e-4918-b8a6-c93618456a92"
Jul 09 21:51:15.197976 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:15.197738    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gpncs"
Jul 09 21:51:15.198486 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:15.197772    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l49xl"
Jul 09 21:51:15.198486 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:15.198077    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gpncs" podUID="daa318c8-a79e-4833-8022-26e9db42aaa9"
Jul 09 21:51:15.198486 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:15.198159    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l49xl" podUID="b99eef2e-6748-4460-bd07-1f99729b663c"
Jul 09 21:51:15.342628 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:15.342594    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-101.ec2.internal" event={"ID":"91fa6d5fff63c7ad729649847f11496f","Type":"ContainerStarted","Data":"1d33473ca2fd6046475fb15576dc7fe51cf76e52e9ad81f8ed81fdea17ff4471"}
Jul 09 21:51:15.344262 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:15.344209    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hv6qq" event={"ID":"469ca9e2-ec48-4e51-83e0-e1daa87df6d9","Type":"ContainerStarted","Data":"66b86334d2e7b54e994cb3a94d319cb0b080a55433e60f969dc632b67219d1e0"}
Jul 09 21:51:15.345847 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:15.345823    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-t97wx" event={"ID":"01708989-c414-4c1b-9886-4d47eb929be1","Type":"ContainerStarted","Data":"748c9773efb4898d508bbf3ac21e6348fa47b80ac8625676877825d5d2acd9a9"}
Jul 09 21:51:15.360914 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:15.360875    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-101.ec2.internal" podStartSLOduration=21.36086416 podStartE2EDuration="21.36086416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 21:50:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:51:15.360624904 +0000 UTC m=+22.692124982" watchObservedRunningTime="2026-07-09 21:51:15.36086416 +0000 UTC m=+22.692364238"
Jul 09 21:51:15.393673 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:15.393640    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-t97wx" podStartSLOduration=3.148744963 podStartE2EDuration="22.393628823s" totalImagesPullingTime="19.24488386s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 21:50:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:51:15.393571329 +0000 UTC m=+22.725071407" watchObservedRunningTime="2026-07-09 21:51:15.393628823 +0000 UTC m=+22.725128902"
Jul 09 21:51:15.393786 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:15.393768    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hv6qq" podStartSLOduration=3.110874767 podStartE2EDuration="22.393764658s" totalImagesPullingTime="19.282889891s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 21:50:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:51:15.378180749 +0000 UTC m=+22.709680828" watchObservedRunningTime="2026-07-09 21:51:15.393764658 +0000 UTC m=+22.725264735"
Jul 09 21:51:16.194664 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:16.194499    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjm26"
Jul 09 21:51:16.194821 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:16.194732    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjm26" podUID="442ba0c0-0b9e-4918-b8a6-c93618456a92"
Jul 09 21:51:16.349941 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:16.349651    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fvncf" event={"ID":"7130e58c-a513-4666-8938-c16760ff494c","Type":"ContainerStarted","Data":"39b615f70c64f67f1ff1521f811be3fac9ad91163fa354c7475a9140261cc17a"}
Jul 09 21:51:16.351393 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:16.351363    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qngdz" event={"ID":"31a02e15-5a13-4e04-a0ba-8e5667bd9420","Type":"ContainerStarted","Data":"851aea4aedfdcb6270b03a08c43755ccde70af014c0cac05d210b0c9303d12ae"}
Jul 09 21:51:16.354612 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:16.354595    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27vrn_10510741-9c12-4044-ac11-97958aa1fc35/ovn-acl-logging/0.log"
Jul 09 21:51:16.355000 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:16.354981    2576 generic.go:356] "Generic (PLEG): container finished" podID="10510741-9c12-4044-ac11-97958aa1fc35" containerID="7770aca733ca029c40218a6f3de997b4bc667b1986fdf28846ec5f899d9daefa" exitCode=1
Jul 09 21:51:16.355112 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:16.355034    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27vrn" event={"ID":"10510741-9c12-4044-ac11-97958aa1fc35","Type":"ContainerStarted","Data":"3535f0c4b50f70210e04d761349161c9c41ac21aa6e25685af2f42ae518a26b3"}
Jul 09 21:51:16.355178 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:16.355123    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27vrn" event={"ID":"10510741-9c12-4044-ac11-97958aa1fc35","Type":"ContainerStarted","Data":"590f6684b7c798b5d7b0ab46eb06eea11eaf4829cb64ed7b5f8f8a8e6917a77f"}
Jul 09 21:51:16.355234 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:16.355177    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27vrn" event={"ID":"10510741-9c12-4044-ac11-97958aa1fc35","Type":"ContainerStarted","Data":"d2a89d9f8877848f624a499b19506a1bca725dc576f2d1c62eea5b924adfb060"}
Jul 09 21:51:16.355234 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:16.355225    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27vrn" event={"ID":"10510741-9c12-4044-ac11-97958aa1fc35","Type":"ContainerStarted","Data":"4c051856d64e2dad7d9cfee7e22b57403a9bc8bcaa9efee1afcbcfd1888a2647"}
Jul 09 21:51:16.355340 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:16.355273    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27vrn" event={"ID":"10510741-9c12-4044-ac11-97958aa1fc35","Type":"ContainerDied","Data":"7770aca733ca029c40218a6f3de997b4bc667b1986fdf28846ec5f899d9daefa"}
Jul 09 21:51:16.355340 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:16.355323    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27vrn" event={"ID":"10510741-9c12-4044-ac11-97958aa1fc35","Type":"ContainerStarted","Data":"7161531ab1dc2dee2ee85f9321c5960e4d5bf2b361815cd6541e61004e99e8af"}
Jul 09 21:51:16.356698 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:16.356675    2576 generic.go:356] "Generic (PLEG): container finished" podID="9b04859f560db6d117b4ad45ac0045f2" containerID="c253ec9635ce4fd4c4c8955b2212f65563e2b96995aaf25c008c5f4d23f62c64" exitCode=0
Jul 09 21:51:16.356798 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:16.356769    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal" event={"ID":"9b04859f560db6d117b4ad45ac0045f2","Type":"ContainerDied","Data":"c253ec9635ce4fd4c4c8955b2212f65563e2b96995aaf25c008c5f4d23f62c64"}
Jul 09 21:51:16.358706 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:16.358676    2576 generic.go:356] "Generic (PLEG): container finished" podID="bc33c68c-1261-400d-991e-308f24c9210b" containerID="8118545070a7a1fce8456a9548a2a878097157400b07544adb5426d2895d1dc3" exitCode=0
Jul 09 21:51:16.358813 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:16.358763    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7tq48" event={"ID":"bc33c68c-1261-400d-991e-308f24c9210b","Type":"ContainerDied","Data":"8118545070a7a1fce8456a9548a2a878097157400b07544adb5426d2895d1dc3"}
Jul 09 21:51:16.361114 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:16.361078    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fxmvw" event={"ID":"06b11cb1-4d06-48b8-a010-c79c999bfec2","Type":"ContainerStarted","Data":"ba7981592ab3eb9b2a28b2f7849d5bb96b05dd0b1dce4094d63575a957a6922c"}
Jul 09 21:51:16.362776 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:16.362753    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wl4xh" event={"ID":"152b4cf8-f137-4a3c-bc4b-de033cc018b8","Type":"ContainerStarted","Data":"312ec9b6e70afafa30a80f3f37d82749c5862941e92c1e05dd70008a9c5dd844"}
Jul 09 21:51:16.364714 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:16.364633    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwd8h" event={"ID":"f26b1dbc-6be7-4c4c-9d63-a5d7a676680a","Type":"ContainerStarted","Data":"abde6da96e04140b0261401e6c71677b0cdf1f6a2887640f8c623a3dfcf2cd0c"}
Jul 09 21:51:16.365390 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:16.365287    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-fvncf" podStartSLOduration=4.124625702 podStartE2EDuration="23.365271038s" totalImagesPullingTime="19.240645336s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 21:50:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:51:16.364430421 +0000 UTC m=+23.695930501" watchObservedRunningTime="2026-07-09 21:51:16.365271038 +0000 UTC m=+23.696771116"
Jul 09 21:51:16.407679 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:16.407600    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wl4xh" podStartSLOduration=4.187449485 podStartE2EDuration="23.407580908s" totalImagesPullingTime="19.220131423s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 21:50:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:51:16.406908521 +0000 UTC m=+23.738408596" watchObservedRunningTime="2026-07-09 21:51:16.407580908 +0000 UTC m=+23.739080987"
Jul 09 21:51:16.407842 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:16.407780    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fxmvw" podStartSLOduration=4.121611468 podStartE2EDuration="23.407768549s" totalImagesPullingTime="19.286157081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 21:50:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:51:16.393276963 +0000 UTC m=+23.724777042" watchObservedRunningTime="2026-07-09 21:51:16.407768549 +0000 UTC m=+23.739268635"
Jul 09 21:51:16.443439 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:16.443099    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qngdz" podStartSLOduration=4.189757148 podStartE2EDuration="23.443078153s" totalImagesPullingTime="19.253321005s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 21:50:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:51:16.442617303 +0000 UTC m=+23.774117381" watchObservedRunningTime="2026-07-09 21:51:16.443078153 +0000 UTC m=+23.774578232"
Jul 09 21:51:17.071787 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:17.071740    2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 09 21:51:17.197950 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:17.197821    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gpncs"
Jul 09 21:51:17.197950 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:17.197821    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l49xl"
Jul 09 21:51:17.197950 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:17.197938    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gpncs" podUID="daa318c8-a79e-4833-8022-26e9db42aaa9"
Jul 09 21:51:17.198342 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:17.198064    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l49xl" podUID="b99eef2e-6748-4460-bd07-1f99729b663c"
Jul 09 21:51:17.210794 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:17.210716    2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T21:51:17.071758832Z","UUID":"4c381ccf-be52-464a-b632-cb691c594902","Handler":null,"Name":"","Endpoint":""}
Jul 09 21:51:17.213507 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:17.213487    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 09 21:51:17.213634 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:17.213524    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 09 21:51:17.368252 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:17.368217    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal" event={"ID":"9b04859f560db6d117b4ad45ac0045f2","Type":"ContainerStarted","Data":"6f312ea5b0c428ff4dcccddc839293081aff3c304ca0d2dfbbcc9065db91ae38"}
Jul 09 21:51:17.369982 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:17.369941    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwd8h" event={"ID":"f26b1dbc-6be7-4c4c-9d63-a5d7a676680a","Type":"ContainerStarted","Data":"8d73eb7a3d72cc29a027160938c437484da51ff5cd759d5c2060914ba545ba60"}
Jul 09 21:51:17.382490 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:17.382451    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-101.ec2.internal" podStartSLOduration=23.382438788 podStartE2EDuration="23.382438788s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 21:50:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:51:17.382144984 +0000 UTC m=+24.713645063" watchObservedRunningTime="2026-07-09 21:51:17.382438788 +0000 UTC m=+24.713938867"
Jul 09 21:51:18.195117 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:18.195085    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjm26"
Jul 09 21:51:18.195303 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:18.195211    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjm26" podUID="442ba0c0-0b9e-4918-b8a6-c93618456a92"
Jul 09 21:51:18.376854 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:18.376781    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27vrn_10510741-9c12-4044-ac11-97958aa1fc35/ovn-acl-logging/0.log"
Jul 09 21:51:18.377363 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:18.377336    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27vrn" event={"ID":"10510741-9c12-4044-ac11-97958aa1fc35","Type":"ContainerStarted","Data":"be18957d060b841592c3d0d1e70b7b25bffe2b4ee882d949f07f5519c3c587b0"}
Jul 09 21:51:18.379382 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:18.379358    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwd8h" event={"ID":"f26b1dbc-6be7-4c4c-9d63-a5d7a676680a","Type":"ContainerStarted","Data":"e7ea35396fd34e77d240d8f645eb69dc18ae6c71e3dde9e67f46682a27b8deb8"}
Jul 09 21:51:18.397317 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:18.397273    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kwd8h" podStartSLOduration=4.106702949 podStartE2EDuration="25.397259706s" totalImagesPullingTime="21.290556757s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 21:50:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:51:18.397033433 +0000 UTC m=+25.728533511" watchObservedRunningTime="2026-07-09 21:51:18.397259706 +0000 UTC m=+25.728759783"
Jul 09 21:51:19.194786 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:19.194753    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l49xl"
Jul 09 21:51:19.194976 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:19.194757    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gpncs"
Jul 09 21:51:19.194976 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:19.194883    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l49xl" podUID="b99eef2e-6748-4460-bd07-1f99729b663c"
Jul 09 21:51:19.194976 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:19.194934    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gpncs" podUID="daa318c8-a79e-4833-8022-26e9db42aaa9"
Jul 09 21:51:20.194629 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:20.194596    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjm26"
Jul 09 21:51:20.195052 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:20.194718    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjm26" podUID="442ba0c0-0b9e-4918-b8a6-c93618456a92"
Jul 09 21:51:20.636113 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:20.636025    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fxmvw"
Jul 09 21:51:20.636719 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:20.636700    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fxmvw"
Jul 09 21:51:21.195088 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:21.195052    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gpncs"
Jul 09 21:51:21.195539 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:21.195058    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l49xl"
Jul 09 21:51:21.195539 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:21.195191    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gpncs" podUID="daa318c8-a79e-4833-8022-26e9db42aaa9"
Jul 09 21:51:21.195539 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:21.195265    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l49xl" podUID="b99eef2e-6748-4460-bd07-1f99729b663c"
Jul 09 21:51:21.386585 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:21.386551    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fxmvw"
Jul 09 21:51:21.387203 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:21.387179    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fxmvw"
Jul 09 21:51:22.194877 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:22.194705    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjm26"
Jul 09 21:51:22.195115 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:22.194942    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjm26" podUID="442ba0c0-0b9e-4918-b8a6-c93618456a92"
Jul 09 21:51:22.391528 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:22.391460    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27vrn_10510741-9c12-4044-ac11-97958aa1fc35/ovn-acl-logging/0.log"
Jul 09 21:51:22.391838 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:22.391815    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27vrn" event={"ID":"10510741-9c12-4044-ac11-97958aa1fc35","Type":"ContainerStarted","Data":"35a4f4b8b2256cba0d3006c482044677fccddf56e165756ac03d592cd8142763"}
Jul 09 21:51:22.392091 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:22.392070    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:51:22.392211 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:22.392140    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:51:22.392211 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:22.392189    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:51:22.392326 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:22.392314    2576 scope.go:117] "RemoveContainer" containerID="7770aca733ca029c40218a6f3de997b4bc667b1986fdf28846ec5f899d9daefa"
Jul 09 21:51:22.394091 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:22.394065    2576 generic.go:356] "Generic (PLEG): container finished" podID="bc33c68c-1261-400d-991e-308f24c9210b" containerID="9107ed10c433c46cdc7629603d7c6a53fba3a15a2d2a67149873398adff84aac" exitCode=0
Jul 09 21:51:22.394189 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:22.394149    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7tq48" event={"ID":"bc33c68c-1261-400d-991e-308f24c9210b","Type":"ContainerDied","Data":"9107ed10c433c46cdc7629603d7c6a53fba3a15a2d2a67149873398adff84aac"}
Jul 09 21:51:22.409057 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:22.409031    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:51:22.409551 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:22.409537    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:51:23.195520 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:23.195289    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gpncs"
Jul 09 21:51:23.196101 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:23.195373    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l49xl"
Jul 09 21:51:23.196101 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:23.195588    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gpncs" podUID="daa318c8-a79e-4833-8022-26e9db42aaa9"
Jul 09 21:51:23.196101 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:23.195679    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l49xl" podUID="b99eef2e-6748-4460-bd07-1f99729b663c"
Jul 09 21:51:23.400410 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:23.400385    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27vrn_10510741-9c12-4044-ac11-97958aa1fc35/ovn-acl-logging/0.log"
Jul 09 21:51:23.400791 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:23.400764    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27vrn" event={"ID":"10510741-9c12-4044-ac11-97958aa1fc35","Type":"ContainerStarted","Data":"537048c3de61e95f8dad536899da79830ef09418b77b62d2e1587e762707fa6c"}
Jul 09 21:51:23.430934 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:23.430883    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-27vrn" podStartSLOduration=10.545122008 podStartE2EDuration="30.430867255s" totalImagesPullingTime="19.885745247s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 21:50:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:51:23.42895082 +0000 UTC m=+30.760450900" watchObservedRunningTime="2026-07-09 21:51:23.430867255 +0000 UTC m=+30.762367334"
Jul 09 21:51:23.744758 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:23.744676    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gpncs"]
Jul 09 21:51:23.744894 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:23.744798    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gpncs"
Jul 09 21:51:23.744894 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:23.744879    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gpncs" podUID="daa318c8-a79e-4833-8022-26e9db42aaa9"
Jul 09 21:51:23.748743 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:23.748717    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fjm26"]
Jul 09 21:51:23.748890 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:23.748824    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjm26"
Jul 09 21:51:23.748982 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:23.748913    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjm26" podUID="442ba0c0-0b9e-4918-b8a6-c93618456a92"
Jul 09 21:51:23.749378 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:23.749357    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l49xl"]
Jul 09 21:51:23.749484 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:23.749472    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l49xl"
Jul 09 21:51:23.749604 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:23.749578    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l49xl" podUID="b99eef2e-6748-4460-bd07-1f99729b663c"
Jul 09 21:51:24.404818 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:24.404790    2576 generic.go:356] "Generic (PLEG): container finished" podID="bc33c68c-1261-400d-991e-308f24c9210b" containerID="feb5987ed7ad4b9e491bf5302c8d0513f919340391ab16651a686f06f04626d3" exitCode=0
Jul 09 21:51:24.405208 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:24.404875    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7tq48" event={"ID":"bc33c68c-1261-400d-991e-308f24c9210b","Type":"ContainerDied","Data":"feb5987ed7ad4b9e491bf5302c8d0513f919340391ab16651a686f06f04626d3"}
Jul 09 21:51:25.195035 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:25.194942    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gpncs"
Jul 09 21:51:25.195229 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:25.194947    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l49xl"
Jul 09 21:51:25.195229 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:25.195064    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gpncs" podUID="daa318c8-a79e-4833-8022-26e9db42aaa9"
Jul 09 21:51:25.195229 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:25.195186    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l49xl" podUID="b99eef2e-6748-4460-bd07-1f99729b663c"
Jul 09 21:51:26.194937 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:26.194855    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjm26"
Jul 09 21:51:26.195298 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:26.194982    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjm26" podUID="442ba0c0-0b9e-4918-b8a6-c93618456a92"
Jul 09 21:51:26.411520 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:26.411484    2576 generic.go:356] "Generic (PLEG): container finished" podID="bc33c68c-1261-400d-991e-308f24c9210b" containerID="ce50698eb74cd16255b2e73f64cc28755ac572e0789a8e78c236e932beaf3a4d" exitCode=0
Jul 09 21:51:26.411676 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:26.411555    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7tq48" event={"ID":"bc33c68c-1261-400d-991e-308f24c9210b","Type":"ContainerDied","Data":"ce50698eb74cd16255b2e73f64cc28755ac572e0789a8e78c236e932beaf3a4d"}
Jul 09 21:51:26.943700 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:26.943593    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/442ba0c0-0b9e-4918-b8a6-c93618456a92-original-pull-secret\") pod \"global-pull-secret-syncer-fjm26\" (UID: \"442ba0c0-0b9e-4918-b8a6-c93618456a92\") " pod="kube-system/global-pull-secret-syncer-fjm26"
Jul 09 21:51:26.943700 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:26.943659    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b99eef2e-6748-4460-bd07-1f99729b663c-metrics-certs\") pod \"network-metrics-daemon-l49xl\" (UID: \"b99eef2e-6748-4460-bd07-1f99729b663c\") " pod="openshift-multus/network-metrics-daemon-l49xl"
Jul 09 21:51:26.943912 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:26.943743    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 21:51:26.943912 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:26.943770    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 21:51:26.943912 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:26.943811    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/442ba0c0-0b9e-4918-b8a6-c93618456a92-original-pull-secret podName:442ba0c0-0b9e-4918-b8a6-c93618456a92 nodeName:}" failed. No retries permitted until 2026-07-09 21:51:58.943793046 +0000 UTC m=+66.275293105 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/442ba0c0-0b9e-4918-b8a6-c93618456a92-original-pull-secret") pod "global-pull-secret-syncer-fjm26" (UID: "442ba0c0-0b9e-4918-b8a6-c93618456a92") : object "kube-system"/"original-pull-secret" not registered
Jul 09 21:51:26.943912 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:26.943828    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b99eef2e-6748-4460-bd07-1f99729b663c-metrics-certs podName:b99eef2e-6748-4460-bd07-1f99729b663c nodeName:}" failed. No retries permitted until 2026-07-09 21:51:58.943821784 +0000 UTC m=+66.275321840 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b99eef2e-6748-4460-bd07-1f99729b663c-metrics-certs") pod "network-metrics-daemon-l49xl" (UID: "b99eef2e-6748-4460-bd07-1f99729b663c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 21:51:27.045001 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:27.044943    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vdft\" (UniqueName: \"kubernetes.io/projected/daa318c8-a79e-4833-8022-26e9db42aaa9-kube-api-access-7vdft\") pod \"network-check-target-gpncs\" (UID: \"daa318c8-a79e-4833-8022-26e9db42aaa9\") " pod="openshift-network-diagnostics/network-check-target-gpncs"
Jul 09 21:51:27.045190 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:27.045107    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 21:51:27.045190 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:27.045130    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 21:51:27.045190 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:27.045145    2576 projected.go:196] Error preparing data for projected volume kube-api-access-7vdft for pod openshift-network-diagnostics/network-check-target-gpncs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 21:51:27.045315 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:27.045205    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/daa318c8-a79e-4833-8022-26e9db42aaa9-kube-api-access-7vdft podName:daa318c8-a79e-4833-8022-26e9db42aaa9 nodeName:}" failed. No retries permitted until 2026-07-09 21:51:59.045184004 +0000 UTC m=+66.376684067 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7vdft" (UniqueName: "kubernetes.io/projected/daa318c8-a79e-4833-8022-26e9db42aaa9-kube-api-access-7vdft") pod "network-check-target-gpncs" (UID: "daa318c8-a79e-4833-8022-26e9db42aaa9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 21:51:27.194985 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:27.194885    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l49xl"
Jul 09 21:51:27.195399 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:27.195018    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l49xl" podUID="b99eef2e-6748-4460-bd07-1f99729b663c"
Jul 09 21:51:27.195399 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:27.195080    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gpncs"
Jul 09 21:51:27.195399 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:27.195190    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gpncs" podUID="daa318c8-a79e-4833-8022-26e9db42aaa9"
Jul 09 21:51:28.194115 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:28.194081    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjm26"
Jul 09 21:51:28.194376 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:28.194200    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjm26" podUID="442ba0c0-0b9e-4918-b8a6-c93618456a92"
Jul 09 21:51:28.985465 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:28.985395    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-101.ec2.internal" event="NodeReady"
Jul 09 21:51:28.985881 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:28.985527    2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 09 21:51:29.019345 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.019313    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-nlmg4"]
Jul 09 21:51:29.021089 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.021074    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-nlmg4"
Jul 09 21:51:29.022817 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.022782    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc97cbc4b-l8ljg"]
Jul 09 21:51:29.023676 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.023637    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-pnthd\""
Jul 09 21:51:29.023817 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.023723    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 09 21:51:29.023817 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.023785    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 09 21:51:29.024546 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.024531    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d7bc86db-ktmq9"]
Jul 09 21:51:29.024666 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.024650    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc97cbc4b-l8ljg"
Jul 09 21:51:29.026232 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.026211    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-54d776fcf9-wxsbc"]
Jul 09 21:51:29.026330 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.026293    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d7bc86db-ktmq9"
Jul 09 21:51:29.027085 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.027067    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 09 21:51:29.027250 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.027216    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 09 21:51:29.027340 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.027284    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 09 21:51:29.027400 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.027358    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 09 21:51:29.027940 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.027920    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cd9998d7-2x7c4"]
Jul 09 21:51:29.028057 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.028044    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc"
Jul 09 21:51:29.028773 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.028734    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 09 21:51:29.028842 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.028790    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-62pmr\""
Jul 09 21:51:29.029885 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.029871    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cd9998d7-2x7c4"
Jul 09 21:51:29.030423 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.030394    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 09 21:51:29.030567 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.030433    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 09 21:51:29.030664 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.030627    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hx9tw\""
Jul 09 21:51:29.030664 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.030635    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 09 21:51:29.032348 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.032329    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-nlmg4"]
Jul 09 21:51:29.033088 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.033069    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 09 21:51:29.033202 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.033157    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 09 21:51:29.033627 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.033585    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 09 21:51:29.033723 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.033669    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 09 21:51:29.036568 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.036280    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 09 21:51:29.037292 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.037270    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gtd7d"]
Jul 09 21:51:29.040090 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.040070    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zxhgh"]
Jul 09 21:51:29.040200 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.040182    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gtd7d"
Jul 09 21:51:29.041755 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.041737    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d7bc86db-ktmq9"]
Jul 09 21:51:29.041845 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.041770    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc97cbc4b-l8ljg"]
Jul 09 21:51:29.041845 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.041793    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cd9998d7-2x7c4"]
Jul 09 21:51:29.041936 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.041854    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zxhgh"
Jul 09 21:51:29.042947 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.042932    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 09 21:51:29.042947 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.042941    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 09 21:51:29.043111 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.043006    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4k4f4\""
Jul 09 21:51:29.044419 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.044344    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 09 21:51:29.044419 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.044344    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 09 21:51:29.044580 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.044514    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 09 21:51:29.044766 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.044750    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vkm9l\""
Jul 09 21:51:29.047697 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.047679    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zxhgh"]
Jul 09 21:51:29.052051 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.052017    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54d776fcf9-wxsbc"]
Jul 09 21:51:29.056301 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.056191    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gtd7d"]
Jul 09 21:51:29.159913 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.159886    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/90442e8a-174f-4a0c-ad42-072254dc26b2-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7d7bc86db-ktmq9\" (UID: \"90442e8a-174f-4a0c-ad42-072254dc26b2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d7bc86db-ktmq9"
Jul 09 21:51:29.159913 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.159918    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/32a4b2a4-8551-4b0b-a786-c086fae647fc-trusted-ca\") pod \"image-registry-54d776fcf9-wxsbc\" (UID: \"32a4b2a4-8551-4b0b-a786-c086fae647fc\") " pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc"
Jul 09 21:51:29.160145 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.159934    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/32a4b2a4-8551-4b0b-a786-c086fae647fc-installation-pull-secrets\") pod \"image-registry-54d776fcf9-wxsbc\" (UID: \"32a4b2a4-8551-4b0b-a786-c086fae647fc\") " pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc"
Jul 09 21:51:29.160145 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.159971    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/19df1dd2-af4a-48ed-b7b5-0defafd5d5fe-ca\") pod \"cluster-proxy-proxy-agent-8cd9998d7-2x7c4\" (UID: \"19df1dd2-af4a-48ed-b7b5-0defafd5d5fe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cd9998d7-2x7c4"
Jul 09 21:51:29.160145 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.160015    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkf5q\" (UniqueName: \"kubernetes.io/projected/2c38ee1b-3029-4868-a93f-54ad94b3122b-kube-api-access-dkf5q\") pod \"klusterlet-addon-workmgr-7fc97cbc4b-l8ljg\" (UID: \"2c38ee1b-3029-4868-a93f-54ad94b3122b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc97cbc4b-l8ljg"
Jul 09 21:51:29.160145 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.160072    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g2h8\" (UniqueName: \"kubernetes.io/projected/a98e7087-edbc-4c9e-804e-b6fa45440ffe-kube-api-access-9g2h8\") pod \"ingress-canary-zxhgh\" (UID: \"a98e7087-edbc-4c9e-804e-b6fa45440ffe\") " pod="openshift-ingress-canary/ingress-canary-zxhgh"
Jul 09 21:51:29.160145 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.160098    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2cb9c33f-a330-489a-96bb-57a7a6ece91a-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-nlmg4\" (UID: \"2cb9c33f-a330-489a-96bb-57a7a6ece91a\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nlmg4"
Jul 09 21:51:29.160145 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.160120    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmhs8\" (UniqueName: \"kubernetes.io/projected/90442e8a-174f-4a0c-ad42-072254dc26b2-kube-api-access-xmhs8\") pod \"managed-serviceaccount-addon-agent-7d7bc86db-ktmq9\" (UID: \"90442e8a-174f-4a0c-ad42-072254dc26b2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d7bc86db-ktmq9"
Jul 09 21:51:29.160317 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.160182    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/32a4b2a4-8551-4b0b-a786-c086fae647fc-image-registry-private-configuration\") pod \"image-registry-54d776fcf9-wxsbc\" (UID: \"32a4b2a4-8551-4b0b-a786-c086fae647fc\") " pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc"
Jul 09 21:51:29.160317 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.160202    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/32a4b2a4-8551-4b0b-a786-c086fae647fc-bound-sa-token\") pod \"image-registry-54d776fcf9-wxsbc\" (UID: \"32a4b2a4-8551-4b0b-a786-c086fae647fc\") " pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc"
Jul 09 21:51:29.160317 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.160241    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/19df1dd2-af4a-48ed-b7b5-0defafd5d5fe-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8cd9998d7-2x7c4\" (UID: \"19df1dd2-af4a-48ed-b7b5-0defafd5d5fe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cd9998d7-2x7c4"
Jul 09 21:51:29.160317 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.160279    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hql85\" (UniqueName: \"kubernetes.io/projected/32a4b2a4-8551-4b0b-a786-c086fae647fc-kube-api-access-hql85\") pod \"image-registry-54d776fcf9-wxsbc\" (UID: \"32a4b2a4-8551-4b0b-a786-c086fae647fc\") " pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc"
Jul 09 21:51:29.160317 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.160301    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/541b0dc1-1400-4cbf-96d1-d248a30a012d-metrics-tls\") pod \"dns-default-gtd7d\" (UID: \"541b0dc1-1400-4cbf-96d1-d248a30a012d\") " pod="openshift-dns/dns-default-gtd7d"
Jul 09 21:51:29.160454 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.160325    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32a4b2a4-8551-4b0b-a786-c086fae647fc-registry-tls\") pod \"image-registry-54d776fcf9-wxsbc\" (UID: \"32a4b2a4-8551-4b0b-a786-c086fae647fc\") " pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc"
Jul 09 21:51:29.160454 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.160340    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/541b0dc1-1400-4cbf-96d1-d248a30a012d-tmp-dir\") pod \"dns-default-gtd7d\" (UID: \"541b0dc1-1400-4cbf-96d1-d248a30a012d\") " pod="openshift-dns/dns-default-gtd7d"
Jul 09 21:51:29.160454 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.160380    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/32a4b2a4-8551-4b0b-a786-c086fae647fc-ca-trust-extracted\") pod \"image-registry-54d776fcf9-wxsbc\" (UID: \"32a4b2a4-8551-4b0b-a786-c086fae647fc\") " pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc"
Jul 09 21:51:29.160454 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.160406    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw66w\" (UniqueName: \"kubernetes.io/projected/19df1dd2-af4a-48ed-b7b5-0defafd5d5fe-kube-api-access-mw66w\") pod \"cluster-proxy-proxy-agent-8cd9998d7-2x7c4\" (UID: \"19df1dd2-af4a-48ed-b7b5-0defafd5d5fe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cd9998d7-2x7c4"
Jul 09 21:51:29.160454 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.160441    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/19df1dd2-af4a-48ed-b7b5-0defafd5d5fe-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8cd9998d7-2x7c4\" (UID: \"19df1dd2-af4a-48ed-b7b5-0defafd5d5fe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cd9998d7-2x7c4"
Jul 09 21:51:29.160590 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.160483    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2c38ee1b-3029-4868-a93f-54ad94b3122b-klusterlet-config\") pod \"klusterlet-addon-workmgr-7fc97cbc4b-l8ljg\" (UID: \"2c38ee1b-3029-4868-a93f-54ad94b3122b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc97cbc4b-l8ljg"
Jul 09 21:51:29.160590 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.160508    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c38ee1b-3029-4868-a93f-54ad94b3122b-tmp\") pod \"klusterlet-addon-workmgr-7fc97cbc4b-l8ljg\" (UID: \"2c38ee1b-3029-4868-a93f-54ad94b3122b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc97cbc4b-l8ljg"
Jul 09 21:51:29.160590 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.160522    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/32a4b2a4-8551-4b0b-a786-c086fae647fc-registry-certificates\") pod \"image-registry-54d776fcf9-wxsbc\" (UID: \"32a4b2a4-8551-4b0b-a786-c086fae647fc\") " pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc"
Jul 09 21:51:29.160590 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.160550    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/541b0dc1-1400-4cbf-96d1-d248a30a012d-config-volume\") pod \"dns-default-gtd7d\" (UID: \"541b0dc1-1400-4cbf-96d1-d248a30a012d\") " pod="openshift-dns/dns-default-gtd7d"
Jul 09 21:51:29.160590 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.160564    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnngp\" (UniqueName: \"kubernetes.io/projected/541b0dc1-1400-4cbf-96d1-d248a30a012d-kube-api-access-rnngp\") pod \"dns-default-gtd7d\" (UID: \"541b0dc1-1400-4cbf-96d1-d248a30a012d\") " pod="openshift-dns/dns-default-gtd7d"
Jul 09 21:51:29.160590 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.160586    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/19df1dd2-af4a-48ed-b7b5-0defafd5d5fe-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8cd9998d7-2x7c4\" (UID: \"19df1dd2-af4a-48ed-b7b5-0defafd5d5fe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cd9998d7-2x7c4"
Jul 09 21:51:29.160756 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.160615    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2cb9c33f-a330-489a-96bb-57a7a6ece91a-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-nlmg4\" (UID: \"2cb9c33f-a330-489a-96bb-57a7a6ece91a\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nlmg4"
Jul 09 21:51:29.160756 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.160632    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/19df1dd2-af4a-48ed-b7b5-0defafd5d5fe-hub\") pod \"cluster-proxy-proxy-agent-8cd9998d7-2x7c4\" (UID: \"19df1dd2-af4a-48ed-b7b5-0defafd5d5fe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cd9998d7-2x7c4"
Jul 09 21:51:29.160756 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.160662    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a98e7087-edbc-4c9e-804e-b6fa45440ffe-cert\") pod \"ingress-canary-zxhgh\" (UID: \"a98e7087-edbc-4c9e-804e-b6fa45440ffe\") " pod="openshift-ingress-canary/ingress-canary-zxhgh"
Jul 09 21:51:29.184686 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.184653    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxmvw_06b11cb1-4d06-48b8-a010-c79c999bfec2/konnectivity-agent/0.log" limit=1024
Jul 09 21:51:29.194612 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.194587    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l49xl"
Jul 09 21:51:29.194804 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.194784    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gpncs"
Jul 09 21:51:29.197260 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.197207    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 21:51:29.197378 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.197295    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-r7ms8\""
Jul 09 21:51:29.197528 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.197512    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qdkql\""
Jul 09 21:51:29.197607 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.197593    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 21:51:29.197683 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.197662    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 21:51:29.261084 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.261001    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/32a4b2a4-8551-4b0b-a786-c086fae647fc-image-registry-private-configuration\") pod \"image-registry-54d776fcf9-wxsbc\" (UID: \"32a4b2a4-8551-4b0b-a786-c086fae647fc\") " pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc"
Jul 09 21:51:29.261084 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.261038    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/32a4b2a4-8551-4b0b-a786-c086fae647fc-bound-sa-token\") pod \"image-registry-54d776fcf9-wxsbc\" (UID: \"32a4b2a4-8551-4b0b-a786-c086fae647fc\") " pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc"
Jul 09 21:51:29.261084 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.261060    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/19df1dd2-af4a-48ed-b7b5-0defafd5d5fe-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8cd9998d7-2x7c4\" (UID: \"19df1dd2-af4a-48ed-b7b5-0defafd5d5fe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cd9998d7-2x7c4"
Jul 09 21:51:29.261350 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.261195    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hql85\" (UniqueName: \"kubernetes.io/projected/32a4b2a4-8551-4b0b-a786-c086fae647fc-kube-api-access-hql85\") pod \"image-registry-54d776fcf9-wxsbc\" (UID: \"32a4b2a4-8551-4b0b-a786-c086fae647fc\") " pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc"
Jul 09 21:51:29.261350 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.261229    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/541b0dc1-1400-4cbf-96d1-d248a30a012d-metrics-tls\") pod \"dns-default-gtd7d\" (UID: \"541b0dc1-1400-4cbf-96d1-d248a30a012d\") " pod="openshift-dns/dns-default-gtd7d"
Jul 09 21:51:29.261350 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.261266    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32a4b2a4-8551-4b0b-a786-c086fae647fc-registry-tls\") pod \"image-registry-54d776fcf9-wxsbc\" (UID: \"32a4b2a4-8551-4b0b-a786-c086fae647fc\") " pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc"
Jul 09 21:51:29.261350 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.261290    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/541b0dc1-1400-4cbf-96d1-d248a30a012d-tmp-dir\") pod \"dns-default-gtd7d\" (UID: \"541b0dc1-1400-4cbf-96d1-d248a30a012d\") " pod="openshift-dns/dns-default-gtd7d"
Jul 09 21:51:29.261350 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.261316    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/32a4b2a4-8551-4b0b-a786-c086fae647fc-ca-trust-extracted\") pod \"image-registry-54d776fcf9-wxsbc\" (UID: \"32a4b2a4-8551-4b0b-a786-c086fae647fc\") " pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc"
Jul 09 21:51:29.261350 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.261342    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw66w\" (UniqueName: \"kubernetes.io/projected/19df1dd2-af4a-48ed-b7b5-0defafd5d5fe-kube-api-access-mw66w\") pod \"cluster-proxy-proxy-agent-8cd9998d7-2x7c4\" (UID: \"19df1dd2-af4a-48ed-b7b5-0defafd5d5fe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cd9998d7-2x7c4"
Jul 09 21:51:29.261598 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.261368    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/19df1dd2-af4a-48ed-b7b5-0defafd5d5fe-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8cd9998d7-2x7c4\" (UID: \"19df1dd2-af4a-48ed-b7b5-0defafd5d5fe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cd9998d7-2x7c4"
Jul 09 21:51:29.261598 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.261412    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2c38ee1b-3029-4868-a93f-54ad94b3122b-klusterlet-config\") pod \"klusterlet-addon-workmgr-7fc97cbc4b-l8ljg\" (UID: \"2c38ee1b-3029-4868-a93f-54ad94b3122b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc97cbc4b-l8ljg"
Jul 09 21:51:29.261598 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.261455    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c38ee1b-3029-4868-a93f-54ad94b3122b-tmp\") pod \"klusterlet-addon-workmgr-7fc97cbc4b-l8ljg\" (UID: \"2c38ee1b-3029-4868-a93f-54ad94b3122b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc97cbc4b-l8ljg"
Jul 09 21:51:29.261598 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.261480    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/32a4b2a4-8551-4b0b-a786-c086fae647fc-registry-certificates\") pod \"image-registry-54d776fcf9-wxsbc\" (UID: \"32a4b2a4-8551-4b0b-a786-c086fae647fc\") " pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc"
Jul 09 21:51:29.261598 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:29.261505    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 21:51:29.261598 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.261522    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxmvw_06b11cb1-4d06-48b8-a010-c79c999bfec2/konnectivity-agent/0.log" limit=1024
Jul 09 21:51:29.261598 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:29.261573    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/541b0dc1-1400-4cbf-96d1-d248a30a012d-metrics-tls podName:541b0dc1-1400-4cbf-96d1-d248a30a012d nodeName:}" failed. No retries permitted until 2026-07-09 21:51:29.761547281 +0000 UTC m=+37.093047342 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/541b0dc1-1400-4cbf-96d1-d248a30a012d-metrics-tls") pod "dns-default-gtd7d" (UID: "541b0dc1-1400-4cbf-96d1-d248a30a012d") : secret "dns-default-metrics-tls" not found
Jul 09 21:51:29.261598 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:29.261576    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 21:51:29.261598 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:29.261594    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54d776fcf9-wxsbc: secret "image-registry-tls" not found
Jul 09 21:51:29.262017 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:29.261651    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32a4b2a4-8551-4b0b-a786-c086fae647fc-registry-tls podName:32a4b2a4-8551-4b0b-a786-c086fae647fc nodeName:}" failed. No retries permitted until 2026-07-09 21:51:29.761635629 +0000 UTC m=+37.093135698 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/32a4b2a4-8551-4b0b-a786-c086fae647fc-registry-tls") pod "image-registry-54d776fcf9-wxsbc" (UID: "32a4b2a4-8551-4b0b-a786-c086fae647fc") : secret "image-registry-tls" not found
Jul 09 21:51:29.262017 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.261529    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/541b0dc1-1400-4cbf-96d1-d248a30a012d-config-volume\") pod \"dns-default-gtd7d\" (UID: \"541b0dc1-1400-4cbf-96d1-d248a30a012d\") " pod="openshift-dns/dns-default-gtd7d"
Jul 09 21:51:29.262017 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.261893    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnngp\" (UniqueName: \"kubernetes.io/projected/541b0dc1-1400-4cbf-96d1-d248a30a012d-kube-api-access-rnngp\") pod \"dns-default-gtd7d\" (UID: \"541b0dc1-1400-4cbf-96d1-d248a30a012d\") " pod="openshift-dns/dns-default-gtd7d"
Jul 09 21:51:29.262017 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.261925    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/19df1dd2-af4a-48ed-b7b5-0defafd5d5fe-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8cd9998d7-2x7c4\" (UID: \"19df1dd2-af4a-48ed-b7b5-0defafd5d5fe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cd9998d7-2x7c4"
Jul 09 21:51:29.262017 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.261973    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2cb9c33f-a330-489a-96bb-57a7a6ece91a-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-nlmg4\" (UID: \"2cb9c33f-a330-489a-96bb-57a7a6ece91a\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nlmg4"
Jul 09 21:51:29.262017 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.261998    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/19df1dd2-af4a-48ed-b7b5-0defafd5d5fe-hub\") pod \"cluster-proxy-proxy-agent-8cd9998d7-2x7c4\" (UID: \"19df1dd2-af4a-48ed-b7b5-0defafd5d5fe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cd9998d7-2x7c4"
Jul 09 21:51:29.262281 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.262026    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a98e7087-edbc-4c9e-804e-b6fa45440ffe-cert\") pod \"ingress-canary-zxhgh\" (UID: \"a98e7087-edbc-4c9e-804e-b6fa45440ffe\") " pod="openshift-ingress-canary/ingress-canary-zxhgh"
Jul 09 21:51:29.262281 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.262057    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/90442e8a-174f-4a0c-ad42-072254dc26b2-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7d7bc86db-ktmq9\" (UID: \"90442e8a-174f-4a0c-ad42-072254dc26b2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d7bc86db-ktmq9"
Jul 09 21:51:29.262281 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.262086    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/32a4b2a4-8551-4b0b-a786-c086fae647fc-trusted-ca\") pod \"image-registry-54d776fcf9-wxsbc\" (UID: \"32a4b2a4-8551-4b0b-a786-c086fae647fc\") " pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc"
Jul 09 21:51:29.262281 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.262113    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/32a4b2a4-8551-4b0b-a786-c086fae647fc-installation-pull-secrets\") pod \"image-registry-54d776fcf9-wxsbc\" (UID: \"32a4b2a4-8551-4b0b-a786-c086fae647fc\") " pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc"
Jul 09 21:51:29.262281 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.262136    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/19df1dd2-af4a-48ed-b7b5-0defafd5d5fe-ca\") pod \"cluster-proxy-proxy-agent-8cd9998d7-2x7c4\" (UID: \"19df1dd2-af4a-48ed-b7b5-0defafd5d5fe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cd9998d7-2x7c4"
Jul 09 21:51:29.262281 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.262165    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkf5q\" (UniqueName: \"kubernetes.io/projected/2c38ee1b-3029-4868-a93f-54ad94b3122b-kube-api-access-dkf5q\") pod \"klusterlet-addon-workmgr-7fc97cbc4b-l8ljg\" (UID: \"2c38ee1b-3029-4868-a93f-54ad94b3122b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc97cbc4b-l8ljg"
Jul 09 21:51:29.262281 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.262169    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/32a4b2a4-8551-4b0b-a786-c086fae647fc-ca-trust-extracted\") pod \"image-registry-54d776fcf9-wxsbc\" (UID: \"32a4b2a4-8551-4b0b-a786-c086fae647fc\") " pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc"
Jul 09 21:51:29.262281 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.261747    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/19df1dd2-af4a-48ed-b7b5-0defafd5d5fe-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8cd9998d7-2x7c4\" (UID: \"19df1dd2-af4a-48ed-b7b5-0defafd5d5fe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cd9998d7-2x7c4"
Jul 09 21:51:29.262281 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.262192    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9g2h8\" (UniqueName: \"kubernetes.io/projected/a98e7087-edbc-4c9e-804e-b6fa45440ffe-kube-api-access-9g2h8\") pod \"ingress-canary-zxhgh\" (UID: \"a98e7087-edbc-4c9e-804e-b6fa45440ffe\") " pod="openshift-ingress-canary/ingress-canary-zxhgh"
Jul 09 21:51:29.262281 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:29.262276    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 09 21:51:29.262732 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.262315    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2cb9c33f-a330-489a-96bb-57a7a6ece91a-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-nlmg4\" (UID: \"2cb9c33f-a330-489a-96bb-57a7a6ece91a\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nlmg4"
Jul 09 21:51:29.262732 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:29.262323    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cb9c33f-a330-489a-96bb-57a7a6ece91a-networking-console-plugin-cert podName:2cb9c33f-a330-489a-96bb-57a7a6ece91a nodeName:}" failed. No retries permitted until 2026-07-09 21:51:29.762309047 +0000 UTC m=+37.093809104 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2cb9c33f-a330-489a-96bb-57a7a6ece91a-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-nlmg4" (UID: "2cb9c33f-a330-489a-96bb-57a7a6ece91a") : secret "networking-console-plugin-cert" not found
Jul 09 21:51:29.262732 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.262375    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmhs8\" (UniqueName: \"kubernetes.io/projected/90442e8a-174f-4a0c-ad42-072254dc26b2-kube-api-access-xmhs8\") pod \"managed-serviceaccount-addon-agent-7d7bc86db-ktmq9\" (UID: \"90442e8a-174f-4a0c-ad42-072254dc26b2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d7bc86db-ktmq9"
Jul 09 21:51:29.262732 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.262399    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/32a4b2a4-8551-4b0b-a786-c086fae647fc-registry-certificates\") pod \"image-registry-54d776fcf9-wxsbc\" (UID: \"32a4b2a4-8551-4b0b-a786-c086fae647fc\") " pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc"
Jul 09 21:51:29.262927 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.262795    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/541b0dc1-1400-4cbf-96d1-d248a30a012d-tmp-dir\") pod \"dns-default-gtd7d\" (UID: \"541b0dc1-1400-4cbf-96d1-d248a30a012d\") " pod="openshift-dns/dns-default-gtd7d"
Jul 09 21:51:29.263597 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.263563    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2cb9c33f-a330-489a-96bb-57a7a6ece91a-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-nlmg4\" (UID: \"2cb9c33f-a330-489a-96bb-57a7a6ece91a\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nlmg4"
Jul 09 21:51:29.263740 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.263719    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c38ee1b-3029-4868-a93f-54ad94b3122b-tmp\") pod \"klusterlet-addon-workmgr-7fc97cbc4b-l8ljg\" (UID: \"2c38ee1b-3029-4868-a93f-54ad94b3122b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc97cbc4b-l8ljg"
Jul 09 21:51:29.264576 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.264525    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/32a4b2a4-8551-4b0b-a786-c086fae647fc-trusted-ca\") pod \"image-registry-54d776fcf9-wxsbc\" (UID: \"32a4b2a4-8551-4b0b-a786-c086fae647fc\") " pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc"
Jul 09 21:51:29.264978 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.264930    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/541b0dc1-1400-4cbf-96d1-d248a30a012d-config-volume\") pod \"dns-default-gtd7d\" (UID: \"541b0dc1-1400-4cbf-96d1-d248a30a012d\") " pod="openshift-dns/dns-default-gtd7d"
Jul 09 21:51:29.266615 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.266551    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/32a4b2a4-8551-4b0b-a786-c086fae647fc-image-registry-private-configuration\") pod \"image-registry-54d776fcf9-wxsbc\" (UID: \"32a4b2a4-8551-4b0b-a786-c086fae647fc\") " pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc"
Jul 09 21:51:29.266615 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.266552    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/32a4b2a4-8551-4b0b-a786-c086fae647fc-installation-pull-secrets\") pod \"image-registry-54d776fcf9-wxsbc\" (UID: \"32a4b2a4-8551-4b0b-a786-c086fae647fc\") " pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc"
Jul 09 21:51:29.266774 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.266684    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2c38ee1b-3029-4868-a93f-54ad94b3122b-klusterlet-config\") pod \"klusterlet-addon-workmgr-7fc97cbc4b-l8ljg\" (UID: \"2c38ee1b-3029-4868-a93f-54ad94b3122b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc97cbc4b-l8ljg"
Jul 09 21:51:29.266996 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.266942    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/19df1dd2-af4a-48ed-b7b5-0defafd5d5fe-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8cd9998d7-2x7c4\" (UID: \"19df1dd2-af4a-48ed-b7b5-0defafd5d5fe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cd9998d7-2x7c4"
Jul 09 21:51:29.267096 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.267034    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/90442e8a-174f-4a0c-ad42-072254dc26b2-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7d7bc86db-ktmq9\" (UID: \"90442e8a-174f-4a0c-ad42-072254dc26b2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d7bc86db-ktmq9"
Jul 09 21:51:29.267174 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.267154    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/19df1dd2-af4a-48ed-b7b5-0defafd5d5fe-hub\") pod \"cluster-proxy-proxy-agent-8cd9998d7-2x7c4\" (UID: \"19df1dd2-af4a-48ed-b7b5-0defafd5d5fe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cd9998d7-2x7c4"
Jul 09 21:51:29.267267 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.267244    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a98e7087-edbc-4c9e-804e-b6fa45440ffe-cert\") pod \"ingress-canary-zxhgh\" (UID: \"a98e7087-edbc-4c9e-804e-b6fa45440ffe\") " pod="openshift-ingress-canary/ingress-canary-zxhgh"
Jul 09 21:51:29.267507 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.267490    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/19df1dd2-af4a-48ed-b7b5-0defafd5d5fe-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8cd9998d7-2x7c4\" (UID: \"19df1dd2-af4a-48ed-b7b5-0defafd5d5fe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cd9998d7-2x7c4"
Jul 09 21:51:29.268215 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.268198    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/19df1dd2-af4a-48ed-b7b5-0defafd5d5fe-ca\") pod \"cluster-proxy-proxy-agent-8cd9998d7-2x7c4\" (UID: \"19df1dd2-af4a-48ed-b7b5-0defafd5d5fe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cd9998d7-2x7c4"
Jul 09 21:51:29.274495 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.274446    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnngp\" (UniqueName: \"kubernetes.io/projected/541b0dc1-1400-4cbf-96d1-d248a30a012d-kube-api-access-rnngp\") pod \"dns-default-gtd7d\" (UID: \"541b0dc1-1400-4cbf-96d1-d248a30a012d\") " pod="openshift-dns/dns-default-gtd7d"
Jul 09 21:51:29.275042 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.274990    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hql85\" (UniqueName: \"kubernetes.io/projected/32a4b2a4-8551-4b0b-a786-c086fae647fc-kube-api-access-hql85\") pod \"image-registry-54d776fcf9-wxsbc\" (UID: \"32a4b2a4-8551-4b0b-a786-c086fae647fc\") " pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc"
Jul 09 21:51:29.275428 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.275401    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g2h8\" (UniqueName: \"kubernetes.io/projected/a98e7087-edbc-4c9e-804e-b6fa45440ffe-kube-api-access-9g2h8\") pod \"ingress-canary-zxhgh\" (UID: \"a98e7087-edbc-4c9e-804e-b6fa45440ffe\") " pod="openshift-ingress-canary/ingress-canary-zxhgh"
Jul 09 21:51:29.276121 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.276101    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw66w\" (UniqueName: \"kubernetes.io/projected/19df1dd2-af4a-48ed-b7b5-0defafd5d5fe-kube-api-access-mw66w\") pod \"cluster-proxy-proxy-agent-8cd9998d7-2x7c4\" (UID: \"19df1dd2-af4a-48ed-b7b5-0defafd5d5fe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cd9998d7-2x7c4"
Jul 09 21:51:29.276190 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.276101    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/32a4b2a4-8551-4b0b-a786-c086fae647fc-bound-sa-token\") pod \"image-registry-54d776fcf9-wxsbc\" (UID: \"32a4b2a4-8551-4b0b-a786-c086fae647fc\") " pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc"
Jul 09 21:51:29.276994 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.276949    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkf5q\" (UniqueName: \"kubernetes.io/projected/2c38ee1b-3029-4868-a93f-54ad94b3122b-kube-api-access-dkf5q\") pod \"klusterlet-addon-workmgr-7fc97cbc4b-l8ljg\" (UID: \"2c38ee1b-3029-4868-a93f-54ad94b3122b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc97cbc4b-l8ljg"
Jul 09 21:51:29.277947 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.277925    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmhs8\" (UniqueName: \"kubernetes.io/projected/90442e8a-174f-4a0c-ad42-072254dc26b2-kube-api-access-xmhs8\") pod \"managed-serviceaccount-addon-agent-7d7bc86db-ktmq9\" (UID: \"90442e8a-174f-4a0c-ad42-072254dc26b2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d7bc86db-ktmq9"
Jul 09 21:51:29.342525 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.342493    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc97cbc4b-l8ljg"
Jul 09 21:51:29.360107 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.359942    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d7bc86db-ktmq9"
Jul 09 21:51:29.374323 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.374291    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cd9998d7-2x7c4"
Jul 09 21:51:29.402182 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.402090    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zxhgh"
Jul 09 21:51:29.521001 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.520913    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc97cbc4b-l8ljg"]
Jul 09 21:51:29.524479 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.524452    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d7bc86db-ktmq9"]
Jul 09 21:51:29.530161 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:51:29.530115    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c38ee1b_3029_4868_a93f_54ad94b3122b.slice/crio-3c5fb5820c6203e3ea82659d30120706cebac92007d5217cc625ccd0c84d4c61 WatchSource:0}: Error finding container 3c5fb5820c6203e3ea82659d30120706cebac92007d5217cc625ccd0c84d4c61: Status 404 returned error can't find the container with id 3c5fb5820c6203e3ea82659d30120706cebac92007d5217cc625ccd0c84d4c61
Jul 09 21:51:29.541009 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.540985    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cd9998d7-2x7c4"]
Jul 09 21:51:29.544906 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:51:29.544875    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod19df1dd2_af4a_48ed_b7b5_0defafd5d5fe.slice/crio-3196b97d04e2c193fcbc1ca69c0a264ec937f05f175aa0ff41035eccbe9c446d WatchSource:0}: Error finding container 3196b97d04e2c193fcbc1ca69c0a264ec937f05f175aa0ff41035eccbe9c446d: Status 404 returned error can't find the container with id 3196b97d04e2c193fcbc1ca69c0a264ec937f05f175aa0ff41035eccbe9c446d
Jul 09 21:51:29.580074 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.580042    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zxhgh"]
Jul 09 21:51:29.583173 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:51:29.583143    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda98e7087_edbc_4c9e_804e_b6fa45440ffe.slice/crio-b75ccf6d787d1b0a393bff071b8cb999fd3e0cd7bafa4307f5bd78d3ad3a31bd WatchSource:0}: Error finding container b75ccf6d787d1b0a393bff071b8cb999fd3e0cd7bafa4307f5bd78d3ad3a31bd: Status 404 returned error can't find the container with id b75ccf6d787d1b0a393bff071b8cb999fd3e0cd7bafa4307f5bd78d3ad3a31bd
Jul 09 21:51:29.766238 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.766144    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32a4b2a4-8551-4b0b-a786-c086fae647fc-registry-tls\") pod \"image-registry-54d776fcf9-wxsbc\" (UID: \"32a4b2a4-8551-4b0b-a786-c086fae647fc\") " pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc"
Jul 09 21:51:29.766408 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.766243    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2cb9c33f-a330-489a-96bb-57a7a6ece91a-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-nlmg4\" (UID: \"2cb9c33f-a330-489a-96bb-57a7a6ece91a\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nlmg4"
Jul 09 21:51:29.766408 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:29.766291    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/541b0dc1-1400-4cbf-96d1-d248a30a012d-metrics-tls\") pod \"dns-default-gtd7d\" (UID: \"541b0dc1-1400-4cbf-96d1-d248a30a012d\") " pod="openshift-dns/dns-default-gtd7d"
Jul 09 21:51:29.766408 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:29.766372    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 21:51:29.766408 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:29.766395    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 09 21:51:29.766567 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:29.766425    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/541b0dc1-1400-4cbf-96d1-d248a30a012d-metrics-tls podName:541b0dc1-1400-4cbf-96d1-d248a30a012d nodeName:}" failed. No retries permitted until 2026-07-09 21:51:30.766411548 +0000 UTC m=+38.097911604 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/541b0dc1-1400-4cbf-96d1-d248a30a012d-metrics-tls") pod "dns-default-gtd7d" (UID: "541b0dc1-1400-4cbf-96d1-d248a30a012d") : secret "dns-default-metrics-tls" not found
Jul 09 21:51:29.766567 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:29.766376    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 21:51:29.766567 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:29.766459    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cb9c33f-a330-489a-96bb-57a7a6ece91a-networking-console-plugin-cert podName:2cb9c33f-a330-489a-96bb-57a7a6ece91a nodeName:}" failed. No retries permitted until 2026-07-09 21:51:30.766440588 +0000 UTC m=+38.097940644 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2cb9c33f-a330-489a-96bb-57a7a6ece91a-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-nlmg4" (UID: "2cb9c33f-a330-489a-96bb-57a7a6ece91a") : secret "networking-console-plugin-cert" not found
Jul 09 21:51:29.766567 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:29.766467    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54d776fcf9-wxsbc: secret "image-registry-tls" not found
Jul 09 21:51:29.766567 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:29.766504    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32a4b2a4-8551-4b0b-a786-c086fae647fc-registry-tls podName:32a4b2a4-8551-4b0b-a786-c086fae647fc nodeName:}" failed. No retries permitted until 2026-07-09 21:51:30.766492088 +0000 UTC m=+38.097992170 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/32a4b2a4-8551-4b0b-a786-c086fae647fc-registry-tls") pod "image-registry-54d776fcf9-wxsbc" (UID: "32a4b2a4-8551-4b0b-a786-c086fae647fc") : secret "image-registry-tls" not found
Jul 09 21:51:30.194471 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:30.194389    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjm26"
Jul 09 21:51:30.197675 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:30.197474    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 21:51:30.430858 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:30.430771    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc97cbc4b-l8ljg" event={"ID":"2c38ee1b-3029-4868-a93f-54ad94b3122b","Type":"ContainerStarted","Data":"3c5fb5820c6203e3ea82659d30120706cebac92007d5217cc625ccd0c84d4c61"}
Jul 09 21:51:30.434592 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:30.434560    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d7bc86db-ktmq9" event={"ID":"90442e8a-174f-4a0c-ad42-072254dc26b2","Type":"ContainerStarted","Data":"a42b109027700b2b22491050eb10b0540648ad4948a981e0c662a99c30825c2c"}
Jul 09 21:51:30.436683 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:30.436655    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cd9998d7-2x7c4" event={"ID":"19df1dd2-af4a-48ed-b7b5-0defafd5d5fe","Type":"ContainerStarted","Data":"3196b97d04e2c193fcbc1ca69c0a264ec937f05f175aa0ff41035eccbe9c446d"}
Jul 09 21:51:30.442112 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:30.442082    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zxhgh" event={"ID":"a98e7087-edbc-4c9e-804e-b6fa45440ffe","Type":"ContainerStarted","Data":"b75ccf6d787d1b0a393bff071b8cb999fd3e0cd7bafa4307f5bd78d3ad3a31bd"}
Jul 09 21:51:30.776006 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:30.774773    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/541b0dc1-1400-4cbf-96d1-d248a30a012d-metrics-tls\") pod \"dns-default-gtd7d\" (UID: \"541b0dc1-1400-4cbf-96d1-d248a30a012d\") " pod="openshift-dns/dns-default-gtd7d"
Jul 09 21:51:30.776006 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:30.774835    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32a4b2a4-8551-4b0b-a786-c086fae647fc-registry-tls\") pod \"image-registry-54d776fcf9-wxsbc\" (UID: \"32a4b2a4-8551-4b0b-a786-c086fae647fc\") " pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc"
Jul 09 21:51:30.776006 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:30.774932    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2cb9c33f-a330-489a-96bb-57a7a6ece91a-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-nlmg4\" (UID: \"2cb9c33f-a330-489a-96bb-57a7a6ece91a\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nlmg4"
Jul 09 21:51:30.776006 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:30.775087    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 09 21:51:30.776006 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:30.775150    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cb9c33f-a330-489a-96bb-57a7a6ece91a-networking-console-plugin-cert podName:2cb9c33f-a330-489a-96bb-57a7a6ece91a nodeName:}" failed. No retries permitted until 2026-07-09 21:51:32.775131775 +0000 UTC m=+40.106631847 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2cb9c33f-a330-489a-96bb-57a7a6ece91a-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-nlmg4" (UID: "2cb9c33f-a330-489a-96bb-57a7a6ece91a") : secret "networking-console-plugin-cert" not found
Jul 09 21:51:30.776006 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:30.775576    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 21:51:30.776006 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:30.775625    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/541b0dc1-1400-4cbf-96d1-d248a30a012d-metrics-tls podName:541b0dc1-1400-4cbf-96d1-d248a30a012d nodeName:}" failed. No retries permitted until 2026-07-09 21:51:32.775609508 +0000 UTC m=+40.107109586 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/541b0dc1-1400-4cbf-96d1-d248a30a012d-metrics-tls") pod "dns-default-gtd7d" (UID: "541b0dc1-1400-4cbf-96d1-d248a30a012d") : secret "dns-default-metrics-tls" not found
Jul 09 21:51:30.776006 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:30.775894    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 21:51:30.776006 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:30.775908    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54d776fcf9-wxsbc: secret "image-registry-tls" not found
Jul 09 21:51:30.776006 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:30.775945    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32a4b2a4-8551-4b0b-a786-c086fae647fc-registry-tls podName:32a4b2a4-8551-4b0b-a786-c086fae647fc nodeName:}" failed. No retries permitted until 2026-07-09 21:51:32.775931805 +0000 UTC m=+40.107431883 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/32a4b2a4-8551-4b0b-a786-c086fae647fc-registry-tls") pod "image-registry-54d776fcf9-wxsbc" (UID: "32a4b2a4-8551-4b0b-a786-c086fae647fc") : secret "image-registry-tls" not found
Jul 09 21:51:31.873591 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:31.873542    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxmvw_06b11cb1-4d06-48b8-a010-c79c999bfec2/konnectivity-agent/0.log" limit=1024
Jul 09 21:51:31.974050 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:31.973924    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxmvw_06b11cb1-4d06-48b8-a010-c79c999bfec2/konnectivity-agent/0.log" limit=1024
Jul 09 21:51:32.029696 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:32.029653    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxmvw_06b11cb1-4d06-48b8-a010-c79c999bfec2/konnectivity-agent/0.log" limit=1024
Jul 09 21:51:32.463591 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:32.463494    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxmvw_06b11cb1-4d06-48b8-a010-c79c999bfec2/konnectivity-agent/0.log" limit=1024
Jul 09 21:51:32.514719 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:32.514684    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxmvw_06b11cb1-4d06-48b8-a010-c79c999bfec2/konnectivity-agent/0.log" limit=1024
Jul 09 21:51:32.795034 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:32.794525    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2cb9c33f-a330-489a-96bb-57a7a6ece91a-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-nlmg4\" (UID: \"2cb9c33f-a330-489a-96bb-57a7a6ece91a\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nlmg4"
Jul 09 21:51:32.795034 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:32.794607    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/541b0dc1-1400-4cbf-96d1-d248a30a012d-metrics-tls\") pod \"dns-default-gtd7d\" (UID: \"541b0dc1-1400-4cbf-96d1-d248a30a012d\") " pod="openshift-dns/dns-default-gtd7d"
Jul 09 21:51:32.795034 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:32.794641    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32a4b2a4-8551-4b0b-a786-c086fae647fc-registry-tls\") pod \"image-registry-54d776fcf9-wxsbc\" (UID: \"32a4b2a4-8551-4b0b-a786-c086fae647fc\") " pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc"
Jul 09 21:51:32.795034 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:32.794709    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 09 21:51:32.795034 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:32.794783    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 21:51:32.795034 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:32.794790    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cb9c33f-a330-489a-96bb-57a7a6ece91a-networking-console-plugin-cert podName:2cb9c33f-a330-489a-96bb-57a7a6ece91a nodeName:}" failed. No retries permitted until 2026-07-09 21:51:36.794767887 +0000 UTC m=+44.126267968 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2cb9c33f-a330-489a-96bb-57a7a6ece91a-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-nlmg4" (UID: "2cb9c33f-a330-489a-96bb-57a7a6ece91a") : secret "networking-console-plugin-cert" not found
Jul 09 21:51:32.795034 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:32.794798    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54d776fcf9-wxsbc: secret "image-registry-tls" not found
Jul 09 21:51:32.795034 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:32.794847    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32a4b2a4-8551-4b0b-a786-c086fae647fc-registry-tls podName:32a4b2a4-8551-4b0b-a786-c086fae647fc nodeName:}" failed. No retries permitted until 2026-07-09 21:51:36.794831534 +0000 UTC m=+44.126331612 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/32a4b2a4-8551-4b0b-a786-c086fae647fc-registry-tls") pod "image-registry-54d776fcf9-wxsbc" (UID: "32a4b2a4-8551-4b0b-a786-c086fae647fc") : secret "image-registry-tls" not found
Jul 09 21:51:32.795034 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:32.794908    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 21:51:32.795034 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:32.794937    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/541b0dc1-1400-4cbf-96d1-d248a30a012d-metrics-tls podName:541b0dc1-1400-4cbf-96d1-d248a30a012d nodeName:}" failed. No retries permitted until 2026-07-09 21:51:36.794927408 +0000 UTC m=+44.126427499 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/541b0dc1-1400-4cbf-96d1-d248a30a012d-metrics-tls") pod "dns-default-gtd7d" (UID: "541b0dc1-1400-4cbf-96d1-d248a30a012d") : secret "dns-default-metrics-tls" not found
Jul 09 21:51:36.830442 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:36.830393    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2cb9c33f-a330-489a-96bb-57a7a6ece91a-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-nlmg4\" (UID: \"2cb9c33f-a330-489a-96bb-57a7a6ece91a\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nlmg4"
Jul 09 21:51:36.830905 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:36.830483    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/541b0dc1-1400-4cbf-96d1-d248a30a012d-metrics-tls\") pod \"dns-default-gtd7d\" (UID: \"541b0dc1-1400-4cbf-96d1-d248a30a012d\") " pod="openshift-dns/dns-default-gtd7d"
Jul 09 21:51:36.830905 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:36.830517    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32a4b2a4-8551-4b0b-a786-c086fae647fc-registry-tls\") pod \"image-registry-54d776fcf9-wxsbc\" (UID: \"32a4b2a4-8551-4b0b-a786-c086fae647fc\") " pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc"
Jul 09 21:51:36.830905 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:36.830537    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 09 21:51:36.830905 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:36.830610    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cb9c33f-a330-489a-96bb-57a7a6ece91a-networking-console-plugin-cert podName:2cb9c33f-a330-489a-96bb-57a7a6ece91a nodeName:}" failed. No retries permitted until 2026-07-09 21:51:44.830591813 +0000 UTC m=+52.162091869 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2cb9c33f-a330-489a-96bb-57a7a6ece91a-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-nlmg4" (UID: "2cb9c33f-a330-489a-96bb-57a7a6ece91a") : secret "networking-console-plugin-cert" not found
Jul 09 21:51:36.830905 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:36.830622    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 21:51:36.830905 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:36.830683    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/541b0dc1-1400-4cbf-96d1-d248a30a012d-metrics-tls podName:541b0dc1-1400-4cbf-96d1-d248a30a012d nodeName:}" failed. No retries permitted until 2026-07-09 21:51:44.830666016 +0000 UTC m=+52.162166077 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/541b0dc1-1400-4cbf-96d1-d248a30a012d-metrics-tls") pod "dns-default-gtd7d" (UID: "541b0dc1-1400-4cbf-96d1-d248a30a012d") : secret "dns-default-metrics-tls" not found
Jul 09 21:51:36.830905 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:36.830624    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 21:51:36.830905 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:36.830705    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54d776fcf9-wxsbc: secret "image-registry-tls" not found
Jul 09 21:51:36.830905 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:36.830746    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32a4b2a4-8551-4b0b-a786-c086fae647fc-registry-tls podName:32a4b2a4-8551-4b0b-a786-c086fae647fc nodeName:}" failed. No retries permitted until 2026-07-09 21:51:44.830735748 +0000 UTC m=+52.162235804 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/32a4b2a4-8551-4b0b-a786-c086fae647fc-registry-tls") pod "image-registry-54d776fcf9-wxsbc" (UID: "32a4b2a4-8551-4b0b-a786-c086fae647fc") : secret "image-registry-tls" not found
Jul 09 21:51:39.469401 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:39.469309    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cd9998d7-2x7c4" event={"ID":"19df1dd2-af4a-48ed-b7b5-0defafd5d5fe","Type":"ContainerStarted","Data":"1f0c81db53729e0fb8b35a60bb2d61dde2eb2219f678beed569557fb1a53dc55"}
Jul 09 21:51:39.469401 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:39.469361    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cd9998d7-2x7c4" event={"ID":"19df1dd2-af4a-48ed-b7b5-0defafd5d5fe","Type":"ContainerStarted","Data":"801e6ecb5f43d1bccbb006d718ab6062db7a3c28a71147726c9d11c86e6a76fc"}
Jul 09 21:51:39.469401 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:39.469378    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cd9998d7-2x7c4" event={"ID":"19df1dd2-af4a-48ed-b7b5-0defafd5d5fe","Type":"ContainerStarted","Data":"824be51fd07a2f14567a15d3eeb40095e2a39889a490c8f5ea6b968eb786b7a1"}
Jul 09 21:51:39.470900 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:39.470838    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zxhgh" event={"ID":"a98e7087-edbc-4c9e-804e-b6fa45440ffe","Type":"ContainerStarted","Data":"6dda3302ef63a3bb4961375cf948cdea30328a49fde1c34ee427c141b89fe9f1"}
Jul 09 21:51:39.472222 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:39.472197    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc97cbc4b-l8ljg" event={"ID":"2c38ee1b-3029-4868-a93f-54ad94b3122b","Type":"ContainerStarted","Data":"b88cfa6a279280f5d9f5ec4a28c533c1a609e651176fc1bc1987c3b3df356edd"}
Jul 09 21:51:39.472384 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:39.472362    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc97cbc4b-l8ljg"
Jul 09 21:51:39.474187 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:39.474167    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc97cbc4b-l8ljg"
Jul 09 21:51:39.475085 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:39.475061    2576 generic.go:356] "Generic (PLEG): container finished" podID="bc33c68c-1261-400d-991e-308f24c9210b" containerID="ce226799a1dae93a25439b601531f8636577170d4d365263b5b0ed6974d582fb" exitCode=0
Jul 09 21:51:39.475164 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:39.475134    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7tq48" event={"ID":"bc33c68c-1261-400d-991e-308f24c9210b","Type":"ContainerDied","Data":"ce226799a1dae93a25439b601531f8636577170d4d365263b5b0ed6974d582fb"}
Jul 09 21:51:39.476444 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:39.476422    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d7bc86db-ktmq9" event={"ID":"90442e8a-174f-4a0c-ad42-072254dc26b2","Type":"ContainerStarted","Data":"f33c9b7886ba37fdac67c416af7ce706580dffa9c8fababc6ebbec33433d2b8d"}
Jul 09 21:51:39.488117 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:39.488080    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cd9998d7-2x7c4" podStartSLOduration=8.04370594 podStartE2EDuration="17.488066583s" totalImagesPullingTime="9.444360643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 21:51:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:51:39.487510079 +0000 UTC m=+46.819010159" watchObservedRunningTime="2026-07-09 21:51:39.488066583 +0000 UTC m=+46.819566663"
Jul 09 21:51:39.528475 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:39.528418    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc97cbc4b-l8ljg" podStartSLOduration=8.085814091 podStartE2EDuration="17.528400465s" totalImagesPullingTime="9.442586374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 21:51:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:51:39.524387282 +0000 UTC m=+46.855887365" watchObservedRunningTime="2026-07-09 21:51:39.528400465 +0000 UTC m=+46.859900542"
Jul 09 21:51:39.543805 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:39.543640    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zxhgh" podStartSLOduration=1.176604504 podStartE2EDuration="10.543624639s" totalImagesPullingTime="9.367020135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 21:51:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:51:39.543094676 +0000 UTC m=+46.874594755" watchObservedRunningTime="2026-07-09 21:51:39.543624639 +0000 UTC m=+46.875124717"
Jul 09 21:51:39.558250 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:39.558191    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d7bc86db-ktmq9" podStartSLOduration=8.139671008 podStartE2EDuration="17.558169238s" totalImagesPullingTime="9.41849823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 21:51:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:51:39.557672385 +0000 UTC m=+46.889172460" watchObservedRunningTime="2026-07-09 21:51:39.558169238 +0000 UTC m=+46.889669318"
Jul 09 21:51:40.482356 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:40.482323    2576 generic.go:356] "Generic (PLEG): container finished" podID="bc33c68c-1261-400d-991e-308f24c9210b" containerID="26f37f32b1af26c3e4b83d297d0ee5b51a4a05ec97e04e93ffd20cfb20d4b7ab" exitCode=0
Jul 09 21:51:40.482835 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:40.482423    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7tq48" event={"ID":"bc33c68c-1261-400d-991e-308f24c9210b","Type":"ContainerDied","Data":"26f37f32b1af26c3e4b83d297d0ee5b51a4a05ec97e04e93ffd20cfb20d4b7ab"}
Jul 09 21:51:41.489438 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:41.489406    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7tq48" event={"ID":"bc33c68c-1261-400d-991e-308f24c9210b","Type":"ContainerStarted","Data":"d57f2226fc077de9779eaa050964a087894d6c78962fb372acdb542ac43da7a4"}
Jul 09 21:51:41.511895 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:41.511852    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7tq48" podStartSLOduration=9.0114006 podStartE2EDuration="48.51183308s" totalImagesPullingTime="39.50043248s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 21:50:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:51:41.511560126 +0000 UTC m=+48.843060203" watchObservedRunningTime="2026-07-09 21:51:41.51183308 +0000 UTC m=+48.843333161"
Jul 09 21:51:44.895727 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:44.895695    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/541b0dc1-1400-4cbf-96d1-d248a30a012d-metrics-tls\") pod \"dns-default-gtd7d\" (UID: \"541b0dc1-1400-4cbf-96d1-d248a30a012d\") " pod="openshift-dns/dns-default-gtd7d"
Jul 09 21:51:44.896199 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:44.895738    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32a4b2a4-8551-4b0b-a786-c086fae647fc-registry-tls\") pod \"image-registry-54d776fcf9-wxsbc\" (UID: \"32a4b2a4-8551-4b0b-a786-c086fae647fc\") " pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc"
Jul 09 21:51:44.896199 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:44.895819    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2cb9c33f-a330-489a-96bb-57a7a6ece91a-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-nlmg4\" (UID: \"2cb9c33f-a330-489a-96bb-57a7a6ece91a\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nlmg4"
Jul 09 21:51:44.896199 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:44.895858    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 21:51:44.896199 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:44.895914    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 09 21:51:44.896199 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:44.895973    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 21:51:44.896199 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:44.895996    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54d776fcf9-wxsbc: secret "image-registry-tls" not found
Jul 09 21:51:44.896199 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:44.895979    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/541b0dc1-1400-4cbf-96d1-d248a30a012d-metrics-tls podName:541b0dc1-1400-4cbf-96d1-d248a30a012d nodeName:}" failed. No retries permitted until 2026-07-09 21:52:00.895934632 +0000 UTC m=+68.227434707 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/541b0dc1-1400-4cbf-96d1-d248a30a012d-metrics-tls") pod "dns-default-gtd7d" (UID: "541b0dc1-1400-4cbf-96d1-d248a30a012d") : secret "dns-default-metrics-tls" not found
Jul 09 21:51:44.896199 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:44.896078    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cb9c33f-a330-489a-96bb-57a7a6ece91a-networking-console-plugin-cert podName:2cb9c33f-a330-489a-96bb-57a7a6ece91a nodeName:}" failed. No retries permitted until 2026-07-09 21:52:00.896060942 +0000 UTC m=+68.227561002 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2cb9c33f-a330-489a-96bb-57a7a6ece91a-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-nlmg4" (UID: "2cb9c33f-a330-489a-96bb-57a7a6ece91a") : secret "networking-console-plugin-cert" not found
Jul 09 21:51:44.896199 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:44.896097    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32a4b2a4-8551-4b0b-a786-c086fae647fc-registry-tls podName:32a4b2a4-8551-4b0b-a786-c086fae647fc nodeName:}" failed. No retries permitted until 2026-07-09 21:52:00.896090072 +0000 UTC m=+68.227590129 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/32a4b2a4-8551-4b0b-a786-c086fae647fc-registry-tls") pod "image-registry-54d776fcf9-wxsbc" (UID: "32a4b2a4-8551-4b0b-a786-c086fae647fc") : secret "image-registry-tls" not found
Jul 09 21:51:54.422509 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:54.422480    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-27vrn"
Jul 09 21:51:59.000107 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:59.000046    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b99eef2e-6748-4460-bd07-1f99729b663c-metrics-certs\") pod \"network-metrics-daemon-l49xl\" (UID: \"b99eef2e-6748-4460-bd07-1f99729b663c\") " pod="openshift-multus/network-metrics-daemon-l49xl"
Jul 09 21:51:59.000107 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:59.000117    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/442ba0c0-0b9e-4918-b8a6-c93618456a92-original-pull-secret\") pod \"global-pull-secret-syncer-fjm26\" (UID: \"442ba0c0-0b9e-4918-b8a6-c93618456a92\") " pod="kube-system/global-pull-secret-syncer-fjm26"
Jul 09 21:51:59.002948 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:59.002924    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 21:51:59.003045 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:59.003034    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 21:51:59.011097 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:59.011076    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 09 21:51:59.011175 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:51:59.011135    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b99eef2e-6748-4460-bd07-1f99729b663c-metrics-certs podName:b99eef2e-6748-4460-bd07-1f99729b663c nodeName:}" failed. No retries permitted until 2026-07-09 21:53:03.011119801 +0000 UTC m=+130.342619860 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b99eef2e-6748-4460-bd07-1f99729b663c-metrics-certs") pod "network-metrics-daemon-l49xl" (UID: "b99eef2e-6748-4460-bd07-1f99729b663c") : secret "metrics-daemon-secret" not found
Jul 09 21:51:59.014081 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:59.014056    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/442ba0c0-0b9e-4918-b8a6-c93618456a92-original-pull-secret\") pod \"global-pull-secret-syncer-fjm26\" (UID: \"442ba0c0-0b9e-4918-b8a6-c93618456a92\") " pod="kube-system/global-pull-secret-syncer-fjm26"
Jul 09 21:51:59.100967 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:59.100927    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vdft\" (UniqueName: \"kubernetes.io/projected/daa318c8-a79e-4833-8022-26e9db42aaa9-kube-api-access-7vdft\") pod \"network-check-target-gpncs\" (UID: \"daa318c8-a79e-4833-8022-26e9db42aaa9\") " pod="openshift-network-diagnostics/network-check-target-gpncs"
Jul 09 21:51:59.103665 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:59.103646    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 21:51:59.113714 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:59.113698    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 21:51:59.125091 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:59.125068    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vdft\" (UniqueName: \"kubernetes.io/projected/daa318c8-a79e-4833-8022-26e9db42aaa9-kube-api-access-7vdft\") pod \"network-check-target-gpncs\" (UID: \"daa318c8-a79e-4833-8022-26e9db42aaa9\") " pod="openshift-network-diagnostics/network-check-target-gpncs"
Jul 09 21:51:59.212093 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:59.212067    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-r7ms8\""
Jul 09 21:51:59.220086 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:59.220069    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gpncs"
Jul 09 21:51:59.308422 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:59.308393    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjm26"
Jul 09 21:51:59.343273 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:59.343244    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gpncs"]
Jul 09 21:51:59.346362 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:51:59.346333    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaa318c8_a79e_4833_8022_26e9db42aaa9.slice/crio-f372d3f159f703d993699ab647caf6356ae502074618ceb760a741f44867079e WatchSource:0}: Error finding container f372d3f159f703d993699ab647caf6356ae502074618ceb760a741f44867079e: Status 404 returned error can't find the container with id f372d3f159f703d993699ab647caf6356ae502074618ceb760a741f44867079e
Jul 09 21:51:59.431360 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:59.431317    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fjm26"]
Jul 09 21:51:59.433799 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:51:59.433777    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod442ba0c0_0b9e_4918_b8a6_c93618456a92.slice/crio-3311c2857f305f76bdcaa6529cfb9710759fa5c2fe332971e34893b11996ff6e WatchSource:0}: Error finding container 3311c2857f305f76bdcaa6529cfb9710759fa5c2fe332971e34893b11996ff6e: Status 404 returned error can't find the container with id 3311c2857f305f76bdcaa6529cfb9710759fa5c2fe332971e34893b11996ff6e
Jul 09 21:51:59.546406 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:59.546368    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gpncs" event={"ID":"daa318c8-a79e-4833-8022-26e9db42aaa9","Type":"ContainerStarted","Data":"f372d3f159f703d993699ab647caf6356ae502074618ceb760a741f44867079e"}
Jul 09 21:51:59.547356 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:51:59.547332    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fjm26" event={"ID":"442ba0c0-0b9e-4918-b8a6-c93618456a92","Type":"ContainerStarted","Data":"3311c2857f305f76bdcaa6529cfb9710759fa5c2fe332971e34893b11996ff6e"}
Jul 09 21:52:00.916172 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:52:00.916130    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/541b0dc1-1400-4cbf-96d1-d248a30a012d-metrics-tls\") pod \"dns-default-gtd7d\" (UID: \"541b0dc1-1400-4cbf-96d1-d248a30a012d\") " pod="openshift-dns/dns-default-gtd7d"
Jul 09 21:52:00.916740 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:52:00.916187    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32a4b2a4-8551-4b0b-a786-c086fae647fc-registry-tls\") pod \"image-registry-54d776fcf9-wxsbc\" (UID: \"32a4b2a4-8551-4b0b-a786-c086fae647fc\") " pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc"
Jul 09 21:52:00.916740 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:52:00.916255    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2cb9c33f-a330-489a-96bb-57a7a6ece91a-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-nlmg4\" (UID: \"2cb9c33f-a330-489a-96bb-57a7a6ece91a\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nlmg4"
Jul 09 21:52:00.916740 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:52:00.916301    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 21:52:00.916740 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:52:00.916365    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 09 21:52:00.916740 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:52:00.916377    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/541b0dc1-1400-4cbf-96d1-d248a30a012d-metrics-tls podName:541b0dc1-1400-4cbf-96d1-d248a30a012d nodeName:}" failed. No retries permitted until 2026-07-09 21:52:32.916354902 +0000 UTC m=+100.247854981 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/541b0dc1-1400-4cbf-96d1-d248a30a012d-metrics-tls") pod "dns-default-gtd7d" (UID: "541b0dc1-1400-4cbf-96d1-d248a30a012d") : secret "dns-default-metrics-tls" not found
Jul 09 21:52:00.916740 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:52:00.916306    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 21:52:00.916740 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:52:00.916408    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54d776fcf9-wxsbc: secret "image-registry-tls" not found
Jul 09 21:52:00.916740 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:52:00.916434    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cb9c33f-a330-489a-96bb-57a7a6ece91a-networking-console-plugin-cert podName:2cb9c33f-a330-489a-96bb-57a7a6ece91a nodeName:}" failed. No retries permitted until 2026-07-09 21:52:32.916403085 +0000 UTC m=+100.247903141 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2cb9c33f-a330-489a-96bb-57a7a6ece91a-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-nlmg4" (UID: "2cb9c33f-a330-489a-96bb-57a7a6ece91a") : secret "networking-console-plugin-cert" not found
Jul 09 21:52:00.916740 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:52:00.916469    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32a4b2a4-8551-4b0b-a786-c086fae647fc-registry-tls podName:32a4b2a4-8551-4b0b-a786-c086fae647fc nodeName:}" failed. No retries permitted until 2026-07-09 21:52:32.916452897 +0000 UTC m=+100.247952968 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/32a4b2a4-8551-4b0b-a786-c086fae647fc-registry-tls") pod "image-registry-54d776fcf9-wxsbc" (UID: "32a4b2a4-8551-4b0b-a786-c086fae647fc") : secret "image-registry-tls" not found
Jul 09 21:52:03.562841 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:52:03.562796    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gpncs" event={"ID":"daa318c8-a79e-4833-8022-26e9db42aaa9","Type":"ContainerStarted","Data":"a19862002e6d1b042c2594c3acafd800202bfefda0d1c8fe9fbf2fa483fb8f28"}
Jul 09 21:52:03.563319 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:52:03.562909    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gpncs"
Jul 09 21:52:03.578575 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:52:03.578522    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gpncs" podStartSLOduration=67.33022904 podStartE2EDuration="1m10.578498673s" totalImagesPullingTime="3.248269633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 21:50:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:52:03.577418081 +0000 UTC m=+70.908918172" watchObservedRunningTime="2026-07-09 21:52:03.578498673 +0000 UTC m=+70.909998754"
Jul 09 21:52:05.570051 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:52:05.570014    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fjm26" event={"ID":"442ba0c0-0b9e-4918-b8a6-c93618456a92","Type":"ContainerStarted","Data":"3aa10d0a410d5a6648dbaaac0b49a414f85d0dc337c542c8c9967de277ab97bf"}
Jul 09 21:52:05.585702 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:52:05.585628    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fjm26" podStartSLOduration=67.405613621 podStartE2EDuration="1m12.585612763s" totalImagesPullingTime="5.179999142s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 21:50:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:52:05.584612043 +0000 UTC m=+72.916112120" watchObservedRunningTime="2026-07-09 21:52:05.585612763 +0000 UTC m=+72.917112867"
Jul 09 21:52:32.965166 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:52:32.965025    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2cb9c33f-a330-489a-96bb-57a7a6ece91a-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-nlmg4\" (UID: \"2cb9c33f-a330-489a-96bb-57a7a6ece91a\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nlmg4"
Jul 09 21:52:32.965166 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:52:32.965092    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/541b0dc1-1400-4cbf-96d1-d248a30a012d-metrics-tls\") pod \"dns-default-gtd7d\" (UID: \"541b0dc1-1400-4cbf-96d1-d248a30a012d\") " pod="openshift-dns/dns-default-gtd7d"
Jul 09 21:52:32.965166 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:52:32.965123    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32a4b2a4-8551-4b0b-a786-c086fae647fc-registry-tls\") pod \"image-registry-54d776fcf9-wxsbc\" (UID: \"32a4b2a4-8551-4b0b-a786-c086fae647fc\") " pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc"
Jul 09 21:52:32.965767 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:52:32.965186    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 09 21:52:32.965767 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:52:32.965225    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 21:52:32.965767 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:52:32.965269    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cb9c33f-a330-489a-96bb-57a7a6ece91a-networking-console-plugin-cert podName:2cb9c33f-a330-489a-96bb-57a7a6ece91a nodeName:}" failed. No retries permitted until 2026-07-09 21:53:36.965252087 +0000 UTC m=+164.296752160 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2cb9c33f-a330-489a-96bb-57a7a6ece91a-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-nlmg4" (UID: "2cb9c33f-a330-489a-96bb-57a7a6ece91a") : secret "networking-console-plugin-cert" not found
Jul 09 21:52:32.965767 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:52:32.965313    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/541b0dc1-1400-4cbf-96d1-d248a30a012d-metrics-tls podName:541b0dc1-1400-4cbf-96d1-d248a30a012d nodeName:}" failed. No retries permitted until 2026-07-09 21:53:36.965289043 +0000 UTC m=+164.296789103 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/541b0dc1-1400-4cbf-96d1-d248a30a012d-metrics-tls") pod "dns-default-gtd7d" (UID: "541b0dc1-1400-4cbf-96d1-d248a30a012d") : secret "dns-default-metrics-tls" not found
Jul 09 21:52:32.965767 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:52:32.965238    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 21:52:32.965767 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:52:32.965334    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54d776fcf9-wxsbc: secret "image-registry-tls" not found
Jul 09 21:52:32.965767 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:52:32.965374    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32a4b2a4-8551-4b0b-a786-c086fae647fc-registry-tls podName:32a4b2a4-8551-4b0b-a786-c086fae647fc nodeName:}" failed. No retries permitted until 2026-07-09 21:53:36.965364288 +0000 UTC m=+164.296864346 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/32a4b2a4-8551-4b0b-a786-c086fae647fc-registry-tls") pod "image-registry-54d776fcf9-wxsbc" (UID: "32a4b2a4-8551-4b0b-a786-c086fae647fc") : secret "image-registry-tls" not found
Jul 09 21:52:34.568340 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:52:34.568312    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gpncs"
Jul 09 21:53:03.072049 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:53:03.072012    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b99eef2e-6748-4460-bd07-1f99729b663c-metrics-certs\") pod \"network-metrics-daemon-l49xl\" (UID: \"b99eef2e-6748-4460-bd07-1f99729b663c\") " pod="openshift-multus/network-metrics-daemon-l49xl"
Jul 09 21:53:03.072517 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:53:03.072114    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 09 21:53:03.072517 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:53:03.072172    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b99eef2e-6748-4460-bd07-1f99729b663c-metrics-certs podName:b99eef2e-6748-4460-bd07-1f99729b663c nodeName:}" failed. No retries permitted until 2026-07-09 21:55:05.072158345 +0000 UTC m=+252.403658410 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b99eef2e-6748-4460-bd07-1f99729b663c-metrics-certs") pod "network-metrics-daemon-l49xl" (UID: "b99eef2e-6748-4460-bd07-1f99729b663c") : secret "metrics-daemon-secret" not found
Jul 09 21:53:32.033740 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:53:32.033691    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-nlmg4" podUID="2cb9c33f-a330-489a-96bb-57a7a6ece91a"
Jul 09 21:53:32.067324 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:53:32.067298    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc" podUID="32a4b2a4-8551-4b0b-a786-c086fae647fc"
Jul 09 21:53:32.095579 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:53:32.095554    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-gtd7d" podUID="541b0dc1-1400-4cbf-96d1-d248a30a012d"
Jul 09 21:53:32.204639 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:53:32.204615    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-l49xl" podUID="b99eef2e-6748-4460-bd07-1f99729b663c"
Jul 09 21:53:32.818675 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:53:32.818645    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gtd7d"
Jul 09 21:53:32.818850 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:53:32.818645    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc"
Jul 09 21:53:32.818850 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:53:32.818645    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-nlmg4"
Jul 09 21:53:37.012585 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:53:37.012539    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2cb9c33f-a330-489a-96bb-57a7a6ece91a-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-nlmg4\" (UID: \"2cb9c33f-a330-489a-96bb-57a7a6ece91a\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nlmg4"
Jul 09 21:53:37.012585 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:53:37.012597    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/541b0dc1-1400-4cbf-96d1-d248a30a012d-metrics-tls\") pod \"dns-default-gtd7d\" (UID: \"541b0dc1-1400-4cbf-96d1-d248a30a012d\") " pod="openshift-dns/dns-default-gtd7d"
Jul 09 21:53:37.013032 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:53:37.012617    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32a4b2a4-8551-4b0b-a786-c086fae647fc-registry-tls\") pod \"image-registry-54d776fcf9-wxsbc\" (UID: \"32a4b2a4-8551-4b0b-a786-c086fae647fc\") " pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc"
Jul 09 21:53:37.013032 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:53:37.012677    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 09 21:53:37.013032 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:53:37.012736    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cb9c33f-a330-489a-96bb-57a7a6ece91a-networking-console-plugin-cert podName:2cb9c33f-a330-489a-96bb-57a7a6ece91a nodeName:}" failed. No retries permitted until 2026-07-09 21:55:39.012720161 +0000 UTC m=+286.344220220 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2cb9c33f-a330-489a-96bb-57a7a6ece91a-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-nlmg4" (UID: "2cb9c33f-a330-489a-96bb-57a7a6ece91a") : secret "networking-console-plugin-cert" not found
Jul 09 21:53:37.013032 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:53:37.012750    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 21:53:37.013032 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:53:37.012788    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 21:53:37.013032 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:53:37.012800    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54d776fcf9-wxsbc: secret "image-registry-tls" not found
Jul 09 21:53:37.013032 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:53:37.012817    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/541b0dc1-1400-4cbf-96d1-d248a30a012d-metrics-tls podName:541b0dc1-1400-4cbf-96d1-d248a30a012d nodeName:}" failed. No retries permitted until 2026-07-09 21:55:39.012803289 +0000 UTC m=+286.344303345 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/541b0dc1-1400-4cbf-96d1-d248a30a012d-metrics-tls") pod "dns-default-gtd7d" (UID: "541b0dc1-1400-4cbf-96d1-d248a30a012d") : secret "dns-default-metrics-tls" not found
Jul 09 21:53:37.013032 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:53:37.012858    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32a4b2a4-8551-4b0b-a786-c086fae647fc-registry-tls podName:32a4b2a4-8551-4b0b-a786-c086fae647fc nodeName:}" failed. No retries permitted until 2026-07-09 21:55:39.012848664 +0000 UTC m=+286.344348743 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/32a4b2a4-8551-4b0b-a786-c086fae647fc-registry-tls") pod "image-registry-54d776fcf9-wxsbc" (UID: "32a4b2a4-8551-4b0b-a786-c086fae647fc") : secret "image-registry-tls" not found
Jul 09 21:53:39.343188 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:53:39.343138    2576 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc97cbc4b-l8ljg" podUID="2c38ee1b-3029-4868-a93f-54ad94b3122b" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.7:8000/healthz\": dial tcp 10.132.0.7:8000: connect: connection refused"
Jul 09 21:53:39.360690 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:53:39.360662    2576 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d7bc86db-ktmq9" podUID="90442e8a-174f-4a0c-ad42-072254dc26b2" containerName="addon-agent" probeResult="failure" output="Get \"http://10.132.0.8:8000/healthz\": dial tcp 10.132.0.8:8000: connect: connection refused"
Jul 09 21:53:39.472715 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:53:39.472650    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc97cbc4b-l8ljg" podUID="2c38ee1b-3029-4868-a93f-54ad94b3122b" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.7:8000/readyz\": dial tcp 10.132.0.7:8000: connect: connection refused"
Jul 09 21:53:39.839031 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:53:39.839002    2576 generic.go:356] "Generic (PLEG): container finished" podID="2c38ee1b-3029-4868-a93f-54ad94b3122b" containerID="b88cfa6a279280f5d9f5ec4a28c533c1a609e651176fc1bc1987c3b3df356edd" exitCode=1
Jul 09 21:53:39.839221 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:53:39.839080    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc97cbc4b-l8ljg" event={"ID":"2c38ee1b-3029-4868-a93f-54ad94b3122b","Type":"ContainerDied","Data":"b88cfa6a279280f5d9f5ec4a28c533c1a609e651176fc1bc1987c3b3df356edd"}
Jul 09 21:53:39.839434 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:53:39.839406    2576 scope.go:117] "RemoveContainer" containerID="b88cfa6a279280f5d9f5ec4a28c533c1a609e651176fc1bc1987c3b3df356edd"
Jul 09 21:53:39.840499 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:53:39.840475    2576 generic.go:356] "Generic (PLEG): container finished" podID="90442e8a-174f-4a0c-ad42-072254dc26b2" containerID="f33c9b7886ba37fdac67c416af7ce706580dffa9c8fababc6ebbec33433d2b8d" exitCode=255
Jul 09 21:53:39.840581 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:53:39.840515    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d7bc86db-ktmq9" event={"ID":"90442e8a-174f-4a0c-ad42-072254dc26b2","Type":"ContainerDied","Data":"f33c9b7886ba37fdac67c416af7ce706580dffa9c8fababc6ebbec33433d2b8d"}
Jul 09 21:53:39.840782 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:53:39.840766    2576 scope.go:117] "RemoveContainer" containerID="f33c9b7886ba37fdac67c416af7ce706580dffa9c8fababc6ebbec33433d2b8d"
Jul 09 21:53:40.845209 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:53:40.845174    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d7bc86db-ktmq9" event={"ID":"90442e8a-174f-4a0c-ad42-072254dc26b2","Type":"ContainerStarted","Data":"1308d227703daf8f94078752fb7055927dcb0152576288c81f71ad6a024fe0ba"}
Jul 09 21:53:40.846860 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:53:40.846838    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc97cbc4b-l8ljg" event={"ID":"2c38ee1b-3029-4868-a93f-54ad94b3122b","Type":"ContainerStarted","Data":"7fe36395c0c8ff472e5376fea24aa2e03496dd4709ecb1db67f4bbc51fe865ad"}
Jul 09 21:53:40.847151 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:53:40.847133    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc97cbc4b-l8ljg"
Jul 09 21:53:40.848033 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:53:40.848016    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc97cbc4b-l8ljg"
Jul 09 21:53:43.195234 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:53:43.195204    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l49xl"
Jul 09 21:55:05.114481 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:05.114447    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b99eef2e-6748-4460-bd07-1f99729b663c-metrics-certs\") pod \"network-metrics-daemon-l49xl\" (UID: \"b99eef2e-6748-4460-bd07-1f99729b663c\") " pod="openshift-multus/network-metrics-daemon-l49xl"
Jul 09 21:55:05.115099 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:55:05.114651    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 09 21:55:05.115099 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:55:05.114729    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b99eef2e-6748-4460-bd07-1f99729b663c-metrics-certs podName:b99eef2e-6748-4460-bd07-1f99729b663c nodeName:}" failed. No retries permitted until 2026-07-09 21:57:07.114708152 +0000 UTC m=+374.446208208 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b99eef2e-6748-4460-bd07-1f99729b663c-metrics-certs") pod "network-metrics-daemon-l49xl" (UID: "b99eef2e-6748-4460-bd07-1f99729b663c") : secret "metrics-daemon-secret" not found
Jul 09 21:55:19.831871 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:19.831801    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xqbg6"]
Jul 09 21:55:19.833762 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:19.833746    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xqbg6"
Jul 09 21:55:19.836291 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:19.836270    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 09 21:55:19.836456 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:19.836440    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 09 21:55:19.836456 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:19.836454    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-78g6p\""
Jul 09 21:55:19.837397 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:19.837379    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 09 21:55:19.837502 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:19.837452    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 09 21:55:19.851183 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:19.851162    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xqbg6"]
Jul 09 21:55:19.906000 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:19.905977    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/44a8d0af-a142-4ca6-8d6e-caee08f1f2e0-crio-socket\") pod \"insights-runtime-extractor-xqbg6\" (UID: \"44a8d0af-a142-4ca6-8d6e-caee08f1f2e0\") " pod="openshift-insights/insights-runtime-extractor-xqbg6"
Jul 09 21:55:19.906087 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:19.906033    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpnnh\" (UniqueName: \"kubernetes.io/projected/44a8d0af-a142-4ca6-8d6e-caee08f1f2e0-kube-api-access-dpnnh\") pod \"insights-runtime-extractor-xqbg6\" (UID: \"44a8d0af-a142-4ca6-8d6e-caee08f1f2e0\") " pod="openshift-insights/insights-runtime-extractor-xqbg6"
Jul 09 21:55:19.906155 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:19.906099    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/44a8d0af-a142-4ca6-8d6e-caee08f1f2e0-data-volume\") pod \"insights-runtime-extractor-xqbg6\" (UID: \"44a8d0af-a142-4ca6-8d6e-caee08f1f2e0\") " pod="openshift-insights/insights-runtime-extractor-xqbg6"
Jul 09 21:55:19.906155 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:19.906147    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/44a8d0af-a142-4ca6-8d6e-caee08f1f2e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xqbg6\" (UID: \"44a8d0af-a142-4ca6-8d6e-caee08f1f2e0\") " pod="openshift-insights/insights-runtime-extractor-xqbg6"
Jul 09 21:55:19.906220 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:19.906178    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/44a8d0af-a142-4ca6-8d6e-caee08f1f2e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xqbg6\" (UID: \"44a8d0af-a142-4ca6-8d6e-caee08f1f2e0\") " pod="openshift-insights/insights-runtime-extractor-xqbg6"
Jul 09 21:55:20.006430 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:20.006402    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpnnh\" (UniqueName: \"kubernetes.io/projected/44a8d0af-a142-4ca6-8d6e-caee08f1f2e0-kube-api-access-dpnnh\") pod \"insights-runtime-extractor-xqbg6\" (UID: \"44a8d0af-a142-4ca6-8d6e-caee08f1f2e0\") " pod="openshift-insights/insights-runtime-extractor-xqbg6"
Jul 09 21:55:20.006529 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:20.006447    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/44a8d0af-a142-4ca6-8d6e-caee08f1f2e0-data-volume\") pod \"insights-runtime-extractor-xqbg6\" (UID: \"44a8d0af-a142-4ca6-8d6e-caee08f1f2e0\") " pod="openshift-insights/insights-runtime-extractor-xqbg6"
Jul 09 21:55:20.006529 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:20.006471    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/44a8d0af-a142-4ca6-8d6e-caee08f1f2e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xqbg6\" (UID: \"44a8d0af-a142-4ca6-8d6e-caee08f1f2e0\") " pod="openshift-insights/insights-runtime-extractor-xqbg6"
Jul 09 21:55:20.006529 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:20.006506    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/44a8d0af-a142-4ca6-8d6e-caee08f1f2e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xqbg6\" (UID: \"44a8d0af-a142-4ca6-8d6e-caee08f1f2e0\") " pod="openshift-insights/insights-runtime-extractor-xqbg6"
Jul 09 21:55:20.006646 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:20.006549    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/44a8d0af-a142-4ca6-8d6e-caee08f1f2e0-crio-socket\") pod \"insights-runtime-extractor-xqbg6\" (UID: \"44a8d0af-a142-4ca6-8d6e-caee08f1f2e0\") " pod="openshift-insights/insights-runtime-extractor-xqbg6"
Jul 09 21:55:20.006646 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:55:20.006555    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 21:55:20.006646 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:55:20.006590    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 21:55:20.006646 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:55:20.006633    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/44a8d0af-a142-4ca6-8d6e-caee08f1f2e0-kube-rbac-proxy-cm podName:44a8d0af-a142-4ca6-8d6e-caee08f1f2e0 nodeName:}" failed. No retries permitted until 2026-07-09 21:55:20.506614319 +0000 UTC m=+267.838114389 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/44a8d0af-a142-4ca6-8d6e-caee08f1f2e0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xqbg6" (UID: "44a8d0af-a142-4ca6-8d6e-caee08f1f2e0") : configmap "kube-rbac-proxy" not found
Jul 09 21:55:20.006794 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:55:20.006652    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44a8d0af-a142-4ca6-8d6e-caee08f1f2e0-insights-runtime-extractor-tls podName:44a8d0af-a142-4ca6-8d6e-caee08f1f2e0 nodeName:}" failed. No retries permitted until 2026-07-09 21:55:20.50664302 +0000 UTC m=+267.838143076 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/44a8d0af-a142-4ca6-8d6e-caee08f1f2e0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xqbg6" (UID: "44a8d0af-a142-4ca6-8d6e-caee08f1f2e0") : secret "insights-runtime-extractor-tls" not found
Jul 09 21:55:20.006794 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:20.006662    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/44a8d0af-a142-4ca6-8d6e-caee08f1f2e0-crio-socket\") pod \"insights-runtime-extractor-xqbg6\" (UID: \"44a8d0af-a142-4ca6-8d6e-caee08f1f2e0\") " pod="openshift-insights/insights-runtime-extractor-xqbg6"
Jul 09 21:55:20.006794 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:20.006755    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/44a8d0af-a142-4ca6-8d6e-caee08f1f2e0-data-volume\") pod \"insights-runtime-extractor-xqbg6\" (UID: \"44a8d0af-a142-4ca6-8d6e-caee08f1f2e0\") " pod="openshift-insights/insights-runtime-extractor-xqbg6"
Jul 09 21:55:20.014536 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:20.014512    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpnnh\" (UniqueName: \"kubernetes.io/projected/44a8d0af-a142-4ca6-8d6e-caee08f1f2e0-kube-api-access-dpnnh\") pod \"insights-runtime-extractor-xqbg6\" (UID: \"44a8d0af-a142-4ca6-8d6e-caee08f1f2e0\") " pod="openshift-insights/insights-runtime-extractor-xqbg6"
Jul 09 21:55:20.510266 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:20.510237    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/44a8d0af-a142-4ca6-8d6e-caee08f1f2e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xqbg6\" (UID: \"44a8d0af-a142-4ca6-8d6e-caee08f1f2e0\") " pod="openshift-insights/insights-runtime-extractor-xqbg6"
Jul 09 21:55:20.510427 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:20.510272    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/44a8d0af-a142-4ca6-8d6e-caee08f1f2e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xqbg6\" (UID: \"44a8d0af-a142-4ca6-8d6e-caee08f1f2e0\") " pod="openshift-insights/insights-runtime-extractor-xqbg6"
Jul 09 21:55:20.510427 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:55:20.510357    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 21:55:20.510427 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:55:20.510416    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/44a8d0af-a142-4ca6-8d6e-caee08f1f2e0-kube-rbac-proxy-cm podName:44a8d0af-a142-4ca6-8d6e-caee08f1f2e0 nodeName:}" failed. No retries permitted until 2026-07-09 21:55:21.510402193 +0000 UTC m=+268.841902248 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/44a8d0af-a142-4ca6-8d6e-caee08f1f2e0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xqbg6" (UID: "44a8d0af-a142-4ca6-8d6e-caee08f1f2e0") : configmap "kube-rbac-proxy" not found
Jul 09 21:55:20.510427 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:55:20.510366    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 21:55:20.510558 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:55:20.510451    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44a8d0af-a142-4ca6-8d6e-caee08f1f2e0-insights-runtime-extractor-tls podName:44a8d0af-a142-4ca6-8d6e-caee08f1f2e0 nodeName:}" failed. No retries permitted until 2026-07-09 21:55:21.510445326 +0000 UTC m=+268.841945381 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/44a8d0af-a142-4ca6-8d6e-caee08f1f2e0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xqbg6" (UID: "44a8d0af-a142-4ca6-8d6e-caee08f1f2e0") : secret "insights-runtime-extractor-tls" not found
Jul 09 21:55:21.519868 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:21.519821    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/44a8d0af-a142-4ca6-8d6e-caee08f1f2e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xqbg6\" (UID: \"44a8d0af-a142-4ca6-8d6e-caee08f1f2e0\") " pod="openshift-insights/insights-runtime-extractor-xqbg6"
Jul 09 21:55:21.519868 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:21.519872    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/44a8d0af-a142-4ca6-8d6e-caee08f1f2e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xqbg6\" (UID: \"44a8d0af-a142-4ca6-8d6e-caee08f1f2e0\") " pod="openshift-insights/insights-runtime-extractor-xqbg6"
Jul 09 21:55:21.520321 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:55:21.519972    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 21:55:21.520321 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:55:21.520011    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 21:55:21.520321 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:55:21.520048    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/44a8d0af-a142-4ca6-8d6e-caee08f1f2e0-kube-rbac-proxy-cm podName:44a8d0af-a142-4ca6-8d6e-caee08f1f2e0 nodeName:}" failed. No retries permitted until 2026-07-09 21:55:23.52002983 +0000 UTC m=+270.851529889 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/44a8d0af-a142-4ca6-8d6e-caee08f1f2e0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xqbg6" (UID: "44a8d0af-a142-4ca6-8d6e-caee08f1f2e0") : configmap "kube-rbac-proxy" not found
Jul 09 21:55:21.520321 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:55:21.520063    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44a8d0af-a142-4ca6-8d6e-caee08f1f2e0-insights-runtime-extractor-tls podName:44a8d0af-a142-4ca6-8d6e-caee08f1f2e0 nodeName:}" failed. No retries permitted until 2026-07-09 21:55:23.520056565 +0000 UTC m=+270.851556620 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/44a8d0af-a142-4ca6-8d6e-caee08f1f2e0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xqbg6" (UID: "44a8d0af-a142-4ca6-8d6e-caee08f1f2e0") : secret "insights-runtime-extractor-tls" not found
Jul 09 21:55:22.831336 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:22.831311    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fvncf_7130e58c-a513-4666-8938-c16760ff494c/dns-node-resolver/0.log"
Jul 09 21:55:23.535640 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:23.535594    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/44a8d0af-a142-4ca6-8d6e-caee08f1f2e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xqbg6\" (UID: \"44a8d0af-a142-4ca6-8d6e-caee08f1f2e0\") " pod="openshift-insights/insights-runtime-extractor-xqbg6"
Jul 09 21:55:23.535640 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:23.535645    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/44a8d0af-a142-4ca6-8d6e-caee08f1f2e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xqbg6\" (UID: \"44a8d0af-a142-4ca6-8d6e-caee08f1f2e0\") " pod="openshift-insights/insights-runtime-extractor-xqbg6"
Jul 09 21:55:23.535863 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:55:23.535729    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 21:55:23.535863 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:55:23.535761    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 21:55:23.535863 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:55:23.535799    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/44a8d0af-a142-4ca6-8d6e-caee08f1f2e0-kube-rbac-proxy-cm podName:44a8d0af-a142-4ca6-8d6e-caee08f1f2e0 nodeName:}" failed. No retries permitted until 2026-07-09 21:55:27.535784748 +0000 UTC m=+274.867284804 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/44a8d0af-a142-4ca6-8d6e-caee08f1f2e0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xqbg6" (UID: "44a8d0af-a142-4ca6-8d6e-caee08f1f2e0") : configmap "kube-rbac-proxy" not found
Jul 09 21:55:23.535863 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:55:23.535815    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44a8d0af-a142-4ca6-8d6e-caee08f1f2e0-insights-runtime-extractor-tls podName:44a8d0af-a142-4ca6-8d6e-caee08f1f2e0 nodeName:}" failed. No retries permitted until 2026-07-09 21:55:27.53580865 +0000 UTC m=+274.867308705 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/44a8d0af-a142-4ca6-8d6e-caee08f1f2e0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xqbg6" (UID: "44a8d0af-a142-4ca6-8d6e-caee08f1f2e0") : secret "insights-runtime-extractor-tls" not found
Jul 09 21:55:23.632332 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:23.632310    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qngdz_31a02e15-5a13-4e04-a0ba-8e5667bd9420/node-ca/0.log"
Jul 09 21:55:24.631103 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:24.631072    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zxhgh_a98e7087-edbc-4c9e-804e-b6fa45440ffe/serve-healthcheck-canary/0.log"
Jul 09 21:55:27.566977 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:27.566889    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/44a8d0af-a142-4ca6-8d6e-caee08f1f2e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xqbg6\" (UID: \"44a8d0af-a142-4ca6-8d6e-caee08f1f2e0\") " pod="openshift-insights/insights-runtime-extractor-xqbg6"
Jul 09 21:55:27.566977 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:27.566926    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/44a8d0af-a142-4ca6-8d6e-caee08f1f2e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xqbg6\" (UID: \"44a8d0af-a142-4ca6-8d6e-caee08f1f2e0\") " pod="openshift-insights/insights-runtime-extractor-xqbg6"
Jul 09 21:55:27.567361 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:55:27.567014    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 21:55:27.567361 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:55:27.567030    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 21:55:27.567361 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:55:27.567071    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/44a8d0af-a142-4ca6-8d6e-caee08f1f2e0-kube-rbac-proxy-cm podName:44a8d0af-a142-4ca6-8d6e-caee08f1f2e0 nodeName:}" failed. No retries permitted until 2026-07-09 21:55:35.567057225 +0000 UTC m=+282.898557281 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/44a8d0af-a142-4ca6-8d6e-caee08f1f2e0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xqbg6" (UID: "44a8d0af-a142-4ca6-8d6e-caee08f1f2e0") : configmap "kube-rbac-proxy" not found
Jul 09 21:55:27.567361 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:55:27.567089    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44a8d0af-a142-4ca6-8d6e-caee08f1f2e0-insights-runtime-extractor-tls podName:44a8d0af-a142-4ca6-8d6e-caee08f1f2e0 nodeName:}" failed. No retries permitted until 2026-07-09 21:55:35.567078554 +0000 UTC m=+282.898578610 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/44a8d0af-a142-4ca6-8d6e-caee08f1f2e0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xqbg6" (UID: "44a8d0af-a142-4ca6-8d6e-caee08f1f2e0") : secret "insights-runtime-extractor-tls" not found
Jul 09 21:55:29.376182 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:29.376147    2576 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cd9998d7-2x7c4" podUID="19df1dd2-af4a-48ed-b7b5-0defafd5d5fe" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 09 21:55:35.628745 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:35.628716    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/44a8d0af-a142-4ca6-8d6e-caee08f1f2e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xqbg6\" (UID: \"44a8d0af-a142-4ca6-8d6e-caee08f1f2e0\") " pod="openshift-insights/insights-runtime-extractor-xqbg6"
Jul 09 21:55:35.629232 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:35.628753    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/44a8d0af-a142-4ca6-8d6e-caee08f1f2e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xqbg6\" (UID: \"44a8d0af-a142-4ca6-8d6e-caee08f1f2e0\") " pod="openshift-insights/insights-runtime-extractor-xqbg6"
Jul 09 21:55:35.629275 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:35.629227    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/44a8d0af-a142-4ca6-8d6e-caee08f1f2e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xqbg6\" (UID: \"44a8d0af-a142-4ca6-8d6e-caee08f1f2e0\") " pod="openshift-insights/insights-runtime-extractor-xqbg6"
Jul 09 21:55:35.630967 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:35.630933    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/44a8d0af-a142-4ca6-8d6e-caee08f1f2e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xqbg6\" (UID: \"44a8d0af-a142-4ca6-8d6e-caee08f1f2e0\") " pod="openshift-insights/insights-runtime-extractor-xqbg6"
Jul 09 21:55:35.742069 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:35.742047    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xqbg6"
Jul 09 21:55:35.819432 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:55:35.819393    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc" podUID="32a4b2a4-8551-4b0b-a786-c086fae647fc"
Jul 09 21:55:35.819546 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:55:35.819410    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-gtd7d" podUID="541b0dc1-1400-4cbf-96d1-d248a30a012d"
Jul 09 21:55:35.819546 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:55:35.819410    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-nlmg4" podUID="2cb9c33f-a330-489a-96bb-57a7a6ece91a"
Jul 09 21:55:35.858917 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:35.858895    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xqbg6"]
Jul 09 21:55:35.861333 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:55:35.861309    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44a8d0af_a142_4ca6_8d6e_caee08f1f2e0.slice/crio-a21bf914851254d02f5da985b67da7a4669a4b88ed8ae0084c4f15d8a3e7ce0c WatchSource:0}: Error finding container a21bf914851254d02f5da985b67da7a4669a4b88ed8ae0084c4f15d8a3e7ce0c: Status 404 returned error can't find the container with id a21bf914851254d02f5da985b67da7a4669a4b88ed8ae0084c4f15d8a3e7ce0c
Jul 09 21:55:36.177804 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:36.177775    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gtd7d"
Jul 09 21:55:36.177804 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:36.177799    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-nlmg4"
Jul 09 21:55:36.178057 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:36.177802    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xqbg6" event={"ID":"44a8d0af-a142-4ca6-8d6e-caee08f1f2e0","Type":"ContainerStarted","Data":"a21bf914851254d02f5da985b67da7a4669a4b88ed8ae0084c4f15d8a3e7ce0c"}
Jul 09 21:55:36.178057 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:36.178005    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc"
Jul 09 21:55:39.057547 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:39.057511    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2cb9c33f-a330-489a-96bb-57a7a6ece91a-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-nlmg4\" (UID: \"2cb9c33f-a330-489a-96bb-57a7a6ece91a\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nlmg4"
Jul 09 21:55:39.058025 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:39.057577    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/541b0dc1-1400-4cbf-96d1-d248a30a012d-metrics-tls\") pod \"dns-default-gtd7d\" (UID: \"541b0dc1-1400-4cbf-96d1-d248a30a012d\") " pod="openshift-dns/dns-default-gtd7d"
Jul 09 21:55:39.058025 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:39.057610    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32a4b2a4-8551-4b0b-a786-c086fae647fc-registry-tls\") pod \"image-registry-54d776fcf9-wxsbc\" (UID: \"32a4b2a4-8551-4b0b-a786-c086fae647fc\") " pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc"
Jul 09 21:55:39.060287 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:39.060259    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/541b0dc1-1400-4cbf-96d1-d248a30a012d-metrics-tls\") pod \"dns-default-gtd7d\" (UID: \"541b0dc1-1400-4cbf-96d1-d248a30a012d\") " pod="openshift-dns/dns-default-gtd7d"
Jul 09 21:55:39.060410 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:39.060261    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2cb9c33f-a330-489a-96bb-57a7a6ece91a-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-nlmg4\" (UID: \"2cb9c33f-a330-489a-96bb-57a7a6ece91a\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nlmg4"
Jul 09 21:55:39.060410 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:39.060262    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32a4b2a4-8551-4b0b-a786-c086fae647fc-registry-tls\") pod \"image-registry-54d776fcf9-wxsbc\" (UID: \"32a4b2a4-8551-4b0b-a786-c086fae647fc\") " pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc"
Jul 09 21:55:39.182459 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:39.182427    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-pnthd\""
Jul 09 21:55:39.182459 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:39.182427    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hx9tw\""
Jul 09 21:55:39.182651 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:39.182459    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4k4f4\""
Jul 09 21:55:39.188649 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:39.188628    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc"
Jul 09 21:55:39.188783 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:39.188768    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gtd7d"
Jul 09 21:55:39.188853 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:39.188793    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-nlmg4"
Jul 09 21:55:39.376414 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:39.376323    2576 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cd9998d7-2x7c4" podUID="19df1dd2-af4a-48ed-b7b5-0defafd5d5fe" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 09 21:55:39.687186 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:39.687115    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-nlmg4"]
Jul 09 21:55:39.690834 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:55:39.690811    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cb9c33f_a330_489a_96bb_57a7a6ece91a.slice/crio-85e8ded550e87d6b517f99bfe23f91467ef1a5193b307bb009d59e71082fecab WatchSource:0}: Error finding container 85e8ded550e87d6b517f99bfe23f91467ef1a5193b307bb009d59e71082fecab: Status 404 returned error can't find the container with id 85e8ded550e87d6b517f99bfe23f91467ef1a5193b307bb009d59e71082fecab
Jul 09 21:55:39.704093 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:39.704070    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54d776fcf9-wxsbc"]
Jul 09 21:55:39.707944 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:55:39.707916    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32a4b2a4_8551_4b0b_a786_c086fae647fc.slice/crio-c907169c47ee41a21a83af0dd6faf1577c917ba8bef20b21cff529c871238f69 WatchSource:0}: Error finding container c907169c47ee41a21a83af0dd6faf1577c917ba8bef20b21cff529c871238f69: Status 404 returned error can't find the container with id c907169c47ee41a21a83af0dd6faf1577c917ba8bef20b21cff529c871238f69
Jul 09 21:55:39.716032 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:39.716011    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gtd7d"]
Jul 09 21:55:39.718625 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:55:39.718603    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod541b0dc1_1400_4cbf_96d1_d248a30a012d.slice/crio-f952ac101a1c5834762425dc24a6254b4ad657dbe6fef1ef646247865c1b76a9 WatchSource:0}: Error finding container f952ac101a1c5834762425dc24a6254b4ad657dbe6fef1ef646247865c1b76a9: Status 404 returned error can't find the container with id f952ac101a1c5834762425dc24a6254b4ad657dbe6fef1ef646247865c1b76a9
Jul 09 21:55:40.194606 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:40.194578    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gtd7d" event={"ID":"541b0dc1-1400-4cbf-96d1-d248a30a012d","Type":"ContainerStarted","Data":"f952ac101a1c5834762425dc24a6254b4ad657dbe6fef1ef646247865c1b76a9"}
Jul 09 21:55:40.196121 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:40.196092    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc" event={"ID":"32a4b2a4-8551-4b0b-a786-c086fae647fc","Type":"ContainerStarted","Data":"b92e6dc3a8a94a60e9266bcfd5f77fd315f03ab082c6ba1297e12d509f23b5dc"}
Jul 09 21:55:40.196250 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:40.196141    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc" event={"ID":"32a4b2a4-8551-4b0b-a786-c086fae647fc","Type":"ContainerStarted","Data":"c907169c47ee41a21a83af0dd6faf1577c917ba8bef20b21cff529c871238f69"}
Jul 09 21:55:40.196316 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:40.196245    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc"
Jul 09 21:55:40.197223 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:40.197200    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-nlmg4" event={"ID":"2cb9c33f-a330-489a-96bb-57a7a6ece91a","Type":"ContainerStarted","Data":"85e8ded550e87d6b517f99bfe23f91467ef1a5193b307bb009d59e71082fecab"}
Jul 09 21:55:40.198736 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:40.198718    2576 generic.go:356] "Generic (PLEG): container finished" podID="2c38ee1b-3029-4868-a93f-54ad94b3122b" containerID="7fe36395c0c8ff472e5376fea24aa2e03496dd4709ecb1db67f4bbc51fe865ad" exitCode=1
Jul 09 21:55:40.198831 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:40.198778    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc97cbc4b-l8ljg" event={"ID":"2c38ee1b-3029-4868-a93f-54ad94b3122b","Type":"ContainerDied","Data":"7fe36395c0c8ff472e5376fea24aa2e03496dd4709ecb1db67f4bbc51fe865ad"}
Jul 09 21:55:40.198831 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:40.198818    2576 scope.go:117] "RemoveContainer" containerID="b88cfa6a279280f5d9f5ec4a28c533c1a609e651176fc1bc1987c3b3df356edd"
Jul 09 21:55:40.199119 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:40.199104    2576 scope.go:117] "RemoveContainer" containerID="7fe36395c0c8ff472e5376fea24aa2e03496dd4709ecb1db67f4bbc51fe865ad"
Jul 09 21:55:40.199283 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:55:40.199264    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-7fc97cbc4b-l8ljg_open-cluster-management-agent-addon(2c38ee1b-3029-4868-a93f-54ad94b3122b)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc97cbc4b-l8ljg" podUID="2c38ee1b-3029-4868-a93f-54ad94b3122b"
Jul 09 21:55:40.200843 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:40.200822    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xqbg6" event={"ID":"44a8d0af-a142-4ca6-8d6e-caee08f1f2e0","Type":"ContainerStarted","Data":"4ad3368e38e603ea59d9479e829563c53d3ec4aa502aace0875954cc77386a97"}
Jul 09 21:55:40.202727 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:40.202627    2576 generic.go:356] "Generic (PLEG): container finished" podID="90442e8a-174f-4a0c-ad42-072254dc26b2" containerID="1308d227703daf8f94078752fb7055927dcb0152576288c81f71ad6a024fe0ba" exitCode=255
Jul 09 21:55:40.202727 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:40.202661    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d7bc86db-ktmq9" event={"ID":"90442e8a-174f-4a0c-ad42-072254dc26b2","Type":"ContainerDied","Data":"1308d227703daf8f94078752fb7055927dcb0152576288c81f71ad6a024fe0ba"}
Jul 09 21:55:40.202931 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:40.202915    2576 scope.go:117] "RemoveContainer" containerID="1308d227703daf8f94078752fb7055927dcb0152576288c81f71ad6a024fe0ba"
Jul 09 21:55:40.203084 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:55:40.203066    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-7d7bc86db-ktmq9_open-cluster-management-agent-addon(90442e8a-174f-4a0c-ad42-072254dc26b2)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d7bc86db-ktmq9" podUID="90442e8a-174f-4a0c-ad42-072254dc26b2"
Jul 09 21:55:40.208325 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:40.208307    2576 scope.go:117] "RemoveContainer" containerID="f33c9b7886ba37fdac67c416af7ce706580dffa9c8fababc6ebbec33433d2b8d"
Jul 09 21:55:40.215253 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:40.215211    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc" podStartSLOduration=286.21519498 podStartE2EDuration="4m46.21519498s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 21:50:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:55:40.21380465 +0000 UTC m=+287.545304728" watchObservedRunningTime="2026-07-09 21:55:40.21519498 +0000 UTC m=+287.546695058"
Jul 09 21:55:40.847661 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:40.847622    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc97cbc4b-l8ljg"
Jul 09 21:55:41.208765 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:41.208676    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-nlmg4" event={"ID":"2cb9c33f-a330-489a-96bb-57a7a6ece91a","Type":"ContainerStarted","Data":"5c1654b8e7e3be937d4d2c4639fc42ea52729e40040e45db40f0bcee2cd7e14b"}
Jul 09 21:55:41.210912 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:41.210885    2576 scope.go:117] "RemoveContainer" containerID="7fe36395c0c8ff472e5376fea24aa2e03496dd4709ecb1db67f4bbc51fe865ad"
Jul 09 21:55:41.211107 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:55:41.211084    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-7fc97cbc4b-l8ljg_open-cluster-management-agent-addon(2c38ee1b-3029-4868-a93f-54ad94b3122b)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc97cbc4b-l8ljg" podUID="2c38ee1b-3029-4868-a93f-54ad94b3122b"
Jul 09 21:55:41.212728 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:41.212706    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xqbg6" event={"ID":"44a8d0af-a142-4ca6-8d6e-caee08f1f2e0","Type":"ContainerStarted","Data":"f01126da581a93231f52760b16aaa94c47c490081d0dd43fc4df142cd39945bd"}
Jul 09 21:55:41.223749 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:41.223679    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-nlmg4" podStartSLOduration=267.887782994 podStartE2EDuration="4m29.223662703s" totalImagesPullingTime="1.335879709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 21:51:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:55:41.223084863 +0000 UTC m=+288.554584953" watchObservedRunningTime="2026-07-09 21:55:41.223662703 +0000 UTC m=+288.555162781"
Jul 09 21:55:43.222866 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:43.222796    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xqbg6" event={"ID":"44a8d0af-a142-4ca6-8d6e-caee08f1f2e0","Type":"ContainerStarted","Data":"2c05b65c1c4948d35e1f0e42a03f83d0f09de8a03077c338a4f154560152b88f"}
Jul 09 21:55:43.224420 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:43.224395    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gtd7d" event={"ID":"541b0dc1-1400-4cbf-96d1-d248a30a012d","Type":"ContainerStarted","Data":"5ba78b2b33b0918a94e7302ffb17ef7bb58cb0adc794a13d2e64786d902bc0c3"}
Jul 09 21:55:43.224527 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:43.224435    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gtd7d" event={"ID":"541b0dc1-1400-4cbf-96d1-d248a30a012d","Type":"ContainerStarted","Data":"267e2a6e2286105880b6c6e4b1ef9e4405ac58b3c091217eaf83c3fe98a2b407"}
Jul 09 21:55:43.224527 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:43.224468    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gtd7d"
Jul 09 21:55:43.240361 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:43.240321    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xqbg6" podStartSLOduration=17.40642339 podStartE2EDuration="24.240307948s" totalImagesPullingTime="6.833884558s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 21:55:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:55:43.239263165 +0000 UTC m=+290.570763242" watchObservedRunningTime="2026-07-09 21:55:43.240307948 +0000 UTC m=+290.571808027"
Jul 09 21:55:43.256529 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:43.256493    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gtd7d" podStartSLOduration=251.171206906 podStartE2EDuration="4m14.256480789s" totalImagesPullingTime="3.085273883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 21:51:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:55:43.254831295 +0000 UTC m=+290.586331376" watchObservedRunningTime="2026-07-09 21:55:43.256480789 +0000 UTC m=+290.587980866"
Jul 09 21:55:46.196303 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:55:46.196264    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-l49xl" podUID="b99eef2e-6748-4460-bd07-1f99729b663c"
Jul 09 21:55:49.343505 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:49.343477    2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc97cbc4b-l8ljg"
Jul 09 21:55:49.344001 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:49.343876    2576 scope.go:117] "RemoveContainer" containerID="7fe36395c0c8ff472e5376fea24aa2e03496dd4709ecb1db67f4bbc51fe865ad"
Jul 09 21:55:49.344108 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:55:49.344081    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-7fc97cbc4b-l8ljg_open-cluster-management-agent-addon(2c38ee1b-3029-4868-a93f-54ad94b3122b)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc97cbc4b-l8ljg" podUID="2c38ee1b-3029-4868-a93f-54ad94b3122b"
Jul 09 21:55:49.360227 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:49.360205    2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d7bc86db-ktmq9"
Jul 09 21:55:49.360469 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:49.360455    2576 scope.go:117] "RemoveContainer" containerID="1308d227703daf8f94078752fb7055927dcb0152576288c81f71ad6a024fe0ba"
Jul 09 21:55:49.360592 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:55:49.360574    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-7d7bc86db-ktmq9_open-cluster-management-agent-addon(90442e8a-174f-4a0c-ad42-072254dc26b2)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d7bc86db-ktmq9" podUID="90442e8a-174f-4a0c-ad42-072254dc26b2"
Jul 09 21:55:49.376011 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:49.375983    2576 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cd9998d7-2x7c4" podUID="19df1dd2-af4a-48ed-b7b5-0defafd5d5fe" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 09 21:55:49.376107 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:49.376032    2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cd9998d7-2x7c4"
Jul 09 21:55:49.376407 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:49.376381    2576 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"1f0c81db53729e0fb8b35a60bb2d61dde2eb2219f678beed569557fb1a53dc55"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cd9998d7-2x7c4" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 09 21:55:49.376447 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:49.376426    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cd9998d7-2x7c4" podUID="19df1dd2-af4a-48ed-b7b5-0defafd5d5fe" containerName="service-proxy" containerID="cri-o://1f0c81db53729e0fb8b35a60bb2d61dde2eb2219f678beed569557fb1a53dc55" gracePeriod=30
Jul 09 21:55:50.247247 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:50.247219    2576 generic.go:356] "Generic (PLEG): container finished" podID="19df1dd2-af4a-48ed-b7b5-0defafd5d5fe" containerID="1f0c81db53729e0fb8b35a60bb2d61dde2eb2219f678beed569557fb1a53dc55" exitCode=2
Jul 09 21:55:50.247391 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:50.247285    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cd9998d7-2x7c4" event={"ID":"19df1dd2-af4a-48ed-b7b5-0defafd5d5fe","Type":"ContainerDied","Data":"1f0c81db53729e0fb8b35a60bb2d61dde2eb2219f678beed569557fb1a53dc55"}
Jul 09 21:55:50.247391 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:50.247326    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cd9998d7-2x7c4" event={"ID":"19df1dd2-af4a-48ed-b7b5-0defafd5d5fe","Type":"ContainerStarted","Data":"ed840cccd9def94a8e0458f476640a43e639b7d81e71b9e62ce64e215d315aff"}
Jul 09 21:55:52.645087 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:52.645057    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-c85sk"]
Jul 09 21:55:52.648192 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:52.648175    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c85sk"
Jul 09 21:55:52.650800 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:52.650776    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 09 21:55:52.650931 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:52.650812    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 09 21:55:52.650931 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:52.650849    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 09 21:55:52.651147 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:52.651131    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 09 21:55:52.651234 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:52.651219    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 09 21:55:52.652149 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:52.652135    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 09 21:55:52.652235 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:52.652178    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7bmbr\""
Jul 09 21:55:52.758881 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:52.758859    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1-node-exporter-wtmp\") pod \"node-exporter-c85sk\" (UID: \"43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1\") " pod="openshift-monitoring/node-exporter-c85sk"
Jul 09 21:55:52.759002 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:52.758884    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1-metrics-client-ca\") pod \"node-exporter-c85sk\" (UID: \"43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1\") " pod="openshift-monitoring/node-exporter-c85sk"
Jul 09 21:55:52.759002 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:52.758906    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj7wm\" (UniqueName: \"kubernetes.io/projected/43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1-kube-api-access-sj7wm\") pod \"node-exporter-c85sk\" (UID: \"43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1\") " pod="openshift-monitoring/node-exporter-c85sk"
Jul 09 21:55:52.759002 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:52.758925    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1-root\") pod \"node-exporter-c85sk\" (UID: \"43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1\") " pod="openshift-monitoring/node-exporter-c85sk"
Jul 09 21:55:52.759150 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:52.759013    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1-node-exporter-textfile\") pod \"node-exporter-c85sk\" (UID: \"43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1\") " pod="openshift-monitoring/node-exporter-c85sk"
Jul 09 21:55:52.759150 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:52.759044    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1-node-exporter-tls\") pod \"node-exporter-c85sk\" (UID: \"43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1\") " pod="openshift-monitoring/node-exporter-c85sk"
Jul 09 21:55:52.759150 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:52.759066    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1-sys\") pod \"node-exporter-c85sk\" (UID: \"43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1\") " pod="openshift-monitoring/node-exporter-c85sk"
Jul 09 21:55:52.759150 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:52.759090    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c85sk\" (UID: \"43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1\") " pod="openshift-monitoring/node-exporter-c85sk"
Jul 09 21:55:52.759150 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:52.759121    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1-node-exporter-accelerators-collector-config\") pod \"node-exporter-c85sk\" (UID: \"43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1\") " pod="openshift-monitoring/node-exporter-c85sk"
Jul 09 21:55:52.859879 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:52.859854    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1-node-exporter-wtmp\") pod \"node-exporter-c85sk\" (UID: \"43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1\") " pod="openshift-monitoring/node-exporter-c85sk"
Jul 09 21:55:52.860020 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:52.859883    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1-metrics-client-ca\") pod \"node-exporter-c85sk\" (UID: \"43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1\") " pod="openshift-monitoring/node-exporter-c85sk"
Jul 09 21:55:52.860020 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:52.859916    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj7wm\" (UniqueName: \"kubernetes.io/projected/43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1-kube-api-access-sj7wm\") pod \"node-exporter-c85sk\" (UID: \"43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1\") " pod="openshift-monitoring/node-exporter-c85sk"
Jul 09 21:55:52.860020 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:52.859943    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1-root\") pod \"node-exporter-c85sk\" (UID: \"43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1\") " pod="openshift-monitoring/node-exporter-c85sk"
Jul 09 21:55:52.860020 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:52.860000    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1-node-exporter-textfile\") pod \"node-exporter-c85sk\" (UID: \"43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1\") " pod="openshift-monitoring/node-exporter-c85sk"
Jul 09 21:55:52.860231 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:52.860024    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1-root\") pod \"node-exporter-c85sk\" (UID: \"43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1\") " pod="openshift-monitoring/node-exporter-c85sk"
Jul 09 21:55:52.860231 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:52.860038    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1-node-exporter-tls\") pod \"node-exporter-c85sk\" (UID: \"43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1\") " pod="openshift-monitoring/node-exporter-c85sk"
Jul 09 21:55:52.860231 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:52.860038    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1-node-exporter-wtmp\") pod \"node-exporter-c85sk\" (UID: \"43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1\") " pod="openshift-monitoring/node-exporter-c85sk"
Jul 09 21:55:52.860231 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:52.860089    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1-sys\") pod \"node-exporter-c85sk\" (UID: \"43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1\") " pod="openshift-monitoring/node-exporter-c85sk"
Jul 09 21:55:52.860231 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:55:52.860124    2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 09 21:55:52.860231 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:52.860127    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c85sk\" (UID: \"43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1\") " pod="openshift-monitoring/node-exporter-c85sk"
Jul 09 21:55:52.860231 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:55:52.860185    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1-node-exporter-tls podName:43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1 nodeName:}" failed. No retries permitted until 2026-07-09 21:55:53.360167309 +0000 UTC m=+300.691667383 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1-node-exporter-tls") pod "node-exporter-c85sk" (UID: "43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1") : secret "node-exporter-tls" not found
Jul 09 21:55:52.860231 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:52.860201    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1-sys\") pod \"node-exporter-c85sk\" (UID: \"43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1\") " pod="openshift-monitoring/node-exporter-c85sk"
Jul 09 21:55:52.860684 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:52.860226    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1-node-exporter-accelerators-collector-config\") pod \"node-exporter-c85sk\" (UID: \"43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1\") " pod="openshift-monitoring/node-exporter-c85sk"
Jul 09 21:55:52.860812 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:52.860694    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1-node-exporter-textfile\") pod \"node-exporter-c85sk\" (UID: \"43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1\") " pod="openshift-monitoring/node-exporter-c85sk"
Jul 09 21:55:52.864630 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:52.861252    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1-node-exporter-accelerators-collector-config\") pod \"node-exporter-c85sk\" (UID: \"43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1\") " pod="openshift-monitoring/node-exporter-c85sk"
Jul 09 21:55:52.864630 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:52.861372    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1-metrics-client-ca\") pod \"node-exporter-c85sk\" (UID: \"43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1\") " pod="openshift-monitoring/node-exporter-c85sk"
Jul 09 21:55:52.864630 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:52.863165    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c85sk\" (UID: \"43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1\") " pod="openshift-monitoring/node-exporter-c85sk"
Jul 09 21:55:52.869263 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:52.869235    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj7wm\" (UniqueName: \"kubernetes.io/projected/43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1-kube-api-access-sj7wm\") pod \"node-exporter-c85sk\" (UID: \"43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1\") " pod="openshift-monitoring/node-exporter-c85sk"
Jul 09 21:55:53.100077 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:53.100050    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27vrn_10510741-9c12-4044-ac11-97958aa1fc35/ovn-acl-logging/0.log"
Jul 09 21:55:53.100374 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:53.100351    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27vrn_10510741-9c12-4044-ac11-97958aa1fc35/ovn-acl-logging/0.log"
Jul 09 21:55:53.105504 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:53.105489    2576 kubelet.go:1648] "Image garbage collection succeeded"
Jul 09 21:55:53.230082 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:53.229978    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gtd7d"
Jul 09 21:55:53.364425 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:53.364347    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1-node-exporter-tls\") pod \"node-exporter-c85sk\" (UID: \"43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1\") " pod="openshift-monitoring/node-exporter-c85sk"
Jul 09 21:55:53.366558 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:53.366537    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1-node-exporter-tls\") pod \"node-exporter-c85sk\" (UID: \"43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1\") " pod="openshift-monitoring/node-exporter-c85sk"
Jul 09 21:55:53.559461 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:53.559436    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7bmbr\""
Jul 09 21:55:53.567000 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:53.566980    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c85sk"
Jul 09 21:55:53.576719 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:55:53.576694    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43c56e56_fb8e_40a6_9df0_0c9aa4fab2e1.slice/crio-9ee78822940cbf089b6d3b271bc3c544fed66051fcfa083984bfcc4f9b229196 WatchSource:0}: Error finding container 9ee78822940cbf089b6d3b271bc3c544fed66051fcfa083984bfcc4f9b229196: Status 404 returned error can't find the container with id 9ee78822940cbf089b6d3b271bc3c544fed66051fcfa083984bfcc4f9b229196
Jul 09 21:55:54.262036 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:54.261996    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c85sk" event={"ID":"43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1","Type":"ContainerStarted","Data":"9ee78822940cbf089b6d3b271bc3c544fed66051fcfa083984bfcc4f9b229196"}
Jul 09 21:55:55.266001 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:55.265971    2576 generic.go:356] "Generic (PLEG): container finished" podID="43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1" containerID="5791267fee1a4a08985f00acea04199ac73eea0a3555f989cdf60d1562d27722" exitCode=0
Jul 09 21:55:55.266382 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:55.266023    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c85sk" event={"ID":"43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1","Type":"ContainerDied","Data":"5791267fee1a4a08985f00acea04199ac73eea0a3555f989cdf60d1562d27722"}
Jul 09 21:55:56.271482 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:56.271443    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c85sk" event={"ID":"43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1","Type":"ContainerStarted","Data":"60c99a1ddd1e2a3e221b22ec16094ad32209c3afc3eee26f798fe43bda01fe15"}
Jul 09 21:55:56.271482 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:56.271489    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c85sk" event={"ID":"43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1","Type":"ContainerStarted","Data":"fa4ee769de52073d2a55e6268abb8ee5e1b2c5d6ed3042ebea2c730899a7a991"}
Jul 09 21:55:56.296722 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:56.296681    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-c85sk" podStartSLOduration=3.265934206 podStartE2EDuration="4.296668241s" totalImagesPullingTime="968.988126ms" totalInitContainerRuntime="61.745909ms" isStatefulPod=true podCreationTimestamp="2026-07-09 21:55:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:55:56.295059117 +0000 UTC m=+303.626559222" watchObservedRunningTime="2026-07-09 21:55:56.296668241 +0000 UTC m=+303.628168319"
Jul 09 21:55:58.194968 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:58.194922    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l49xl"
Jul 09 21:55:59.193491 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:59.193454    2576 patch_prober.go:28] interesting pod/image-registry-54d776fcf9-wxsbc container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 09 21:55:59.193647 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:55:59.193498    2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc" podUID="32a4b2a4-8551-4b0b-a786-c086fae647fc" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 09 21:56:01.194884 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:56:01.194855    2576 scope.go:117] "RemoveContainer" containerID="7fe36395c0c8ff472e5376fea24aa2e03496dd4709ecb1db67f4bbc51fe865ad"
Jul 09 21:56:01.218444 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:56:01.218423    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc"
Jul 09 21:56:01.289852 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:56:01.289816    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc97cbc4b-l8ljg" event={"ID":"2c38ee1b-3029-4868-a93f-54ad94b3122b","Type":"ContainerStarted","Data":"62d79e111899b57c2761412210abc5ad9c901352ba85c80e874f4e7355790c7c"}
Jul 09 21:56:01.290312 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:56:01.290283    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc97cbc4b-l8ljg"
Jul 09 21:56:01.291438 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:56:01.291423    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc97cbc4b-l8ljg"
Jul 09 21:56:04.194918 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:56:04.194890    2576 scope.go:117] "RemoveContainer" containerID="1308d227703daf8f94078752fb7055927dcb0152576288c81f71ad6a024fe0ba"
Jul 09 21:56:04.266641 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:56:04.266619    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-54d776fcf9-wxsbc"]
Jul 09 21:56:04.303195 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:56:04.303170    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d7bc86db-ktmq9" event={"ID":"90442e8a-174f-4a0c-ad42-072254dc26b2","Type":"ContainerStarted","Data":"410baf82580642a9c16e6db4d5c4d7335fc8d3878eac10559c3ccb60b98d4035"}
Jul 09 21:56:29.286161 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:56:29.286095    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc" podUID="32a4b2a4-8551-4b0b-a786-c086fae647fc" containerName="registry" containerID="cri-o://b92e6dc3a8a94a60e9266bcfd5f77fd315f03ab082c6ba1297e12d509f23b5dc" gracePeriod=30
Jul 09 21:56:29.521251 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:56:29.521230    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc"
Jul 09 21:56:29.608493 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:56:29.608435    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hql85\" (UniqueName: \"kubernetes.io/projected/32a4b2a4-8551-4b0b-a786-c086fae647fc-kube-api-access-hql85\") pod \"32a4b2a4-8551-4b0b-a786-c086fae647fc\" (UID: \"32a4b2a4-8551-4b0b-a786-c086fae647fc\") "
Jul 09 21:56:29.608493 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:56:29.608464    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/32a4b2a4-8551-4b0b-a786-c086fae647fc-registry-certificates\") pod \"32a4b2a4-8551-4b0b-a786-c086fae647fc\" (UID: \"32a4b2a4-8551-4b0b-a786-c086fae647fc\") "
Jul 09 21:56:29.608493 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:56:29.608492    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/32a4b2a4-8551-4b0b-a786-c086fae647fc-trusted-ca\") pod \"32a4b2a4-8551-4b0b-a786-c086fae647fc\" (UID: \"32a4b2a4-8551-4b0b-a786-c086fae647fc\") "
Jul 09 21:56:29.608710 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:56:29.608517    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32a4b2a4-8551-4b0b-a786-c086fae647fc-registry-tls\") pod \"32a4b2a4-8551-4b0b-a786-c086fae647fc\" (UID: \"32a4b2a4-8551-4b0b-a786-c086fae647fc\") "
Jul 09 21:56:29.608710 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:56:29.608536    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/32a4b2a4-8551-4b0b-a786-c086fae647fc-ca-trust-extracted\") pod \"32a4b2a4-8551-4b0b-a786-c086fae647fc\" (UID: \"32a4b2a4-8551-4b0b-a786-c086fae647fc\") "
Jul 09 21:56:29.608710 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:56:29.608565    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/32a4b2a4-8551-4b0b-a786-c086fae647fc-bound-sa-token\") pod \"32a4b2a4-8551-4b0b-a786-c086fae647fc\" (UID: \"32a4b2a4-8551-4b0b-a786-c086fae647fc\") "
Jul 09 21:56:29.608710 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:56:29.608597    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/32a4b2a4-8551-4b0b-a786-c086fae647fc-image-registry-private-configuration\") pod \"32a4b2a4-8551-4b0b-a786-c086fae647fc\" (UID: \"32a4b2a4-8551-4b0b-a786-c086fae647fc\") "
Jul 09 21:56:29.608710 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:56:29.608617    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/32a4b2a4-8551-4b0b-a786-c086fae647fc-installation-pull-secrets\") pod \"32a4b2a4-8551-4b0b-a786-c086fae647fc\" (UID: \"32a4b2a4-8551-4b0b-a786-c086fae647fc\") "
Jul 09 21:56:29.609035 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:56:29.609007    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32a4b2a4-8551-4b0b-a786-c086fae647fc-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "32a4b2a4-8551-4b0b-a786-c086fae647fc" (UID: "32a4b2a4-8551-4b0b-a786-c086fae647fc"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 21:56:29.609395 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:56:29.609366    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32a4b2a4-8551-4b0b-a786-c086fae647fc-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "32a4b2a4-8551-4b0b-a786-c086fae647fc" (UID: "32a4b2a4-8551-4b0b-a786-c086fae647fc"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 21:56:29.610869 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:56:29.610825    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32a4b2a4-8551-4b0b-a786-c086fae647fc-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "32a4b2a4-8551-4b0b-a786-c086fae647fc" (UID: "32a4b2a4-8551-4b0b-a786-c086fae647fc"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 21:56:29.611154 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:56:29.611117    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32a4b2a4-8551-4b0b-a786-c086fae647fc-kube-api-access-hql85" (OuterVolumeSpecName: "kube-api-access-hql85") pod "32a4b2a4-8551-4b0b-a786-c086fae647fc" (UID: "32a4b2a4-8551-4b0b-a786-c086fae647fc"). InnerVolumeSpecName "kube-api-access-hql85". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 21:56:29.611260 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:56:29.611148    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32a4b2a4-8551-4b0b-a786-c086fae647fc-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "32a4b2a4-8551-4b0b-a786-c086fae647fc" (UID: "32a4b2a4-8551-4b0b-a786-c086fae647fc"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 21:56:29.611260 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:56:29.611190    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32a4b2a4-8551-4b0b-a786-c086fae647fc-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "32a4b2a4-8551-4b0b-a786-c086fae647fc" (UID: "32a4b2a4-8551-4b0b-a786-c086fae647fc"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 21:56:29.611386 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:56:29.611291    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32a4b2a4-8551-4b0b-a786-c086fae647fc-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "32a4b2a4-8551-4b0b-a786-c086fae647fc" (UID: "32a4b2a4-8551-4b0b-a786-c086fae647fc"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 21:56:29.617439 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:56:29.617416    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32a4b2a4-8551-4b0b-a786-c086fae647fc-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "32a4b2a4-8551-4b0b-a786-c086fae647fc" (UID: "32a4b2a4-8551-4b0b-a786-c086fae647fc"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 21:56:29.709839 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:56:29.709811    2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/32a4b2a4-8551-4b0b-a786-c086fae647fc-installation-pull-secrets\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 21:56:29.709839 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:56:29.709835    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hql85\" (UniqueName: \"kubernetes.io/projected/32a4b2a4-8551-4b0b-a786-c086fae647fc-kube-api-access-hql85\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 21:56:29.709996 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:56:29.709849    2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/32a4b2a4-8551-4b0b-a786-c086fae647fc-registry-certificates\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 21:56:29.709996 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:56:29.709861    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/32a4b2a4-8551-4b0b-a786-c086fae647fc-trusted-ca\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 21:56:29.709996 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:56:29.709874    2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32a4b2a4-8551-4b0b-a786-c086fae647fc-registry-tls\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 21:56:29.709996 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:56:29.709885    2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/32a4b2a4-8551-4b0b-a786-c086fae647fc-ca-trust-extracted\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 21:56:29.709996 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:56:29.709897    2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/32a4b2a4-8551-4b0b-a786-c086fae647fc-bound-sa-token\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 21:56:29.709996 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:56:29.709911    2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/32a4b2a4-8551-4b0b-a786-c086fae647fc-image-registry-private-configuration\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 21:56:30.386357 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:56:30.386320    2576 generic.go:356] "Generic (PLEG): container finished" podID="32a4b2a4-8551-4b0b-a786-c086fae647fc" containerID="b92e6dc3a8a94a60e9266bcfd5f77fd315f03ab082c6ba1297e12d509f23b5dc" exitCode=0
Jul 09 21:56:30.386723 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:56:30.386376    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc" event={"ID":"32a4b2a4-8551-4b0b-a786-c086fae647fc","Type":"ContainerDied","Data":"b92e6dc3a8a94a60e9266bcfd5f77fd315f03ab082c6ba1297e12d509f23b5dc"}
Jul 09 21:56:30.386723 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:56:30.386420    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc" event={"ID":"32a4b2a4-8551-4b0b-a786-c086fae647fc","Type":"ContainerDied","Data":"c907169c47ee41a21a83af0dd6faf1577c917ba8bef20b21cff529c871238f69"}
Jul 09 21:56:30.386723 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:56:30.386441    2576 scope.go:117] "RemoveContainer" containerID="b92e6dc3a8a94a60e9266bcfd5f77fd315f03ab082c6ba1297e12d509f23b5dc"
Jul 09 21:56:30.386723 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:56:30.386381    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54d776fcf9-wxsbc"
Jul 09 21:56:30.395148 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:56:30.395031    2576 scope.go:117] "RemoveContainer" containerID="b92e6dc3a8a94a60e9266bcfd5f77fd315f03ab082c6ba1297e12d509f23b5dc"
Jul 09 21:56:30.395344 ip-10-0-141-101 kubenswrapper[2576]: E0709 21:56:30.395324    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b92e6dc3a8a94a60e9266bcfd5f77fd315f03ab082c6ba1297e12d509f23b5dc\": container with ID starting with b92e6dc3a8a94a60e9266bcfd5f77fd315f03ab082c6ba1297e12d509f23b5dc not found: ID does not exist" containerID="b92e6dc3a8a94a60e9266bcfd5f77fd315f03ab082c6ba1297e12d509f23b5dc"
Jul 09 21:56:30.395401 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:56:30.395351    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b92e6dc3a8a94a60e9266bcfd5f77fd315f03ab082c6ba1297e12d509f23b5dc"} err="failed to get container status \"b92e6dc3a8a94a60e9266bcfd5f77fd315f03ab082c6ba1297e12d509f23b5dc\": rpc error: code = NotFound desc = could not find container \"b92e6dc3a8a94a60e9266bcfd5f77fd315f03ab082c6ba1297e12d509f23b5dc\": container with ID starting with b92e6dc3a8a94a60e9266bcfd5f77fd315f03ab082c6ba1297e12d509f23b5dc not found: ID does not exist"
Jul 09 21:56:30.416884 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:56:30.416860    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-54d776fcf9-wxsbc"]
Jul 09 21:56:30.422723 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:56:30.422704    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-54d776fcf9-wxsbc"]
Jul 09 21:56:31.198581 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:56:31.198549    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32a4b2a4-8551-4b0b-a786-c086fae647fc" path="/var/lib/kubelet/pods/32a4b2a4-8551-4b0b-a786-c086fae647fc/volumes"
Jul 09 21:57:07.166251 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:57:07.166217    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b99eef2e-6748-4460-bd07-1f99729b663c-metrics-certs\") pod \"network-metrics-daemon-l49xl\" (UID: \"b99eef2e-6748-4460-bd07-1f99729b663c\") " pod="openshift-multus/network-metrics-daemon-l49xl"
Jul 09 21:57:07.168402 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:57:07.168383    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b99eef2e-6748-4460-bd07-1f99729b663c-metrics-certs\") pod \"network-metrics-daemon-l49xl\" (UID: \"b99eef2e-6748-4460-bd07-1f99729b663c\") " pod="openshift-multus/network-metrics-daemon-l49xl"
Jul 09 21:57:07.198107 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:57:07.198084    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qdkql\""
Jul 09 21:57:07.206073 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:57:07.206056    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l49xl"
Jul 09 21:57:07.325509 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:57:07.325480    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l49xl"]
Jul 09 21:57:07.328606 ip-10-0-141-101 kubenswrapper[2576]: W0709 21:57:07.328577    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb99eef2e_6748_4460_bd07_1f99729b663c.slice/crio-1c47ed7bbec12d3759e85de7d0caeb82e72d6cf03ad4e9f984d0f32db3ffd506 WatchSource:0}: Error finding container 1c47ed7bbec12d3759e85de7d0caeb82e72d6cf03ad4e9f984d0f32db3ffd506: Status 404 returned error can't find the container with id 1c47ed7bbec12d3759e85de7d0caeb82e72d6cf03ad4e9f984d0f32db3ffd506
Jul 09 21:57:07.331006 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:57:07.330992    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 21:57:07.507070 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:57:07.507003    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l49xl" event={"ID":"b99eef2e-6748-4460-bd07-1f99729b663c","Type":"ContainerStarted","Data":"1c47ed7bbec12d3759e85de7d0caeb82e72d6cf03ad4e9f984d0f32db3ffd506"}
Jul 09 21:57:09.516024 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:57:09.515989    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l49xl" event={"ID":"b99eef2e-6748-4460-bd07-1f99729b663c","Type":"ContainerStarted","Data":"22c136346827e9a1eb3cbc31bfc93077d241ce4dabf5877d356c7fda902c1813"}
Jul 09 21:57:09.516392 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:57:09.516049    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l49xl" event={"ID":"b99eef2e-6748-4460-bd07-1f99729b663c","Type":"ContainerStarted","Data":"008ee0e7271b47552fde510529869b7330c8825d8d9ed563e6cf77b6315ba7cb"}
Jul 09 21:57:09.533986 ip-10-0-141-101 kubenswrapper[2576]: I0709 21:57:09.533921    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-l49xl" podStartSLOduration=375.369107287 podStartE2EDuration="6m16.533905105s" totalImagesPullingTime="1.164797818s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 21:50:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 21:57:09.532565709 +0000 UTC m=+376.864065787" watchObservedRunningTime="2026-07-09 21:57:09.533905105 +0000 UTC m=+376.865405184"
Jul 09 22:00:03.843907 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:03.843835    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xbctf"]
Jul 09 22:00:03.844358 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:03.844080    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32a4b2a4-8551-4b0b-a786-c086fae647fc" containerName="registry"
Jul 09 22:00:03.844358 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:03.844092    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="32a4b2a4-8551-4b0b-a786-c086fae647fc" containerName="registry"
Jul 09 22:00:03.844358 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:03.844143    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="32a4b2a4-8551-4b0b-a786-c086fae647fc" containerName="registry"
Jul 09 22:00:03.846785 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:03.846770    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xbctf"
Jul 09 22:00:03.850105 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:03.850083    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 09 22:00:03.850296 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:03.850281    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-cpzcr\""
Jul 09 22:00:03.851321 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:03.851307    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 09 22:00:03.856041 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:03.856019    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xbctf"]
Jul 09 22:00:04.030902 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:04.030873    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b476d6cd-9827-4c64-afd3-b4807b79eecc-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xbctf\" (UID: \"b476d6cd-9827-4c64-afd3-b4807b79eecc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xbctf"
Jul 09 22:00:04.031037 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:04.030918    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc2gg\" (UniqueName: \"kubernetes.io/projected/b476d6cd-9827-4c64-afd3-b4807b79eecc-kube-api-access-sc2gg\") pod \"cert-manager-cainjector-559cdd8c87-xbctf\" (UID: \"b476d6cd-9827-4c64-afd3-b4807b79eecc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xbctf"
Jul 09 22:00:04.132033 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:04.131977    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b476d6cd-9827-4c64-afd3-b4807b79eecc-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xbctf\" (UID: \"b476d6cd-9827-4c64-afd3-b4807b79eecc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xbctf"
Jul 09 22:00:04.132033 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:04.132012    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sc2gg\" (UniqueName: \"kubernetes.io/projected/b476d6cd-9827-4c64-afd3-b4807b79eecc-kube-api-access-sc2gg\") pod \"cert-manager-cainjector-559cdd8c87-xbctf\" (UID: \"b476d6cd-9827-4c64-afd3-b4807b79eecc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xbctf"
Jul 09 22:00:04.141367 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:04.141341    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b476d6cd-9827-4c64-afd3-b4807b79eecc-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xbctf\" (UID: \"b476d6cd-9827-4c64-afd3-b4807b79eecc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xbctf"
Jul 09 22:00:04.141638 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:04.141614    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc2gg\" (UniqueName: \"kubernetes.io/projected/b476d6cd-9827-4c64-afd3-b4807b79eecc-kube-api-access-sc2gg\") pod \"cert-manager-cainjector-559cdd8c87-xbctf\" (UID: \"b476d6cd-9827-4c64-afd3-b4807b79eecc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xbctf"
Jul 09 22:00:04.155199 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:04.155181    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xbctf"
Jul 09 22:00:04.277445 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:04.277379    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xbctf"]
Jul 09 22:00:04.279840 ip-10-0-141-101 kubenswrapper[2576]: W0709 22:00:04.279814    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb476d6cd_9827_4c64_afd3_b4807b79eecc.slice/crio-c68f51f1d48ac67b0f95693ee58621e9f853128b2d2903d83778891b411892ca WatchSource:0}: Error finding container c68f51f1d48ac67b0f95693ee58621e9f853128b2d2903d83778891b411892ca: Status 404 returned error can't find the container with id c68f51f1d48ac67b0f95693ee58621e9f853128b2d2903d83778891b411892ca
Jul 09 22:00:05.083612 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:05.083577    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xbctf" event={"ID":"b476d6cd-9827-4c64-afd3-b4807b79eecc","Type":"ContainerStarted","Data":"c68f51f1d48ac67b0f95693ee58621e9f853128b2d2903d83778891b411892ca"}
Jul 09 22:00:09.102158 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:09.102123    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xbctf" event={"ID":"b476d6cd-9827-4c64-afd3-b4807b79eecc","Type":"ContainerStarted","Data":"94d6f68aa854689117b67ee518bfd3a384ec38a17ece00d348a1f92474c77866"}
Jul 09 22:00:09.116555 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:09.116508    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xbctf" podStartSLOduration=2.045824468 podStartE2EDuration="6.116494433s" totalImagesPullingTime="4.070669965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:00:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:00:09.116076806 +0000 UTC m=+556.447576876" watchObservedRunningTime="2026-07-09 22:00:09.116494433 +0000 UTC m=+556.447994512"
Jul 09 22:00:20.697456 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:20.697424    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p6pq9"]
Jul 09 22:00:20.700288 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:20.700272    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p6pq9"
Jul 09 22:00:20.702794 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:20.702769    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 09 22:00:20.704045 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:20.704021    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-qqmlj\""
Jul 09 22:00:20.704137 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:20.704030    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 09 22:00:20.708832 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:20.708811    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p6pq9"]
Jul 09 22:00:20.733802 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:20.733769    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qck29\" (UniqueName: \"kubernetes.io/projected/e128db91-9318-4d6e-a5eb-289fc54a678d-kube-api-access-qck29\") pod \"openshift-lws-operator-fd8ccff4c-p6pq9\" (UID: \"e128db91-9318-4d6e-a5eb-289fc54a678d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p6pq9"
Jul 09 22:00:20.733926 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:20.733816    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e128db91-9318-4d6e-a5eb-289fc54a678d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-p6pq9\" (UID: \"e128db91-9318-4d6e-a5eb-289fc54a678d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p6pq9"
Jul 09 22:00:20.835125 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:20.835087    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e128db91-9318-4d6e-a5eb-289fc54a678d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-p6pq9\" (UID: \"e128db91-9318-4d6e-a5eb-289fc54a678d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p6pq9"
Jul 09 22:00:20.835296 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:20.835152    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qck29\" (UniqueName: \"kubernetes.io/projected/e128db91-9318-4d6e-a5eb-289fc54a678d-kube-api-access-qck29\") pod \"openshift-lws-operator-fd8ccff4c-p6pq9\" (UID: \"e128db91-9318-4d6e-a5eb-289fc54a678d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p6pq9"
Jul 09 22:00:20.835476 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:20.835456    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e128db91-9318-4d6e-a5eb-289fc54a678d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-p6pq9\" (UID: \"e128db91-9318-4d6e-a5eb-289fc54a678d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p6pq9"
Jul 09 22:00:20.843378 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:20.843357    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qck29\" (UniqueName: \"kubernetes.io/projected/e128db91-9318-4d6e-a5eb-289fc54a678d-kube-api-access-qck29\") pod \"openshift-lws-operator-fd8ccff4c-p6pq9\" (UID: \"e128db91-9318-4d6e-a5eb-289fc54a678d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p6pq9"
Jul 09 22:00:21.009596 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:21.009518    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p6pq9"
Jul 09 22:00:21.129266 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:21.129237    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p6pq9"]
Jul 09 22:00:21.132356 ip-10-0-141-101 kubenswrapper[2576]: W0709 22:00:21.132324    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode128db91_9318_4d6e_a5eb_289fc54a678d.slice/crio-d651b91781c336ea32e814918dbbe657189d0fb94c8ee39c3baabbe1e03c0ac3 WatchSource:0}: Error finding container d651b91781c336ea32e814918dbbe657189d0fb94c8ee39c3baabbe1e03c0ac3: Status 404 returned error can't find the container with id d651b91781c336ea32e814918dbbe657189d0fb94c8ee39c3baabbe1e03c0ac3
Jul 09 22:00:21.146347 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:21.146320    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p6pq9" event={"ID":"e128db91-9318-4d6e-a5eb-289fc54a678d","Type":"ContainerStarted","Data":"d651b91781c336ea32e814918dbbe657189d0fb94c8ee39c3baabbe1e03c0ac3"}
Jul 09 22:00:24.159052 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:24.158950    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p6pq9" event={"ID":"e128db91-9318-4d6e-a5eb-289fc54a678d","Type":"ContainerStarted","Data":"e4990c2a9295b2c0fd085822496b00a1cb0e058dddb77e65b434a1cdfa44a9df"}
Jul 09 22:00:24.175352 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:24.175294    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p6pq9" podStartSLOduration=1.51749912 podStartE2EDuration="4.17527355s" totalImagesPullingTime="2.65777443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:00:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:00:24.17358191 +0000 UTC m=+571.505081990" watchObservedRunningTime="2026-07-09 22:00:24.17527355 +0000 UTC m=+571.506773632"
Jul 09 22:00:51.771927 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:51.771894    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85dfbddc47-n2h8l"]
Jul 09 22:00:51.773901 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:51.773886    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-n2h8l"
Jul 09 22:00:51.776812 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:51.776793    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 09 22:00:51.777273 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:51.777257    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 09 22:00:51.777347 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:51.777274    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 09 22:00:51.777442 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:51.777424    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 09 22:00:51.777560 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:51.777544    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xz842\""
Jul 09 22:00:51.789142 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:51.789119    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85dfbddc47-n2h8l"]
Jul 09 22:00:51.836950 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:51.836926    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6e915a81-51e4-4910-931c-7c743c0939b5-webhook-cert\") pod \"opendatahub-operator-controller-manager-85dfbddc47-n2h8l\" (UID: \"6e915a81-51e4-4910-931c-7c743c0939b5\") " pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-n2h8l"
Jul 09 22:00:51.837076 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:51.837004    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zkpk\" (UniqueName: \"kubernetes.io/projected/6e915a81-51e4-4910-931c-7c743c0939b5-kube-api-access-9zkpk\") pod \"opendatahub-operator-controller-manager-85dfbddc47-n2h8l\" (UID: \"6e915a81-51e4-4910-931c-7c743c0939b5\") " pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-n2h8l"
Jul 09 22:00:51.837076 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:51.837034    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6e915a81-51e4-4910-931c-7c743c0939b5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85dfbddc47-n2h8l\" (UID: \"6e915a81-51e4-4910-931c-7c743c0939b5\") " pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-n2h8l"
Jul 09 22:00:51.837076 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:51.837066    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6e915a81-51e4-4910-931c-7c743c0939b5-manifests\") pod \"opendatahub-operator-controller-manager-85dfbddc47-n2h8l\" (UID: \"6e915a81-51e4-4910-931c-7c743c0939b5\") " pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-n2h8l"
Jul 09 22:00:51.837203 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:51.837093    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e915a81-51e4-4910-931c-7c743c0939b5-tmp\") pod \"opendatahub-operator-controller-manager-85dfbddc47-n2h8l\" (UID: \"6e915a81-51e4-4910-931c-7c743c0939b5\") " pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-n2h8l"
Jul 09 22:00:51.937622 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:51.937599    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zkpk\" (UniqueName: \"kubernetes.io/projected/6e915a81-51e4-4910-931c-7c743c0939b5-kube-api-access-9zkpk\") pod \"opendatahub-operator-controller-manager-85dfbddc47-n2h8l\" (UID: \"6e915a81-51e4-4910-931c-7c743c0939b5\") " pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-n2h8l"
Jul 09 22:00:51.937714 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:51.937628    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6e915a81-51e4-4910-931c-7c743c0939b5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85dfbddc47-n2h8l\" (UID: \"6e915a81-51e4-4910-931c-7c743c0939b5\") " pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-n2h8l"
Jul 09 22:00:51.937714 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:51.937650    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6e915a81-51e4-4910-931c-7c743c0939b5-manifests\") pod \"opendatahub-operator-controller-manager-85dfbddc47-n2h8l\" (UID: \"6e915a81-51e4-4910-931c-7c743c0939b5\") " pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-n2h8l"
Jul 09 22:00:51.937790 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:51.937756    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e915a81-51e4-4910-931c-7c743c0939b5-tmp\") pod \"opendatahub-operator-controller-manager-85dfbddc47-n2h8l\" (UID: \"6e915a81-51e4-4910-931c-7c743c0939b5\") " pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-n2h8l"
Jul 09 22:00:51.937824 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:51.937802    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6e915a81-51e4-4910-931c-7c743c0939b5-webhook-cert\") pod \"opendatahub-operator-controller-manager-85dfbddc47-n2h8l\" (UID: \"6e915a81-51e4-4910-931c-7c743c0939b5\") " pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-n2h8l"
Jul 09 22:00:51.937986 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:51.937949    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6e915a81-51e4-4910-931c-7c743c0939b5-manifests\") pod \"opendatahub-operator-controller-manager-85dfbddc47-n2h8l\" (UID: \"6e915a81-51e4-4910-931c-7c743c0939b5\") " pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-n2h8l"
Jul 09 22:00:51.940079 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:51.940054    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e915a81-51e4-4910-931c-7c743c0939b5-tmp\") pod \"opendatahub-operator-controller-manager-85dfbddc47-n2h8l\" (UID: \"6e915a81-51e4-4910-931c-7c743c0939b5\") " pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-n2h8l"
Jul 09 22:00:51.940170 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:51.940154    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6e915a81-51e4-4910-931c-7c743c0939b5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85dfbddc47-n2h8l\" (UID: \"6e915a81-51e4-4910-931c-7c743c0939b5\") " pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-n2h8l"
Jul 09 22:00:51.940244 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:51.940229    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6e915a81-51e4-4910-931c-7c743c0939b5-webhook-cert\") pod \"opendatahub-operator-controller-manager-85dfbddc47-n2h8l\" (UID: \"6e915a81-51e4-4910-931c-7c743c0939b5\") " pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-n2h8l"
Jul 09 22:00:51.945819 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:51.945786    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zkpk\" (UniqueName: \"kubernetes.io/projected/6e915a81-51e4-4910-931c-7c743c0939b5-kube-api-access-9zkpk\") pod \"opendatahub-operator-controller-manager-85dfbddc47-n2h8l\" (UID: \"6e915a81-51e4-4910-931c-7c743c0939b5\") " pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-n2h8l"
Jul 09 22:00:52.084222 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:52.084171    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-n2h8l"
Jul 09 22:00:52.210160 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:52.210128    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85dfbddc47-n2h8l"]
Jul 09 22:00:52.212635 ip-10-0-141-101 kubenswrapper[2576]: W0709 22:00:52.212613    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e915a81_51e4_4910_931c_7c743c0939b5.slice/crio-f491bd821e0696b2e3104a4b8a1118680fb13075751b6d11f199a85657e77536 WatchSource:0}: Error finding container f491bd821e0696b2e3104a4b8a1118680fb13075751b6d11f199a85657e77536: Status 404 returned error can't find the container with id f491bd821e0696b2e3104a4b8a1118680fb13075751b6d11f199a85657e77536
Jul 09 22:00:52.254614 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:52.254580    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-n2h8l" event={"ID":"6e915a81-51e4-4910-931c-7c743c0939b5","Type":"ContainerStarted","Data":"f491bd821e0696b2e3104a4b8a1118680fb13075751b6d11f199a85657e77536"}
Jul 09 22:00:53.129498 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:53.129469    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27vrn_10510741-9c12-4044-ac11-97958aa1fc35/ovn-acl-logging/0.log"
Jul 09 22:00:53.130203 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:53.130038    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27vrn_10510741-9c12-4044-ac11-97958aa1fc35/ovn-acl-logging/0.log"
Jul 09 22:00:56.269789 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:56.269748    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-n2h8l" event={"ID":"6e915a81-51e4-4910-931c-7c743c0939b5","Type":"ContainerStarted","Data":"6000a36bb59aa3ae5edb829cdcc943bd04585db73656bd3062c9ffa71f4134bc"}
Jul 09 22:00:57.275177 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:57.275144    2576 generic.go:356] "Generic (PLEG): container finished" podID="6e915a81-51e4-4910-931c-7c743c0939b5" containerID="6000a36bb59aa3ae5edb829cdcc943bd04585db73656bd3062c9ffa71f4134bc" exitCode=0
Jul 09 22:00:57.275549 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:57.275213    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-n2h8l" event={"ID":"6e915a81-51e4-4910-931c-7c743c0939b5","Type":"ContainerDied","Data":"6000a36bb59aa3ae5edb829cdcc943bd04585db73656bd3062c9ffa71f4134bc"}
Jul 09 22:00:58.286925 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:58.286887    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-n2h8l" event={"ID":"6e915a81-51e4-4910-931c-7c743c0939b5","Type":"ContainerStarted","Data":"8739c3f6886b0fdd35afbe327604c4d38a3a608bb56462aa587b97bd5a1d522f"}
Jul 09 22:00:58.287350 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:58.287110    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-n2h8l"
Jul 09 22:00:58.310325 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:00:58.310249    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-n2h8l" podStartSLOduration=2.876594153 podStartE2EDuration="7.310229907s" totalImagesPullingTime="3.410088611s" totalInitContainerRuntime="1.023547143s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:00:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:00:58.309513569 +0000 UTC m=+605.641013647" watchObservedRunningTime="2026-07-09 22:00:58.310229907 +0000 UTC m=+605.641729986"
Jul 09 22:01:09.292537 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:09.292509    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-85dfbddc47-n2h8l"
Jul 09 22:01:22.276395 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:22.276302    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-b6b884787-sj2k9"]
Jul 09 22:01:22.279544 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:22.279518    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-b6b884787-sj2k9"
Jul 09 22:01:22.282313 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:22.282290    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 09 22:01:22.283436 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:22.283411    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 09 22:01:22.283513 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:22.283443    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-98c2c\""
Jul 09 22:01:22.283513 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:22.283441    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 09 22:01:22.283617 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:22.283443    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 09 22:01:22.292156 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:22.292133    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-b6b884787-sj2k9"]
Jul 09 22:01:22.363399 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:22.363357    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj4c7\" (UniqueName: \"kubernetes.io/projected/201e5101-4e2c-4500-8f1e-c91537b9ffd5-kube-api-access-lj4c7\") pod \"kube-auth-proxy-b6b884787-sj2k9\" (UID: \"201e5101-4e2c-4500-8f1e-c91537b9ffd5\") " pod="openshift-ingress/kube-auth-proxy-b6b884787-sj2k9"
Jul 09 22:01:22.363399 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:22.363398    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/201e5101-4e2c-4500-8f1e-c91537b9ffd5-tls-certs\") pod \"kube-auth-proxy-b6b884787-sj2k9\" (UID: \"201e5101-4e2c-4500-8f1e-c91537b9ffd5\") " pod="openshift-ingress/kube-auth-proxy-b6b884787-sj2k9"
Jul 09 22:01:22.363620 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:22.363441    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/201e5101-4e2c-4500-8f1e-c91537b9ffd5-tmp\") pod \"kube-auth-proxy-b6b884787-sj2k9\" (UID: \"201e5101-4e2c-4500-8f1e-c91537b9ffd5\") " pod="openshift-ingress/kube-auth-proxy-b6b884787-sj2k9"
Jul 09 22:01:22.417569 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:22.417537    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-pq9r8"]
Jul 09 22:01:22.420379 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:22.420363    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-pq9r8"
Jul 09 22:01:22.423507 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:22.423484    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 09 22:01:22.423594 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:22.423509    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-stv84\""
Jul 09 22:01:22.432809 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:22.432785    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-pq9r8"]
Jul 09 22:01:22.464053 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:22.464017    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/201e5101-4e2c-4500-8f1e-c91537b9ffd5-tmp\") pod \"kube-auth-proxy-b6b884787-sj2k9\" (UID: \"201e5101-4e2c-4500-8f1e-c91537b9ffd5\") " pod="openshift-ingress/kube-auth-proxy-b6b884787-sj2k9"
Jul 09 22:01:22.464245 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:22.464078    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj4c7\" (UniqueName: \"kubernetes.io/projected/201e5101-4e2c-4500-8f1e-c91537b9ffd5-kube-api-access-lj4c7\") pod \"kube-auth-proxy-b6b884787-sj2k9\" (UID: \"201e5101-4e2c-4500-8f1e-c91537b9ffd5\") " pod="openshift-ingress/kube-auth-proxy-b6b884787-sj2k9"
Jul 09 22:01:22.464245 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:22.464113    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/201e5101-4e2c-4500-8f1e-c91537b9ffd5-tls-certs\") pod \"kube-auth-proxy-b6b884787-sj2k9\" (UID: \"201e5101-4e2c-4500-8f1e-c91537b9ffd5\") " pod="openshift-ingress/kube-auth-proxy-b6b884787-sj2k9"
Jul 09 22:01:22.464245 ip-10-0-141-101 kubenswrapper[2576]: E0709 22:01:22.464239    2576 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 09 22:01:22.464411 ip-10-0-141-101 kubenswrapper[2576]: E0709 22:01:22.464319    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/201e5101-4e2c-4500-8f1e-c91537b9ffd5-tls-certs podName:201e5101-4e2c-4500-8f1e-c91537b9ffd5 nodeName:}" failed. No retries permitted until 2026-07-09 22:01:22.964297461 +0000 UTC m=+630.295797533 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/201e5101-4e2c-4500-8f1e-c91537b9ffd5-tls-certs") pod "kube-auth-proxy-b6b884787-sj2k9" (UID: "201e5101-4e2c-4500-8f1e-c91537b9ffd5") : secret "kube-auth-proxy-tls" not found
Jul 09 22:01:22.466396 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:22.466368    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/201e5101-4e2c-4500-8f1e-c91537b9ffd5-tmp\") pod \"kube-auth-proxy-b6b884787-sj2k9\" (UID: \"201e5101-4e2c-4500-8f1e-c91537b9ffd5\") " pod="openshift-ingress/kube-auth-proxy-b6b884787-sj2k9"
Jul 09 22:01:22.480883 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:22.480858    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj4c7\" (UniqueName: \"kubernetes.io/projected/201e5101-4e2c-4500-8f1e-c91537b9ffd5-kube-api-access-lj4c7\") pod \"kube-auth-proxy-b6b884787-sj2k9\" (UID: \"201e5101-4e2c-4500-8f1e-c91537b9ffd5\") " pod="openshift-ingress/kube-auth-proxy-b6b884787-sj2k9"
Jul 09 22:01:22.565329 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:22.565246    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a324cc7-d71c-4d55-83f4-479a7ebbeb6e-cert\") pod \"odh-model-controller-7998c67dc4-pq9r8\" (UID: \"0a324cc7-d71c-4d55-83f4-479a7ebbeb6e\") " pod="opendatahub/odh-model-controller-7998c67dc4-pq9r8"
Jul 09 22:01:22.565329 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:22.565296    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8sxk\" (UniqueName: \"kubernetes.io/projected/0a324cc7-d71c-4d55-83f4-479a7ebbeb6e-kube-api-access-b8sxk\") pod \"odh-model-controller-7998c67dc4-pq9r8\" (UID: \"0a324cc7-d71c-4d55-83f4-479a7ebbeb6e\") " pod="opendatahub/odh-model-controller-7998c67dc4-pq9r8"
Jul 09 22:01:22.665728 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:22.665692    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a324cc7-d71c-4d55-83f4-479a7ebbeb6e-cert\") pod \"odh-model-controller-7998c67dc4-pq9r8\" (UID: \"0a324cc7-d71c-4d55-83f4-479a7ebbeb6e\") " pod="opendatahub/odh-model-controller-7998c67dc4-pq9r8"
Jul 09 22:01:22.666012 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:22.665740    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8sxk\" (UniqueName: \"kubernetes.io/projected/0a324cc7-d71c-4d55-83f4-479a7ebbeb6e-kube-api-access-b8sxk\") pod \"odh-model-controller-7998c67dc4-pq9r8\" (UID: \"0a324cc7-d71c-4d55-83f4-479a7ebbeb6e\") " pod="opendatahub/odh-model-controller-7998c67dc4-pq9r8"
Jul 09 22:01:22.666012 ip-10-0-141-101 kubenswrapper[2576]: E0709 22:01:22.665852    2576 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 09 22:01:22.666012 ip-10-0-141-101 kubenswrapper[2576]: E0709 22:01:22.665917    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a324cc7-d71c-4d55-83f4-479a7ebbeb6e-cert podName:0a324cc7-d71c-4d55-83f4-479a7ebbeb6e nodeName:}" failed. No retries permitted until 2026-07-09 22:01:23.165898523 +0000 UTC m=+630.497398579 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0a324cc7-d71c-4d55-83f4-479a7ebbeb6e-cert") pod "odh-model-controller-7998c67dc4-pq9r8" (UID: "0a324cc7-d71c-4d55-83f4-479a7ebbeb6e") : secret "odh-model-controller-webhook-cert" not found
Jul 09 22:01:22.681083 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:22.681047    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8sxk\" (UniqueName: \"kubernetes.io/projected/0a324cc7-d71c-4d55-83f4-479a7ebbeb6e-kube-api-access-b8sxk\") pod \"odh-model-controller-7998c67dc4-pq9r8\" (UID: \"0a324cc7-d71c-4d55-83f4-479a7ebbeb6e\") " pod="opendatahub/odh-model-controller-7998c67dc4-pq9r8"
Jul 09 22:01:22.968346 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:22.968255    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/201e5101-4e2c-4500-8f1e-c91537b9ffd5-tls-certs\") pod \"kube-auth-proxy-b6b884787-sj2k9\" (UID: \"201e5101-4e2c-4500-8f1e-c91537b9ffd5\") " pod="openshift-ingress/kube-auth-proxy-b6b884787-sj2k9"
Jul 09 22:01:22.970908 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:22.970878    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/201e5101-4e2c-4500-8f1e-c91537b9ffd5-tls-certs\") pod \"kube-auth-proxy-b6b884787-sj2k9\" (UID: \"201e5101-4e2c-4500-8f1e-c91537b9ffd5\") " pod="openshift-ingress/kube-auth-proxy-b6b884787-sj2k9"
Jul 09 22:01:22.986161 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:22.986131    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-l2w25"]
Jul 09 22:01:22.990443 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:22.990422    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-l2w25"
Jul 09 22:01:22.993667 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:22.993651    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 09 22:01:23.001299 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:23.001278    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-l2w25"]
Jul 09 22:01:23.069266 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:23.069229    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/958185da-7f44-4a72-b425-fb2c0061901f-tls-certs\") pod \"model-serving-api-54d89bd5fc-l2w25\" (UID: \"958185da-7f44-4a72-b425-fb2c0061901f\") " pod="opendatahub/model-serving-api-54d89bd5fc-l2w25"
Jul 09 22:01:23.069454 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:23.069302    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhjwn\" (UniqueName: \"kubernetes.io/projected/958185da-7f44-4a72-b425-fb2c0061901f-kube-api-access-jhjwn\") pod \"model-serving-api-54d89bd5fc-l2w25\" (UID: \"958185da-7f44-4a72-b425-fb2c0061901f\") " pod="opendatahub/model-serving-api-54d89bd5fc-l2w25"
Jul 09 22:01:23.170600 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:23.170562    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhjwn\" (UniqueName: \"kubernetes.io/projected/958185da-7f44-4a72-b425-fb2c0061901f-kube-api-access-jhjwn\") pod \"model-serving-api-54d89bd5fc-l2w25\" (UID: \"958185da-7f44-4a72-b425-fb2c0061901f\") " pod="opendatahub/model-serving-api-54d89bd5fc-l2w25"
Jul 09 22:01:23.170783 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:23.170627    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a324cc7-d71c-4d55-83f4-479a7ebbeb6e-cert\") pod \"odh-model-controller-7998c67dc4-pq9r8\" (UID: \"0a324cc7-d71c-4d55-83f4-479a7ebbeb6e\") " pod="opendatahub/odh-model-controller-7998c67dc4-pq9r8"
Jul 09 22:01:23.170783 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:23.170692    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/958185da-7f44-4a72-b425-fb2c0061901f-tls-certs\") pod \"model-serving-api-54d89bd5fc-l2w25\" (UID: \"958185da-7f44-4a72-b425-fb2c0061901f\") " pod="opendatahub/model-serving-api-54d89bd5fc-l2w25"
Jul 09 22:01:23.170920 ip-10-0-141-101 kubenswrapper[2576]: E0709 22:01:23.170899    2576 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 09 22:01:23.171026 ip-10-0-141-101 kubenswrapper[2576]: E0709 22:01:23.171014    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/958185da-7f44-4a72-b425-fb2c0061901f-tls-certs podName:958185da-7f44-4a72-b425-fb2c0061901f nodeName:}" failed. No retries permitted until 2026-07-09 22:01:23.670992329 +0000 UTC m=+631.002492404 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/958185da-7f44-4a72-b425-fb2c0061901f-tls-certs") pod "model-serving-api-54d89bd5fc-l2w25" (UID: "958185da-7f44-4a72-b425-fb2c0061901f") : secret "model-serving-api-tls" not found
Jul 09 22:01:23.173588 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:23.173562    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a324cc7-d71c-4d55-83f4-479a7ebbeb6e-cert\") pod \"odh-model-controller-7998c67dc4-pq9r8\" (UID: \"0a324cc7-d71c-4d55-83f4-479a7ebbeb6e\") " pod="opendatahub/odh-model-controller-7998c67dc4-pq9r8"
Jul 09 22:01:23.187703 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:23.187678    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhjwn\" (UniqueName: \"kubernetes.io/projected/958185da-7f44-4a72-b425-fb2c0061901f-kube-api-access-jhjwn\") pod \"model-serving-api-54d89bd5fc-l2w25\" (UID: \"958185da-7f44-4a72-b425-fb2c0061901f\") " pod="opendatahub/model-serving-api-54d89bd5fc-l2w25"
Jul 09 22:01:23.189473 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:23.189457    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-b6b884787-sj2k9"
Jul 09 22:01:23.323566 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:23.323503    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-b6b884787-sj2k9"]
Jul 09 22:01:23.327407 ip-10-0-141-101 kubenswrapper[2576]: W0709 22:01:23.327384    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod201e5101_4e2c_4500_8f1e_c91537b9ffd5.slice/crio-e53f10290d8da3dd13db5f9fec0fd93a898ef19ee5c6696ecb364174f46a8c6d WatchSource:0}: Error finding container e53f10290d8da3dd13db5f9fec0fd93a898ef19ee5c6696ecb364174f46a8c6d: Status 404 returned error can't find the container with id e53f10290d8da3dd13db5f9fec0fd93a898ef19ee5c6696ecb364174f46a8c6d
Jul 09 22:01:23.331510 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:23.331485    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-pq9r8"
Jul 09 22:01:23.375209 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:23.375163    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-b6b884787-sj2k9" event={"ID":"201e5101-4e2c-4500-8f1e-c91537b9ffd5","Type":"ContainerStarted","Data":"e53f10290d8da3dd13db5f9fec0fd93a898ef19ee5c6696ecb364174f46a8c6d"}
Jul 09 22:01:23.474123 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:23.474089    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-pq9r8"]
Jul 09 22:01:23.475619 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:23.475595    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-2lmwp"]
Jul 09 22:01:23.477917 ip-10-0-141-101 kubenswrapper[2576]: W0709 22:01:23.477885    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a324cc7_d71c_4d55_83f4_479a7ebbeb6e.slice/crio-b2dccb62788466a1d83b0c3a08a73e19bd0fbd70f1126ef107dfc3b63bdffb8f WatchSource:0}: Error finding container b2dccb62788466a1d83b0c3a08a73e19bd0fbd70f1126ef107dfc3b63bdffb8f: Status 404 returned error can't find the container with id b2dccb62788466a1d83b0c3a08a73e19bd0fbd70f1126ef107dfc3b63bdffb8f
Jul 09 22:01:23.480469 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:23.480439    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2lmwp"
Jul 09 22:01:23.483054 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:23.483035    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 09 22:01:23.483166 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:23.483128    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 09 22:01:23.483226 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:23.483184    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 09 22:01:23.483462 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:23.483448    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-7cp4j\""
Jul 09 22:01:23.483531 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:23.483453    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 09 22:01:23.491439 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:23.491374    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-2lmwp"]
Jul 09 22:01:23.573386 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:23.573347    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f81d4b0-b575-40c0-86b9-57ef406493fc-istio-token\") pod \"istiod-openshift-gateway-7574459656-2lmwp\" (UID: \"9f81d4b0-b575-40c0-86b9-57ef406493fc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2lmwp"
Jul 09 22:01:23.573572 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:23.573404    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f81d4b0-b575-40c0-86b9-57ef406493fc-local-certs\") pod \"istiod-openshift-gateway-7574459656-2lmwp\" (UID: \"9f81d4b0-b575-40c0-86b9-57ef406493fc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2lmwp"
Jul 09 22:01:23.573572 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:23.573424    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs2b2\" (UniqueName: \"kubernetes.io/projected/9f81d4b0-b575-40c0-86b9-57ef406493fc-kube-api-access-fs2b2\") pod \"istiod-openshift-gateway-7574459656-2lmwp\" (UID: \"9f81d4b0-b575-40c0-86b9-57ef406493fc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2lmwp"
Jul 09 22:01:23.573572 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:23.573490    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9f81d4b0-b575-40c0-86b9-57ef406493fc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-2lmwp\" (UID: \"9f81d4b0-b575-40c0-86b9-57ef406493fc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2lmwp"
Jul 09 22:01:23.573778 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:23.573614    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9f81d4b0-b575-40c0-86b9-57ef406493fc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-2lmwp\" (UID: \"9f81d4b0-b575-40c0-86b9-57ef406493fc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2lmwp"
Jul 09 22:01:23.573778 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:23.573642    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9f81d4b0-b575-40c0-86b9-57ef406493fc-cacerts\") pod \"istiod-openshift-gateway-7574459656-2lmwp\" (UID: \"9f81d4b0-b575-40c0-86b9-57ef406493fc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2lmwp"
Jul 09 22:01:23.573778 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:23.573664    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9f81d4b0-b575-40c0-86b9-57ef406493fc-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-2lmwp\" (UID: \"9f81d4b0-b575-40c0-86b9-57ef406493fc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2lmwp"
Jul 09 22:01:23.674836 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:23.674796    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs2b2\" (UniqueName: \"kubernetes.io/projected/9f81d4b0-b575-40c0-86b9-57ef406493fc-kube-api-access-fs2b2\") pod \"istiod-openshift-gateway-7574459656-2lmwp\" (UID: \"9f81d4b0-b575-40c0-86b9-57ef406493fc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2lmwp"
Jul 09 22:01:23.674836 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:23.674835    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9f81d4b0-b575-40c0-86b9-57ef406493fc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-2lmwp\" (UID: \"9f81d4b0-b575-40c0-86b9-57ef406493fc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2lmwp"
Jul 09 22:01:23.675138 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:23.674878    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9f81d4b0-b575-40c0-86b9-57ef406493fc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-2lmwp\" (UID: \"9f81d4b0-b575-40c0-86b9-57ef406493fc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2lmwp"
Jul 09 22:01:23.675138 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:23.674899    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9f81d4b0-b575-40c0-86b9-57ef406493fc-cacerts\") pod \"istiod-openshift-gateway-7574459656-2lmwp\" (UID: \"9f81d4b0-b575-40c0-86b9-57ef406493fc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2lmwp"
Jul 09 22:01:23.675138 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:23.674915    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9f81d4b0-b575-40c0-86b9-57ef406493fc-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-2lmwp\" (UID: \"9f81d4b0-b575-40c0-86b9-57ef406493fc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2lmwp"
Jul 09 22:01:23.675138 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:23.674983    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f81d4b0-b575-40c0-86b9-57ef406493fc-istio-token\") pod \"istiod-openshift-gateway-7574459656-2lmwp\" (UID: \"9f81d4b0-b575-40c0-86b9-57ef406493fc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2lmwp"
Jul 09 22:01:23.675138 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:23.675029    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/958185da-7f44-4a72-b425-fb2c0061901f-tls-certs\") pod \"model-serving-api-54d89bd5fc-l2w25\" (UID: \"958185da-7f44-4a72-b425-fb2c0061901f\") " pod="opendatahub/model-serving-api-54d89bd5fc-l2w25"
Jul 09 22:01:23.675138 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:23.675055    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f81d4b0-b575-40c0-86b9-57ef406493fc-local-certs\") pod \"istiod-openshift-gateway-7574459656-2lmwp\" (UID: \"9f81d4b0-b575-40c0-86b9-57ef406493fc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2lmwp"
Jul 09 22:01:23.676006 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:23.675976    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9f81d4b0-b575-40c0-86b9-57ef406493fc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-2lmwp\" (UID: \"9f81d4b0-b575-40c0-86b9-57ef406493fc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2lmwp"
Jul 09 22:01:23.678098 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:23.678074    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9f81d4b0-b575-40c0-86b9-57ef406493fc-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-2lmwp\" (UID: \"9f81d4b0-b575-40c0-86b9-57ef406493fc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2lmwp"
Jul 09 22:01:23.678190 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:23.678154    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/958185da-7f44-4a72-b425-fb2c0061901f-tls-certs\") pod \"model-serving-api-54d89bd5fc-l2w25\" (UID: \"958185da-7f44-4a72-b425-fb2c0061901f\") " pod="opendatahub/model-serving-api-54d89bd5fc-l2w25"
Jul 09 22:01:23.678365 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:23.678345    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f81d4b0-b575-40c0-86b9-57ef406493fc-local-certs\") pod \"istiod-openshift-gateway-7574459656-2lmwp\" (UID: \"9f81d4b0-b575-40c0-86b9-57ef406493fc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2lmwp"
Jul 09 22:01:23.678420 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:23.678402    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9f81d4b0-b575-40c0-86b9-57ef406493fc-cacerts\") pod \"istiod-openshift-gateway-7574459656-2lmwp\" (UID: \"9f81d4b0-b575-40c0-86b9-57ef406493fc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2lmwp"
Jul 09 22:01:23.678489 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:23.678476    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9f81d4b0-b575-40c0-86b9-57ef406493fc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-2lmwp\" (UID: \"9f81d4b0-b575-40c0-86b9-57ef406493fc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2lmwp"
Jul 09 22:01:23.682772 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:23.682750    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f81d4b0-b575-40c0-86b9-57ef406493fc-istio-token\") pod \"istiod-openshift-gateway-7574459656-2lmwp\" (UID: \"9f81d4b0-b575-40c0-86b9-57ef406493fc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2lmwp"
Jul 09 22:01:23.683419 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:23.683398    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs2b2\" (UniqueName: \"kubernetes.io/projected/9f81d4b0-b575-40c0-86b9-57ef406493fc-kube-api-access-fs2b2\") pod \"istiod-openshift-gateway-7574459656-2lmwp\" (UID: \"9f81d4b0-b575-40c0-86b9-57ef406493fc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2lmwp"
Jul 09 22:01:23.795381 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:23.795343    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2lmwp"
Jul 09 22:01:23.900303 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:23.900264    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-l2w25"
Jul 09 22:01:23.966286 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:23.966252    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-2lmwp"]
Jul 09 22:01:24.075849 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:24.075819    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-l2w25"]
Jul 09 22:01:24.078370 ip-10-0-141-101 kubenswrapper[2576]: W0709 22:01:24.078340    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod958185da_7f44_4a72_b425_fb2c0061901f.slice/crio-b1f0e00bc54c5256ecba42abffdcd989c05ba1b5524ed93c9e7ef830d38d94eb WatchSource:0}: Error finding container b1f0e00bc54c5256ecba42abffdcd989c05ba1b5524ed93c9e7ef830d38d94eb: Status 404 returned error can't find the container with id b1f0e00bc54c5256ecba42abffdcd989c05ba1b5524ed93c9e7ef830d38d94eb
Jul 09 22:01:24.381816 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:24.381723    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-pq9r8" event={"ID":"0a324cc7-d71c-4d55-83f4-479a7ebbeb6e","Type":"ContainerStarted","Data":"b2dccb62788466a1d83b0c3a08a73e19bd0fbd70f1126ef107dfc3b63bdffb8f"}
Jul 09 22:01:24.383234 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:24.383213    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2lmwp" event={"ID":"9f81d4b0-b575-40c0-86b9-57ef406493fc","Type":"ContainerStarted","Data":"7be8e91b1ff055f468f94fdb3df069edc6d9d258f9832c562a1674c37da963aa"}
Jul 09 22:01:24.384673 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:24.384643    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-l2w25" event={"ID":"958185da-7f44-4a72-b425-fb2c0061901f","Type":"ContainerStarted","Data":"b1f0e00bc54c5256ecba42abffdcd989c05ba1b5524ed93c9e7ef830d38d94eb"}
Jul 09 22:01:27.410760 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:27.410697    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:01:27.411051 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:27.410761    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:01:28.410428 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:28.410389    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2lmwp" event={"ID":"9f81d4b0-b575-40c0-86b9-57ef406493fc","Type":"ContainerStarted","Data":"bccdfeae44c2d7580c9dd7e59fb3d83a231ee792740aa3a00e3bd09efc5acd2a"}
Jul 09 22:01:28.410625 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:28.410596    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2lmwp"
Jul 09 22:01:28.412365 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:28.412338    2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-2lmwp container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 09 22:01:28.412777 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:28.412387    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2lmwp" podUID="9f81d4b0-b575-40c0-86b9-57ef406493fc" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 09 22:01:28.412842 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:28.412815    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-l2w25" event={"ID":"958185da-7f44-4a72-b425-fb2c0061901f","Type":"ContainerStarted","Data":"0c0a6d10d98f830d198901372cf42225ce9c7d95ccad543ee8dd8dfb8e78fd3e"}
Jul 09 22:01:28.412893 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:28.412874    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-l2w25"
Jul 09 22:01:28.414475 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:28.414449    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-b6b884787-sj2k9" event={"ID":"201e5101-4e2c-4500-8f1e-c91537b9ffd5","Type":"ContainerStarted","Data":"5d7a53aef968be4c0faa65533ea1185a7b04a10dda65935e5fd9d8e438300320"}
Jul 09 22:01:28.437392 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:28.437342    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2lmwp" podStartSLOduration=2.023133586 podStartE2EDuration="5.43732959s" totalImagesPullingTime="3.414196004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:01:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:01:28.435665459 +0000 UTC m=+635.767165542" watchObservedRunningTime="2026-07-09 22:01:28.43732959 +0000 UTC m=+635.768829667"
Jul 09 22:01:28.478372 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:28.478312    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-l2w25" podStartSLOduration=3.148486372 podStartE2EDuration="6.478285853s" totalImagesPullingTime="3.329799481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:01:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:01:28.459252293 +0000 UTC m=+635.790752372" watchObservedRunningTime="2026-07-09 22:01:28.478285853 +0000 UTC m=+635.809785932"
Jul 09 22:01:28.478800 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:28.478761    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-b6b884787-sj2k9" podStartSLOduration=2.401175248 podStartE2EDuration="6.478746755s" totalImagesPullingTime="4.077571507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:01:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:01:28.477113912 +0000 UTC m=+635.808613990" watchObservedRunningTime="2026-07-09 22:01:28.478746755 +0000 UTC m=+635.810246834"
Jul 09 22:01:29.419353 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:29.419327    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2lmwp"
Jul 09 22:01:30.423945 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:30.423863    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-pq9r8" event={"ID":"0a324cc7-d71c-4d55-83f4-479a7ebbeb6e","Type":"ContainerStarted","Data":"d85bf72178849060b0dd31f2b1e16c153e8aab507660b195946fdd60475f5601"}
Jul 09 22:01:30.424351 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:30.424007    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-pq9r8"
Jul 09 22:01:30.447353 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:30.447288    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-pq9r8" podStartSLOduration=1.8418641249999999 podStartE2EDuration="8.447266523s" totalImagesPullingTime="6.605402398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:01:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:01:30.445264411 +0000 UTC m=+637.776764489" watchObservedRunningTime="2026-07-09 22:01:30.447266523 +0000 UTC m=+637.778766602"
Jul 09 22:01:33.539535 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:33.539501    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-df4jq"]
Jul 09 22:01:33.541889 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:33.541864    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-df4jq"
Jul 09 22:01:33.546014 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:33.545992    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 09 22:01:33.546137 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:33.546032    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-ltwbv\""
Jul 09 22:01:33.554283 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:33.554258    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-cx5r7"]
Jul 09 22:01:33.556386 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:33.556368    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-df4jq"]
Jul 09 22:01:33.556472 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:33.556454    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cx5r7"
Jul 09 22:01:33.559098 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:33.559077    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 09 22:01:33.559217 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:33.559159    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-gmd2p\""
Jul 09 22:01:33.573258 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:33.573236    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-cx5r7"]
Jul 09 22:01:33.669248 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:33.669208    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bb2m\" (UniqueName: \"kubernetes.io/projected/9218a4f8-3388-4b31-b7f7-92ebdb02576d-kube-api-access-8bb2m\") pod \"kserve-controller-manager-d6f4b65b8-df4jq\" (UID: \"9218a4f8-3388-4b31-b7f7-92ebdb02576d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-df4jq"
Jul 09 22:01:33.669413 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:33.669274    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2433c8e7-20ef-453c-9a58-6e660be175f7-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-cx5r7\" (UID: \"2433c8e7-20ef-453c-9a58-6e660be175f7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cx5r7"
Jul 09 22:01:33.669413 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:33.669326    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9218a4f8-3388-4b31-b7f7-92ebdb02576d-cert\") pod \"kserve-controller-manager-d6f4b65b8-df4jq\" (UID: \"9218a4f8-3388-4b31-b7f7-92ebdb02576d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-df4jq"
Jul 09 22:01:33.669413 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:33.669358    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtbmm\" (UniqueName: \"kubernetes.io/projected/2433c8e7-20ef-453c-9a58-6e660be175f7-kube-api-access-rtbmm\") pod \"llmisvc-controller-manager-777c6bd7d5-cx5r7\" (UID: \"2433c8e7-20ef-453c-9a58-6e660be175f7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cx5r7"
Jul 09 22:01:33.770562 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:33.770529    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2433c8e7-20ef-453c-9a58-6e660be175f7-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-cx5r7\" (UID: \"2433c8e7-20ef-453c-9a58-6e660be175f7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cx5r7"
Jul 09 22:01:33.770710 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:33.770574    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9218a4f8-3388-4b31-b7f7-92ebdb02576d-cert\") pod \"kserve-controller-manager-d6f4b65b8-df4jq\" (UID: \"9218a4f8-3388-4b31-b7f7-92ebdb02576d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-df4jq"
Jul 09 22:01:33.770710 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:33.770605    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtbmm\" (UniqueName: \"kubernetes.io/projected/2433c8e7-20ef-453c-9a58-6e660be175f7-kube-api-access-rtbmm\") pod \"llmisvc-controller-manager-777c6bd7d5-cx5r7\" (UID: \"2433c8e7-20ef-453c-9a58-6e660be175f7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cx5r7"
Jul 09 22:01:33.770710 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:33.770658    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bb2m\" (UniqueName: \"kubernetes.io/projected/9218a4f8-3388-4b31-b7f7-92ebdb02576d-kube-api-access-8bb2m\") pod \"kserve-controller-manager-d6f4b65b8-df4jq\" (UID: \"9218a4f8-3388-4b31-b7f7-92ebdb02576d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-df4jq"
Jul 09 22:01:33.770710 ip-10-0-141-101 kubenswrapper[2576]: E0709 22:01:33.770700    2576 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 09 22:01:33.770885 ip-10-0-141-101 kubenswrapper[2576]: E0709 22:01:33.770768    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9218a4f8-3388-4b31-b7f7-92ebdb02576d-cert podName:9218a4f8-3388-4b31-b7f7-92ebdb02576d nodeName:}" failed. No retries permitted until 2026-07-09 22:01:34.2707486 +0000 UTC m=+641.602248665 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9218a4f8-3388-4b31-b7f7-92ebdb02576d-cert") pod "kserve-controller-manager-d6f4b65b8-df4jq" (UID: "9218a4f8-3388-4b31-b7f7-92ebdb02576d") : secret "kserve-webhook-server-cert" not found
Jul 09 22:01:33.773111 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:33.773081    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2433c8e7-20ef-453c-9a58-6e660be175f7-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-cx5r7\" (UID: \"2433c8e7-20ef-453c-9a58-6e660be175f7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cx5r7"
Jul 09 22:01:33.782306 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:33.782283    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtbmm\" (UniqueName: \"kubernetes.io/projected/2433c8e7-20ef-453c-9a58-6e660be175f7-kube-api-access-rtbmm\") pod \"llmisvc-controller-manager-777c6bd7d5-cx5r7\" (UID: \"2433c8e7-20ef-453c-9a58-6e660be175f7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cx5r7"
Jul 09 22:01:33.794347 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:33.794292    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bb2m\" (UniqueName: \"kubernetes.io/projected/9218a4f8-3388-4b31-b7f7-92ebdb02576d-kube-api-access-8bb2m\") pod \"kserve-controller-manager-d6f4b65b8-df4jq\" (UID: \"9218a4f8-3388-4b31-b7f7-92ebdb02576d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-df4jq"
Jul 09 22:01:33.866750 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:33.866722    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cx5r7"
Jul 09 22:01:34.011165 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:34.011130    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-cx5r7"]
Jul 09 22:01:34.013684 ip-10-0-141-101 kubenswrapper[2576]: W0709 22:01:34.013654    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2433c8e7_20ef_453c_9a58_6e660be175f7.slice/crio-c8bab17954039e4643db753768758505ffbe401546c2e7bed81c4d3b883fb0cd WatchSource:0}: Error finding container c8bab17954039e4643db753768758505ffbe401546c2e7bed81c4d3b883fb0cd: Status 404 returned error can't find the container with id c8bab17954039e4643db753768758505ffbe401546c2e7bed81c4d3b883fb0cd
Jul 09 22:01:34.274855 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:34.274821    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9218a4f8-3388-4b31-b7f7-92ebdb02576d-cert\") pod \"kserve-controller-manager-d6f4b65b8-df4jq\" (UID: \"9218a4f8-3388-4b31-b7f7-92ebdb02576d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-df4jq"
Jul 09 22:01:34.277136 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:34.277119    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9218a4f8-3388-4b31-b7f7-92ebdb02576d-cert\") pod \"kserve-controller-manager-d6f4b65b8-df4jq\" (UID: \"9218a4f8-3388-4b31-b7f7-92ebdb02576d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-df4jq"
Jul 09 22:01:34.440801 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:34.440768    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cx5r7" event={"ID":"2433c8e7-20ef-453c-9a58-6e660be175f7","Type":"ContainerStarted","Data":"c8bab17954039e4643db753768758505ffbe401546c2e7bed81c4d3b883fb0cd"}
Jul 09 22:01:34.453035 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:34.453006    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-df4jq"
Jul 09 22:01:34.575409 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:34.575383    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-df4jq"]
Jul 09 22:01:34.577518 ip-10-0-141-101 kubenswrapper[2576]: W0709 22:01:34.577495    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9218a4f8_3388_4b31_b7f7_92ebdb02576d.slice/crio-5243380ca0bf882dbe84b153c5ef1c23c63dfe2a1a56345ce826308c8266e823 WatchSource:0}: Error finding container 5243380ca0bf882dbe84b153c5ef1c23c63dfe2a1a56345ce826308c8266e823: Status 404 returned error can't find the container with id 5243380ca0bf882dbe84b153c5ef1c23c63dfe2a1a56345ce826308c8266e823
Jul 09 22:01:35.448144 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:35.448109    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-df4jq" event={"ID":"9218a4f8-3388-4b31-b7f7-92ebdb02576d","Type":"ContainerStarted","Data":"5243380ca0bf882dbe84b153c5ef1c23c63dfe2a1a56345ce826308c8266e823"}
Jul 09 22:01:35.959946 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:35.959909    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-2lmwp"]
Jul 09 22:01:35.960324 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:35.960100    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2lmwp" podUID="9f81d4b0-b575-40c0-86b9-57ef406493fc" containerName="discovery" containerID="cri-o://bccdfeae44c2d7580c9dd7e59fb3d83a231ee792740aa3a00e3bd09efc5acd2a" gracePeriod=30
Jul 09 22:01:36.218329 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:36.218274    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2lmwp"
Jul 09 22:01:36.289498 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:36.289464    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9f81d4b0-b575-40c0-86b9-57ef406493fc-istio-kubeconfig\") pod \"9f81d4b0-b575-40c0-86b9-57ef406493fc\" (UID: \"9f81d4b0-b575-40c0-86b9-57ef406493fc\") "
Jul 09 22:01:36.289498 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:36.289504    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f81d4b0-b575-40c0-86b9-57ef406493fc-istio-token\") pod \"9f81d4b0-b575-40c0-86b9-57ef406493fc\" (UID: \"9f81d4b0-b575-40c0-86b9-57ef406493fc\") "
Jul 09 22:01:36.289725 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:36.289526    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9f81d4b0-b575-40c0-86b9-57ef406493fc-istio-csr-ca-configmap\") pod \"9f81d4b0-b575-40c0-86b9-57ef406493fc\" (UID: \"9f81d4b0-b575-40c0-86b9-57ef406493fc\") "
Jul 09 22:01:36.289725 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:36.289558    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fs2b2\" (UniqueName: \"kubernetes.io/projected/9f81d4b0-b575-40c0-86b9-57ef406493fc-kube-api-access-fs2b2\") pod \"9f81d4b0-b575-40c0-86b9-57ef406493fc\" (UID: \"9f81d4b0-b575-40c0-86b9-57ef406493fc\") "
Jul 09 22:01:36.289725 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:36.289609    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9f81d4b0-b575-40c0-86b9-57ef406493fc-cacerts\") pod \"9f81d4b0-b575-40c0-86b9-57ef406493fc\" (UID: \"9f81d4b0-b575-40c0-86b9-57ef406493fc\") "
Jul 09 22:01:36.289725 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:36.289632    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9f81d4b0-b575-40c0-86b9-57ef406493fc-istio-csr-dns-cert\") pod \"9f81d4b0-b575-40c0-86b9-57ef406493fc\" (UID: \"9f81d4b0-b575-40c0-86b9-57ef406493fc\") "
Jul 09 22:01:36.289725 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:36.289690    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f81d4b0-b575-40c0-86b9-57ef406493fc-local-certs\") pod \"9f81d4b0-b575-40c0-86b9-57ef406493fc\" (UID: \"9f81d4b0-b575-40c0-86b9-57ef406493fc\") "
Jul 09 22:01:36.290011 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:36.289973    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f81d4b0-b575-40c0-86b9-57ef406493fc-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "9f81d4b0-b575-40c0-86b9-57ef406493fc" (UID: "9f81d4b0-b575-40c0-86b9-57ef406493fc"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:01:36.292460 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:36.292427    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f81d4b0-b575-40c0-86b9-57ef406493fc-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "9f81d4b0-b575-40c0-86b9-57ef406493fc" (UID: "9f81d4b0-b575-40c0-86b9-57ef406493fc"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:01:36.292460 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:36.292446    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f81d4b0-b575-40c0-86b9-57ef406493fc-istio-token" (OuterVolumeSpecName: "istio-token") pod "9f81d4b0-b575-40c0-86b9-57ef406493fc" (UID: "9f81d4b0-b575-40c0-86b9-57ef406493fc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:01:36.292644 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:36.292445    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f81d4b0-b575-40c0-86b9-57ef406493fc-cacerts" (OuterVolumeSpecName: "cacerts") pod "9f81d4b0-b575-40c0-86b9-57ef406493fc" (UID: "9f81d4b0-b575-40c0-86b9-57ef406493fc"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:01:36.292644 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:36.292632    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f81d4b0-b575-40c0-86b9-57ef406493fc-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "9f81d4b0-b575-40c0-86b9-57ef406493fc" (UID: "9f81d4b0-b575-40c0-86b9-57ef406493fc"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:01:36.292737 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:36.292632    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f81d4b0-b575-40c0-86b9-57ef406493fc-kube-api-access-fs2b2" (OuterVolumeSpecName: "kube-api-access-fs2b2") pod "9f81d4b0-b575-40c0-86b9-57ef406493fc" (UID: "9f81d4b0-b575-40c0-86b9-57ef406493fc"). InnerVolumeSpecName "kube-api-access-fs2b2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:01:36.292772 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:36.292742    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f81d4b0-b575-40c0-86b9-57ef406493fc-local-certs" (OuterVolumeSpecName: "local-certs") pod "9f81d4b0-b575-40c0-86b9-57ef406493fc" (UID: "9f81d4b0-b575-40c0-86b9-57ef406493fc"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:01:36.390697 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:36.390663    2576 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9f81d4b0-b575-40c0-86b9-57ef406493fc-istio-kubeconfig\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:01:36.390697 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:36.390691    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f81d4b0-b575-40c0-86b9-57ef406493fc-istio-token\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:01:36.390697 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:36.390702    2576 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9f81d4b0-b575-40c0-86b9-57ef406493fc-istio-csr-ca-configmap\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:01:36.390911 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:36.390712    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fs2b2\" (UniqueName: \"kubernetes.io/projected/9f81d4b0-b575-40c0-86b9-57ef406493fc-kube-api-access-fs2b2\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:01:36.390911 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:36.390720    2576 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9f81d4b0-b575-40c0-86b9-57ef406493fc-cacerts\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:01:36.390911 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:36.390728    2576 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9f81d4b0-b575-40c0-86b9-57ef406493fc-istio-csr-dns-cert\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:01:36.390911 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:36.390736    2576 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f81d4b0-b575-40c0-86b9-57ef406493fc-local-certs\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:01:36.453666 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:36.453630    2576 generic.go:356] "Generic (PLEG): container finished" podID="9f81d4b0-b575-40c0-86b9-57ef406493fc" containerID="bccdfeae44c2d7580c9dd7e59fb3d83a231ee792740aa3a00e3bd09efc5acd2a" exitCode=0
Jul 09 22:01:36.453811 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:36.453690    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2lmwp"
Jul 09 22:01:36.453811 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:36.453701    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2lmwp" event={"ID":"9f81d4b0-b575-40c0-86b9-57ef406493fc","Type":"ContainerDied","Data":"bccdfeae44c2d7580c9dd7e59fb3d83a231ee792740aa3a00e3bd09efc5acd2a"}
Jul 09 22:01:36.453811 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:36.453765    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2lmwp" event={"ID":"9f81d4b0-b575-40c0-86b9-57ef406493fc","Type":"ContainerDied","Data":"7be8e91b1ff055f468f94fdb3df069edc6d9d258f9832c562a1674c37da963aa"}
Jul 09 22:01:36.453811 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:36.453783    2576 scope.go:117] "RemoveContainer" containerID="bccdfeae44c2d7580c9dd7e59fb3d83a231ee792740aa3a00e3bd09efc5acd2a"
Jul 09 22:01:36.462315 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:36.462296    2576 scope.go:117] "RemoveContainer" containerID="bccdfeae44c2d7580c9dd7e59fb3d83a231ee792740aa3a00e3bd09efc5acd2a"
Jul 09 22:01:36.462579 ip-10-0-141-101 kubenswrapper[2576]: E0709 22:01:36.462561    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bccdfeae44c2d7580c9dd7e59fb3d83a231ee792740aa3a00e3bd09efc5acd2a\": container with ID starting with bccdfeae44c2d7580c9dd7e59fb3d83a231ee792740aa3a00e3bd09efc5acd2a not found: ID does not exist" containerID="bccdfeae44c2d7580c9dd7e59fb3d83a231ee792740aa3a00e3bd09efc5acd2a"
Jul 09 22:01:36.462615 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:36.462589    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bccdfeae44c2d7580c9dd7e59fb3d83a231ee792740aa3a00e3bd09efc5acd2a"} err="failed to get container status \"bccdfeae44c2d7580c9dd7e59fb3d83a231ee792740aa3a00e3bd09efc5acd2a\": rpc error: code = NotFound desc = could not find container \"bccdfeae44c2d7580c9dd7e59fb3d83a231ee792740aa3a00e3bd09efc5acd2a\": container with ID starting with bccdfeae44c2d7580c9dd7e59fb3d83a231ee792740aa3a00e3bd09efc5acd2a not found: ID does not exist"
Jul 09 22:01:36.486087 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:36.486010    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-2lmwp"]
Jul 09 22:01:36.497815 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:36.497790    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-2lmwp"]
Jul 09 22:01:37.201764 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:37.201733    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f81d4b0-b575-40c0-86b9-57ef406493fc" path="/var/lib/kubelet/pods/9f81d4b0-b575-40c0-86b9-57ef406493fc/volumes"
Jul 09 22:01:37.460153 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:37.460085    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cx5r7" event={"ID":"2433c8e7-20ef-453c-9a58-6e660be175f7","Type":"ContainerStarted","Data":"0800276e7861cb02f8c7e7e6b5fff4da438dc52dbe28542e4b078432356f901d"}
Jul 09 22:01:37.460266 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:37.460229    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cx5r7"
Jul 09 22:01:37.480896 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:37.480849    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cx5r7" podStartSLOduration=1.187386461 podStartE2EDuration="4.480835698s" totalImagesPullingTime="3.293449237s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:01:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:01:37.479752678 +0000 UTC m=+644.811252755" watchObservedRunningTime="2026-07-09 22:01:37.480835698 +0000 UTC m=+644.812335775"
Jul 09 22:01:39.423492 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:39.423462    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-l2w25"
Jul 09 22:01:40.473439 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:40.473407    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-df4jq" event={"ID":"9218a4f8-3388-4b31-b7f7-92ebdb02576d","Type":"ContainerStarted","Data":"4cc5932ad830a5b185eee3ae3e3f505a2601f93202fc3533a987f2d16953b671"}
Jul 09 22:01:40.473818 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:40.473499    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-df4jq"
Jul 09 22:01:40.492265 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:40.492216    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-df4jq" podStartSLOduration=2.302155774 podStartE2EDuration="7.492199757s" totalImagesPullingTime="5.190043983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:01:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:01:40.491177694 +0000 UTC m=+647.822677774" watchObservedRunningTime="2026-07-09 22:01:40.492199757 +0000 UTC m=+647.823699835"
Jul 09 22:01:41.430784 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:01:41.430756    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-pq9r8"
Jul 09 22:02:08.466512 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:08.466481    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cx5r7"
Jul 09 22:02:11.482710 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:11.482683    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-df4jq"
Jul 09 22:02:12.923630 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:12.923594    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8jnhl"]
Jul 09 22:02:12.924044 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:12.923883    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f81d4b0-b575-40c0-86b9-57ef406493fc" containerName="discovery"
Jul 09 22:02:12.924044 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:12.923894    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f81d4b0-b575-40c0-86b9-57ef406493fc" containerName="discovery"
Jul 09 22:02:12.924044 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:12.923945    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f81d4b0-b575-40c0-86b9-57ef406493fc" containerName="discovery"
Jul 09 22:02:12.933697 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:12.933672    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8jnhl"
Jul 09 22:02:12.936481 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:12.936455    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 09 22:02:12.937619 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:12.937568    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-nc9p9\""
Jul 09 22:02:12.937739 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:12.937649    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 09 22:02:12.937739 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:12.937723    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8jnhl"]
Jul 09 22:02:13.075620 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:13.075581    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd7wf\" (UniqueName: \"kubernetes.io/projected/f8ca2315-27ab-4fe0-901a-88721856d000-kube-api-access-pd7wf\") pod \"kuadrant-operator-catalog-8jnhl\" (UID: \"f8ca2315-27ab-4fe0-901a-88721856d000\") " pod="kuadrant-system/kuadrant-operator-catalog-8jnhl"
Jul 09 22:02:13.176247 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:13.176161    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd7wf\" (UniqueName: \"kubernetes.io/projected/f8ca2315-27ab-4fe0-901a-88721856d000-kube-api-access-pd7wf\") pod \"kuadrant-operator-catalog-8jnhl\" (UID: \"f8ca2315-27ab-4fe0-901a-88721856d000\") " pod="kuadrant-system/kuadrant-operator-catalog-8jnhl"
Jul 09 22:02:13.198731 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:13.198701    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd7wf\" (UniqueName: \"kubernetes.io/projected/f8ca2315-27ab-4fe0-901a-88721856d000-kube-api-access-pd7wf\") pod \"kuadrant-operator-catalog-8jnhl\" (UID: \"f8ca2315-27ab-4fe0-901a-88721856d000\") " pod="kuadrant-system/kuadrant-operator-catalog-8jnhl"
Jul 09 22:02:13.245533 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:13.245494    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8jnhl"
Jul 09 22:02:13.303490 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:13.303461    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8jnhl"]
Jul 09 22:02:13.379853 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:13.379828    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8jnhl"]
Jul 09 22:02:13.382482 ip-10-0-141-101 kubenswrapper[2576]: W0709 22:02:13.382454    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8ca2315_27ab_4fe0_901a_88721856d000.slice/crio-67bbe3968993f96403cfd63e3c47db584e1bb488e4e563efef8bf143253407e6 WatchSource:0}: Error finding container 67bbe3968993f96403cfd63e3c47db584e1bb488e4e563efef8bf143253407e6: Status 404 returned error can't find the container with id 67bbe3968993f96403cfd63e3c47db584e1bb488e4e563efef8bf143253407e6
Jul 09 22:02:13.383788 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:13.383774    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 22:02:13.507180 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:13.507101    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vssxp"]
Jul 09 22:02:13.509700 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:13.509683    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vssxp"
Jul 09 22:02:13.518303 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:13.518278    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vssxp"]
Jul 09 22:02:13.580710 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:13.580673    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqp74\" (UniqueName: \"kubernetes.io/projected/633464e5-3653-4e43-aecd-d02bce6c2e88-kube-api-access-zqp74\") pod \"kuadrant-operator-catalog-vssxp\" (UID: \"633464e5-3653-4e43-aecd-d02bce6c2e88\") " pod="kuadrant-system/kuadrant-operator-catalog-vssxp"
Jul 09 22:02:13.609158 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:13.609127    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8jnhl" event={"ID":"f8ca2315-27ab-4fe0-901a-88721856d000","Type":"ContainerStarted","Data":"67bbe3968993f96403cfd63e3c47db584e1bb488e4e563efef8bf143253407e6"}
Jul 09 22:02:13.681732 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:13.681693    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqp74\" (UniqueName: \"kubernetes.io/projected/633464e5-3653-4e43-aecd-d02bce6c2e88-kube-api-access-zqp74\") pod \"kuadrant-operator-catalog-vssxp\" (UID: \"633464e5-3653-4e43-aecd-d02bce6c2e88\") " pod="kuadrant-system/kuadrant-operator-catalog-vssxp"
Jul 09 22:02:13.694783 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:13.694745    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqp74\" (UniqueName: \"kubernetes.io/projected/633464e5-3653-4e43-aecd-d02bce6c2e88-kube-api-access-zqp74\") pod \"kuadrant-operator-catalog-vssxp\" (UID: \"633464e5-3653-4e43-aecd-d02bce6c2e88\") " pod="kuadrant-system/kuadrant-operator-catalog-vssxp"
Jul 09 22:02:13.820111 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:13.820065    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vssxp"
Jul 09 22:02:13.949165 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:13.949135    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vssxp"]
Jul 09 22:02:13.951523 ip-10-0-141-101 kubenswrapper[2576]: W0709 22:02:13.951496    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod633464e5_3653_4e43_aecd_d02bce6c2e88.slice/crio-53c8e4e1ba673f7a6e33ef94bef1ae4c1084534c4feba3784f8277fbebd9b5c2 WatchSource:0}: Error finding container 53c8e4e1ba673f7a6e33ef94bef1ae4c1084534c4feba3784f8277fbebd9b5c2: Status 404 returned error can't find the container with id 53c8e4e1ba673f7a6e33ef94bef1ae4c1084534c4feba3784f8277fbebd9b5c2
Jul 09 22:02:14.614514 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:14.614484    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vssxp" event={"ID":"633464e5-3653-4e43-aecd-d02bce6c2e88","Type":"ContainerStarted","Data":"53c8e4e1ba673f7a6e33ef94bef1ae4c1084534c4feba3784f8277fbebd9b5c2"}
Jul 09 22:02:15.621755 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:15.621715    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8jnhl" event={"ID":"f8ca2315-27ab-4fe0-901a-88721856d000","Type":"ContainerStarted","Data":"3beb6a1eb54836b0ed41969f90d68139e59752248b3368811b7e323e256f6cce"}
Jul 09 22:02:15.622216 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:15.621924    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-8jnhl" podUID="f8ca2315-27ab-4fe0-901a-88721856d000" containerName="registry-server" containerID="cri-o://3beb6a1eb54836b0ed41969f90d68139e59752248b3368811b7e323e256f6cce" gracePeriod=2
Jul 09 22:02:15.623700 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:15.623672    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vssxp" event={"ID":"633464e5-3653-4e43-aecd-d02bce6c2e88","Type":"ContainerStarted","Data":"add2862ff2a06f831b314dfeefe96bbab3d3124578a3a59fd1c08f6afe1925fa"}
Jul 09 22:02:15.637760 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:15.637690    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-8jnhl" podStartSLOduration=1.5075252209999999 podStartE2EDuration="3.637667982s" totalImagesPullingTime="2.130142761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:02:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:02:15.636325019 +0000 UTC m=+682.967825098" watchObservedRunningTime="2026-07-09 22:02:15.637667982 +0000 UTC m=+682.969168123"
Jul 09 22:02:15.657447 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:15.657260    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-vssxp" podStartSLOduration=1.0952303429999999 podStartE2EDuration="2.657236707s" totalImagesPullingTime="1.562006364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:02:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:02:15.656489746 +0000 UTC m=+682.987989815" watchObservedRunningTime="2026-07-09 22:02:15.657236707 +0000 UTC m=+682.988736787"
Jul 09 22:02:15.867462 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:15.867427    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-8jnhl_f8ca2315-27ab-4fe0-901a-88721856d000/registry-server/0.log"
Jul 09 22:02:15.869865 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:15.869850    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8jnhl"
Jul 09 22:02:16.000401 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:16.000364    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pd7wf\" (UniqueName: \"kubernetes.io/projected/f8ca2315-27ab-4fe0-901a-88721856d000-kube-api-access-pd7wf\") pod \"f8ca2315-27ab-4fe0-901a-88721856d000\" (UID: \"f8ca2315-27ab-4fe0-901a-88721856d000\") "
Jul 09 22:02:16.002491 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:16.002466    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8ca2315-27ab-4fe0-901a-88721856d000-kube-api-access-pd7wf" (OuterVolumeSpecName: "kube-api-access-pd7wf") pod "f8ca2315-27ab-4fe0-901a-88721856d000" (UID: "f8ca2315-27ab-4fe0-901a-88721856d000"). InnerVolumeSpecName "kube-api-access-pd7wf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:02:16.101539 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:16.101452    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pd7wf\" (UniqueName: \"kubernetes.io/projected/f8ca2315-27ab-4fe0-901a-88721856d000-kube-api-access-pd7wf\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:02:16.628747 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:16.628720    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-8jnhl_f8ca2315-27ab-4fe0-901a-88721856d000/registry-server/0.log"
Jul 09 22:02:16.629168 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:16.628755    2576 generic.go:356] "Generic (PLEG): container finished" podID="f8ca2315-27ab-4fe0-901a-88721856d000" containerID="3beb6a1eb54836b0ed41969f90d68139e59752248b3368811b7e323e256f6cce" exitCode=2
Jul 09 22:02:16.629168 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:16.628805    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8jnhl"
Jul 09 22:02:16.629168 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:16.628855    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8jnhl" event={"ID":"f8ca2315-27ab-4fe0-901a-88721856d000","Type":"ContainerDied","Data":"3beb6a1eb54836b0ed41969f90d68139e59752248b3368811b7e323e256f6cce"}
Jul 09 22:02:16.629168 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:16.628904    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8jnhl" event={"ID":"f8ca2315-27ab-4fe0-901a-88721856d000","Type":"ContainerDied","Data":"67bbe3968993f96403cfd63e3c47db584e1bb488e4e563efef8bf143253407e6"}
Jul 09 22:02:16.629168 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:16.628927    2576 scope.go:117] "RemoveContainer" containerID="3beb6a1eb54836b0ed41969f90d68139e59752248b3368811b7e323e256f6cce"
Jul 09 22:02:16.637176 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:16.637160    2576 scope.go:117] "RemoveContainer" containerID="3beb6a1eb54836b0ed41969f90d68139e59752248b3368811b7e323e256f6cce"
Jul 09 22:02:16.637435 ip-10-0-141-101 kubenswrapper[2576]: E0709 22:02:16.637418    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3beb6a1eb54836b0ed41969f90d68139e59752248b3368811b7e323e256f6cce\": container with ID starting with 3beb6a1eb54836b0ed41969f90d68139e59752248b3368811b7e323e256f6cce not found: ID does not exist" containerID="3beb6a1eb54836b0ed41969f90d68139e59752248b3368811b7e323e256f6cce"
Jul 09 22:02:16.637473 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:16.637445    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3beb6a1eb54836b0ed41969f90d68139e59752248b3368811b7e323e256f6cce"} err="failed to get container status \"3beb6a1eb54836b0ed41969f90d68139e59752248b3368811b7e323e256f6cce\": rpc error: code = NotFound desc = could not find container \"3beb6a1eb54836b0ed41969f90d68139e59752248b3368811b7e323e256f6cce\": container with ID starting with 3beb6a1eb54836b0ed41969f90d68139e59752248b3368811b7e323e256f6cce not found: ID does not exist"
Jul 09 22:02:16.649266 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:16.649236    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8jnhl"]
Jul 09 22:02:16.655466 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:16.655438    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8jnhl"]
Jul 09 22:02:17.199792 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:17.199758    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8ca2315-27ab-4fe0-901a-88721856d000" path="/var/lib/kubelet/pods/f8ca2315-27ab-4fe0-901a-88721856d000/volumes"
Jul 09 22:02:23.821093 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:23.821052    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-vssxp"
Jul 09 22:02:23.821603 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:23.821111    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-vssxp"
Jul 09 22:02:23.843814 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:23.843786    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-vssxp"
Jul 09 22:02:24.685782 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:24.685752    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-vssxp"
Jul 09 22:02:44.476664 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:44.476629    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hrxsd"]
Jul 09 22:02:44.477104 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:44.476911    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8ca2315-27ab-4fe0-901a-88721856d000" containerName="registry-server"
Jul 09 22:02:44.477104 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:44.476922    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8ca2315-27ab-4fe0-901a-88721856d000" containerName="registry-server"
Jul 09 22:02:44.477104 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:44.477006    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8ca2315-27ab-4fe0-901a-88721856d000" containerName="registry-server"
Jul 09 22:02:44.480293 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:44.480275    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hrxsd"
Jul 09 22:02:44.483026 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:44.483002    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-t27rs\""
Jul 09 22:02:44.493419 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:44.493390    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hrxsd"]
Jul 09 22:02:44.524364 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:44.524324    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc65p\" (UniqueName: \"kubernetes.io/projected/d8a359fa-f426-459f-82fd-079247dbd8d1-kube-api-access-wc65p\") pod \"limitador-operator-controller-manager-859d7b78bd-hrxsd\" (UID: \"d8a359fa-f426-459f-82fd-079247dbd8d1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hrxsd"
Jul 09 22:02:44.625188 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:44.625149    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc65p\" (UniqueName: \"kubernetes.io/projected/d8a359fa-f426-459f-82fd-079247dbd8d1-kube-api-access-wc65p\") pod \"limitador-operator-controller-manager-859d7b78bd-hrxsd\" (UID: \"d8a359fa-f426-459f-82fd-079247dbd8d1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hrxsd"
Jul 09 22:02:44.634022 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:44.633997    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc65p\" (UniqueName: \"kubernetes.io/projected/d8a359fa-f426-459f-82fd-079247dbd8d1-kube-api-access-wc65p\") pod \"limitador-operator-controller-manager-859d7b78bd-hrxsd\" (UID: \"d8a359fa-f426-459f-82fd-079247dbd8d1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hrxsd"
Jul 09 22:02:44.790182 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:44.790140    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hrxsd"
Jul 09 22:02:44.933893 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:44.933869    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hrxsd"]
Jul 09 22:02:44.936098 ip-10-0-141-101 kubenswrapper[2576]: W0709 22:02:44.936072    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8a359fa_f426_459f_82fd_079247dbd8d1.slice/crio-ebb17b2810c27fc36101ceb84fd7538aa698e25c4281a60bb2284031c6d15785 WatchSource:0}: Error finding container ebb17b2810c27fc36101ceb84fd7538aa698e25c4281a60bb2284031c6d15785: Status 404 returned error can't find the container with id ebb17b2810c27fc36101ceb84fd7538aa698e25c4281a60bb2284031c6d15785
Jul 09 22:02:45.751044 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:45.751007    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hrxsd" event={"ID":"d8a359fa-f426-459f-82fd-079247dbd8d1","Type":"ContainerStarted","Data":"ebb17b2810c27fc36101ceb84fd7538aa698e25c4281a60bb2284031c6d15785"}
Jul 09 22:02:47.762030 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:47.761997    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hrxsd" event={"ID":"d8a359fa-f426-459f-82fd-079247dbd8d1","Type":"ContainerStarted","Data":"d74eebed1ca9d27e2994f690d7419a4ff9535ce069d6a80fbc3a1b4dcb043f46"}
Jul 09 22:02:47.762494 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:47.762100    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hrxsd"
Jul 09 22:02:47.780860 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:47.780804    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hrxsd" podStartSLOduration=1.201129699 podStartE2EDuration="3.780785083s" totalImagesPullingTime="2.579655384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:02:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:02:47.780011205 +0000 UTC m=+715.111511284" watchObservedRunningTime="2026-07-09 22:02:47.780785083 +0000 UTC m=+715.112285162"
Jul 09 22:02:48.531423 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:48.531389    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-2vpk5"]
Jul 09 22:02:48.534568 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:48.534546    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2vpk5"
Jul 09 22:02:48.537140 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:48.537121    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-s95km\""
Jul 09 22:02:48.553344 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:48.553303    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-2vpk5"]
Jul 09 22:02:48.555065 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:48.555035    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tsrx\" (UniqueName: \"kubernetes.io/projected/993f9d45-7a82-405d-976e-cbb3be273ead-kube-api-access-8tsrx\") pod \"authorino-operator-75cc8d5cb7-2vpk5\" (UID: \"993f9d45-7a82-405d-976e-cbb3be273ead\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-2vpk5"
Jul 09 22:02:48.655951 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:48.655913    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tsrx\" (UniqueName: \"kubernetes.io/projected/993f9d45-7a82-405d-976e-cbb3be273ead-kube-api-access-8tsrx\") pod \"authorino-operator-75cc8d5cb7-2vpk5\" (UID: \"993f9d45-7a82-405d-976e-cbb3be273ead\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-2vpk5"
Jul 09 22:02:48.667062 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:48.667027    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tsrx\" (UniqueName: \"kubernetes.io/projected/993f9d45-7a82-405d-976e-cbb3be273ead-kube-api-access-8tsrx\") pod \"authorino-operator-75cc8d5cb7-2vpk5\" (UID: \"993f9d45-7a82-405d-976e-cbb3be273ead\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-2vpk5"
Jul 09 22:02:48.845011 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:48.844903    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2vpk5"
Jul 09 22:02:48.980920 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:48.980875    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-2vpk5"]
Jul 09 22:02:48.983068 ip-10-0-141-101 kubenswrapper[2576]: W0709 22:02:48.983034    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod993f9d45_7a82_405d_976e_cbb3be273ead.slice/crio-56802ba0f76d7e6b05f77f8654ada14bf41a48d7d4402117f7ab7a2d604c3a89 WatchSource:0}: Error finding container 56802ba0f76d7e6b05f77f8654ada14bf41a48d7d4402117f7ab7a2d604c3a89: Status 404 returned error can't find the container with id 56802ba0f76d7e6b05f77f8654ada14bf41a48d7d4402117f7ab7a2d604c3a89
Jul 09 22:02:49.773182 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:49.773140    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2vpk5" event={"ID":"993f9d45-7a82-405d-976e-cbb3be273ead","Type":"ContainerStarted","Data":"56802ba0f76d7e6b05f77f8654ada14bf41a48d7d4402117f7ab7a2d604c3a89"}
Jul 09 22:02:51.806971 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:51.806932    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-bfdbb"]
Jul 09 22:02:51.810579 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:51.810554    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bfdbb"
Jul 09 22:02:51.813974 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:51.813904    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 09 22:02:51.814189 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:51.814165    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-cbch6\""
Jul 09 22:02:51.826462 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:51.826424    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-bfdbb"]
Jul 09 22:02:51.887127 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:51.887095    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh29c\" (UniqueName: \"kubernetes.io/projected/fb19fa9f-5de3-410c-85e1-b368b16b2843-kube-api-access-gh29c\") pod \"dns-operator-controller-manager-864dd78c4c-bfdbb\" (UID: \"fb19fa9f-5de3-410c-85e1-b368b16b2843\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bfdbb"
Jul 09 22:02:51.987419 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:51.987401    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh29c\" (UniqueName: \"kubernetes.io/projected/fb19fa9f-5de3-410c-85e1-b368b16b2843-kube-api-access-gh29c\") pod \"dns-operator-controller-manager-864dd78c4c-bfdbb\" (UID: \"fb19fa9f-5de3-410c-85e1-b368b16b2843\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bfdbb"
Jul 09 22:02:51.997828 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:51.997798    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh29c\" (UniqueName: \"kubernetes.io/projected/fb19fa9f-5de3-410c-85e1-b368b16b2843-kube-api-access-gh29c\") pod \"dns-operator-controller-manager-864dd78c4c-bfdbb\" (UID: \"fb19fa9f-5de3-410c-85e1-b368b16b2843\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bfdbb"
Jul 09 22:02:52.125806 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:52.125721    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bfdbb"
Jul 09 22:02:52.292241 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:52.292186    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-bfdbb"]
Jul 09 22:02:52.294420 ip-10-0-141-101 kubenswrapper[2576]: W0709 22:02:52.294395    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb19fa9f_5de3_410c_85e1_b368b16b2843.slice/crio-9bd61fb23686a93ce2ce12f41b3c601e62e43e15c69416809895b622e85252b6 WatchSource:0}: Error finding container 9bd61fb23686a93ce2ce12f41b3c601e62e43e15c69416809895b622e85252b6: Status 404 returned error can't find the container with id 9bd61fb23686a93ce2ce12f41b3c601e62e43e15c69416809895b622e85252b6
Jul 09 22:02:52.789250 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:52.789218    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2vpk5" event={"ID":"993f9d45-7a82-405d-976e-cbb3be273ead","Type":"ContainerStarted","Data":"8bf1e49342753626b1fd278105a752c4a4f12afdb811f4dbf2a44b19d4f3b6f2"}
Jul 09 22:02:52.789425 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:52.789340    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2vpk5"
Jul 09 22:02:52.790558 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:52.790536    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bfdbb" event={"ID":"fb19fa9f-5de3-410c-85e1-b368b16b2843","Type":"ContainerStarted","Data":"9bd61fb23686a93ce2ce12f41b3c601e62e43e15c69416809895b622e85252b6"}
Jul 09 22:02:52.807969 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:52.807902    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2vpk5" podStartSLOduration=1.85326455 podStartE2EDuration="4.807880254s" totalImagesPullingTime="2.954615704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:02:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:02:52.806212298 +0000 UTC m=+720.137712387" watchObservedRunningTime="2026-07-09 22:02:52.807880254 +0000 UTC m=+720.139380334"
Jul 09 22:02:54.339225 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:54.339202    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 09 22:02:54.801260 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:54.801225    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bfdbb" event={"ID":"fb19fa9f-5de3-410c-85e1-b368b16b2843","Type":"ContainerStarted","Data":"46861dcf909f3df113220a4c8bd7a7be4bd9f8b7e702d007d5f0fedabccb0ea8"}
Jul 09 22:02:54.801438 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:54.801298    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bfdbb"
Jul 09 22:02:54.819444 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:54.819398    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bfdbb" podStartSLOduration=1.7790013089999999 podStartE2EDuration="3.819381468s" totalImagesPullingTime="2.040380159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:02:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:02:54.81797645 +0000 UTC m=+722.149476519" watchObservedRunningTime="2026-07-09 22:02:54.819381468 +0000 UTC m=+722.150881546"
Jul 09 22:02:58.768230 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:02:58.768199    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hrxsd"
Jul 09 22:03:03.797208 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:03.797172    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2vpk5"
Jul 09 22:03:05.807365 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:05.807331    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bfdbb"
Jul 09 22:03:06.208056 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:06.207976    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-r65sc"]
Jul 09 22:03:06.211364 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:06.211346    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r65sc"
Jul 09 22:03:06.214869 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:06.214846    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-86c5k\""
Jul 09 22:03:06.214988 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:06.214905    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 09 22:03:06.215331 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:06.215316    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 09 22:03:06.223338 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:06.223314    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-r65sc"]
Jul 09 22:03:06.300216 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:06.300177    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1adea14a-9e34-4e9a-bf5d-897041459b81-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-r65sc\" (UID: \"1adea14a-9e34-4e9a-bf5d-897041459b81\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r65sc"
Jul 09 22:03:06.300216 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:06.300217    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g9t9\" (UniqueName: \"kubernetes.io/projected/1adea14a-9e34-4e9a-bf5d-897041459b81-kube-api-access-5g9t9\") pod \"kuadrant-console-plugin-66b5774985-r65sc\" (UID: \"1adea14a-9e34-4e9a-bf5d-897041459b81\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r65sc"
Jul 09 22:03:06.300495 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:06.300313    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1adea14a-9e34-4e9a-bf5d-897041459b81-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-r65sc\" (UID: \"1adea14a-9e34-4e9a-bf5d-897041459b81\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r65sc"
Jul 09 22:03:06.401245 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:06.401208    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1adea14a-9e34-4e9a-bf5d-897041459b81-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-r65sc\" (UID: \"1adea14a-9e34-4e9a-bf5d-897041459b81\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r65sc"
Jul 09 22:03:06.401422 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:06.401254    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g9t9\" (UniqueName: \"kubernetes.io/projected/1adea14a-9e34-4e9a-bf5d-897041459b81-kube-api-access-5g9t9\") pod \"kuadrant-console-plugin-66b5774985-r65sc\" (UID: \"1adea14a-9e34-4e9a-bf5d-897041459b81\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r65sc"
Jul 09 22:03:06.401422 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:06.401316    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1adea14a-9e34-4e9a-bf5d-897041459b81-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-r65sc\" (UID: \"1adea14a-9e34-4e9a-bf5d-897041459b81\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r65sc"
Jul 09 22:03:06.402013 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:06.401992    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1adea14a-9e34-4e9a-bf5d-897041459b81-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-r65sc\" (UID: \"1adea14a-9e34-4e9a-bf5d-897041459b81\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r65sc"
Jul 09 22:03:06.403733 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:06.403716    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1adea14a-9e34-4e9a-bf5d-897041459b81-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-r65sc\" (UID: \"1adea14a-9e34-4e9a-bf5d-897041459b81\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r65sc"
Jul 09 22:03:06.409491 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:06.409463    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g9t9\" (UniqueName: \"kubernetes.io/projected/1adea14a-9e34-4e9a-bf5d-897041459b81-kube-api-access-5g9t9\") pod \"kuadrant-console-plugin-66b5774985-r65sc\" (UID: \"1adea14a-9e34-4e9a-bf5d-897041459b81\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r65sc"
Jul 09 22:03:06.520377 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:06.520347    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r65sc"
Jul 09 22:03:06.652122 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:06.652088    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-r65sc"]
Jul 09 22:03:06.855086 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:06.854994    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r65sc" event={"ID":"1adea14a-9e34-4e9a-bf5d-897041459b81","Type":"ContainerStarted","Data":"dab66738cb16dac980ee3ffc5734b817bf0e576ae73f19a3723af5bb32f97fb3"}
Jul 09 22:03:16.962881 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:16.962830    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hrxsd"]
Jul 09 22:03:16.963484 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:16.963234    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hrxsd" podUID="d8a359fa-f426-459f-82fd-079247dbd8d1" containerName="manager" containerID="cri-o://d74eebed1ca9d27e2994f690d7419a4ff9535ce069d6a80fbc3a1b4dcb043f46" gracePeriod=2
Jul 09 22:03:16.975703 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:16.975668    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hrxsd"]
Jul 09 22:03:16.994346 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:16.994311    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chkh7"]
Jul 09 22:03:16.994765 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:16.994732    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8a359fa-f426-459f-82fd-079247dbd8d1" containerName="manager"
Jul 09 22:03:16.994765 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:16.994755    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8a359fa-f426-459f-82fd-079247dbd8d1" containerName="manager"
Jul 09 22:03:16.994919 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:16.994858    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8a359fa-f426-459f-82fd-079247dbd8d1" containerName="manager"
Jul 09 22:03:16.999256 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:16.999229    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chkh7"
Jul 09 22:03:17.005323 ip-10-0-141-101 kubenswrapper[2576]: E0709 22:03:17.005220    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hrxsd\" is forbidden: User \"system:node:ip-10-0-141-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-101.ec2.internal' and this object" podUID="d8a359fa-f426-459f-82fd-079247dbd8d1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hrxsd"
Jul 09 22:03:17.018490 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:17.018457    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chkh7"]
Jul 09 22:03:17.100828 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:17.100794    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6w4fl\" (UniqueName: \"kubernetes.io/projected/1b58c863-7d8f-47f4-a80d-f7ae73235656-kube-api-access-6w4fl\") pod \"limitador-operator-controller-manager-859d7b78bd-chkh7\" (UID: \"1b58c863-7d8f-47f4-a80d-f7ae73235656\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chkh7"
Jul 09 22:03:17.202030 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:17.201987    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6w4fl\" (UniqueName: \"kubernetes.io/projected/1b58c863-7d8f-47f4-a80d-f7ae73235656-kube-api-access-6w4fl\") pod \"limitador-operator-controller-manager-859d7b78bd-chkh7\" (UID: \"1b58c863-7d8f-47f4-a80d-f7ae73235656\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chkh7"
Jul 09 22:03:17.213316 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:17.213244    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6w4fl\" (UniqueName: \"kubernetes.io/projected/1b58c863-7d8f-47f4-a80d-f7ae73235656-kube-api-access-6w4fl\") pod \"limitador-operator-controller-manager-859d7b78bd-chkh7\" (UID: \"1b58c863-7d8f-47f4-a80d-f7ae73235656\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chkh7"
Jul 09 22:03:17.332709 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:17.332670    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chkh7"
Jul 09 22:03:30.617727 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:30.617700    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hrxsd"
Jul 09 22:03:30.620117 ip-10-0-141-101 kubenswrapper[2576]: E0709 22:03:30.620084    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hrxsd\" is forbidden: User \"system:node:ip-10-0-141-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-101.ec2.internal' and this object" podUID="d8a359fa-f426-459f-82fd-079247dbd8d1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hrxsd"
Jul 09 22:03:30.632145 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:30.629894    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chkh7"]
Jul 09 22:03:30.635041 ip-10-0-141-101 kubenswrapper[2576]: W0709 22:03:30.635010    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b58c863_7d8f_47f4_a80d_f7ae73235656.slice/crio-64f7433eb6857c695c02f34c792d5319b2550c170a9ef119be0dfa67bfef394f WatchSource:0}: Error finding container 64f7433eb6857c695c02f34c792d5319b2550c170a9ef119be0dfa67bfef394f: Status 404 returned error can't find the container with id 64f7433eb6857c695c02f34c792d5319b2550c170a9ef119be0dfa67bfef394f
Jul 09 22:03:30.715610 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:30.715577    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wc65p\" (UniqueName: \"kubernetes.io/projected/d8a359fa-f426-459f-82fd-079247dbd8d1-kube-api-access-wc65p\") pod \"d8a359fa-f426-459f-82fd-079247dbd8d1\" (UID: \"d8a359fa-f426-459f-82fd-079247dbd8d1\") "
Jul 09 22:03:30.717547 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:30.717525    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8a359fa-f426-459f-82fd-079247dbd8d1-kube-api-access-wc65p" (OuterVolumeSpecName: "kube-api-access-wc65p") pod "d8a359fa-f426-459f-82fd-079247dbd8d1" (UID: "d8a359fa-f426-459f-82fd-079247dbd8d1"). InnerVolumeSpecName "kube-api-access-wc65p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:03:30.816189 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:30.816152    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wc65p\" (UniqueName: \"kubernetes.io/projected/d8a359fa-f426-459f-82fd-079247dbd8d1-kube-api-access-wc65p\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:03:30.974597 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:30.974565    2576 generic.go:356] "Generic (PLEG): container finished" podID="d8a359fa-f426-459f-82fd-079247dbd8d1" containerID="d74eebed1ca9d27e2994f690d7419a4ff9535ce069d6a80fbc3a1b4dcb043f46" exitCode=0
Jul 09 22:03:30.974766 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:30.974622    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hrxsd"
Jul 09 22:03:30.974766 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:30.974667    2576 scope.go:117] "RemoveContainer" containerID="d74eebed1ca9d27e2994f690d7419a4ff9535ce069d6a80fbc3a1b4dcb043f46"
Jul 09 22:03:30.976304 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:30.976276    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r65sc" event={"ID":"1adea14a-9e34-4e9a-bf5d-897041459b81","Type":"ContainerStarted","Data":"0696efe55395b14c87c867159f6277e2b97fc0c86937a882f36cf17e607d4bc3"}
Jul 09 22:03:30.977794 ip-10-0-141-101 kubenswrapper[2576]: E0709 22:03:30.977765    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hrxsd\" is forbidden: User \"system:node:ip-10-0-141-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-101.ec2.internal' and this object" podUID="d8a359fa-f426-459f-82fd-079247dbd8d1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hrxsd"
Jul 09 22:03:30.977894 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:30.977866    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chkh7" event={"ID":"1b58c863-7d8f-47f4-a80d-f7ae73235656","Type":"ContainerStarted","Data":"1d076d55402f96462d962a61223e3e425eb5ec19e37dfc346d73c40243738872"}
Jul 09 22:03:30.977946 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:30.977916    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chkh7" event={"ID":"1b58c863-7d8f-47f4-a80d-f7ae73235656","Type":"ContainerStarted","Data":"64f7433eb6857c695c02f34c792d5319b2550c170a9ef119be0dfa67bfef394f"}
Jul 09 22:03:30.978007 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:30.977979    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chkh7"
Jul 09 22:03:30.983819 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:30.983802    2576 scope.go:117] "RemoveContainer" containerID="d74eebed1ca9d27e2994f690d7419a4ff9535ce069d6a80fbc3a1b4dcb043f46"
Jul 09 22:03:30.984099 ip-10-0-141-101 kubenswrapper[2576]: E0709 22:03:30.984074    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d74eebed1ca9d27e2994f690d7419a4ff9535ce069d6a80fbc3a1b4dcb043f46\": container with ID starting with d74eebed1ca9d27e2994f690d7419a4ff9535ce069d6a80fbc3a1b4dcb043f46 not found: ID does not exist" containerID="d74eebed1ca9d27e2994f690d7419a4ff9535ce069d6a80fbc3a1b4dcb043f46"
Jul 09 22:03:30.984161 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:30.984112    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d74eebed1ca9d27e2994f690d7419a4ff9535ce069d6a80fbc3a1b4dcb043f46"} err="failed to get container status \"d74eebed1ca9d27e2994f690d7419a4ff9535ce069d6a80fbc3a1b4dcb043f46\": rpc error: code = NotFound desc = could not find container \"d74eebed1ca9d27e2994f690d7419a4ff9535ce069d6a80fbc3a1b4dcb043f46\": container with ID starting with d74eebed1ca9d27e2994f690d7419a4ff9535ce069d6a80fbc3a1b4dcb043f46 not found: ID does not exist"
Jul 09 22:03:30.995527 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:30.995476    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r65sc" podStartSLOduration=1.102496452 podStartE2EDuration="24.995459597s" totalImagesPullingTime="23.892963145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:03:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:03:30.994163447 +0000 UTC m=+758.325663522" watchObservedRunningTime="2026-07-09 22:03:30.995459597 +0000 UTC m=+758.326959675"
Jul 09 22:03:30.996893 ip-10-0-141-101 kubenswrapper[2576]: E0709 22:03:30.996865    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hrxsd\" is forbidden: User \"system:node:ip-10-0-141-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-101.ec2.internal' and this object" podUID="d8a359fa-f426-459f-82fd-079247dbd8d1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hrxsd"
Jul 09 22:03:30.999068 ip-10-0-141-101 kubenswrapper[2576]: E0709 22:03:30.999045    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hrxsd\" is forbidden: User \"system:node:ip-10-0-141-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-101.ec2.internal' and this object" podUID="d8a359fa-f426-459f-82fd-079247dbd8d1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hrxsd"
Jul 09 22:03:31.020911 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:31.020861    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chkh7" podStartSLOduration=15.020845756 podStartE2EDuration="15.020845756s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:03:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:03:31.02006564 +0000 UTC m=+758.351565720" watchObservedRunningTime="2026-07-09 22:03:31.020845756 +0000 UTC m=+758.352345834"
Jul 09 22:03:31.200388 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:31.200302    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8a359fa-f426-459f-82fd-079247dbd8d1" path="/var/lib/kubelet/pods/d8a359fa-f426-459f-82fd-079247dbd8d1/volumes"
Jul 09 22:03:41.984767 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:41.984736    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-chkh7"
Jul 09 22:03:45.643855 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:45.643824    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97"]
Jul 09 22:03:45.663453 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:45.663426    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97"]
Jul 09 22:03:45.663652 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:45.663524    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97"
Jul 09 22:03:45.666540 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:45.666513    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 09 22:03:45.666540 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:45.666535    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-ng9bw\""
Jul 09 22:03:45.837709 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:45.837671    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e0705e6-7963-4d77-827c-cee07947f167-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-m2w97\" (UID: \"1e0705e6-7963-4d77-827c-cee07947f167\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97"
Jul 09 22:03:45.837709 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:45.837713    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e0705e6-7963-4d77-827c-cee07947f167-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-m2w97\" (UID: \"1e0705e6-7963-4d77-827c-cee07947f167\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97"
Jul 09 22:03:45.837942 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:45.837733    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e0705e6-7963-4d77-827c-cee07947f167-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-m2w97\" (UID: \"1e0705e6-7963-4d77-827c-cee07947f167\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97"
Jul 09 22:03:45.837942 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:45.837753    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e0705e6-7963-4d77-827c-cee07947f167-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-m2w97\" (UID: \"1e0705e6-7963-4d77-827c-cee07947f167\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97"
Jul 09 22:03:45.837942 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:45.837815    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e0705e6-7963-4d77-827c-cee07947f167-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-m2w97\" (UID: \"1e0705e6-7963-4d77-827c-cee07947f167\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97"
Jul 09 22:03:45.837942 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:45.837877    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e0705e6-7963-4d77-827c-cee07947f167-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-m2w97\" (UID: \"1e0705e6-7963-4d77-827c-cee07947f167\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97"
Jul 09 22:03:45.837942 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:45.837905    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjhmx\" (UniqueName: \"kubernetes.io/projected/1e0705e6-7963-4d77-827c-cee07947f167-kube-api-access-wjhmx\") pod \"maas-default-gateway-openshift-default-56654dcf7-m2w97\" (UID: \"1e0705e6-7963-4d77-827c-cee07947f167\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97"
Jul 09 22:03:45.838163 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:45.838002    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e0705e6-7963-4d77-827c-cee07947f167-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-m2w97\" (UID: \"1e0705e6-7963-4d77-827c-cee07947f167\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97"
Jul 09 22:03:45.838163 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:45.838021    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e0705e6-7963-4d77-827c-cee07947f167-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-m2w97\" (UID: \"1e0705e6-7963-4d77-827c-cee07947f167\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97"
Jul 09 22:03:45.939115 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:45.939023    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e0705e6-7963-4d77-827c-cee07947f167-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-m2w97\" (UID: \"1e0705e6-7963-4d77-827c-cee07947f167\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97"
Jul 09 22:03:45.939115 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:45.939071    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjhmx\" (UniqueName: \"kubernetes.io/projected/1e0705e6-7963-4d77-827c-cee07947f167-kube-api-access-wjhmx\") pod \"maas-default-gateway-openshift-default-56654dcf7-m2w97\" (UID: \"1e0705e6-7963-4d77-827c-cee07947f167\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97"
Jul 09 22:03:45.939346 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:45.939130    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e0705e6-7963-4d77-827c-cee07947f167-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-m2w97\" (UID: \"1e0705e6-7963-4d77-827c-cee07947f167\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97"
Jul 09 22:03:45.939346 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:45.939155    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e0705e6-7963-4d77-827c-cee07947f167-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-m2w97\" (UID: \"1e0705e6-7963-4d77-827c-cee07947f167\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97"
Jul 09 22:03:45.939346 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:45.939180    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e0705e6-7963-4d77-827c-cee07947f167-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-m2w97\" (UID: \"1e0705e6-7963-4d77-827c-cee07947f167\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97"
Jul 09 22:03:45.939346 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:45.939208    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e0705e6-7963-4d77-827c-cee07947f167-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-m2w97\" (UID: \"1e0705e6-7963-4d77-827c-cee07947f167\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97"
Jul 09 22:03:45.939346 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:45.939231    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e0705e6-7963-4d77-827c-cee07947f167-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-m2w97\" (UID: \"1e0705e6-7963-4d77-827c-cee07947f167\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97"
Jul 09 22:03:45.939346 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:45.939256    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e0705e6-7963-4d77-827c-cee07947f167-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-m2w97\" (UID: \"1e0705e6-7963-4d77-827c-cee07947f167\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97"
Jul 09 22:03:45.939346 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:45.939282    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e0705e6-7963-4d77-827c-cee07947f167-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-m2w97\" (UID: \"1e0705e6-7963-4d77-827c-cee07947f167\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97"
Jul 09 22:03:45.939681 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:45.939498    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e0705e6-7963-4d77-827c-cee07947f167-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-m2w97\" (UID: \"1e0705e6-7963-4d77-827c-cee07947f167\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97"
Jul 09 22:03:45.939681 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:45.939513    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e0705e6-7963-4d77-827c-cee07947f167-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-m2w97\" (UID: \"1e0705e6-7963-4d77-827c-cee07947f167\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97"
Jul 09 22:03:45.939681 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:45.939620    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e0705e6-7963-4d77-827c-cee07947f167-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-m2w97\" (UID: \"1e0705e6-7963-4d77-827c-cee07947f167\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97"
Jul 09 22:03:45.939828 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:45.939772    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e0705e6-7963-4d77-827c-cee07947f167-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-m2w97\" (UID: \"1e0705e6-7963-4d77-827c-cee07947f167\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97"
Jul 09 22:03:45.939890 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:45.939865    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e0705e6-7963-4d77-827c-cee07947f167-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-m2w97\" (UID: \"1e0705e6-7963-4d77-827c-cee07947f167\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97"
Jul 09 22:03:45.941732 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:45.941709    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e0705e6-7963-4d77-827c-cee07947f167-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-m2w97\" (UID: \"1e0705e6-7963-4d77-827c-cee07947f167\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97"
Jul 09 22:03:45.941884 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:45.941865    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e0705e6-7963-4d77-827c-cee07947f167-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-m2w97\" (UID: \"1e0705e6-7963-4d77-827c-cee07947f167\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97"
Jul 09 22:03:45.948281 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:45.948258    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e0705e6-7963-4d77-827c-cee07947f167-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-m2w97\" (UID: \"1e0705e6-7963-4d77-827c-cee07947f167\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97"
Jul 09 22:03:45.948525 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:45.948505    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjhmx\" (UniqueName: \"kubernetes.io/projected/1e0705e6-7963-4d77-827c-cee07947f167-kube-api-access-wjhmx\") pod \"maas-default-gateway-openshift-default-56654dcf7-m2w97\" (UID: \"1e0705e6-7963-4d77-827c-cee07947f167\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97"
Jul 09 22:03:45.975239 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:45.975201    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97"
Jul 09 22:03:46.114450 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:46.114426    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97"]
Jul 09 22:03:46.116526 ip-10-0-141-101 kubenswrapper[2576]: W0709 22:03:46.116497    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e0705e6_7963_4d77_827c_cee07947f167.slice/crio-865384f4f372d07dfc418bacf4e37895c0f71f6d88963ffcb509aa1163455454 WatchSource:0}: Error finding container 865384f4f372d07dfc418bacf4e37895c0f71f6d88963ffcb509aa1163455454: Status 404 returned error can't find the container with id 865384f4f372d07dfc418bacf4e37895c0f71f6d88963ffcb509aa1163455454
Jul 09 22:03:47.052547 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:47.052506    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97" event={"ID":"1e0705e6-7963-4d77-827c-cee07947f167","Type":"ContainerStarted","Data":"865384f4f372d07dfc418bacf4e37895c0f71f6d88963ffcb509aa1163455454"}
Jul 09 22:03:48.496475 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:48.496442    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:03:48.496771 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:48.496514    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:03:48.496771 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:48.496542    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:03:49.063266 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:49.063231    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97" event={"ID":"1e0705e6-7963-4d77-827c-cee07947f167","Type":"ContainerStarted","Data":"27fd5d47d82bae6baf929660a9350f35d68701811ae2b0037625c846c65b88da"}
Jul 09 22:03:49.092019 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:49.091948    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97" podStartSLOduration=1.714464287 podStartE2EDuration="4.091927258s" totalImagesPullingTime="2.377462971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:03:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:03:49.083480544 +0000 UTC m=+776.414980624" watchObservedRunningTime="2026-07-09 22:03:49.091927258 +0000 UTC m=+776.423427392"
Jul 09 22:03:49.976323 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:49.976283    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97"
Jul 09 22:03:49.981509 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:49.981479    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97"
Jul 09 22:03:50.070624 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:50.070586    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97"
Jul 09 22:03:50.071484 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:50.071466    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97"
Jul 09 22:03:59.950254 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:03:59.950220    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zfgnc"]
Jul 09 22:04:00.011064 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:00.011030    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zfgnc"]
Jul 09 22:04:00.011224 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:00.011156    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zfgnc"
Jul 09 22:04:00.014063 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:00.014037    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 09 22:04:00.046631 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:00.046593    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/07fa3512-ac48-4b12-b7d6-e78104030746-config-file\") pod \"limitador-limitador-64c94fd64f-zfgnc\" (UID: \"07fa3512-ac48-4b12-b7d6-e78104030746\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zfgnc"
Jul 09 22:04:00.047017 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:00.046991    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j46h\" (UniqueName: \"kubernetes.io/projected/07fa3512-ac48-4b12-b7d6-e78104030746-kube-api-access-2j46h\") pod \"limitador-limitador-64c94fd64f-zfgnc\" (UID: \"07fa3512-ac48-4b12-b7d6-e78104030746\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zfgnc"
Jul 09 22:04:00.049335 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:00.049310    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zfgnc"]
Jul 09 22:04:00.148400 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:00.148364    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/07fa3512-ac48-4b12-b7d6-e78104030746-config-file\") pod \"limitador-limitador-64c94fd64f-zfgnc\" (UID: \"07fa3512-ac48-4b12-b7d6-e78104030746\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zfgnc"
Jul 09 22:04:00.148626 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:00.148435    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j46h\" (UniqueName: \"kubernetes.io/projected/07fa3512-ac48-4b12-b7d6-e78104030746-kube-api-access-2j46h\") pod \"limitador-limitador-64c94fd64f-zfgnc\" (UID: \"07fa3512-ac48-4b12-b7d6-e78104030746\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zfgnc"
Jul 09 22:04:00.149283 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:00.149256    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/07fa3512-ac48-4b12-b7d6-e78104030746-config-file\") pod \"limitador-limitador-64c94fd64f-zfgnc\" (UID: \"07fa3512-ac48-4b12-b7d6-e78104030746\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zfgnc"
Jul 09 22:04:00.157205 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:00.157170    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j46h\" (UniqueName: \"kubernetes.io/projected/07fa3512-ac48-4b12-b7d6-e78104030746-kube-api-access-2j46h\") pod \"limitador-limitador-64c94fd64f-zfgnc\" (UID: \"07fa3512-ac48-4b12-b7d6-e78104030746\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zfgnc"
Jul 09 22:04:00.324506 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:00.324468    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zfgnc"
Jul 09 22:04:00.488427 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:00.488403    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zfgnc"]
Jul 09 22:04:00.949250 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:00.949211    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-w6nmv"]
Jul 09 22:04:01.057088 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:01.057056    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-w6nmv"]
Jul 09 22:04:01.057503 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:01.057150    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-w6nmv"
Jul 09 22:04:01.060367 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:01.060346    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-6chww\""
Jul 09 22:04:01.123574 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:01.123543    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zfgnc" event={"ID":"07fa3512-ac48-4b12-b7d6-e78104030746","Type":"ContainerStarted","Data":"87188b5ee52eee9fcf75a5f5849fed3bfb94bf74871d62a76c28f1f522cd37fe"}
Jul 09 22:04:01.158175 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:01.158137    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsczr\" (UniqueName: \"kubernetes.io/projected/423e9c6c-987c-404b-a748-0025b5e671cb-kube-api-access-zsczr\") pod \"authorino-75d556bd77-w6nmv\" (UID: \"423e9c6c-987c-404b-a748-0025b5e671cb\") " pod="kuadrant-system/authorino-75d556bd77-w6nmv"
Jul 09 22:04:01.258984 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:01.258898    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsczr\" (UniqueName: \"kubernetes.io/projected/423e9c6c-987c-404b-a748-0025b5e671cb-kube-api-access-zsczr\") pod \"authorino-75d556bd77-w6nmv\" (UID: \"423e9c6c-987c-404b-a748-0025b5e671cb\") " pod="kuadrant-system/authorino-75d556bd77-w6nmv"
Jul 09 22:04:01.267144 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:01.267119    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsczr\" (UniqueName: \"kubernetes.io/projected/423e9c6c-987c-404b-a748-0025b5e671cb-kube-api-access-zsczr\") pod \"authorino-75d556bd77-w6nmv\" (UID: \"423e9c6c-987c-404b-a748-0025b5e671cb\") " pod="kuadrant-system/authorino-75d556bd77-w6nmv"
Jul 09 22:04:01.367173 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:01.367136    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-w6nmv"
Jul 09 22:04:01.544243 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:01.544155    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-w6nmv"]
Jul 09 22:04:01.552570 ip-10-0-141-101 kubenswrapper[2576]: W0709 22:04:01.552500    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod423e9c6c_987c_404b_a748_0025b5e671cb.slice/crio-73956a7f927d53e1b57daa206f5a9d72f5a92b402d9ced4e5d2746e6e0e65769 WatchSource:0}: Error finding container 73956a7f927d53e1b57daa206f5a9d72f5a92b402d9ced4e5d2746e6e0e65769: Status 404 returned error can't find the container with id 73956a7f927d53e1b57daa206f5a9d72f5a92b402d9ced4e5d2746e6e0e65769
Jul 09 22:04:02.130527 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:02.130495    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-w6nmv" event={"ID":"423e9c6c-987c-404b-a748-0025b5e671cb","Type":"ContainerStarted","Data":"73956a7f927d53e1b57daa206f5a9d72f5a92b402d9ced4e5d2746e6e0e65769"}
Jul 09 22:04:06.153645 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:06.153606    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-w6nmv" event={"ID":"423e9c6c-987c-404b-a748-0025b5e671cb","Type":"ContainerStarted","Data":"e8fb694700c42c42923108c0a9ffc32e6f1487f127089cce9a61007b6bb7fcd0"}
Jul 09 22:04:06.155021 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:06.154996    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zfgnc" event={"ID":"07fa3512-ac48-4b12-b7d6-e78104030746","Type":"ContainerStarted","Data":"2ea5468120625f671389e7a926d3a706c9e0afb0eaed0518654b1edfaa1d39e9"}
Jul 09 22:04:06.155144 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:06.155128    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-zfgnc"
Jul 09 22:04:06.172090 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:06.172036    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-w6nmv" podStartSLOduration=2.393893154 podStartE2EDuration="6.172021011s" totalImagesPullingTime="3.778127857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:04:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:04:06.170514742 +0000 UTC m=+793.502014821" watchObservedRunningTime="2026-07-09 22:04:06.172021011 +0000 UTC m=+793.503521089"
Jul 09 22:04:06.190639 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:06.190573    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-zfgnc" podStartSLOduration=2.358767736 podStartE2EDuration="7.190555973s" totalImagesPullingTime="4.831788237s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:03:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:04:06.189189015 +0000 UTC m=+793.520689094" watchObservedRunningTime="2026-07-09 22:04:06.190555973 +0000 UTC m=+793.522056050"
Jul 09 22:04:16.541731 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:16.541648    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zfgnc"]
Jul 09 22:04:16.542134 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:16.541906    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-zfgnc" podUID="07fa3512-ac48-4b12-b7d6-e78104030746" containerName="limitador" containerID="cri-o://2ea5468120625f671389e7a926d3a706c9e0afb0eaed0518654b1edfaa1d39e9" gracePeriod=30
Jul 09 22:04:16.542601 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:16.542581    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-zfgnc"
Jul 09 22:04:17.208023 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:17.207922    2576 generic.go:356] "Generic (PLEG): container finished" podID="07fa3512-ac48-4b12-b7d6-e78104030746" containerID="2ea5468120625f671389e7a926d3a706c9e0afb0eaed0518654b1edfaa1d39e9" exitCode=0
Jul 09 22:04:17.208023 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:17.207991    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zfgnc" event={"ID":"07fa3512-ac48-4b12-b7d6-e78104030746","Type":"ContainerDied","Data":"2ea5468120625f671389e7a926d3a706c9e0afb0eaed0518654b1edfaa1d39e9"}
Jul 09 22:04:17.483549 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:17.483524    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zfgnc"
Jul 09 22:04:17.600674 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:17.600636    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/07fa3512-ac48-4b12-b7d6-e78104030746-config-file\") pod \"07fa3512-ac48-4b12-b7d6-e78104030746\" (UID: \"07fa3512-ac48-4b12-b7d6-e78104030746\") "
Jul 09 22:04:17.601095 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:17.600710    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2j46h\" (UniqueName: \"kubernetes.io/projected/07fa3512-ac48-4b12-b7d6-e78104030746-kube-api-access-2j46h\") pod \"07fa3512-ac48-4b12-b7d6-e78104030746\" (UID: \"07fa3512-ac48-4b12-b7d6-e78104030746\") "
Jul 09 22:04:17.601095 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:17.601073    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07fa3512-ac48-4b12-b7d6-e78104030746-config-file" (OuterVolumeSpecName: "config-file") pod "07fa3512-ac48-4b12-b7d6-e78104030746" (UID: "07fa3512-ac48-4b12-b7d6-e78104030746"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:04:17.602777 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:17.602758    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07fa3512-ac48-4b12-b7d6-e78104030746-kube-api-access-2j46h" (OuterVolumeSpecName: "kube-api-access-2j46h") pod "07fa3512-ac48-4b12-b7d6-e78104030746" (UID: "07fa3512-ac48-4b12-b7d6-e78104030746"). InnerVolumeSpecName "kube-api-access-2j46h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:04:17.702288 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:17.702252    2576 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/07fa3512-ac48-4b12-b7d6-e78104030746-config-file\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:04:17.702288 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:17.702281    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2j46h\" (UniqueName: \"kubernetes.io/projected/07fa3512-ac48-4b12-b7d6-e78104030746-kube-api-access-2j46h\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:04:18.214098 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:18.214058    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zfgnc" event={"ID":"07fa3512-ac48-4b12-b7d6-e78104030746","Type":"ContainerDied","Data":"87188b5ee52eee9fcf75a5f5849fed3bfb94bf74871d62a76c28f1f522cd37fe"}
Jul 09 22:04:18.214098 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:18.214085    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zfgnc"
Jul 09 22:04:18.214329 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:18.214133    2576 scope.go:117] "RemoveContainer" containerID="2ea5468120625f671389e7a926d3a706c9e0afb0eaed0518654b1edfaa1d39e9"
Jul 09 22:04:18.236179 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:18.236140    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zfgnc"]
Jul 09 22:04:18.241615 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:18.241587    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zfgnc"]
Jul 09 22:04:19.200322 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:19.200290    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07fa3512-ac48-4b12-b7d6-e78104030746" path="/var/lib/kubelet/pods/07fa3512-ac48-4b12-b7d6-e78104030746/volumes"
Jul 09 22:04:22.276732 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:22.276689    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-xx8s9"]
Jul 09 22:04:22.277188 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:22.277171    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07fa3512-ac48-4b12-b7d6-e78104030746" containerName="limitador"
Jul 09 22:04:22.277242 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:22.277194    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="07fa3512-ac48-4b12-b7d6-e78104030746" containerName="limitador"
Jul 09 22:04:22.277302 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:22.277291    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="07fa3512-ac48-4b12-b7d6-e78104030746" containerName="limitador"
Jul 09 22:04:22.282169 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:22.282147    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx8s9"
Jul 09 22:04:22.284929 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:22.284906    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 09 22:04:22.285059 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:22.284906    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 22:04:22.285059 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:22.285006    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 22:04:22.286150 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:22.286125    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-lhqgb\""
Jul 09 22:04:22.288234 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:22.288211    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-xx8s9"]
Jul 09 22:04:22.343255 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:22.343211    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9d0a2ef5-5ec5-4eec-97c1-806e6aebcf4c-data\") pod \"postgres-69fb4594cf-xx8s9\" (UID: \"9d0a2ef5-5ec5-4eec-97c1-806e6aebcf4c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx8s9"
Jul 09 22:04:22.343435 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:22.343334    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkgt8\" (UniqueName: \"kubernetes.io/projected/9d0a2ef5-5ec5-4eec-97c1-806e6aebcf4c-kube-api-access-wkgt8\") pod \"postgres-69fb4594cf-xx8s9\" (UID: \"9d0a2ef5-5ec5-4eec-97c1-806e6aebcf4c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx8s9"
Jul 09 22:04:22.444676 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:22.444637    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9d0a2ef5-5ec5-4eec-97c1-806e6aebcf4c-data\") pod \"postgres-69fb4594cf-xx8s9\" (UID: \"9d0a2ef5-5ec5-4eec-97c1-806e6aebcf4c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx8s9"
Jul 09 22:04:22.444846 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:22.444716    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkgt8\" (UniqueName: \"kubernetes.io/projected/9d0a2ef5-5ec5-4eec-97c1-806e6aebcf4c-kube-api-access-wkgt8\") pod \"postgres-69fb4594cf-xx8s9\" (UID: \"9d0a2ef5-5ec5-4eec-97c1-806e6aebcf4c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx8s9"
Jul 09 22:04:22.445138 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:22.445118    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9d0a2ef5-5ec5-4eec-97c1-806e6aebcf4c-data\") pod \"postgres-69fb4594cf-xx8s9\" (UID: \"9d0a2ef5-5ec5-4eec-97c1-806e6aebcf4c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx8s9"
Jul 09 22:04:22.453996 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:22.453945    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkgt8\" (UniqueName: \"kubernetes.io/projected/9d0a2ef5-5ec5-4eec-97c1-806e6aebcf4c-kube-api-access-wkgt8\") pod \"postgres-69fb4594cf-xx8s9\" (UID: \"9d0a2ef5-5ec5-4eec-97c1-806e6aebcf4c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx8s9"
Jul 09 22:04:22.593524 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:22.593421    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx8s9"
Jul 09 22:04:22.732771 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:22.732736    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-xx8s9"]
Jul 09 22:04:22.735996 ip-10-0-141-101 kubenswrapper[2576]: W0709 22:04:22.735964    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d0a2ef5_5ec5_4eec_97c1_806e6aebcf4c.slice/crio-da3a4a931be415d9408bcee4dee06a3a19530b582d31293f84abc0ff9ad85575 WatchSource:0}: Error finding container da3a4a931be415d9408bcee4dee06a3a19530b582d31293f84abc0ff9ad85575: Status 404 returned error can't find the container with id da3a4a931be415d9408bcee4dee06a3a19530b582d31293f84abc0ff9ad85575
Jul 09 22:04:23.237388 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:23.237351    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx8s9" event={"ID":"9d0a2ef5-5ec5-4eec-97c1-806e6aebcf4c","Type":"ContainerStarted","Data":"da3a4a931be415d9408bcee4dee06a3a19530b582d31293f84abc0ff9ad85575"}
Jul 09 22:04:29.271085 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:29.271042    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx8s9" event={"ID":"9d0a2ef5-5ec5-4eec-97c1-806e6aebcf4c","Type":"ContainerStarted","Data":"9099e6f4c558c1209cd711576aec04557d668c41a22e27c1587e281fb6c28a90"}
Jul 09 22:04:29.271476 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:29.271202    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx8s9"
Jul 09 22:04:29.287967 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:29.287911    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx8s9" podStartSLOduration=1.5553810019999998 podStartE2EDuration="7.287894092s" totalImagesPullingTime="5.73251309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:04:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:04:29.286475793 +0000 UTC m=+816.617975872" watchObservedRunningTime="2026-07-09 22:04:29.287894092 +0000 UTC m=+816.619394169"
Jul 09 22:04:35.307997 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:35.307934    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xx8s9"
Jul 09 22:04:35.856838 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:35.856800    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-sq28p"]
Jul 09 22:04:35.867266 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:35.867239    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-sq28p"
Jul 09 22:04:35.868181 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:35.868149    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-sq28p"]
Jul 09 22:04:35.967928 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:35.967885    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mknn8\" (UniqueName: \"kubernetes.io/projected/5c31fe7f-a0e9-4a59-acf8-c35e37cf87f6-kube-api-access-mknn8\") pod \"authorino-5d4b67c446-sq28p\" (UID: \"5c31fe7f-a0e9-4a59-acf8-c35e37cf87f6\") " pod="kuadrant-system/authorino-5d4b67c446-sq28p"
Jul 09 22:04:36.041340 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:36.041309    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-sq28p"]
Jul 09 22:04:36.041567 ip-10-0-141-101 kubenswrapper[2576]: E0709 22:04:36.041548    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-mknn8], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-sq28p" podUID="5c31fe7f-a0e9-4a59-acf8-c35e37cf87f6"
Jul 09 22:04:36.068721 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:36.068686    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mknn8\" (UniqueName: \"kubernetes.io/projected/5c31fe7f-a0e9-4a59-acf8-c35e37cf87f6-kube-api-access-mknn8\") pod \"authorino-5d4b67c446-sq28p\" (UID: \"5c31fe7f-a0e9-4a59-acf8-c35e37cf87f6\") " pod="kuadrant-system/authorino-5d4b67c446-sq28p"
Jul 09 22:04:36.082996 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:36.082944    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mknn8\" (UniqueName: \"kubernetes.io/projected/5c31fe7f-a0e9-4a59-acf8-c35e37cf87f6-kube-api-access-mknn8\") pod \"authorino-5d4b67c446-sq28p\" (UID: \"5c31fe7f-a0e9-4a59-acf8-c35e37cf87f6\") " pod="kuadrant-system/authorino-5d4b67c446-sq28p"
Jul 09 22:04:36.145183 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:36.145104    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-67978f9f8d-p6hbr"]
Jul 09 22:04:36.148410 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:36.148388    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67978f9f8d-p6hbr"
Jul 09 22:04:36.150736 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:36.150717    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 09 22:04:36.155594 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:36.155566    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67978f9f8d-p6hbr"]
Jul 09 22:04:36.271270 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:36.271230    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0c7c8970-5ce1-4b0b-8599-423f193dc6e1-tls-cert\") pod \"authorino-67978f9f8d-p6hbr\" (UID: \"0c7c8970-5ce1-4b0b-8599-423f193dc6e1\") " pod="kuadrant-system/authorino-67978f9f8d-p6hbr"
Jul 09 22:04:36.271438 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:36.271337    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6szr\" (UniqueName: \"kubernetes.io/projected/0c7c8970-5ce1-4b0b-8599-423f193dc6e1-kube-api-access-f6szr\") pod \"authorino-67978f9f8d-p6hbr\" (UID: \"0c7c8970-5ce1-4b0b-8599-423f193dc6e1\") " pod="kuadrant-system/authorino-67978f9f8d-p6hbr"
Jul 09 22:04:36.307141 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:36.307109    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-sq28p"
Jul 09 22:04:36.313736 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:36.313716    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-sq28p"
Jul 09 22:04:36.371888 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:36.371854    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0c7c8970-5ce1-4b0b-8599-423f193dc6e1-tls-cert\") pod \"authorino-67978f9f8d-p6hbr\" (UID: \"0c7c8970-5ce1-4b0b-8599-423f193dc6e1\") " pod="kuadrant-system/authorino-67978f9f8d-p6hbr"
Jul 09 22:04:36.372092 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:36.371912    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6szr\" (UniqueName: \"kubernetes.io/projected/0c7c8970-5ce1-4b0b-8599-423f193dc6e1-kube-api-access-f6szr\") pod \"authorino-67978f9f8d-p6hbr\" (UID: \"0c7c8970-5ce1-4b0b-8599-423f193dc6e1\") " pod="kuadrant-system/authorino-67978f9f8d-p6hbr"
Jul 09 22:04:36.374403 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:36.374379    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0c7c8970-5ce1-4b0b-8599-423f193dc6e1-tls-cert\") pod \"authorino-67978f9f8d-p6hbr\" (UID: \"0c7c8970-5ce1-4b0b-8599-423f193dc6e1\") " pod="kuadrant-system/authorino-67978f9f8d-p6hbr"
Jul 09 22:04:36.380042 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:36.380017    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6szr\" (UniqueName: \"kubernetes.io/projected/0c7c8970-5ce1-4b0b-8599-423f193dc6e1-kube-api-access-f6szr\") pod \"authorino-67978f9f8d-p6hbr\" (UID: \"0c7c8970-5ce1-4b0b-8599-423f193dc6e1\") " pod="kuadrant-system/authorino-67978f9f8d-p6hbr"
Jul 09 22:04:36.459009 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:36.458889    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67978f9f8d-p6hbr"
Jul 09 22:04:36.473219 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:36.473191    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mknn8\" (UniqueName: \"kubernetes.io/projected/5c31fe7f-a0e9-4a59-acf8-c35e37cf87f6-kube-api-access-mknn8\") pod \"5c31fe7f-a0e9-4a59-acf8-c35e37cf87f6\" (UID: \"5c31fe7f-a0e9-4a59-acf8-c35e37cf87f6\") "
Jul 09 22:04:36.475551 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:36.475518    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c31fe7f-a0e9-4a59-acf8-c35e37cf87f6-kube-api-access-mknn8" (OuterVolumeSpecName: "kube-api-access-mknn8") pod "5c31fe7f-a0e9-4a59-acf8-c35e37cf87f6" (UID: "5c31fe7f-a0e9-4a59-acf8-c35e37cf87f6"). InnerVolumeSpecName "kube-api-access-mknn8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:04:36.574808 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:36.574775    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mknn8\" (UniqueName: \"kubernetes.io/projected/5c31fe7f-a0e9-4a59-acf8-c35e37cf87f6-kube-api-access-mknn8\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:04:36.589859 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:36.589833    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67978f9f8d-p6hbr"]
Jul 09 22:04:36.592466 ip-10-0-141-101 kubenswrapper[2576]: W0709 22:04:36.592440    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0c7c8970_5ce1_4b0b_8599_423f193dc6e1.slice/crio-0cdd8832ba271348f8874e3e50583ddfd706d6b838f2acc13a2f41be4b75f50d WatchSource:0}: Error finding container 0cdd8832ba271348f8874e3e50583ddfd706d6b838f2acc13a2f41be4b75f50d: Status 404 returned error can't find the container with id 0cdd8832ba271348f8874e3e50583ddfd706d6b838f2acc13a2f41be4b75f50d
Jul 09 22:04:37.312837 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:37.312809    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-sq28p"
Jul 09 22:04:37.312837 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:37.312821    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67978f9f8d-p6hbr" event={"ID":"0c7c8970-5ce1-4b0b-8599-423f193dc6e1","Type":"ContainerStarted","Data":"843fb93fb36bf573567bbe299a006b7c3e911756e66169f97cd919183a505970"}
Jul 09 22:04:37.313135 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:37.312856    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67978f9f8d-p6hbr" event={"ID":"0c7c8970-5ce1-4b0b-8599-423f193dc6e1","Type":"ContainerStarted","Data":"0cdd8832ba271348f8874e3e50583ddfd706d6b838f2acc13a2f41be4b75f50d"}
Jul 09 22:04:37.328183 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:37.328125    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-67978f9f8d-p6hbr" podStartSLOduration=0.974557206 podStartE2EDuration="1.328108698s" totalImagesPullingTime="353.551492ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:04:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:04:37.327400191 +0000 UTC m=+824.658900260" watchObservedRunningTime="2026-07-09 22:04:37.328108698 +0000 UTC m=+824.659608776"
Jul 09 22:04:37.353209 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:37.353176    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-sq28p"]
Jul 09 22:04:37.362176 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:37.362146    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-w6nmv"]
Jul 09 22:04:37.362337 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:37.362317    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-w6nmv" podUID="423e9c6c-987c-404b-a748-0025b5e671cb" containerName="authorino" containerID="cri-o://e8fb694700c42c42923108c0a9ffc32e6f1487f127089cce9a61007b6bb7fcd0" gracePeriod=30
Jul 09 22:04:37.365653 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:37.365623    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-sq28p"]
Jul 09 22:04:37.617884 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:37.617853    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-w6nmv"
Jul 09 22:04:37.783894 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:37.783863    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zsczr\" (UniqueName: \"kubernetes.io/projected/423e9c6c-987c-404b-a748-0025b5e671cb-kube-api-access-zsczr\") pod \"423e9c6c-987c-404b-a748-0025b5e671cb\" (UID: \"423e9c6c-987c-404b-a748-0025b5e671cb\") "
Jul 09 22:04:37.785975 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:37.785923    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/423e9c6c-987c-404b-a748-0025b5e671cb-kube-api-access-zsczr" (OuterVolumeSpecName: "kube-api-access-zsczr") pod "423e9c6c-987c-404b-a748-0025b5e671cb" (UID: "423e9c6c-987c-404b-a748-0025b5e671cb"). InnerVolumeSpecName "kube-api-access-zsczr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:04:37.885295 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:37.885253    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zsczr\" (UniqueName: \"kubernetes.io/projected/423e9c6c-987c-404b-a748-0025b5e671cb-kube-api-access-zsczr\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:04:38.318847 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:38.318809    2576 generic.go:356] "Generic (PLEG): container finished" podID="423e9c6c-987c-404b-a748-0025b5e671cb" containerID="e8fb694700c42c42923108c0a9ffc32e6f1487f127089cce9a61007b6bb7fcd0" exitCode=0
Jul 09 22:04:38.319058 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:38.318854    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-w6nmv"
Jul 09 22:04:38.319058 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:38.318894    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-w6nmv" event={"ID":"423e9c6c-987c-404b-a748-0025b5e671cb","Type":"ContainerDied","Data":"e8fb694700c42c42923108c0a9ffc32e6f1487f127089cce9a61007b6bb7fcd0"}
Jul 09 22:04:38.319058 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:38.318938    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-w6nmv" event={"ID":"423e9c6c-987c-404b-a748-0025b5e671cb","Type":"ContainerDied","Data":"73956a7f927d53e1b57daa206f5a9d72f5a92b402d9ced4e5d2746e6e0e65769"}
Jul 09 22:04:38.319058 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:38.318967    2576 scope.go:117] "RemoveContainer" containerID="e8fb694700c42c42923108c0a9ffc32e6f1487f127089cce9a61007b6bb7fcd0"
Jul 09 22:04:38.327855 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:38.327834    2576 scope.go:117] "RemoveContainer" containerID="e8fb694700c42c42923108c0a9ffc32e6f1487f127089cce9a61007b6bb7fcd0"
Jul 09 22:04:38.328194 ip-10-0-141-101 kubenswrapper[2576]: E0709 22:04:38.328172    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8fb694700c42c42923108c0a9ffc32e6f1487f127089cce9a61007b6bb7fcd0\": container with ID starting with e8fb694700c42c42923108c0a9ffc32e6f1487f127089cce9a61007b6bb7fcd0 not found: ID does not exist" containerID="e8fb694700c42c42923108c0a9ffc32e6f1487f127089cce9a61007b6bb7fcd0"
Jul 09 22:04:38.328266 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:38.328201    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8fb694700c42c42923108c0a9ffc32e6f1487f127089cce9a61007b6bb7fcd0"} err="failed to get container status \"e8fb694700c42c42923108c0a9ffc32e6f1487f127089cce9a61007b6bb7fcd0\": rpc error: code = NotFound desc = could not find container \"e8fb694700c42c42923108c0a9ffc32e6f1487f127089cce9a61007b6bb7fcd0\": container with ID starting with e8fb694700c42c42923108c0a9ffc32e6f1487f127089cce9a61007b6bb7fcd0 not found: ID does not exist"
Jul 09 22:04:38.339767 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:38.339742    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-w6nmv"]
Jul 09 22:04:38.345941 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:38.345913    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-w6nmv"]
Jul 09 22:04:39.199973 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:39.199932    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="423e9c6c-987c-404b-a748-0025b5e671cb" path="/var/lib/kubelet/pods/423e9c6c-987c-404b-a748-0025b5e671cb/volumes"
Jul 09 22:04:39.200293 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:04:39.200280    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c31fe7f-a0e9-4a59-acf8-c35e37cf87f6" path="/var/lib/kubelet/pods/5c31fe7f-a0e9-4a59-acf8-c35e37cf87f6/volumes"
Jul 09 22:05:18.064300 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:18.064259    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-sjf46"]
Jul 09 22:05:18.064798 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:18.064576    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="423e9c6c-987c-404b-a748-0025b5e671cb" containerName="authorino"
Jul 09 22:05:18.064798 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:18.064587    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="423e9c6c-987c-404b-a748-0025b5e671cb" containerName="authorino"
Jul 09 22:05:18.064798 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:18.064656    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="423e9c6c-987c-404b-a748-0025b5e671cb" containerName="authorino"
Jul 09 22:05:18.081436 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:18.081399    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-sjf46"]
Jul 09 22:05:18.081670 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:18.081508    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-sjf46"
Jul 09 22:05:18.084183 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:18.084147    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 09 22:05:18.084322 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:18.084234    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-gd7z9\""
Jul 09 22:05:18.216278 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:18.216245    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4th7\" (UniqueName: \"kubernetes.io/projected/46ec86b5-bc9f-49c4-b9bc-00994f0ae977-kube-api-access-f4th7\") pod \"payload-pre-processing-7964457696-sjf46\" (UID: \"46ec86b5-bc9f-49c4-b9bc-00994f0ae977\") " pod="openshift-ingress/payload-pre-processing-7964457696-sjf46"
Jul 09 22:05:18.216454 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:18.216386    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46ec86b5-bc9f-49c4-b9bc-00994f0ae977-plugins-config-volume\") pod \"payload-pre-processing-7964457696-sjf46\" (UID: \"46ec86b5-bc9f-49c4-b9bc-00994f0ae977\") " pod="openshift-ingress/payload-pre-processing-7964457696-sjf46"
Jul 09 22:05:18.317227 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:18.317134    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46ec86b5-bc9f-49c4-b9bc-00994f0ae977-plugins-config-volume\") pod \"payload-pre-processing-7964457696-sjf46\" (UID: \"46ec86b5-bc9f-49c4-b9bc-00994f0ae977\") " pod="openshift-ingress/payload-pre-processing-7964457696-sjf46"
Jul 09 22:05:18.317227 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:18.317176    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4th7\" (UniqueName: \"kubernetes.io/projected/46ec86b5-bc9f-49c4-b9bc-00994f0ae977-kube-api-access-f4th7\") pod \"payload-pre-processing-7964457696-sjf46\" (UID: \"46ec86b5-bc9f-49c4-b9bc-00994f0ae977\") " pod="openshift-ingress/payload-pre-processing-7964457696-sjf46"
Jul 09 22:05:18.317839 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:18.317817    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46ec86b5-bc9f-49c4-b9bc-00994f0ae977-plugins-config-volume\") pod \"payload-pre-processing-7964457696-sjf46\" (UID: \"46ec86b5-bc9f-49c4-b9bc-00994f0ae977\") " pod="openshift-ingress/payload-pre-processing-7964457696-sjf46"
Jul 09 22:05:18.327525 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:18.327491    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4th7\" (UniqueName: \"kubernetes.io/projected/46ec86b5-bc9f-49c4-b9bc-00994f0ae977-kube-api-access-f4th7\") pod \"payload-pre-processing-7964457696-sjf46\" (UID: \"46ec86b5-bc9f-49c4-b9bc-00994f0ae977\") " pod="openshift-ingress/payload-pre-processing-7964457696-sjf46"
Jul 09 22:05:18.392697 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:18.392663    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-sjf46"
Jul 09 22:05:18.524912 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:18.524884    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-sjf46"]
Jul 09 22:05:18.526893 ip-10-0-141-101 kubenswrapper[2576]: W0709 22:05:18.526868    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46ec86b5_bc9f_49c4_b9bc_00994f0ae977.slice/crio-d5b86bf0199667233d3203019b87006d469efba1757126f74773e2f5c984a8b3 WatchSource:0}: Error finding container d5b86bf0199667233d3203019b87006d469efba1757126f74773e2f5c984a8b3: Status 404 returned error can't find the container with id d5b86bf0199667233d3203019b87006d469efba1757126f74773e2f5c984a8b3
Jul 09 22:05:19.507281 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:19.507240    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-sjf46" event={"ID":"46ec86b5-bc9f-49c4-b9bc-00994f0ae977","Type":"ContainerStarted","Data":"d5b86bf0199667233d3203019b87006d469efba1757126f74773e2f5c984a8b3"}
Jul 09 22:05:20.513455 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:20.513373    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-sjf46" event={"ID":"46ec86b5-bc9f-49c4-b9bc-00994f0ae977","Type":"ContainerStarted","Data":"ff7833eaa4392da6bf7dd067cece924d70fd74b8e7c3cf6cc47682e3922ee4a1"}
Jul 09 22:05:20.513455 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:20.513437    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-sjf46"
Jul 09 22:05:20.531145 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:20.531098    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-sjf46" podStartSLOduration=0.999646665 podStartE2EDuration="2.531080809s" totalImagesPullingTime="1.531434144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:05:20.528506539 +0000 UTC m=+867.860006617" watchObservedRunningTime="2026-07-09 22:05:20.531080809 +0000 UTC m=+867.862580886"
Jul 09 22:05:26.544158 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:26.544120    2576 generic.go:356] "Generic (PLEG): container finished" podID="1e0705e6-7963-4d77-827c-cee07947f167" containerID="27fd5d47d82bae6baf929660a9350f35d68701811ae2b0037625c846c65b88da" exitCode=0
Jul 09 22:05:26.544644 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:26.544196    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97" event={"ID":"1e0705e6-7963-4d77-827c-cee07947f167","Type":"ContainerDied","Data":"27fd5d47d82bae6baf929660a9350f35d68701811ae2b0037625c846c65b88da"}
Jul 09 22:05:26.544644 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:26.544577    2576 scope.go:117] "RemoveContainer" containerID="27fd5d47d82bae6baf929660a9350f35d68701811ae2b0037625c846c65b88da"
Jul 09 22:05:26.545548 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:26.545516    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:05:26.545608 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:26.545595    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:05:26.545642 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:26.545634    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:05:27.551811 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:27.551774    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97" event={"ID":"1e0705e6-7963-4d77-827c-cee07947f167","Type":"ContainerStarted","Data":"b53eb093cefea60d27600c855d337c41f38f5987289e7e0ffbef70cdf079fd8b"}
Jul 09 22:05:27.976356 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:27.976321    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97"
Jul 09 22:05:27.976595 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:27.976572    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-m2w97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body=
Jul 09 22:05:27.976649 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:27.976629    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97" podUID="1e0705e6-7963-4d77-827c-cee07947f167" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused"
Jul 09 22:05:28.976268 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:28.976225    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-m2w97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body=
Jul 09 22:05:28.976673 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:28.976286    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97" podUID="1e0705e6-7963-4d77-827c-cee07947f167" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused"
Jul 09 22:05:29.976525 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:29.976487    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-m2w97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body=
Jul 09 22:05:29.976919 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:29.976545    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97" podUID="1e0705e6-7963-4d77-827c-cee07947f167" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused"
Jul 09 22:05:30.976555 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:30.976514    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-m2w97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body=
Jul 09 22:05:30.976948 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:30.976589    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97" podUID="1e0705e6-7963-4d77-827c-cee07947f167" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused"
Jul 09 22:05:31.519813 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:31.519767    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-7964457696-sjf46" podUID="46ec86b5-bc9f-49c4-b9bc-00994f0ae977" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.36:9004: connect: connection refused"
Jul 09 22:05:31.980287 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:31.980217    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97"
Jul 09 22:05:31.980664 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:31.980602    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97"
Jul 09 22:05:31.981404 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:31.981384    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m2w97"
Jul 09 22:05:38.393100 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:38.393053    2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-ingress/payload-pre-processing-7964457696-sjf46" podUID="46ec86b5-bc9f-49c4-b9bc-00994f0ae977" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.36:9004: connect: connection refused"
Jul 09 22:05:41.518266 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:41.518225    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-7964457696-sjf46" podUID="46ec86b5-bc9f-49c4-b9bc-00994f0ae977" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.36:9004: connect: connection refused"
Jul 09 22:05:41.975676 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:41.975642    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch"]
Jul 09 22:05:41.978121 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:41.978102    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch"
Jul 09 22:05:41.981771 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:41.981736    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-x55j4\""
Jul 09 22:05:41.981771 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:41.981765    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 09 22:05:41.981946 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:41.981796    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 09 22:05:41.981946 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:41.981766    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 09 22:05:41.986974 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:41.986940    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch"]
Jul 09 22:05:42.038524 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:42.038482    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/238b2591-3d5d-4e43-a89e-26e4991d2a4a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch\" (UID: \"238b2591-3d5d-4e43-a89e-26e4991d2a4a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch"
Jul 09 22:05:42.038683 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:42.038595    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/238b2591-3d5d-4e43-a89e-26e4991d2a4a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch\" (UID: \"238b2591-3d5d-4e43-a89e-26e4991d2a4a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch"
Jul 09 22:05:42.038683 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:42.038658    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/238b2591-3d5d-4e43-a89e-26e4991d2a4a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch\" (UID: \"238b2591-3d5d-4e43-a89e-26e4991d2a4a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch"
Jul 09 22:05:42.038821 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:42.038763    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8n9w\" (UniqueName: \"kubernetes.io/projected/238b2591-3d5d-4e43-a89e-26e4991d2a4a-kube-api-access-k8n9w\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch\" (UID: \"238b2591-3d5d-4e43-a89e-26e4991d2a4a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch"
Jul 09 22:05:42.038821 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:42.038807    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/238b2591-3d5d-4e43-a89e-26e4991d2a4a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch\" (UID: \"238b2591-3d5d-4e43-a89e-26e4991d2a4a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch"
Jul 09 22:05:42.038937 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:42.038833    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/238b2591-3d5d-4e43-a89e-26e4991d2a4a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch\" (UID: \"238b2591-3d5d-4e43-a89e-26e4991d2a4a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch"
Jul 09 22:05:42.139230 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:42.139186    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8n9w\" (UniqueName: \"kubernetes.io/projected/238b2591-3d5d-4e43-a89e-26e4991d2a4a-kube-api-access-k8n9w\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch\" (UID: \"238b2591-3d5d-4e43-a89e-26e4991d2a4a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch"
Jul 09 22:05:42.139230 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:42.139227    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/238b2591-3d5d-4e43-a89e-26e4991d2a4a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch\" (UID: \"238b2591-3d5d-4e43-a89e-26e4991d2a4a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch"
Jul 09 22:05:42.139428 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:42.139348    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/238b2591-3d5d-4e43-a89e-26e4991d2a4a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch\" (UID: \"238b2591-3d5d-4e43-a89e-26e4991d2a4a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch"
Jul 09 22:05:42.139428 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:42.139412    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/238b2591-3d5d-4e43-a89e-26e4991d2a4a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch\" (UID: \"238b2591-3d5d-4e43-a89e-26e4991d2a4a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch"
Jul 09 22:05:42.139498 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:42.139455    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/238b2591-3d5d-4e43-a89e-26e4991d2a4a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch\" (UID: \"238b2591-3d5d-4e43-a89e-26e4991d2a4a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch"
Jul 09 22:05:42.139559 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:42.139500    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/238b2591-3d5d-4e43-a89e-26e4991d2a4a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch\" (UID: \"238b2591-3d5d-4e43-a89e-26e4991d2a4a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch"
Jul 09 22:05:42.139812 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:42.139774    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/238b2591-3d5d-4e43-a89e-26e4991d2a4a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch\" (UID: \"238b2591-3d5d-4e43-a89e-26e4991d2a4a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch"
Jul 09 22:05:42.139949 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:42.139837    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/238b2591-3d5d-4e43-a89e-26e4991d2a4a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch\" (UID: \"238b2591-3d5d-4e43-a89e-26e4991d2a4a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch"
Jul 09 22:05:42.139949 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:42.139873    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/238b2591-3d5d-4e43-a89e-26e4991d2a4a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch\" (UID: \"238b2591-3d5d-4e43-a89e-26e4991d2a4a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch"
Jul 09 22:05:42.141583 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:42.141559    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/238b2591-3d5d-4e43-a89e-26e4991d2a4a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch\" (UID: \"238b2591-3d5d-4e43-a89e-26e4991d2a4a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch"
Jul 09 22:05:42.142043 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:42.142026    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/238b2591-3d5d-4e43-a89e-26e4991d2a4a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch\" (UID: \"238b2591-3d5d-4e43-a89e-26e4991d2a4a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch"
Jul 09 22:05:42.146915 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:42.146896    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8n9w\" (UniqueName: \"kubernetes.io/projected/238b2591-3d5d-4e43-a89e-26e4991d2a4a-kube-api-access-k8n9w\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch\" (UID: \"238b2591-3d5d-4e43-a89e-26e4991d2a4a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch"
Jul 09 22:05:42.313329 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:42.313287    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch"
Jul 09 22:05:42.466872 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:42.466843    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch"]
Jul 09 22:05:42.468984 ip-10-0-141-101 kubenswrapper[2576]: W0709 22:05:42.468936    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod238b2591_3d5d_4e43_a89e_26e4991d2a4a.slice/crio-880039dbb026e95b989752fe1268cf60abaf72ef12bd46ae80959f260b9854ba WatchSource:0}: Error finding container 880039dbb026e95b989752fe1268cf60abaf72ef12bd46ae80959f260b9854ba: Status 404 returned error can't find the container with id 880039dbb026e95b989752fe1268cf60abaf72ef12bd46ae80959f260b9854ba
Jul 09 22:05:42.625299 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:42.625214    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch" event={"ID":"238b2591-3d5d-4e43-a89e-26e4991d2a4a","Type":"ContainerStarted","Data":"880039dbb026e95b989752fe1268cf60abaf72ef12bd46ae80959f260b9854ba"}
Jul 09 22:05:44.637331 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:44.637294    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch" event={"ID":"238b2591-3d5d-4e43-a89e-26e4991d2a4a","Type":"ContainerStarted","Data":"9037509756c4417730104d2ef034d3b8b2a0037ff9f584210dd9f1db05fde6eb"}
Jul 09 22:05:44.654397 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:44.654345    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch" podStartSLOduration=2.415804218 podStartE2EDuration="3.654327779s" totalImagesPullingTime="1.238523561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:05:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:05:44.65357511 +0000 UTC m=+891.985075189" watchObservedRunningTime="2026-07-09 22:05:44.654327779 +0000 UTC m=+891.985827857"
Jul 09 22:05:51.519434 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:51.519353    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-sjf46"
Jul 09 22:05:52.313999 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:52.313943    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch"
Jul 09 22:05:52.314172 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:52.314024    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch"
Jul 09 22:05:52.326112 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:52.326090    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch"
Jul 09 22:05:52.684852 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:52.684774    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch"
Jul 09 22:05:53.156523 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:53.156493    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27vrn_10510741-9c12-4044-ac11-97958aa1fc35/ovn-acl-logging/0.log"
Jul 09 22:05:53.157828 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:05:53.157806    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27vrn_10510741-9c12-4044-ac11-97958aa1fc35/ovn-acl-logging/0.log"
Jul 09 22:08:17.116383 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:08:17.116347    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-689f8cfdb9-km4kh"]
Jul 09 22:08:17.119636 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:08:17.119620    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-689f8cfdb9-km4kh"
Jul 09 22:08:17.128951 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:08:17.128929    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-689f8cfdb9-km4kh"]
Jul 09 22:08:17.267018 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:08:17.266977    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a279158d-2210-4bb4-9444-709b83ccc3eb-tls-cert\") pod \"authorino-689f8cfdb9-km4kh\" (UID: \"a279158d-2210-4bb4-9444-709b83ccc3eb\") " pod="kuadrant-system/authorino-689f8cfdb9-km4kh"
Jul 09 22:08:17.267181 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:08:17.267027    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b59kw\" (UniqueName: \"kubernetes.io/projected/a279158d-2210-4bb4-9444-709b83ccc3eb-kube-api-access-b59kw\") pod \"authorino-689f8cfdb9-km4kh\" (UID: \"a279158d-2210-4bb4-9444-709b83ccc3eb\") " pod="kuadrant-system/authorino-689f8cfdb9-km4kh"
Jul 09 22:08:17.368640 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:08:17.368545    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a279158d-2210-4bb4-9444-709b83ccc3eb-tls-cert\") pod \"authorino-689f8cfdb9-km4kh\" (UID: \"a279158d-2210-4bb4-9444-709b83ccc3eb\") " pod="kuadrant-system/authorino-689f8cfdb9-km4kh"
Jul 09 22:08:17.368640 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:08:17.368591    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b59kw\" (UniqueName: \"kubernetes.io/projected/a279158d-2210-4bb4-9444-709b83ccc3eb-kube-api-access-b59kw\") pod \"authorino-689f8cfdb9-km4kh\" (UID: \"a279158d-2210-4bb4-9444-709b83ccc3eb\") " pod="kuadrant-system/authorino-689f8cfdb9-km4kh"
Jul 09 22:08:17.371014 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:08:17.370988    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a279158d-2210-4bb4-9444-709b83ccc3eb-tls-cert\") pod \"authorino-689f8cfdb9-km4kh\" (UID: \"a279158d-2210-4bb4-9444-709b83ccc3eb\") " pod="kuadrant-system/authorino-689f8cfdb9-km4kh"
Jul 09 22:08:17.377653 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:08:17.377626    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b59kw\" (UniqueName: \"kubernetes.io/projected/a279158d-2210-4bb4-9444-709b83ccc3eb-kube-api-access-b59kw\") pod \"authorino-689f8cfdb9-km4kh\" (UID: \"a279158d-2210-4bb4-9444-709b83ccc3eb\") " pod="kuadrant-system/authorino-689f8cfdb9-km4kh"
Jul 09 22:08:17.429624 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:08:17.429592    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-689f8cfdb9-km4kh"
Jul 09 22:08:17.570500 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:08:17.570452    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-689f8cfdb9-km4kh"]
Jul 09 22:08:17.573419 ip-10-0-141-101 kubenswrapper[2576]: W0709 22:08:17.573390    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda279158d_2210_4bb4_9444_709b83ccc3eb.slice/crio-46d690afc1714f3d0c8d2785178a387b5507586c050407d98f3b94a629176601 WatchSource:0}: Error finding container 46d690afc1714f3d0c8d2785178a387b5507586c050407d98f3b94a629176601: Status 404 returned error can't find the container with id 46d690afc1714f3d0c8d2785178a387b5507586c050407d98f3b94a629176601
Jul 09 22:08:17.574736 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:08:17.574721    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 22:08:18.343701 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:08:18.343667    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-689f8cfdb9-km4kh" event={"ID":"a279158d-2210-4bb4-9444-709b83ccc3eb","Type":"ContainerStarted","Data":"ff5e799338ce967159331072020554876130ef63ba559f3549d1055529c5c7b7"}
Jul 09 22:08:18.344108 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:08:18.343710    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-689f8cfdb9-km4kh" event={"ID":"a279158d-2210-4bb4-9444-709b83ccc3eb","Type":"ContainerStarted","Data":"46d690afc1714f3d0c8d2785178a387b5507586c050407d98f3b94a629176601"}
Jul 09 22:08:18.368379 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:08:18.368328    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-689f8cfdb9-km4kh" podStartSLOduration=1.002376243 podStartE2EDuration="1.368308653s" totalImagesPullingTime="365.93241ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:08:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:08:18.366406706 +0000 UTC m=+1045.697906785" watchObservedRunningTime="2026-07-09 22:08:18.368308653 +0000 UTC m=+1045.699808730"
Jul 09 22:08:18.423881 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:08:18.423840    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-67978f9f8d-p6hbr"]
Jul 09 22:08:18.424106 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:08:18.424080    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-67978f9f8d-p6hbr" podUID="0c7c8970-5ce1-4b0b-8599-423f193dc6e1" containerName="authorino" containerID="cri-o://843fb93fb36bf573567bbe299a006b7c3e911756e66169f97cd919183a505970" gracePeriod=30
Jul 09 22:08:18.697612 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:08:18.697575    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67978f9f8d-p6hbr"
Jul 09 22:08:18.781300 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:08:18.781266    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0c7c8970-5ce1-4b0b-8599-423f193dc6e1-tls-cert\") pod \"0c7c8970-5ce1-4b0b-8599-423f193dc6e1\" (UID: \"0c7c8970-5ce1-4b0b-8599-423f193dc6e1\") "
Jul 09 22:08:18.781504 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:08:18.781359    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6szr\" (UniqueName: \"kubernetes.io/projected/0c7c8970-5ce1-4b0b-8599-423f193dc6e1-kube-api-access-f6szr\") pod \"0c7c8970-5ce1-4b0b-8599-423f193dc6e1\" (UID: \"0c7c8970-5ce1-4b0b-8599-423f193dc6e1\") "
Jul 09 22:08:18.783859 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:08:18.783823    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c7c8970-5ce1-4b0b-8599-423f193dc6e1-kube-api-access-f6szr" (OuterVolumeSpecName: "kube-api-access-f6szr") pod "0c7c8970-5ce1-4b0b-8599-423f193dc6e1" (UID: "0c7c8970-5ce1-4b0b-8599-423f193dc6e1"). InnerVolumeSpecName "kube-api-access-f6szr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:08:18.792221 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:08:18.792194    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c7c8970-5ce1-4b0b-8599-423f193dc6e1-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "0c7c8970-5ce1-4b0b-8599-423f193dc6e1" (UID: "0c7c8970-5ce1-4b0b-8599-423f193dc6e1"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:08:18.882510 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:08:18.882430    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6szr\" (UniqueName: \"kubernetes.io/projected/0c7c8970-5ce1-4b0b-8599-423f193dc6e1-kube-api-access-f6szr\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:08:18.882510 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:08:18.882460    2576 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0c7c8970-5ce1-4b0b-8599-423f193dc6e1-tls-cert\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:08:19.349355 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:08:19.349321    2576 generic.go:356] "Generic (PLEG): container finished" podID="0c7c8970-5ce1-4b0b-8599-423f193dc6e1" containerID="843fb93fb36bf573567bbe299a006b7c3e911756e66169f97cd919183a505970" exitCode=0
Jul 09 22:08:19.349824 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:08:19.349364    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67978f9f8d-p6hbr"
Jul 09 22:08:19.349824 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:08:19.349401    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67978f9f8d-p6hbr" event={"ID":"0c7c8970-5ce1-4b0b-8599-423f193dc6e1","Type":"ContainerDied","Data":"843fb93fb36bf573567bbe299a006b7c3e911756e66169f97cd919183a505970"}
Jul 09 22:08:19.349824 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:08:19.349457    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67978f9f8d-p6hbr" event={"ID":"0c7c8970-5ce1-4b0b-8599-423f193dc6e1","Type":"ContainerDied","Data":"0cdd8832ba271348f8874e3e50583ddfd706d6b838f2acc13a2f41be4b75f50d"}
Jul 09 22:08:19.349824 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:08:19.349492    2576 scope.go:117] "RemoveContainer" containerID="843fb93fb36bf573567bbe299a006b7c3e911756e66169f97cd919183a505970"
Jul 09 22:08:19.359077 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:08:19.359052    2576 scope.go:117] "RemoveContainer" containerID="843fb93fb36bf573567bbe299a006b7c3e911756e66169f97cd919183a505970"
Jul 09 22:08:19.359368 ip-10-0-141-101 kubenswrapper[2576]: E0709 22:08:19.359347    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"843fb93fb36bf573567bbe299a006b7c3e911756e66169f97cd919183a505970\": container with ID starting with 843fb93fb36bf573567bbe299a006b7c3e911756e66169f97cd919183a505970 not found: ID does not exist" containerID="843fb93fb36bf573567bbe299a006b7c3e911756e66169f97cd919183a505970"
Jul 09 22:08:19.359459 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:08:19.359376    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"843fb93fb36bf573567bbe299a006b7c3e911756e66169f97cd919183a505970"} err="failed to get container status \"843fb93fb36bf573567bbe299a006b7c3e911756e66169f97cd919183a505970\": rpc error: code = NotFound desc = could not find container \"843fb93fb36bf573567bbe299a006b7c3e911756e66169f97cd919183a505970\": container with ID starting with 843fb93fb36bf573567bbe299a006b7c3e911756e66169f97cd919183a505970 not found: ID does not exist"
Jul 09 22:08:19.366331 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:08:19.366303    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-67978f9f8d-p6hbr"]
Jul 09 22:08:19.376120 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:08:19.376089    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-67978f9f8d-p6hbr"]
Jul 09 22:08:21.200514 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:08:21.200481    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c7c8970-5ce1-4b0b-8599-423f193dc6e1" path="/var/lib/kubelet/pods/0c7c8970-5ce1-4b0b-8599-423f193dc6e1/volumes"
Jul 09 22:10:53.182346 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:10:53.182319    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27vrn_10510741-9c12-4044-ac11-97958aa1fc35/ovn-acl-logging/0.log"
Jul 09 22:10:53.184393 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:10:53.184373    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27vrn_10510741-9c12-4044-ac11-97958aa1fc35/ovn-acl-logging/0.log"
Jul 09 22:15:00.151731 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:15:00.151646    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727255-psrgw"]
Jul 09 22:15:00.152258 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:15:00.152055    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c7c8970-5ce1-4b0b-8599-423f193dc6e1" containerName="authorino"
Jul 09 22:15:00.152258 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:15:00.152073    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c7c8970-5ce1-4b0b-8599-423f193dc6e1" containerName="authorino"
Jul 09 22:15:00.152258 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:15:00.152178    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c7c8970-5ce1-4b0b-8599-423f193dc6e1" containerName="authorino"
Jul 09 22:15:00.155093 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:15:00.155076    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727255-psrgw"
Jul 09 22:15:00.158015 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:15:00.157994    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-t4ml9\""
Jul 09 22:15:00.163348 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:15:00.163324    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727255-psrgw"]
Jul 09 22:15:00.295109 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:15:00.295076    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9kd6\" (UniqueName: \"kubernetes.io/projected/8c6a10dd-6e4f-40be-a1df-253e02093ed0-kube-api-access-k9kd6\") pod \"maas-api-key-cleanup-29727255-psrgw\" (UID: \"8c6a10dd-6e4f-40be-a1df-253e02093ed0\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727255-psrgw"
Jul 09 22:15:00.395646 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:15:00.395606    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9kd6\" (UniqueName: \"kubernetes.io/projected/8c6a10dd-6e4f-40be-a1df-253e02093ed0-kube-api-access-k9kd6\") pod \"maas-api-key-cleanup-29727255-psrgw\" (UID: \"8c6a10dd-6e4f-40be-a1df-253e02093ed0\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727255-psrgw"
Jul 09 22:15:00.404115 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:15:00.404051    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9kd6\" (UniqueName: \"kubernetes.io/projected/8c6a10dd-6e4f-40be-a1df-253e02093ed0-kube-api-access-k9kd6\") pod \"maas-api-key-cleanup-29727255-psrgw\" (UID: \"8c6a10dd-6e4f-40be-a1df-253e02093ed0\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727255-psrgw"
Jul 09 22:15:00.465714 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:15:00.465669    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727255-psrgw"
Jul 09 22:15:00.598096 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:15:00.598074    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727255-psrgw"]
Jul 09 22:15:00.600344 ip-10-0-141-101 kubenswrapper[2576]: W0709 22:15:00.600312    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c6a10dd_6e4f_40be_a1df_253e02093ed0.slice/crio-70211c16e7afd830b5eb0666f50f3413fdf309e6d38a62edc2ce6f466d07790b WatchSource:0}: Error finding container 70211c16e7afd830b5eb0666f50f3413fdf309e6d38a62edc2ce6f466d07790b: Status 404 returned error can't find the container with id 70211c16e7afd830b5eb0666f50f3413fdf309e6d38a62edc2ce6f466d07790b
Jul 09 22:15:00.602233 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:15:00.602216    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 22:15:01.223601 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:15:01.223568    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727255-psrgw" event={"ID":"8c6a10dd-6e4f-40be-a1df-253e02093ed0","Type":"ContainerStarted","Data":"70211c16e7afd830b5eb0666f50f3413fdf309e6d38a62edc2ce6f466d07790b"}
Jul 09 22:15:04.239499 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:15:04.239464    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727255-psrgw" event={"ID":"8c6a10dd-6e4f-40be-a1df-253e02093ed0","Type":"ContainerStarted","Data":"7450db05a15c8e06d39d8332a5baa113e9b86e2cba6c000fbec8b86d1daeb105"}
Jul 09 22:15:04.256723 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:15:04.256669    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727255-psrgw" podStartSLOduration=1.91010327 podStartE2EDuration="4.25665189s" totalImagesPullingTime="2.34654862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:15:04.255636957 +0000 UTC m=+1451.587137035" watchObservedRunningTime="2026-07-09 22:15:04.25665189 +0000 UTC m=+1451.588151968"
Jul 09 22:15:53.209591 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:15:53.209563    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27vrn_10510741-9c12-4044-ac11-97958aa1fc35/ovn-acl-logging/0.log"
Jul 09 22:15:53.212208 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:15:53.212097    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27vrn_10510741-9c12-4044-ac11-97958aa1fc35/ovn-acl-logging/0.log"
Jul 09 22:16:00.009567 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:16:00.009532    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727255-psrgw"]
Jul 09 22:16:00.010036 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:16:00.009738    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727255-psrgw" podUID="8c6a10dd-6e4f-40be-a1df-253e02093ed0" containerName="cleanup" containerID="cri-o://7450db05a15c8e06d39d8332a5baa113e9b86e2cba6c000fbec8b86d1daeb105" gracePeriod=30
Jul 09 22:16:30.200489 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:16:30.200462    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727255-psrgw"
Jul 09 22:16:30.252502 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:16:30.252470    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9kd6\" (UniqueName: \"kubernetes.io/projected/8c6a10dd-6e4f-40be-a1df-253e02093ed0-kube-api-access-k9kd6\") pod \"8c6a10dd-6e4f-40be-a1df-253e02093ed0\" (UID: \"8c6a10dd-6e4f-40be-a1df-253e02093ed0\") "
Jul 09 22:16:30.254639 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:16:30.254609    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c6a10dd-6e4f-40be-a1df-253e02093ed0-kube-api-access-k9kd6" (OuterVolumeSpecName: "kube-api-access-k9kd6") pod "8c6a10dd-6e4f-40be-a1df-253e02093ed0" (UID: "8c6a10dd-6e4f-40be-a1df-253e02093ed0"). InnerVolumeSpecName "kube-api-access-k9kd6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:16:30.353777 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:16:30.353744    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9kd6\" (UniqueName: \"kubernetes.io/projected/8c6a10dd-6e4f-40be-a1df-253e02093ed0-kube-api-access-k9kd6\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:16:30.646176 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:16:30.646084    2576 generic.go:356] "Generic (PLEG): container finished" podID="8c6a10dd-6e4f-40be-a1df-253e02093ed0" containerID="7450db05a15c8e06d39d8332a5baa113e9b86e2cba6c000fbec8b86d1daeb105" exitCode=137
Jul 09 22:16:30.646176 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:16:30.646135    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727255-psrgw"
Jul 09 22:16:30.646176 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:16:30.646144    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727255-psrgw" event={"ID":"8c6a10dd-6e4f-40be-a1df-253e02093ed0","Type":"ContainerDied","Data":"7450db05a15c8e06d39d8332a5baa113e9b86e2cba6c000fbec8b86d1daeb105"}
Jul 09 22:16:30.646435 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:16:30.646187    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727255-psrgw" event={"ID":"8c6a10dd-6e4f-40be-a1df-253e02093ed0","Type":"ContainerDied","Data":"70211c16e7afd830b5eb0666f50f3413fdf309e6d38a62edc2ce6f466d07790b"}
Jul 09 22:16:30.646435 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:16:30.646210    2576 scope.go:117] "RemoveContainer" containerID="7450db05a15c8e06d39d8332a5baa113e9b86e2cba6c000fbec8b86d1daeb105"
Jul 09 22:16:30.655090 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:16:30.654997    2576 scope.go:117] "RemoveContainer" containerID="7450db05a15c8e06d39d8332a5baa113e9b86e2cba6c000fbec8b86d1daeb105"
Jul 09 22:16:30.655345 ip-10-0-141-101 kubenswrapper[2576]: E0709 22:16:30.655309    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7450db05a15c8e06d39d8332a5baa113e9b86e2cba6c000fbec8b86d1daeb105\": container with ID starting with 7450db05a15c8e06d39d8332a5baa113e9b86e2cba6c000fbec8b86d1daeb105 not found: ID does not exist" containerID="7450db05a15c8e06d39d8332a5baa113e9b86e2cba6c000fbec8b86d1daeb105"
Jul 09 22:16:30.655472 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:16:30.655360    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7450db05a15c8e06d39d8332a5baa113e9b86e2cba6c000fbec8b86d1daeb105"} err="failed to get container status \"7450db05a15c8e06d39d8332a5baa113e9b86e2cba6c000fbec8b86d1daeb105\": rpc error: code = NotFound desc = could not find container \"7450db05a15c8e06d39d8332a5baa113e9b86e2cba6c000fbec8b86d1daeb105\": container with ID starting with 7450db05a15c8e06d39d8332a5baa113e9b86e2cba6c000fbec8b86d1daeb105 not found: ID does not exist"
Jul 09 22:16:30.668126 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:16:30.668094    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727255-psrgw"]
Jul 09 22:16:30.673467 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:16:30.673445    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727255-psrgw"]
Jul 09 22:16:31.200671 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:16:31.200637    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c6a10dd-6e4f-40be-a1df-253e02093ed0" path="/var/lib/kubelet/pods/8c6a10dd-6e4f-40be-a1df-253e02093ed0/volumes"
Jul 09 22:20:53.236912 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:20:53.236794    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27vrn_10510741-9c12-4044-ac11-97958aa1fc35/ovn-acl-logging/0.log"
Jul 09 22:20:53.243644 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:20:53.240435    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27vrn_10510741-9c12-4044-ac11-97958aa1fc35/ovn-acl-logging/0.log"
Jul 09 22:21:24.667461 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:24.667426    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6"]
Jul 09 22:21:24.667938 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:24.667776    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c6a10dd-6e4f-40be-a1df-253e02093ed0" containerName="cleanup"
Jul 09 22:21:24.667938 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:24.667787    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c6a10dd-6e4f-40be-a1df-253e02093ed0" containerName="cleanup"
Jul 09 22:21:24.667938 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:24.667868    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c6a10dd-6e4f-40be-a1df-253e02093ed0" containerName="cleanup"
Jul 09 22:21:24.671317 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:24.671076    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6"
Jul 09 22:21:24.673878 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:24.673856    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-61237e1b-openshift-default-dockercfg-2k4t8\""
Jul 09 22:21:24.691002 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:24.690945    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6"]
Jul 09 22:21:24.706724 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:24.706687    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c201d24-589b-497d-beab-a6a2f793d548-workload-socket\") pod \"e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6\" (UID: \"0c201d24-589b-497d-beab-a6a2f793d548\") " pod="openshift-ingress/e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6"
Jul 09 22:21:24.706879 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:24.706732    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c201d24-589b-497d-beab-a6a2f793d548-workload-certs\") pod \"e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6\" (UID: \"0c201d24-589b-497d-beab-a6a2f793d548\") " pod="openshift-ingress/e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6"
Jul 09 22:21:24.706879 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:24.706759    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c201d24-589b-497d-beab-a6a2f793d548-istio-data\") pod \"e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6\" (UID: \"0c201d24-589b-497d-beab-a6a2f793d548\") " pod="openshift-ingress/e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6"
Jul 09 22:21:24.706879 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:24.706836    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c201d24-589b-497d-beab-a6a2f793d548-istio-podinfo\") pod \"e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6\" (UID: \"0c201d24-589b-497d-beab-a6a2f793d548\") " pod="openshift-ingress/e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6"
Jul 09 22:21:24.706879 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:24.706875    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c201d24-589b-497d-beab-a6a2f793d548-istio-envoy\") pod \"e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6\" (UID: \"0c201d24-589b-497d-beab-a6a2f793d548\") " pod="openshift-ingress/e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6"
Jul 09 22:21:24.707343 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:24.706902    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c201d24-589b-497d-beab-a6a2f793d548-istiod-ca-cert\") pod \"e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6\" (UID: \"0c201d24-589b-497d-beab-a6a2f793d548\") " pod="openshift-ingress/e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6"
Jul 09 22:21:24.707343 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:24.706921    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c201d24-589b-497d-beab-a6a2f793d548-istio-token\") pod \"e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6\" (UID: \"0c201d24-589b-497d-beab-a6a2f793d548\") " pod="openshift-ingress/e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6"
Jul 09 22:21:24.707343 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:24.707018    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c201d24-589b-497d-beab-a6a2f793d548-credential-socket\") pod \"e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6\" (UID: \"0c201d24-589b-497d-beab-a6a2f793d548\") " pod="openshift-ingress/e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6"
Jul 09 22:21:24.707343 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:24.707105    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fm94\" (UniqueName: \"kubernetes.io/projected/0c201d24-589b-497d-beab-a6a2f793d548-kube-api-access-6fm94\") pod \"e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6\" (UID: \"0c201d24-589b-497d-beab-a6a2f793d548\") " pod="openshift-ingress/e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6"
Jul 09 22:21:24.807580 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:24.807539    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c201d24-589b-497d-beab-a6a2f793d548-istio-envoy\") pod \"e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6\" (UID: \"0c201d24-589b-497d-beab-a6a2f793d548\") " pod="openshift-ingress/e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6"
Jul 09 22:21:24.807580 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:24.807581    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c201d24-589b-497d-beab-a6a2f793d548-istiod-ca-cert\") pod \"e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6\" (UID: \"0c201d24-589b-497d-beab-a6a2f793d548\") " pod="openshift-ingress/e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6"
Jul 09 22:21:24.807838 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:24.807601    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c201d24-589b-497d-beab-a6a2f793d548-istio-token\") pod \"e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6\" (UID: \"0c201d24-589b-497d-beab-a6a2f793d548\") " pod="openshift-ingress/e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6"
Jul 09 22:21:24.807838 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:24.807625    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c201d24-589b-497d-beab-a6a2f793d548-credential-socket\") pod \"e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6\" (UID: \"0c201d24-589b-497d-beab-a6a2f793d548\") " pod="openshift-ingress/e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6"
Jul 09 22:21:24.807838 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:24.807654    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fm94\" (UniqueName: \"kubernetes.io/projected/0c201d24-589b-497d-beab-a6a2f793d548-kube-api-access-6fm94\") pod \"e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6\" (UID: \"0c201d24-589b-497d-beab-a6a2f793d548\") " pod="openshift-ingress/e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6"
Jul 09 22:21:24.807838 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:24.807731    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c201d24-589b-497d-beab-a6a2f793d548-workload-socket\") pod \"e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6\" (UID: \"0c201d24-589b-497d-beab-a6a2f793d548\") " pod="openshift-ingress/e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6"
Jul 09 22:21:24.807838 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:24.807764    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c201d24-589b-497d-beab-a6a2f793d548-workload-certs\") pod \"e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6\" (UID: \"0c201d24-589b-497d-beab-a6a2f793d548\") " pod="openshift-ingress/e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6"
Jul 09 22:21:24.808101 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:24.807885    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c201d24-589b-497d-beab-a6a2f793d548-istio-data\") pod \"e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6\" (UID: \"0c201d24-589b-497d-beab-a6a2f793d548\") " pod="openshift-ingress/e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6"
Jul 09 22:21:24.808101 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:24.807944    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c201d24-589b-497d-beab-a6a2f793d548-istio-podinfo\") pod \"e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6\" (UID: \"0c201d24-589b-497d-beab-a6a2f793d548\") " pod="openshift-ingress/e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6"
Jul 09 22:21:24.808209 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:24.808155    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c201d24-589b-497d-beab-a6a2f793d548-workload-certs\") pod \"e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6\" (UID: \"0c201d24-589b-497d-beab-a6a2f793d548\") " pod="openshift-ingress/e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6"
Jul 09 22:21:24.808282 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:24.808253    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c201d24-589b-497d-beab-a6a2f793d548-credential-socket\") pod \"e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6\" (UID: \"0c201d24-589b-497d-beab-a6a2f793d548\") " pod="openshift-ingress/e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6"
Jul 09 22:21:24.808333 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:24.808299    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c201d24-589b-497d-beab-a6a2f793d548-workload-socket\") pod \"e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6\" (UID: \"0c201d24-589b-497d-beab-a6a2f793d548\") " pod="openshift-ingress/e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6"
Jul 09 22:21:24.808368 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:24.808339    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c201d24-589b-497d-beab-a6a2f793d548-istio-data\") pod \"e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6\" (UID: \"0c201d24-589b-497d-beab-a6a2f793d548\") " pod="openshift-ingress/e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6"
Jul 09 22:21:24.808465 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:24.808444    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c201d24-589b-497d-beab-a6a2f793d548-istiod-ca-cert\") pod \"e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6\" (UID: \"0c201d24-589b-497d-beab-a6a2f793d548\") " pod="openshift-ingress/e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6"
Jul 09 22:21:24.809982 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:24.809946    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c201d24-589b-497d-beab-a6a2f793d548-istio-envoy\") pod \"e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6\" (UID: \"0c201d24-589b-497d-beab-a6a2f793d548\") " pod="openshift-ingress/e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6"
Jul 09 22:21:24.810298 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:24.810281    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c201d24-589b-497d-beab-a6a2f793d548-istio-podinfo\") pod \"e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6\" (UID: \"0c201d24-589b-497d-beab-a6a2f793d548\") " pod="openshift-ingress/e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6"
Jul 09 22:21:24.816358 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:24.816332    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fm94\" (UniqueName: \"kubernetes.io/projected/0c201d24-589b-497d-beab-a6a2f793d548-kube-api-access-6fm94\") pod \"e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6\" (UID: \"0c201d24-589b-497d-beab-a6a2f793d548\") " pod="openshift-ingress/e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6"
Jul 09 22:21:24.816462 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:24.816447    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c201d24-589b-497d-beab-a6a2f793d548-istio-token\") pod \"e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6\" (UID: \"0c201d24-589b-497d-beab-a6a2f793d548\") " pod="openshift-ingress/e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6"
Jul 09 22:21:24.982021 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:24.981922    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6"
Jul 09 22:21:25.142932 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:25.142906    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6"]
Jul 09 22:21:25.145103 ip-10-0-141-101 kubenswrapper[2576]: W0709 22:21:25.145077    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c201d24_589b_497d_beab_a6a2f793d548.slice/crio-9e33005215e9f5ec4ed8ac942da921167934f003cf7bdba826a71e422c9daef8 WatchSource:0}: Error finding container 9e33005215e9f5ec4ed8ac942da921167934f003cf7bdba826a71e422c9daef8: Status 404 returned error can't find the container with id 9e33005215e9f5ec4ed8ac942da921167934f003cf7bdba826a71e422c9daef8
Jul 09 22:21:25.147255 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:25.147223    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:21:25.147346 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:25.147307    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:21:25.147413 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:25.147350    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:21:26.020451 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:26.020416    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6" event={"ID":"0c201d24-589b-497d-beab-a6a2f793d548","Type":"ContainerStarted","Data":"274b5221254fb2d3af76af00b1e5e9fe42a863fe7eed85e2a0cdffad508fa4dd"}
Jul 09 22:21:26.020862 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:26.020469    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6" event={"ID":"0c201d24-589b-497d-beab-a6a2f793d548","Type":"ContainerStarted","Data":"9e33005215e9f5ec4ed8ac942da921167934f003cf7bdba826a71e422c9daef8"}
Jul 09 22:21:26.048592 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:26.048537    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6" podStartSLOduration=2.048518224 podStartE2EDuration="2.048518224s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:21:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:21:26.046916979 +0000 UTC m=+1833.378417058" watchObservedRunningTime="2026-07-09 22:21:26.048518224 +0000 UTC m=+1833.380018302"
Jul 09 22:21:26.982117 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:26.982085    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6"
Jul 09 22:21:26.987221 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:26.987192    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6"
Jul 09 22:21:27.025256 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:27.025219    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6"
Jul 09 22:21:27.026178 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:27.026161    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6"
Jul 09 22:21:31.186179 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:31.186143    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6"]
Jul 09 22:21:31.186651 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:31.186365    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6" podUID="0c201d24-589b-497d-beab-a6a2f793d548" containerName="istio-proxy" containerID="cri-o://274b5221254fb2d3af76af00b1e5e9fe42a863fe7eed85e2a0cdffad508fa4dd" gracePeriod=30
Jul 09 22:21:37.246814 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.246785    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6"
Jul 09 22:21:37.319910 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.319875    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c201d24-589b-497d-beab-a6a2f793d548-istio-podinfo\") pod \"0c201d24-589b-497d-beab-a6a2f793d548\" (UID: \"0c201d24-589b-497d-beab-a6a2f793d548\") "
Jul 09 22:21:37.320121 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.319982    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c201d24-589b-497d-beab-a6a2f793d548-credential-socket\") pod \"0c201d24-589b-497d-beab-a6a2f793d548\" (UID: \"0c201d24-589b-497d-beab-a6a2f793d548\") "
Jul 09 22:21:37.320121 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.320028    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c201d24-589b-497d-beab-a6a2f793d548-istio-envoy\") pod \"0c201d24-589b-497d-beab-a6a2f793d548\" (UID: \"0c201d24-589b-497d-beab-a6a2f793d548\") "
Jul 09 22:21:37.320121 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.320044    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c201d24-589b-497d-beab-a6a2f793d548-istio-token\") pod \"0c201d24-589b-497d-beab-a6a2f793d548\" (UID: \"0c201d24-589b-497d-beab-a6a2f793d548\") "
Jul 09 22:21:37.320121 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.320072    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fm94\" (UniqueName: \"kubernetes.io/projected/0c201d24-589b-497d-beab-a6a2f793d548-kube-api-access-6fm94\") pod \"0c201d24-589b-497d-beab-a6a2f793d548\" (UID: \"0c201d24-589b-497d-beab-a6a2f793d548\") "
Jul 09 22:21:37.320121 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.320096    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c201d24-589b-497d-beab-a6a2f793d548-workload-socket\") pod \"0c201d24-589b-497d-beab-a6a2f793d548\" (UID: \"0c201d24-589b-497d-beab-a6a2f793d548\") "
Jul 09 22:21:37.320121 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.320118    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c201d24-589b-497d-beab-a6a2f793d548-istiod-ca-cert\") pod \"0c201d24-589b-497d-beab-a6a2f793d548\" (UID: \"0c201d24-589b-497d-beab-a6a2f793d548\") "
Jul 09 22:21:37.320448 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.320160    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c201d24-589b-497d-beab-a6a2f793d548-workload-certs\") pod \"0c201d24-589b-497d-beab-a6a2f793d548\" (UID: \"0c201d24-589b-497d-beab-a6a2f793d548\") "
Jul 09 22:21:37.320448 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.320186    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c201d24-589b-497d-beab-a6a2f793d548-istio-data\") pod \"0c201d24-589b-497d-beab-a6a2f793d548\" (UID: \"0c201d24-589b-497d-beab-a6a2f793d548\") "
Jul 09 22:21:37.320448 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.320304    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c201d24-589b-497d-beab-a6a2f793d548-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0c201d24-589b-497d-beab-a6a2f793d548" (UID: "0c201d24-589b-497d-beab-a6a2f793d548"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:21:37.320448 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.320369    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c201d24-589b-497d-beab-a6a2f793d548-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0c201d24-589b-497d-beab-a6a2f793d548" (UID: "0c201d24-589b-497d-beab-a6a2f793d548"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:21:37.320643 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.320497    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c201d24-589b-497d-beab-a6a2f793d548-credential-socket\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:21:37.320643 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.320516    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c201d24-589b-497d-beab-a6a2f793d548-workload-socket\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:21:37.320772 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.320746    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c201d24-589b-497d-beab-a6a2f793d548-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0c201d24-589b-497d-beab-a6a2f793d548" (UID: "0c201d24-589b-497d-beab-a6a2f793d548"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:21:37.320829 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.320797    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c201d24-589b-497d-beab-a6a2f793d548-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0c201d24-589b-497d-beab-a6a2f793d548" (UID: "0c201d24-589b-497d-beab-a6a2f793d548"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:21:37.321080 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.321057    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c201d24-589b-497d-beab-a6a2f793d548-istio-data" (OuterVolumeSpecName: "istio-data") pod "0c201d24-589b-497d-beab-a6a2f793d548" (UID: "0c201d24-589b-497d-beab-a6a2f793d548"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:21:37.322311 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.322283    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0c201d24-589b-497d-beab-a6a2f793d548-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0c201d24-589b-497d-beab-a6a2f793d548" (UID: "0c201d24-589b-497d-beab-a6a2f793d548"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 22:21:37.322432 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.322389    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c201d24-589b-497d-beab-a6a2f793d548-istio-token" (OuterVolumeSpecName: "istio-token") pod "0c201d24-589b-497d-beab-a6a2f793d548" (UID: "0c201d24-589b-497d-beab-a6a2f793d548"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:21:37.322501 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.322482    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c201d24-589b-497d-beab-a6a2f793d548-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0c201d24-589b-497d-beab-a6a2f793d548" (UID: "0c201d24-589b-497d-beab-a6a2f793d548"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:21:37.322588 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.322571    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c201d24-589b-497d-beab-a6a2f793d548-kube-api-access-6fm94" (OuterVolumeSpecName: "kube-api-access-6fm94") pod "0c201d24-589b-497d-beab-a6a2f793d548" (UID: "0c201d24-589b-497d-beab-a6a2f793d548"). InnerVolumeSpecName "kube-api-access-6fm94". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:21:37.345667 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.345622    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4"]
Jul 09 22:21:37.345997 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.345979    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c201d24-589b-497d-beab-a6a2f793d548" containerName="istio-proxy"
Jul 09 22:21:37.345997 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.345996    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c201d24-589b-497d-beab-a6a2f793d548" containerName="istio-proxy"
Jul 09 22:21:37.346152 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.346067    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c201d24-589b-497d-beab-a6a2f793d548" containerName="istio-proxy"
Jul 09 22:21:37.348302 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.348280    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4"
Jul 09 22:21:37.351602 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.351581    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-80d0ec86-openshift-default-dockercfg-cv86z\""
Jul 09 22:21:37.364196 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.364164    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4"]
Jul 09 22:21:37.420871 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.420836    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-istio-token\") pod \"e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4\" (UID: \"111a5ec1-8833-4fc0-a6a8-b9b40431a40f\") " pod="openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4"
Jul 09 22:21:37.421066 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.420888    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-istio-data\") pod \"e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4\" (UID: \"111a5ec1-8833-4fc0-a6a8-b9b40431a40f\") " pod="openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4"
Jul 09 22:21:37.421066 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.420917    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-workload-certs\") pod \"e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4\" (UID: \"111a5ec1-8833-4fc0-a6a8-b9b40431a40f\") " pod="openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4"
Jul 09 22:21:37.421066 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.420934    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-istio-envoy\") pod \"e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4\" (UID: \"111a5ec1-8833-4fc0-a6a8-b9b40431a40f\") " pod="openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4"
Jul 09 22:21:37.421066 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.420971    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-credential-socket\") pod \"e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4\" (UID: \"111a5ec1-8833-4fc0-a6a8-b9b40431a40f\") " pod="openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4"
Jul 09 22:21:37.421066 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.420987    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-istiod-ca-cert\") pod \"e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4\" (UID: \"111a5ec1-8833-4fc0-a6a8-b9b40431a40f\") " pod="openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4"
Jul 09 22:21:37.421066 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.421035    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-workload-socket\") pod \"e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4\" (UID: \"111a5ec1-8833-4fc0-a6a8-b9b40431a40f\") " pod="openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4"
Jul 09 22:21:37.421066 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.421064    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8xmx\" (UniqueName: \"kubernetes.io/projected/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-kube-api-access-l8xmx\") pod \"e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4\" (UID: \"111a5ec1-8833-4fc0-a6a8-b9b40431a40f\") " pod="openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4"
Jul 09 22:21:37.421281 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.421092    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-istio-podinfo\") pod \"e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4\" (UID: \"111a5ec1-8833-4fc0-a6a8-b9b40431a40f\") " pod="openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4"
Jul 09 22:21:37.421281 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.421143    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c201d24-589b-497d-beab-a6a2f793d548-istio-envoy\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:21:37.421281 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.421153    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c201d24-589b-497d-beab-a6a2f793d548-istio-token\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:21:37.421281 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.421162    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6fm94\" (UniqueName: \"kubernetes.io/projected/0c201d24-589b-497d-beab-a6a2f793d548-kube-api-access-6fm94\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:21:37.421281 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.421170    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c201d24-589b-497d-beab-a6a2f793d548-istiod-ca-cert\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:21:37.421281 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.421181    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c201d24-589b-497d-beab-a6a2f793d548-workload-certs\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:21:37.421281 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.421189    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c201d24-589b-497d-beab-a6a2f793d548-istio-data\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:21:37.421281 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.421197    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c201d24-589b-497d-beab-a6a2f793d548-istio-podinfo\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:21:37.522011 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.521944    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-workload-certs\") pod \"e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4\" (UID: \"111a5ec1-8833-4fc0-a6a8-b9b40431a40f\") " pod="openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4"
Jul 09 22:21:37.522011 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.522013    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-istio-envoy\") pod \"e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4\" (UID: \"111a5ec1-8833-4fc0-a6a8-b9b40431a40f\") " pod="openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4"
Jul 09 22:21:37.522244 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.522046    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-credential-socket\") pod \"e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4\" (UID: \"111a5ec1-8833-4fc0-a6a8-b9b40431a40f\") " pod="openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4"
Jul 09 22:21:37.522244 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.522065    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-istiod-ca-cert\") pod \"e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4\" (UID: \"111a5ec1-8833-4fc0-a6a8-b9b40431a40f\") " pod="openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4"
Jul 09 22:21:37.522244 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.522095    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-workload-socket\") pod \"e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4\" (UID: \"111a5ec1-8833-4fc0-a6a8-b9b40431a40f\") " pod="openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4"
Jul 09 22:21:37.522244 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.522123    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8xmx\" (UniqueName: \"kubernetes.io/projected/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-kube-api-access-l8xmx\") pod \"e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4\" (UID: \"111a5ec1-8833-4fc0-a6a8-b9b40431a40f\") " pod="openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4"
Jul 09 22:21:37.522244 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.522160    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-istio-podinfo\") pod \"e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4\" (UID: \"111a5ec1-8833-4fc0-a6a8-b9b40431a40f\") " pod="openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4"
Jul 09 22:21:37.522244 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.522188    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-istio-token\") pod \"e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4\" (UID: \"111a5ec1-8833-4fc0-a6a8-b9b40431a40f\") " pod="openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4"
Jul 09 22:21:37.522631 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.522250    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-istio-data\") pod \"e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4\" (UID: \"111a5ec1-8833-4fc0-a6a8-b9b40431a40f\") " pod="openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4"
Jul 09 22:21:37.522631 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.522408    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-workload-certs\") pod \"e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4\" (UID: \"111a5ec1-8833-4fc0-a6a8-b9b40431a40f\") " pod="openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4"
Jul 09 22:21:37.522875 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.522850    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-istiod-ca-cert\") pod \"e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4\" (UID: \"111a5ec1-8833-4fc0-a6a8-b9b40431a40f\") " pod="openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4"
Jul 09 22:21:37.522991 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.522894    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-workload-socket\") pod \"e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4\" (UID: \"111a5ec1-8833-4fc0-a6a8-b9b40431a40f\") " pod="openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4"
Jul 09 22:21:37.522991 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.522897    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-credential-socket\") pod \"e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4\" (UID: \"111a5ec1-8833-4fc0-a6a8-b9b40431a40f\") " pod="openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4"
Jul 09 22:21:37.523107 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.522998    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-istio-data\") pod \"e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4\" (UID: \"111a5ec1-8833-4fc0-a6a8-b9b40431a40f\") " pod="openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4"
Jul 09 22:21:37.524447 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.524426    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-istio-envoy\") pod \"e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4\" (UID: \"111a5ec1-8833-4fc0-a6a8-b9b40431a40f\") " pod="openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4"
Jul 09 22:21:37.524650 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.524632    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-istio-podinfo\") pod \"e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4\" (UID: \"111a5ec1-8833-4fc0-a6a8-b9b40431a40f\") " pod="openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4"
Jul 09 22:21:37.533726 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.533697    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8xmx\" (UniqueName: \"kubernetes.io/projected/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-kube-api-access-l8xmx\") pod \"e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4\" (UID: \"111a5ec1-8833-4fc0-a6a8-b9b40431a40f\") " pod="openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4"
Jul 09 22:21:37.534567 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.534542    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-istio-token\") pod \"e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4\" (UID: \"111a5ec1-8833-4fc0-a6a8-b9b40431a40f\") " pod="openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4"
Jul 09 22:21:37.659218 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.659130    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4"
Jul 09 22:21:37.792452 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.792429    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4"]
Jul 09 22:21:37.794549 ip-10-0-141-101 kubenswrapper[2576]: W0709 22:21:37.794523    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod111a5ec1_8833_4fc0_a6a8_b9b40431a40f.slice/crio-ff2c9887f33c074c934158e7ea1b3b9db392d5e58d8bda12a933802d079dc2b3 WatchSource:0}: Error finding container ff2c9887f33c074c934158e7ea1b3b9db392d5e58d8bda12a933802d079dc2b3: Status 404 returned error can't find the container with id ff2c9887f33c074c934158e7ea1b3b9db392d5e58d8bda12a933802d079dc2b3
Jul 09 22:21:37.796521 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.796494    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:21:37.796587 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.796555    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:21:37.796624 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:37.796584    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:21:38.097122 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:38.097090    2576 generic.go:356] "Generic (PLEG): container finished" podID="0c201d24-589b-497d-beab-a6a2f793d548" containerID="274b5221254fb2d3af76af00b1e5e9fe42a863fe7eed85e2a0cdffad508fa4dd" exitCode=0
Jul 09 22:21:38.097286 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:38.097143    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6"
Jul 09 22:21:38.097286 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:38.097176    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6" event={"ID":"0c201d24-589b-497d-beab-a6a2f793d548","Type":"ContainerDied","Data":"274b5221254fb2d3af76af00b1e5e9fe42a863fe7eed85e2a0cdffad508fa4dd"}
Jul 09 22:21:38.097286 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:38.097232    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6" event={"ID":"0c201d24-589b-497d-beab-a6a2f793d548","Type":"ContainerDied","Data":"9e33005215e9f5ec4ed8ac942da921167934f003cf7bdba826a71e422c9daef8"}
Jul 09 22:21:38.097286 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:38.097262    2576 scope.go:117] "RemoveContainer" containerID="274b5221254fb2d3af76af00b1e5e9fe42a863fe7eed85e2a0cdffad508fa4dd"
Jul 09 22:21:38.099023 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:38.098995    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4" event={"ID":"111a5ec1-8833-4fc0-a6a8-b9b40431a40f","Type":"ContainerStarted","Data":"226bfb8a4b27cf763c59f22eda53e112f6692406b577d5c147d0cb4332712b45"}
Jul 09 22:21:38.099133 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:38.099072    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4" event={"ID":"111a5ec1-8833-4fc0-a6a8-b9b40431a40f","Type":"ContainerStarted","Data":"ff2c9887f33c074c934158e7ea1b3b9db392d5e58d8bda12a933802d079dc2b3"}
Jul 09 22:21:38.109355 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:38.109215    2576 scope.go:117] "RemoveContainer" containerID="274b5221254fb2d3af76af00b1e5e9fe42a863fe7eed85e2a0cdffad508fa4dd"
Jul 09 22:21:38.109504 ip-10-0-141-101 kubenswrapper[2576]: E0709 22:21:38.109479    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"274b5221254fb2d3af76af00b1e5e9fe42a863fe7eed85e2a0cdffad508fa4dd\": container with ID starting with 274b5221254fb2d3af76af00b1e5e9fe42a863fe7eed85e2a0cdffad508fa4dd not found: ID does not exist" containerID="274b5221254fb2d3af76af00b1e5e9fe42a863fe7eed85e2a0cdffad508fa4dd"
Jul 09 22:21:38.109609 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:38.109510    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"274b5221254fb2d3af76af00b1e5e9fe42a863fe7eed85e2a0cdffad508fa4dd"} err="failed to get container status \"274b5221254fb2d3af76af00b1e5e9fe42a863fe7eed85e2a0cdffad508fa4dd\": rpc error: code = NotFound desc = could not find container \"274b5221254fb2d3af76af00b1e5e9fe42a863fe7eed85e2a0cdffad508fa4dd\": container with ID starting with 274b5221254fb2d3af76af00b1e5e9fe42a863fe7eed85e2a0cdffad508fa4dd not found: ID does not exist"
Jul 09 22:21:38.123011 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:38.122945    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4" podStartSLOduration=1.122930624 podStartE2EDuration="1.122930624s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:21:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:21:38.122217279 +0000 UTC m=+1845.453717356" watchObservedRunningTime="2026-07-09 22:21:38.122930624 +0000 UTC m=+1845.454430702"
Jul 09 22:21:38.137296 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:38.137271    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6"]
Jul 09 22:21:38.144569 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:38.144545    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-61237e1b-openshift-default-6b4bb78bcc-xlgn6"]
Jul 09 22:21:38.659657 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:38.659619    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4"
Jul 09 22:21:38.664513 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:38.664488    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4"
Jul 09 22:21:39.110774 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:39.110739    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4"
Jul 09 22:21:39.111646 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:39.111630    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4"
Jul 09 22:21:39.201145 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:39.201113    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c201d24-589b-497d-beab-a6a2f793d548" path="/var/lib/kubelet/pods/0c201d24-589b-497d-beab-a6a2f793d548/volumes"
Jul 09 22:21:49.163792 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:49.163712    2576 generic.go:356] "Generic (PLEG): container finished" podID="111a5ec1-8833-4fc0-a6a8-b9b40431a40f" containerID="226bfb8a4b27cf763c59f22eda53e112f6692406b577d5c147d0cb4332712b45" exitCode=0
Jul 09 22:21:49.164236 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:49.163791    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4" event={"ID":"111a5ec1-8833-4fc0-a6a8-b9b40431a40f","Type":"ContainerDied","Data":"226bfb8a4b27cf763c59f22eda53e112f6692406b577d5c147d0cb4332712b45"}
Jul 09 22:21:49.164280 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:49.164237    2576 scope.go:117] "RemoveContainer" containerID="226bfb8a4b27cf763c59f22eda53e112f6692406b577d5c147d0cb4332712b45"
Jul 09 22:21:49.165206 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:49.165175    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:21:49.165315 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:49.165263    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:21:49.165315 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:49.165309    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:21:49.793755 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:49.793717    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4"]
Jul 09 22:21:50.170341 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:50.170257    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4" event={"ID":"111a5ec1-8833-4fc0-a6a8-b9b40431a40f","Type":"ContainerStarted","Data":"1da26b56a0d0adc85c02800d808bd342fb9e51bc6174fdae6fc8a7ca4b86e94c"}
Jul 09 22:21:50.170341 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:50.170321    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4" podUID="111a5ec1-8833-4fc0-a6a8-b9b40431a40f" containerName="istio-proxy" containerID="cri-o://1da26b56a0d0adc85c02800d808bd342fb9e51bc6174fdae6fc8a7ca4b86e94c" gracePeriod=30
Jul 09 22:21:54.111828 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:54.111768    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4"
Jul 09 22:21:55.418511 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:55.418484    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4"
Jul 09 22:21:55.473507 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:55.473427    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-credential-socket\") pod \"111a5ec1-8833-4fc0-a6a8-b9b40431a40f\" (UID: \"111a5ec1-8833-4fc0-a6a8-b9b40431a40f\") "
Jul 09 22:21:55.473507 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:55.473473    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-istiod-ca-cert\") pod \"111a5ec1-8833-4fc0-a6a8-b9b40431a40f\" (UID: \"111a5ec1-8833-4fc0-a6a8-b9b40431a40f\") "
Jul 09 22:21:55.473507 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:55.473503    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-istio-data\") pod \"111a5ec1-8833-4fc0-a6a8-b9b40431a40f\" (UID: \"111a5ec1-8833-4fc0-a6a8-b9b40431a40f\") "
Jul 09 22:21:55.473907 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:55.473547    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-istio-podinfo\") pod \"111a5ec1-8833-4fc0-a6a8-b9b40431a40f\" (UID: \"111a5ec1-8833-4fc0-a6a8-b9b40431a40f\") "
Jul 09 22:21:55.473907 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:55.473574    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-workload-certs\") pod \"111a5ec1-8833-4fc0-a6a8-b9b40431a40f\" (UID: \"111a5ec1-8833-4fc0-a6a8-b9b40431a40f\") "
Jul 09 22:21:55.473907 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:55.473599    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-istio-token\") pod \"111a5ec1-8833-4fc0-a6a8-b9b40431a40f\" (UID: \"111a5ec1-8833-4fc0-a6a8-b9b40431a40f\") "
Jul 09 22:21:55.473907 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:55.473656    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-workload-socket\") pod \"111a5ec1-8833-4fc0-a6a8-b9b40431a40f\" (UID: \"111a5ec1-8833-4fc0-a6a8-b9b40431a40f\") "
Jul 09 22:21:55.473907 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:55.473693    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l8xmx\" (UniqueName: \"kubernetes.io/projected/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-kube-api-access-l8xmx\") pod \"111a5ec1-8833-4fc0-a6a8-b9b40431a40f\" (UID: \"111a5ec1-8833-4fc0-a6a8-b9b40431a40f\") "
Jul 09 22:21:55.473907 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:55.473714    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "111a5ec1-8833-4fc0-a6a8-b9b40431a40f" (UID: "111a5ec1-8833-4fc0-a6a8-b9b40431a40f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:21:55.473907 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:55.473786    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-istio-envoy\") pod \"111a5ec1-8833-4fc0-a6a8-b9b40431a40f\" (UID: \"111a5ec1-8833-4fc0-a6a8-b9b40431a40f\") "
Jul 09 22:21:55.474297 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:55.474009    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "111a5ec1-8833-4fc0-a6a8-b9b40431a40f" (UID: "111a5ec1-8833-4fc0-a6a8-b9b40431a40f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:21:55.474297 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:55.474043    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-credential-socket\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:21:55.474297 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:55.474094    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "111a5ec1-8833-4fc0-a6a8-b9b40431a40f" (UID: "111a5ec1-8833-4fc0-a6a8-b9b40431a40f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:21:55.474297 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:55.474157    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "111a5ec1-8833-4fc0-a6a8-b9b40431a40f" (UID: "111a5ec1-8833-4fc0-a6a8-b9b40431a40f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:21:55.474297 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:55.474286    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-istio-data" (OuterVolumeSpecName: "istio-data") pod "111a5ec1-8833-4fc0-a6a8-b9b40431a40f" (UID: "111a5ec1-8833-4fc0-a6a8-b9b40431a40f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:21:55.475833 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:55.475803    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "111a5ec1-8833-4fc0-a6a8-b9b40431a40f" (UID: "111a5ec1-8833-4fc0-a6a8-b9b40431a40f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 22:21:55.475937 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:55.475857    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-istio-token" (OuterVolumeSpecName: "istio-token") pod "111a5ec1-8833-4fc0-a6a8-b9b40431a40f" (UID: "111a5ec1-8833-4fc0-a6a8-b9b40431a40f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:21:55.476025 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:55.475934    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "111a5ec1-8833-4fc0-a6a8-b9b40431a40f" (UID: "111a5ec1-8833-4fc0-a6a8-b9b40431a40f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:21:55.476129 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:55.476108    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-kube-api-access-l8xmx" (OuterVolumeSpecName: "kube-api-access-l8xmx") pod "111a5ec1-8833-4fc0-a6a8-b9b40431a40f" (UID: "111a5ec1-8833-4fc0-a6a8-b9b40431a40f"). InnerVolumeSpecName "kube-api-access-l8xmx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:21:55.575478 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:55.575444    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-istiod-ca-cert\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:21:55.575478 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:55.575474    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-istio-data\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:21:55.575478 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:55.575483    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-istio-podinfo\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:21:55.575478 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:55.575491    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-workload-certs\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:21:55.575749 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:55.575501    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-istio-token\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:21:55.575749 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:55.575509    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-workload-socket\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:21:55.575749 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:55.575521    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8xmx\" (UniqueName: \"kubernetes.io/projected/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-kube-api-access-l8xmx\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:21:55.575749 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:55.575530    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/111a5ec1-8833-4fc0-a6a8-b9b40431a40f-istio-envoy\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:21:55.920277 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:55.920242    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf"]
Jul 09 22:21:55.920752 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:55.920729    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="111a5ec1-8833-4fc0-a6a8-b9b40431a40f" containerName="istio-proxy"
Jul 09 22:21:55.920752 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:55.920751    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="111a5ec1-8833-4fc0-a6a8-b9b40431a40f" containerName="istio-proxy"
Jul 09 22:21:55.920912 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:55.920769    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="111a5ec1-8833-4fc0-a6a8-b9b40431a40f" containerName="istio-proxy"
Jul 09 22:21:55.920912 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:55.920824    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="111a5ec1-8833-4fc0-a6a8-b9b40431a40f" containerName="istio-proxy"
Jul 09 22:21:55.921041 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:55.920970    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="111a5ec1-8833-4fc0-a6a8-b9b40431a40f" containerName="istio-proxy"
Jul 09 22:21:55.921041 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:55.920984    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="111a5ec1-8833-4fc0-a6a8-b9b40431a40f" containerName="istio-proxy"
Jul 09 22:21:55.924692 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:55.924668    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf"
Jul 09 22:21:55.927987 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:55.927951    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-efc29080-openshift-default-dockercfg-mzc2h\""
Jul 09 22:21:55.939795 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:55.939765    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf"]
Jul 09 22:21:55.979377 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:55.979343    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d916261-5890-4cda-97e6-3d7e585e3d89-credential-socket\") pod \"e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf\" (UID: \"5d916261-5890-4cda-97e6-3d7e585e3d89\") " pod="openshift-ingress/e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf"
Jul 09 22:21:55.979377 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:55.979378    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d916261-5890-4cda-97e6-3d7e585e3d89-istiod-ca-cert\") pod \"e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf\" (UID: \"5d916261-5890-4cda-97e6-3d7e585e3d89\") " pod="openshift-ingress/e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf"
Jul 09 22:21:55.979593 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:55.979396    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6b5z\" (UniqueName: \"kubernetes.io/projected/5d916261-5890-4cda-97e6-3d7e585e3d89-kube-api-access-q6b5z\") pod \"e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf\" (UID: \"5d916261-5890-4cda-97e6-3d7e585e3d89\") " pod="openshift-ingress/e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf"
Jul 09 22:21:55.979593 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:55.979490    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d916261-5890-4cda-97e6-3d7e585e3d89-workload-certs\") pod \"e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf\" (UID: \"5d916261-5890-4cda-97e6-3d7e585e3d89\") " pod="openshift-ingress/e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf"
Jul 09 22:21:55.979593 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:55.979518    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d916261-5890-4cda-97e6-3d7e585e3d89-workload-socket\") pod \"e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf\" (UID: \"5d916261-5890-4cda-97e6-3d7e585e3d89\") " pod="openshift-ingress/e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf"
Jul 09 22:21:55.979593 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:55.979558    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d916261-5890-4cda-97e6-3d7e585e3d89-istio-token\") pod \"e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf\" (UID: \"5d916261-5890-4cda-97e6-3d7e585e3d89\") " pod="openshift-ingress/e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf"
Jul 09 22:21:55.979593 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:55.979591    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d916261-5890-4cda-97e6-3d7e585e3d89-istio-data\") pod \"e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf\" (UID: \"5d916261-5890-4cda-97e6-3d7e585e3d89\") " pod="openshift-ingress/e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf"
Jul 09 22:21:55.979820 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:55.979641    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d916261-5890-4cda-97e6-3d7e585e3d89-istio-envoy\") pod \"e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf\" (UID: \"5d916261-5890-4cda-97e6-3d7e585e3d89\") " pod="openshift-ingress/e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf"
Jul 09 22:21:55.979820 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:55.979703    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d916261-5890-4cda-97e6-3d7e585e3d89-istio-podinfo\") pod \"e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf\" (UID: \"5d916261-5890-4cda-97e6-3d7e585e3d89\") " pod="openshift-ingress/e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf"
Jul 09 22:21:56.080701 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:56.080657    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d916261-5890-4cda-97e6-3d7e585e3d89-credential-socket\") pod \"e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf\" (UID: \"5d916261-5890-4cda-97e6-3d7e585e3d89\") " pod="openshift-ingress/e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf"
Jul 09 22:21:56.080701 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:56.080699    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d916261-5890-4cda-97e6-3d7e585e3d89-istiod-ca-cert\") pod \"e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf\" (UID: \"5d916261-5890-4cda-97e6-3d7e585e3d89\") " pod="openshift-ingress/e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf"
Jul 09 22:21:56.080937 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:56.080721    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6b5z\" (UniqueName: \"kubernetes.io/projected/5d916261-5890-4cda-97e6-3d7e585e3d89-kube-api-access-q6b5z\") pod \"e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf\" (UID: \"5d916261-5890-4cda-97e6-3d7e585e3d89\") " pod="openshift-ingress/e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf"
Jul 09 22:21:56.080937 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:56.080773    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d916261-5890-4cda-97e6-3d7e585e3d89-workload-certs\") pod \"e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf\" (UID: \"5d916261-5890-4cda-97e6-3d7e585e3d89\") " pod="openshift-ingress/e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf"
Jul 09 22:21:56.080937 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:56.080800    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d916261-5890-4cda-97e6-3d7e585e3d89-workload-socket\") pod \"e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf\" (UID: \"5d916261-5890-4cda-97e6-3d7e585e3d89\") " pod="openshift-ingress/e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf"
Jul 09 22:21:56.080937 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:56.080837    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d916261-5890-4cda-97e6-3d7e585e3d89-istio-token\") pod \"e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf\" (UID: \"5d916261-5890-4cda-97e6-3d7e585e3d89\") " pod="openshift-ingress/e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf"
Jul 09 22:21:56.080937 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:56.080867    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d916261-5890-4cda-97e6-3d7e585e3d89-istio-data\") pod \"e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf\" (UID: \"5d916261-5890-4cda-97e6-3d7e585e3d89\") " pod="openshift-ingress/e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf"
Jul 09 22:21:56.080937 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:56.080911    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d916261-5890-4cda-97e6-3d7e585e3d89-istio-envoy\") pod \"e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf\" (UID: \"5d916261-5890-4cda-97e6-3d7e585e3d89\") " pod="openshift-ingress/e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf"
Jul 09 22:21:56.081279 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:56.080951    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d916261-5890-4cda-97e6-3d7e585e3d89-istio-podinfo\") pod \"e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf\" (UID: \"5d916261-5890-4cda-97e6-3d7e585e3d89\") " pod="openshift-ingress/e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf"
Jul 09 22:21:56.081279 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:56.081190    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d916261-5890-4cda-97e6-3d7e585e3d89-credential-socket\") pod \"e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf\" (UID: \"5d916261-5890-4cda-97e6-3d7e585e3d89\") " pod="openshift-ingress/e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf"
Jul 09 22:21:56.081389 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:56.081289    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d916261-5890-4cda-97e6-3d7e585e3d89-workload-socket\") pod \"e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf\" (UID: \"5d916261-5890-4cda-97e6-3d7e585e3d89\") " pod="openshift-ingress/e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf"
Jul 09 22:21:56.081389 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:56.081333    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d916261-5890-4cda-97e6-3d7e585e3d89-istio-data\") pod \"e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf\" (UID: \"5d916261-5890-4cda-97e6-3d7e585e3d89\") " pod="openshift-ingress/e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf"
Jul 09 22:21:56.081529 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:56.081508    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d916261-5890-4cda-97e6-3d7e585e3d89-workload-certs\") pod \"e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf\" (UID: \"5d916261-5890-4cda-97e6-3d7e585e3d89\") " pod="openshift-ingress/e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf"
Jul 09 22:21:56.081614 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:56.081598    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d916261-5890-4cda-97e6-3d7e585e3d89-istiod-ca-cert\") pod \"e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf\" (UID: \"5d916261-5890-4cda-97e6-3d7e585e3d89\") " pod="openshift-ingress/e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf"
Jul 09 22:21:56.083231 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:56.083209    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d916261-5890-4cda-97e6-3d7e585e3d89-istio-envoy\") pod \"e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf\" (UID: \"5d916261-5890-4cda-97e6-3d7e585e3d89\") " pod="openshift-ingress/e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf"
Jul 09 22:21:56.083476 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:56.083457    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d916261-5890-4cda-97e6-3d7e585e3d89-istio-podinfo\") pod \"e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf\" (UID: \"5d916261-5890-4cda-97e6-3d7e585e3d89\") " pod="openshift-ingress/e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf"
Jul 09 22:21:56.089409 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:56.089385    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d916261-5890-4cda-97e6-3d7e585e3d89-istio-token\") pod \"e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf\" (UID: \"5d916261-5890-4cda-97e6-3d7e585e3d89\") " pod="openshift-ingress/e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf"
Jul 09 22:21:56.089491 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:56.089410    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6b5z\" (UniqueName: \"kubernetes.io/projected/5d916261-5890-4cda-97e6-3d7e585e3d89-kube-api-access-q6b5z\") pod \"e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf\" (UID: \"5d916261-5890-4cda-97e6-3d7e585e3d89\") " pod="openshift-ingress/e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf"
Jul 09 22:21:56.200516 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:56.200434    2576 generic.go:356] "Generic (PLEG): container finished" podID="111a5ec1-8833-4fc0-a6a8-b9b40431a40f" containerID="1da26b56a0d0adc85c02800d808bd342fb9e51bc6174fdae6fc8a7ca4b86e94c" exitCode=0
Jul 09 22:21:56.200516 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:56.200487    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4"
Jul 09 22:21:56.200689 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:56.200515    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4" event={"ID":"111a5ec1-8833-4fc0-a6a8-b9b40431a40f","Type":"ContainerDied","Data":"1da26b56a0d0adc85c02800d808bd342fb9e51bc6174fdae6fc8a7ca4b86e94c"}
Jul 09 22:21:56.200689 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:56.200567    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4" event={"ID":"111a5ec1-8833-4fc0-a6a8-b9b40431a40f","Type":"ContainerDied","Data":"ff2c9887f33c074c934158e7ea1b3b9db392d5e58d8bda12a933802d079dc2b3"}
Jul 09 22:21:56.200689 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:56.200590    2576 scope.go:117] "RemoveContainer" containerID="1da26b56a0d0adc85c02800d808bd342fb9e51bc6174fdae6fc8a7ca4b86e94c"
Jul 09 22:21:56.209610 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:56.209595    2576 scope.go:117] "RemoveContainer" containerID="226bfb8a4b27cf763c59f22eda53e112f6692406b577d5c147d0cb4332712b45"
Jul 09 22:21:56.217293 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:56.217273    2576 scope.go:117] "RemoveContainer" containerID="1da26b56a0d0adc85c02800d808bd342fb9e51bc6174fdae6fc8a7ca4b86e94c"
Jul 09 22:21:56.217550 ip-10-0-141-101 kubenswrapper[2576]: E0709 22:21:56.217532    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1da26b56a0d0adc85c02800d808bd342fb9e51bc6174fdae6fc8a7ca4b86e94c\": container with ID starting with 1da26b56a0d0adc85c02800d808bd342fb9e51bc6174fdae6fc8a7ca4b86e94c not found: ID does not exist" containerID="1da26b56a0d0adc85c02800d808bd342fb9e51bc6174fdae6fc8a7ca4b86e94c"
Jul 09 22:21:56.217597 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:56.217560    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1da26b56a0d0adc85c02800d808bd342fb9e51bc6174fdae6fc8a7ca4b86e94c"} err="failed to get container status \"1da26b56a0d0adc85c02800d808bd342fb9e51bc6174fdae6fc8a7ca4b86e94c\": rpc error: code = NotFound desc = could not find container \"1da26b56a0d0adc85c02800d808bd342fb9e51bc6174fdae6fc8a7ca4b86e94c\": container with ID starting with 1da26b56a0d0adc85c02800d808bd342fb9e51bc6174fdae6fc8a7ca4b86e94c not found: ID does not exist"
Jul 09 22:21:56.217597 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:56.217577    2576 scope.go:117] "RemoveContainer" containerID="226bfb8a4b27cf763c59f22eda53e112f6692406b577d5c147d0cb4332712b45"
Jul 09 22:21:56.217822 ip-10-0-141-101 kubenswrapper[2576]: E0709 22:21:56.217803    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"226bfb8a4b27cf763c59f22eda53e112f6692406b577d5c147d0cb4332712b45\": container with ID starting with 226bfb8a4b27cf763c59f22eda53e112f6692406b577d5c147d0cb4332712b45 not found: ID does not exist" containerID="226bfb8a4b27cf763c59f22eda53e112f6692406b577d5c147d0cb4332712b45"
Jul 09 22:21:56.217870 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:56.217829    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"226bfb8a4b27cf763c59f22eda53e112f6692406b577d5c147d0cb4332712b45"} err="failed to get container status \"226bfb8a4b27cf763c59f22eda53e112f6692406b577d5c147d0cb4332712b45\": rpc error: code = NotFound desc = could not find container \"226bfb8a4b27cf763c59f22eda53e112f6692406b577d5c147d0cb4332712b45\": container with ID starting with 226bfb8a4b27cf763c59f22eda53e112f6692406b577d5c147d0cb4332712b45 not found: ID does not exist"
Jul 09 22:21:56.223775 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:56.223750    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4"]
Jul 09 22:21:56.229001 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:56.228980    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-80d0ec86-openshift-default-6794d89f95-cmrg4"]
Jul 09 22:21:56.235869 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:56.235853    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf"
Jul 09 22:21:56.389216 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:56.389193    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf"]
Jul 09 22:21:56.390971 ip-10-0-141-101 kubenswrapper[2576]: W0709 22:21:56.390930    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d916261_5890_4cda_97e6_3d7e585e3d89.slice/crio-6d0b81c2f972fd56b626e2fc2da684f8bb7fc98ed306c33b61ae9b919f37cb4c WatchSource:0}: Error finding container 6d0b81c2f972fd56b626e2fc2da684f8bb7fc98ed306c33b61ae9b919f37cb4c: Status 404 returned error can't find the container with id 6d0b81c2f972fd56b626e2fc2da684f8bb7fc98ed306c33b61ae9b919f37cb4c
Jul 09 22:21:56.393145 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:56.393118    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:21:56.393218 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:56.393180    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:21:56.393218 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:56.393211    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:21:57.200936 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:57.200899    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="111a5ec1-8833-4fc0-a6a8-b9b40431a40f" path="/var/lib/kubelet/pods/111a5ec1-8833-4fc0-a6a8-b9b40431a40f/volumes"
Jul 09 22:21:57.207239 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:57.207207    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf" event={"ID":"5d916261-5890-4cda-97e6-3d7e585e3d89","Type":"ContainerStarted","Data":"273fc2760571d6325e6ed07d6344c32753e9f15685878100de4a87a79e1d2ea1"}
Jul 09 22:21:57.207425 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:57.207267    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf" event={"ID":"5d916261-5890-4cda-97e6-3d7e585e3d89","Type":"ContainerStarted","Data":"6d0b81c2f972fd56b626e2fc2da684f8bb7fc98ed306c33b61ae9b919f37cb4c"}
Jul 09 22:21:57.233648 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:57.233585    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf" podStartSLOduration=2.2335614 podStartE2EDuration="2.2335614s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:21:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:21:57.232683613 +0000 UTC m=+1864.564183701" watchObservedRunningTime="2026-07-09 22:21:57.2335614 +0000 UTC m=+1864.565061479"
Jul 09 22:21:57.236779 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:57.236758    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf"
Jul 09 22:21:57.241898 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:57.241870    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf"
Jul 09 22:21:58.211699 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:58.211668    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf"
Jul 09 22:21:58.212605 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:21:58.212590    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf"
Jul 09 22:22:01.668888 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:22:01.668850    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf"]
Jul 09 22:22:01.669328 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:22:01.669058    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf" podUID="5d916261-5890-4cda-97e6-3d7e585e3d89" containerName="istio-proxy" containerID="cri-o://273fc2760571d6325e6ed07d6344c32753e9f15685878100de4a87a79e1d2ea1" gracePeriod=30
Jul 09 22:22:06.930231 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:22:06.930202    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf"
Jul 09 22:22:06.979749 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:22:06.979665    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d916261-5890-4cda-97e6-3d7e585e3d89-istio-envoy\") pod \"5d916261-5890-4cda-97e6-3d7e585e3d89\" (UID: \"5d916261-5890-4cda-97e6-3d7e585e3d89\") "
Jul 09 22:22:06.979749 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:22:06.979712    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d916261-5890-4cda-97e6-3d7e585e3d89-workload-socket\") pod \"5d916261-5890-4cda-97e6-3d7e585e3d89\" (UID: \"5d916261-5890-4cda-97e6-3d7e585e3d89\") "
Jul 09 22:22:06.979749 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:22:06.979738    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d916261-5890-4cda-97e6-3d7e585e3d89-istio-token\") pod \"5d916261-5890-4cda-97e6-3d7e585e3d89\" (UID: \"5d916261-5890-4cda-97e6-3d7e585e3d89\") "
Jul 09 22:22:06.980024 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:22:06.979781    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d916261-5890-4cda-97e6-3d7e585e3d89-workload-certs\") pod \"5d916261-5890-4cda-97e6-3d7e585e3d89\" (UID: \"5d916261-5890-4cda-97e6-3d7e585e3d89\") "
Jul 09 22:22:06.980024 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:22:06.979806    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d916261-5890-4cda-97e6-3d7e585e3d89-istio-podinfo\") pod \"5d916261-5890-4cda-97e6-3d7e585e3d89\" (UID: \"5d916261-5890-4cda-97e6-3d7e585e3d89\") "
Jul 09 22:22:06.980024 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:22:06.979846    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d916261-5890-4cda-97e6-3d7e585e3d89-istiod-ca-cert\") pod \"5d916261-5890-4cda-97e6-3d7e585e3d89\" (UID: \"5d916261-5890-4cda-97e6-3d7e585e3d89\") "
Jul 09 22:22:06.980024 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:22:06.979881    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d916261-5890-4cda-97e6-3d7e585e3d89-credential-socket\") pod \"5d916261-5890-4cda-97e6-3d7e585e3d89\" (UID: \"5d916261-5890-4cda-97e6-3d7e585e3d89\") "
Jul 09 22:22:06.980249 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:22:06.980050    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d916261-5890-4cda-97e6-3d7e585e3d89-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5d916261-5890-4cda-97e6-3d7e585e3d89" (UID: "5d916261-5890-4cda-97e6-3d7e585e3d89"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:22:06.980249 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:22:06.980067    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d916261-5890-4cda-97e6-3d7e585e3d89-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5d916261-5890-4cda-97e6-3d7e585e3d89" (UID: "5d916261-5890-4cda-97e6-3d7e585e3d89"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:22:06.980249 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:22:06.980070    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d916261-5890-4cda-97e6-3d7e585e3d89-istio-data\") pod \"5d916261-5890-4cda-97e6-3d7e585e3d89\" (UID: \"5d916261-5890-4cda-97e6-3d7e585e3d89\") "
Jul 09 22:22:06.980249 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:22:06.980175    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q6b5z\" (UniqueName: \"kubernetes.io/projected/5d916261-5890-4cda-97e6-3d7e585e3d89-kube-api-access-q6b5z\") pod \"5d916261-5890-4cda-97e6-3d7e585e3d89\" (UID: \"5d916261-5890-4cda-97e6-3d7e585e3d89\") "
Jul 09 22:22:06.980459 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:22:06.980328    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d916261-5890-4cda-97e6-3d7e585e3d89-istio-data" (OuterVolumeSpecName: "istio-data") pod "5d916261-5890-4cda-97e6-3d7e585e3d89" (UID: "5d916261-5890-4cda-97e6-3d7e585e3d89"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:22:06.980459 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:22:06.980339    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d916261-5890-4cda-97e6-3d7e585e3d89-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5d916261-5890-4cda-97e6-3d7e585e3d89" (UID: "5d916261-5890-4cda-97e6-3d7e585e3d89"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:22:06.980563 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:22:06.980475    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d916261-5890-4cda-97e6-3d7e585e3d89-workload-socket\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:22:06.980563 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:22:06.980553    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d916261-5890-4cda-97e6-3d7e585e3d89-workload-certs\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:22:06.980671 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:22:06.980569    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d916261-5890-4cda-97e6-3d7e585e3d89-istiod-ca-cert\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:22:06.980671 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:22:06.980574    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d916261-5890-4cda-97e6-3d7e585e3d89-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5d916261-5890-4cda-97e6-3d7e585e3d89" (UID: "5d916261-5890-4cda-97e6-3d7e585e3d89"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:22:06.980671 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:22:06.980581    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d916261-5890-4cda-97e6-3d7e585e3d89-istio-data\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:22:06.982007 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:22:06.981979    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d916261-5890-4cda-97e6-3d7e585e3d89-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5d916261-5890-4cda-97e6-3d7e585e3d89" (UID: "5d916261-5890-4cda-97e6-3d7e585e3d89"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:22:06.982132 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:22:06.982019    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d916261-5890-4cda-97e6-3d7e585e3d89-istio-token" (OuterVolumeSpecName: "istio-token") pod "5d916261-5890-4cda-97e6-3d7e585e3d89" (UID: "5d916261-5890-4cda-97e6-3d7e585e3d89"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:22:06.982202 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:22:06.982138    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5d916261-5890-4cda-97e6-3d7e585e3d89-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5d916261-5890-4cda-97e6-3d7e585e3d89" (UID: "5d916261-5890-4cda-97e6-3d7e585e3d89"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 22:22:06.982202 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:22:06.982150    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d916261-5890-4cda-97e6-3d7e585e3d89-kube-api-access-q6b5z" (OuterVolumeSpecName: "kube-api-access-q6b5z") pod "5d916261-5890-4cda-97e6-3d7e585e3d89" (UID: "5d916261-5890-4cda-97e6-3d7e585e3d89"). InnerVolumeSpecName "kube-api-access-q6b5z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:22:07.081367 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:22:07.081329    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d916261-5890-4cda-97e6-3d7e585e3d89-istio-podinfo\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:22:07.081367 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:22:07.081361    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d916261-5890-4cda-97e6-3d7e585e3d89-credential-socket\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:22:07.081367 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:22:07.081375    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q6b5z\" (UniqueName: \"kubernetes.io/projected/5d916261-5890-4cda-97e6-3d7e585e3d89-kube-api-access-q6b5z\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:22:07.081606 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:22:07.081389    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d916261-5890-4cda-97e6-3d7e585e3d89-istio-envoy\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:22:07.081606 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:22:07.081401    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d916261-5890-4cda-97e6-3d7e585e3d89-istio-token\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:22:07.255867 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:22:07.255786    2576 generic.go:356] "Generic (PLEG): container finished" podID="5d916261-5890-4cda-97e6-3d7e585e3d89" containerID="273fc2760571d6325e6ed07d6344c32753e9f15685878100de4a87a79e1d2ea1" exitCode=0
Jul 09 22:22:07.255867 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:22:07.255826    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf"
Jul 09 22:22:07.255867 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:22:07.255843    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf" event={"ID":"5d916261-5890-4cda-97e6-3d7e585e3d89","Type":"ContainerDied","Data":"273fc2760571d6325e6ed07d6344c32753e9f15685878100de4a87a79e1d2ea1"}
Jul 09 22:22:07.256121 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:22:07.255890    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf" event={"ID":"5d916261-5890-4cda-97e6-3d7e585e3d89","Type":"ContainerDied","Data":"6d0b81c2f972fd56b626e2fc2da684f8bb7fc98ed306c33b61ae9b919f37cb4c"}
Jul 09 22:22:07.256121 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:22:07.255913    2576 scope.go:117] "RemoveContainer" containerID="273fc2760571d6325e6ed07d6344c32753e9f15685878100de4a87a79e1d2ea1"
Jul 09 22:22:07.264548 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:22:07.264530    2576 scope.go:117] "RemoveContainer" containerID="273fc2760571d6325e6ed07d6344c32753e9f15685878100de4a87a79e1d2ea1"
Jul 09 22:22:07.264819 ip-10-0-141-101 kubenswrapper[2576]: E0709 22:22:07.264799    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"273fc2760571d6325e6ed07d6344c32753e9f15685878100de4a87a79e1d2ea1\": container with ID starting with 273fc2760571d6325e6ed07d6344c32753e9f15685878100de4a87a79e1d2ea1 not found: ID does not exist" containerID="273fc2760571d6325e6ed07d6344c32753e9f15685878100de4a87a79e1d2ea1"
Jul 09 22:22:07.264882 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:22:07.264827    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"273fc2760571d6325e6ed07d6344c32753e9f15685878100de4a87a79e1d2ea1"} err="failed to get container status \"273fc2760571d6325e6ed07d6344c32753e9f15685878100de4a87a79e1d2ea1\": rpc error: code = NotFound desc = could not find container \"273fc2760571d6325e6ed07d6344c32753e9f15685878100de4a87a79e1d2ea1\": container with ID starting with 273fc2760571d6325e6ed07d6344c32753e9f15685878100de4a87a79e1d2ea1 not found: ID does not exist"
Jul 09 22:22:07.272746 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:22:07.272718    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf"]
Jul 09 22:22:07.276474 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:22:07.276453    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-efc29080-openshift-default-5c58b758c9-glrtf"]
Jul 09 22:22:09.200467 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:22:09.200431    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d916261-5890-4cda-97e6-3d7e585e3d89" path="/var/lib/kubelet/pods/5d916261-5890-4cda-97e6-3d7e585e3d89/volumes"
Jul 09 22:23:43.316660 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:23:43.316625    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr"]
Jul 09 22:23:43.317150 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:23:43.316987    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d916261-5890-4cda-97e6-3d7e585e3d89" containerName="istio-proxy"
Jul 09 22:23:43.317150 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:23:43.317003    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d916261-5890-4cda-97e6-3d7e585e3d89" containerName="istio-proxy"
Jul 09 22:23:43.317150 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:23:43.317085    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d916261-5890-4cda-97e6-3d7e585e3d89" containerName="istio-proxy"
Jul 09 22:23:43.320112 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:23:43.320095    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr"
Jul 09 22:23:43.326804 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:23:43.326785    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-8389e858-openshift-default-dockercfg-flsqz\""
Jul 09 22:23:43.352910 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:23:43.352874    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr"]
Jul 09 22:23:43.388583 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:23:43.388538    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5db51997-3248-4e34-908c-adaf4eaaaeeb-istio-token\") pod \"e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr\" (UID: \"5db51997-3248-4e34-908c-adaf4eaaaeeb\") " pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr"
Jul 09 22:23:43.388583 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:23:43.388590    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5db51997-3248-4e34-908c-adaf4eaaaeeb-istio-envoy\") pod \"e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr\" (UID: \"5db51997-3248-4e34-908c-adaf4eaaaeeb\") " pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr"
Jul 09 22:23:43.388824 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:23:43.388663    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5db51997-3248-4e34-908c-adaf4eaaaeeb-istio-data\") pod \"e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr\" (UID: \"5db51997-3248-4e34-908c-adaf4eaaaeeb\") " pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr"
Jul 09 22:23:43.388824 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:23:43.388690    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5db51997-3248-4e34-908c-adaf4eaaaeeb-credential-socket\") pod \"e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr\" (UID: \"5db51997-3248-4e34-908c-adaf4eaaaeeb\") " pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr"
Jul 09 22:23:43.388824 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:23:43.388712    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5db51997-3248-4e34-908c-adaf4eaaaeeb-istio-podinfo\") pod \"e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr\" (UID: \"5db51997-3248-4e34-908c-adaf4eaaaeeb\") " pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr"
Jul 09 22:23:43.388824 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:23:43.388797    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5db51997-3248-4e34-908c-adaf4eaaaeeb-workload-socket\") pod \"e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr\" (UID: \"5db51997-3248-4e34-908c-adaf4eaaaeeb\") " pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr"
Jul 09 22:23:43.389065 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:23:43.388831    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdpng\" (UniqueName: \"kubernetes.io/projected/5db51997-3248-4e34-908c-adaf4eaaaeeb-kube-api-access-wdpng\") pod \"e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr\" (UID: \"5db51997-3248-4e34-908c-adaf4eaaaeeb\") " pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr"
Jul 09 22:23:43.389065 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:23:43.388884    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5db51997-3248-4e34-908c-adaf4eaaaeeb-workload-certs\") pod \"e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr\" (UID: \"5db51997-3248-4e34-908c-adaf4eaaaeeb\") " pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr"
Jul 09 22:23:43.389065 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:23:43.388901    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5db51997-3248-4e34-908c-adaf4eaaaeeb-istiod-ca-cert\") pod \"e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr\" (UID: \"5db51997-3248-4e34-908c-adaf4eaaaeeb\") " pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr"
Jul 09 22:23:43.489461 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:23:43.489421    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5db51997-3248-4e34-908c-adaf4eaaaeeb-istio-token\") pod \"e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr\" (UID: \"5db51997-3248-4e34-908c-adaf4eaaaeeb\") " pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr"
Jul 09 22:23:43.489461 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:23:43.489465    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5db51997-3248-4e34-908c-adaf4eaaaeeb-istio-envoy\") pod \"e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr\" (UID: \"5db51997-3248-4e34-908c-adaf4eaaaeeb\") " pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr"
Jul 09 22:23:43.489679 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:23:43.489487    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5db51997-3248-4e34-908c-adaf4eaaaeeb-istio-data\") pod \"e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr\" (UID: \"5db51997-3248-4e34-908c-adaf4eaaaeeb\") " pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr"
Jul 09 22:23:43.489679 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:23:43.489515    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5db51997-3248-4e34-908c-adaf4eaaaeeb-credential-socket\") pod \"e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr\" (UID: \"5db51997-3248-4e34-908c-adaf4eaaaeeb\") " pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr"
Jul 09 22:23:43.489679 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:23:43.489539    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5db51997-3248-4e34-908c-adaf4eaaaeeb-istio-podinfo\") pod \"e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr\" (UID: \"5db51997-3248-4e34-908c-adaf4eaaaeeb\") " pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr"
Jul 09 22:23:43.489679 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:23:43.489588    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5db51997-3248-4e34-908c-adaf4eaaaeeb-workload-socket\") pod \"e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr\" (UID: \"5db51997-3248-4e34-908c-adaf4eaaaeeb\") " pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr"
Jul 09 22:23:43.489679 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:23:43.489614    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdpng\" (UniqueName: \"kubernetes.io/projected/5db51997-3248-4e34-908c-adaf4eaaaeeb-kube-api-access-wdpng\") pod \"e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr\" (UID: \"5db51997-3248-4e34-908c-adaf4eaaaeeb\") " pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr"
Jul 09 22:23:43.489679 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:23:43.489642    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5db51997-3248-4e34-908c-adaf4eaaaeeb-workload-certs\") pod \"e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr\" (UID: \"5db51997-3248-4e34-908c-adaf4eaaaeeb\") " pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr"
Jul 09 22:23:43.489679 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:23:43.489662    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5db51997-3248-4e34-908c-adaf4eaaaeeb-istiod-ca-cert\") pod \"e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr\" (UID: \"5db51997-3248-4e34-908c-adaf4eaaaeeb\") " pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr"
Jul 09 22:23:43.490037 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:23:43.490010    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5db51997-3248-4e34-908c-adaf4eaaaeeb-credential-socket\") pod \"e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr\" (UID: \"5db51997-3248-4e34-908c-adaf4eaaaeeb\") " pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr"
Jul 09 22:23:43.490120 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:23:43.490097    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5db51997-3248-4e34-908c-adaf4eaaaeeb-istio-data\") pod \"e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr\" (UID: \"5db51997-3248-4e34-908c-adaf4eaaaeeb\") " pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr"
Jul 09 22:23:43.490209 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:23:43.490188    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5db51997-3248-4e34-908c-adaf4eaaaeeb-workload-certs\") pod \"e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr\" (UID: \"5db51997-3248-4e34-908c-adaf4eaaaeeb\") " pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr"
Jul 09 22:23:43.490304 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:23:43.490281    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5db51997-3248-4e34-908c-adaf4eaaaeeb-workload-socket\") pod \"e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr\" (UID: \"5db51997-3248-4e34-908c-adaf4eaaaeeb\") " pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr"
Jul 09 22:23:43.490477 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:23:43.490460    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5db51997-3248-4e34-908c-adaf4eaaaeeb-istiod-ca-cert\") pod \"e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr\" (UID: \"5db51997-3248-4e34-908c-adaf4eaaaeeb\") " pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr"
Jul 09 22:23:43.491795 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:23:43.491776    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5db51997-3248-4e34-908c-adaf4eaaaeeb-istio-envoy\") pod \"e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr\" (UID: \"5db51997-3248-4e34-908c-adaf4eaaaeeb\") " pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr"
Jul 09 22:23:43.492117 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:23:43.492099    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5db51997-3248-4e34-908c-adaf4eaaaeeb-istio-podinfo\") pod \"e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr\" (UID: \"5db51997-3248-4e34-908c-adaf4eaaaeeb\") " pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr"
Jul 09 22:23:43.503837 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:23:43.503815    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5db51997-3248-4e34-908c-adaf4eaaaeeb-istio-token\") pod \"e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr\" (UID: \"5db51997-3248-4e34-908c-adaf4eaaaeeb\") " pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr"
Jul 09 22:23:43.504004 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:23:43.503847    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdpng\" (UniqueName: \"kubernetes.io/projected/5db51997-3248-4e34-908c-adaf4eaaaeeb-kube-api-access-wdpng\") pod \"e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr\" (UID: \"5db51997-3248-4e34-908c-adaf4eaaaeeb\") " pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr"
Jul 09 22:23:43.630621 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:23:43.630515    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr"
Jul 09 22:23:43.775838 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:23:43.775788    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr"]
Jul 09 22:23:43.778168 ip-10-0-141-101 kubenswrapper[2576]: W0709 22:23:43.778131    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5db51997_3248_4e34_908c_adaf4eaaaeeb.slice/crio-f81cea3d476be6df9af6710ed3f02ded8ee78fe12664ac9878c06c349b454223 WatchSource:0}: Error finding container f81cea3d476be6df9af6710ed3f02ded8ee78fe12664ac9878c06c349b454223: Status 404 returned error can't find the container with id f81cea3d476be6df9af6710ed3f02ded8ee78fe12664ac9878c06c349b454223
Jul 09 22:23:43.780701 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:23:43.780667    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:23:43.780776 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:23:43.780744    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:23:43.780826 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:23:43.780780    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:23:44.720824 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:23:44.720784    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr" event={"ID":"5db51997-3248-4e34-908c-adaf4eaaaeeb","Type":"ContainerStarted","Data":"1db80b4990bca98f7de13396b5330143b1ff17125ac9a17e5551bcee692ede11"}
Jul 09 22:23:44.721271 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:23:44.720841    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr" event={"ID":"5db51997-3248-4e34-908c-adaf4eaaaeeb","Type":"ContainerStarted","Data":"f81cea3d476be6df9af6710ed3f02ded8ee78fe12664ac9878c06c349b454223"}
Jul 09 22:23:44.747149 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:23:44.747104    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr" podStartSLOduration=1.7470842709999999 podStartE2EDuration="1.747084271s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:23:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:23:44.746631994 +0000 UTC m=+1972.078132074" watchObservedRunningTime="2026-07-09 22:23:44.747084271 +0000 UTC m=+1972.078584349"
Jul 09 22:23:45.631782 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:23:45.631691    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr"
Jul 09 22:23:45.636846 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:23:45.636820    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr"
Jul 09 22:23:45.725739 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:23:45.725713    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr"
Jul 09 22:23:45.726817 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:23:45.726796    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr"
Jul 09 22:24:01.132922 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:01.131951    2576 patch_prober.go:28] interesting pod/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": read tcp 10.132.0.2:56856->10.132.0.43:15021: read: connection reset by peer" start-of-body=
Jul 09 22:24:01.132922 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:01.132046    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr" podUID="5db51997-3248-4e34-908c-adaf4eaaaeeb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": read tcp 10.132.0.2:56856->10.132.0.43:15021: read: connection reset by peer"
Jul 09 22:24:01.799555 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:01.799520    2576 generic.go:356] "Generic (PLEG): container finished" podID="5db51997-3248-4e34-908c-adaf4eaaaeeb" containerID="1db80b4990bca98f7de13396b5330143b1ff17125ac9a17e5551bcee692ede11" exitCode=0
Jul 09 22:24:01.799727 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:01.799591    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr" event={"ID":"5db51997-3248-4e34-908c-adaf4eaaaeeb","Type":"ContainerDied","Data":"1db80b4990bca98f7de13396b5330143b1ff17125ac9a17e5551bcee692ede11"}
Jul 09 22:24:01.800023 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:01.800010    2576 scope.go:117] "RemoveContainer" containerID="1db80b4990bca98f7de13396b5330143b1ff17125ac9a17e5551bcee692ede11"
Jul 09 22:24:01.800972 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:01.800933    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:24:01.801072 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:01.801021    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:24:01.801072 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:01.801057    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:24:02.806212 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:02.806176    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr" event={"ID":"5db51997-3248-4e34-908c-adaf4eaaaeeb","Type":"ContainerStarted","Data":"ee38f6f54da895dd6e847ed934a15913d15b23ad1b6d62d59c74e5613df5ffdb"}
Jul 09 22:24:03.631528 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:03.631491    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr"
Jul 09 22:24:03.634947 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:03.634920    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr"
Jul 09 22:24:03.811009 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:03.810951    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr"
Jul 09 22:24:03.812024 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:03.812006    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr"
Jul 09 22:24:05.079134 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:05.079099    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr"]
Jul 09 22:24:05.819623 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:05.819589    2576 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr" secret="" err="secret \"e2e-mt-8389e858-openshift-default-dockercfg-flsqz\" not found"
Jul 09 22:24:06.823414 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:06.823369    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr" podUID="5db51997-3248-4e34-908c-adaf4eaaaeeb" containerName="istio-proxy" containerID="cri-o://ee38f6f54da895dd6e847ed934a15913d15b23ad1b6d62d59c74e5613df5ffdb" gracePeriod=30
Jul 09 22:24:12.086464 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:12.086400    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr"
Jul 09 22:24:12.236187 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:12.236144    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5db51997-3248-4e34-908c-adaf4eaaaeeb-istio-envoy\") pod \"5db51997-3248-4e34-908c-adaf4eaaaeeb\" (UID: \"5db51997-3248-4e34-908c-adaf4eaaaeeb\") "
Jul 09 22:24:12.236413 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:12.236207    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5db51997-3248-4e34-908c-adaf4eaaaeeb-istio-data\") pod \"5db51997-3248-4e34-908c-adaf4eaaaeeb\" (UID: \"5db51997-3248-4e34-908c-adaf4eaaaeeb\") "
Jul 09 22:24:12.236413 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:12.236226    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5db51997-3248-4e34-908c-adaf4eaaaeeb-istio-podinfo\") pod \"5db51997-3248-4e34-908c-adaf4eaaaeeb\" (UID: \"5db51997-3248-4e34-908c-adaf4eaaaeeb\") "
Jul 09 22:24:12.236413 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:12.236253    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5db51997-3248-4e34-908c-adaf4eaaaeeb-credential-socket\") pod \"5db51997-3248-4e34-908c-adaf4eaaaeeb\" (UID: \"5db51997-3248-4e34-908c-adaf4eaaaeeb\") "
Jul 09 22:24:12.236413 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:12.236281    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5db51997-3248-4e34-908c-adaf4eaaaeeb-istio-token\") pod \"5db51997-3248-4e34-908c-adaf4eaaaeeb\" (UID: \"5db51997-3248-4e34-908c-adaf4eaaaeeb\") "
Jul 09 22:24:12.236413 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:12.236317    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdpng\" (UniqueName: \"kubernetes.io/projected/5db51997-3248-4e34-908c-adaf4eaaaeeb-kube-api-access-wdpng\") pod \"5db51997-3248-4e34-908c-adaf4eaaaeeb\" (UID: \"5db51997-3248-4e34-908c-adaf4eaaaeeb\") "
Jul 09 22:24:12.236413 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:12.236343    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5db51997-3248-4e34-908c-adaf4eaaaeeb-workload-socket\") pod \"5db51997-3248-4e34-908c-adaf4eaaaeeb\" (UID: \"5db51997-3248-4e34-908c-adaf4eaaaeeb\") "
Jul 09 22:24:12.236413 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:12.236374    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5db51997-3248-4e34-908c-adaf4eaaaeeb-workload-certs\") pod \"5db51997-3248-4e34-908c-adaf4eaaaeeb\" (UID: \"5db51997-3248-4e34-908c-adaf4eaaaeeb\") "
Jul 09 22:24:12.236794 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:12.236431    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5db51997-3248-4e34-908c-adaf4eaaaeeb-istiod-ca-cert\") pod \"5db51997-3248-4e34-908c-adaf4eaaaeeb\" (UID: \"5db51997-3248-4e34-908c-adaf4eaaaeeb\") "
Jul 09 22:24:12.236794 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:12.236723    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5db51997-3248-4e34-908c-adaf4eaaaeeb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5db51997-3248-4e34-908c-adaf4eaaaeeb" (UID: "5db51997-3248-4e34-908c-adaf4eaaaeeb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:24:12.237003 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:12.236951    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5db51997-3248-4e34-908c-adaf4eaaaeeb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5db51997-3248-4e34-908c-adaf4eaaaeeb" (UID: "5db51997-3248-4e34-908c-adaf4eaaaeeb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:24:12.237209 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:12.237184    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5db51997-3248-4e34-908c-adaf4eaaaeeb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5db51997-3248-4e34-908c-adaf4eaaaeeb" (UID: "5db51997-3248-4e34-908c-adaf4eaaaeeb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:24:12.237417 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:12.237388    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5db51997-3248-4e34-908c-adaf4eaaaeeb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5db51997-3248-4e34-908c-adaf4eaaaeeb" (UID: "5db51997-3248-4e34-908c-adaf4eaaaeeb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:24:12.237882 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:12.237855    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5db51997-3248-4e34-908c-adaf4eaaaeeb-istio-data" (OuterVolumeSpecName: "istio-data") pod "5db51997-3248-4e34-908c-adaf4eaaaeeb" (UID: "5db51997-3248-4e34-908c-adaf4eaaaeeb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:24:12.238636 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:12.238607    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5db51997-3248-4e34-908c-adaf4eaaaeeb-istio-token" (OuterVolumeSpecName: "istio-token") pod "5db51997-3248-4e34-908c-adaf4eaaaeeb" (UID: "5db51997-3248-4e34-908c-adaf4eaaaeeb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:24:12.238739 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:12.238631    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5db51997-3248-4e34-908c-adaf4eaaaeeb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5db51997-3248-4e34-908c-adaf4eaaaeeb" (UID: "5db51997-3248-4e34-908c-adaf4eaaaeeb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 22:24:12.238739 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:12.238635    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5db51997-3248-4e34-908c-adaf4eaaaeeb-kube-api-access-wdpng" (OuterVolumeSpecName: "kube-api-access-wdpng") pod "5db51997-3248-4e34-908c-adaf4eaaaeeb" (UID: "5db51997-3248-4e34-908c-adaf4eaaaeeb"). InnerVolumeSpecName "kube-api-access-wdpng". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:24:12.238739 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:12.238694    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5db51997-3248-4e34-908c-adaf4eaaaeeb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5db51997-3248-4e34-908c-adaf4eaaaeeb" (UID: "5db51997-3248-4e34-908c-adaf4eaaaeeb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:24:12.337333 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:12.337243    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5db51997-3248-4e34-908c-adaf4eaaaeeb-istio-data\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:24:12.337333 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:12.337270    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5db51997-3248-4e34-908c-adaf4eaaaeeb-istio-podinfo\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:24:12.337333 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:12.337283    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5db51997-3248-4e34-908c-adaf4eaaaeeb-credential-socket\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:24:12.337333 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:12.337295    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5db51997-3248-4e34-908c-adaf4eaaaeeb-istio-token\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:24:12.337333 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:12.337307    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdpng\" (UniqueName: \"kubernetes.io/projected/5db51997-3248-4e34-908c-adaf4eaaaeeb-kube-api-access-wdpng\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:24:12.337333 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:12.337320    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5db51997-3248-4e34-908c-adaf4eaaaeeb-workload-socket\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:24:12.337647 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:12.337332    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5db51997-3248-4e34-908c-adaf4eaaaeeb-workload-certs\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:24:12.337647 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:12.337353    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5db51997-3248-4e34-908c-adaf4eaaaeeb-istiod-ca-cert\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:24:12.337647 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:12.337363    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5db51997-3248-4e34-908c-adaf4eaaaeeb-istio-envoy\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:24:12.852737 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:12.852705    2576 generic.go:356] "Generic (PLEG): container finished" podID="5db51997-3248-4e34-908c-adaf4eaaaeeb" containerID="ee38f6f54da895dd6e847ed934a15913d15b23ad1b6d62d59c74e5613df5ffdb" exitCode=0
Jul 09 22:24:12.852950 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:12.852770    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr"
Jul 09 22:24:12.852950 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:12.852804    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr" event={"ID":"5db51997-3248-4e34-908c-adaf4eaaaeeb","Type":"ContainerDied","Data":"ee38f6f54da895dd6e847ed934a15913d15b23ad1b6d62d59c74e5613df5ffdb"}
Jul 09 22:24:12.852950 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:12.852860    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr" event={"ID":"5db51997-3248-4e34-908c-adaf4eaaaeeb","Type":"ContainerDied","Data":"f81cea3d476be6df9af6710ed3f02ded8ee78fe12664ac9878c06c349b454223"}
Jul 09 22:24:12.852950 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:12.852882    2576 scope.go:117] "RemoveContainer" containerID="ee38f6f54da895dd6e847ed934a15913d15b23ad1b6d62d59c74e5613df5ffdb"
Jul 09 22:24:12.862154 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:12.862139    2576 scope.go:117] "RemoveContainer" containerID="1db80b4990bca98f7de13396b5330143b1ff17125ac9a17e5551bcee692ede11"
Jul 09 22:24:12.869794 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:12.869776    2576 scope.go:117] "RemoveContainer" containerID="ee38f6f54da895dd6e847ed934a15913d15b23ad1b6d62d59c74e5613df5ffdb"
Jul 09 22:24:12.870077 ip-10-0-141-101 kubenswrapper[2576]: E0709 22:24:12.870060    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee38f6f54da895dd6e847ed934a15913d15b23ad1b6d62d59c74e5613df5ffdb\": container with ID starting with ee38f6f54da895dd6e847ed934a15913d15b23ad1b6d62d59c74e5613df5ffdb not found: ID does not exist" containerID="ee38f6f54da895dd6e847ed934a15913d15b23ad1b6d62d59c74e5613df5ffdb"
Jul 09 22:24:12.870130 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:12.870086    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee38f6f54da895dd6e847ed934a15913d15b23ad1b6d62d59c74e5613df5ffdb"} err="failed to get container status \"ee38f6f54da895dd6e847ed934a15913d15b23ad1b6d62d59c74e5613df5ffdb\": rpc error: code = NotFound desc = could not find container \"ee38f6f54da895dd6e847ed934a15913d15b23ad1b6d62d59c74e5613df5ffdb\": container with ID starting with ee38f6f54da895dd6e847ed934a15913d15b23ad1b6d62d59c74e5613df5ffdb not found: ID does not exist"
Jul 09 22:24:12.870130 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:12.870104    2576 scope.go:117] "RemoveContainer" containerID="1db80b4990bca98f7de13396b5330143b1ff17125ac9a17e5551bcee692ede11"
Jul 09 22:24:12.870357 ip-10-0-141-101 kubenswrapper[2576]: E0709 22:24:12.870340    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1db80b4990bca98f7de13396b5330143b1ff17125ac9a17e5551bcee692ede11\": container with ID starting with 1db80b4990bca98f7de13396b5330143b1ff17125ac9a17e5551bcee692ede11 not found: ID does not exist" containerID="1db80b4990bca98f7de13396b5330143b1ff17125ac9a17e5551bcee692ede11"
Jul 09 22:24:12.870410 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:12.870366    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1db80b4990bca98f7de13396b5330143b1ff17125ac9a17e5551bcee692ede11"} err="failed to get container status \"1db80b4990bca98f7de13396b5330143b1ff17125ac9a17e5551bcee692ede11\": rpc error: code = NotFound desc = could not find container \"1db80b4990bca98f7de13396b5330143b1ff17125ac9a17e5551bcee692ede11\": container with ID starting with 1db80b4990bca98f7de13396b5330143b1ff17125ac9a17e5551bcee692ede11 not found: ID does not exist"
Jul 09 22:24:12.874859 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:12.874837    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr"]
Jul 09 22:24:12.886440 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:12.886420    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-8389e858-openshift-default-7fc9d9448c-4zbqr"]
Jul 09 22:24:13.201422 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:13.201341    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5db51997-3248-4e34-908c-adaf4eaaaeeb" path="/var/lib/kubelet/pods/5db51997-3248-4e34-908c-adaf4eaaaeeb/volumes"
Jul 09 22:24:24.645692 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:24.645638    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl"]
Jul 09 22:24:24.646158 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:24.646041    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5db51997-3248-4e34-908c-adaf4eaaaeeb" containerName="istio-proxy"
Jul 09 22:24:24.646158 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:24.646054    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5db51997-3248-4e34-908c-adaf4eaaaeeb" containerName="istio-proxy"
Jul 09 22:24:24.646158 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:24.646064    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5db51997-3248-4e34-908c-adaf4eaaaeeb" containerName="istio-proxy"
Jul 09 22:24:24.646158 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:24.646070    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5db51997-3248-4e34-908c-adaf4eaaaeeb" containerName="istio-proxy"
Jul 09 22:24:24.646158 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:24.646122    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5db51997-3248-4e34-908c-adaf4eaaaeeb" containerName="istio-proxy"
Jul 09 22:24:24.646158 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:24.646132    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5db51997-3248-4e34-908c-adaf4eaaaeeb" containerName="istio-proxy"
Jul 09 22:24:24.650746 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:24.650723    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl"
Jul 09 22:24:24.657396 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:24.657018    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-f4b46590-openshift-default-dockercfg-zn9qk\""
Jul 09 22:24:24.663856 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:24.663833    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl"]
Jul 09 22:24:24.749050 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:24.749014    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9tz5\" (UniqueName: \"kubernetes.io/projected/b3b198e2-98d7-47f4-a4c4-7eb370970e04-kube-api-access-t9tz5\") pod \"e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl\" (UID: \"b3b198e2-98d7-47f4-a4c4-7eb370970e04\") " pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl"
Jul 09 22:24:24.749240 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:24.749069    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3b198e2-98d7-47f4-a4c4-7eb370970e04-istio-podinfo\") pod \"e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl\" (UID: \"b3b198e2-98d7-47f4-a4c4-7eb370970e04\") " pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl"
Jul 09 22:24:24.749240 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:24.749098    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3b198e2-98d7-47f4-a4c4-7eb370970e04-istio-envoy\") pod \"e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl\" (UID: \"b3b198e2-98d7-47f4-a4c4-7eb370970e04\") " pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl"
Jul 09 22:24:24.749240 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:24.749159    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3b198e2-98d7-47f4-a4c4-7eb370970e04-workload-certs\") pod \"e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl\" (UID: \"b3b198e2-98d7-47f4-a4c4-7eb370970e04\") " pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl"
Jul 09 22:24:24.749240 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:24.749192    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3b198e2-98d7-47f4-a4c4-7eb370970e04-istio-token\") pod \"e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl\" (UID: \"b3b198e2-98d7-47f4-a4c4-7eb370970e04\") " pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl"
Jul 09 22:24:24.749240 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:24.749210    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3b198e2-98d7-47f4-a4c4-7eb370970e04-credential-socket\") pod \"e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl\" (UID: \"b3b198e2-98d7-47f4-a4c4-7eb370970e04\") " pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl"
Jul 09 22:24:24.749240 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:24.749227    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3b198e2-98d7-47f4-a4c4-7eb370970e04-istiod-ca-cert\") pod \"e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl\" (UID: \"b3b198e2-98d7-47f4-a4c4-7eb370970e04\") " pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl"
Jul 09 22:24:24.749474 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:24.749251    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3b198e2-98d7-47f4-a4c4-7eb370970e04-istio-data\") pod \"e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl\" (UID: \"b3b198e2-98d7-47f4-a4c4-7eb370970e04\") " pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl"
Jul 09 22:24:24.749474 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:24.749286    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3b198e2-98d7-47f4-a4c4-7eb370970e04-workload-socket\") pod \"e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl\" (UID: \"b3b198e2-98d7-47f4-a4c4-7eb370970e04\") " pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl"
Jul 09 22:24:24.850121 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:24.850087    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3b198e2-98d7-47f4-a4c4-7eb370970e04-istio-podinfo\") pod \"e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl\" (UID: \"b3b198e2-98d7-47f4-a4c4-7eb370970e04\") " pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl"
Jul 09 22:24:24.850121 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:24.850126    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3b198e2-98d7-47f4-a4c4-7eb370970e04-istio-envoy\") pod \"e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl\" (UID: \"b3b198e2-98d7-47f4-a4c4-7eb370970e04\") " pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl"
Jul 09 22:24:24.850383 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:24.850160    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3b198e2-98d7-47f4-a4c4-7eb370970e04-workload-certs\") pod \"e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl\" (UID: \"b3b198e2-98d7-47f4-a4c4-7eb370970e04\") " pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl"
Jul 09 22:24:24.850383 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:24.850193    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3b198e2-98d7-47f4-a4c4-7eb370970e04-istio-token\") pod \"e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl\" (UID: \"b3b198e2-98d7-47f4-a4c4-7eb370970e04\") " pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl"
Jul 09 22:24:24.850383 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:24.850213    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3b198e2-98d7-47f4-a4c4-7eb370970e04-credential-socket\") pod \"e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl\" (UID: \"b3b198e2-98d7-47f4-a4c4-7eb370970e04\") " pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl"
Jul 09 22:24:24.850383 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:24.850231    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3b198e2-98d7-47f4-a4c4-7eb370970e04-istiod-ca-cert\") pod \"e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl\" (UID: \"b3b198e2-98d7-47f4-a4c4-7eb370970e04\") " pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl"
Jul 09 22:24:24.850383 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:24.850253    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3b198e2-98d7-47f4-a4c4-7eb370970e04-istio-data\") pod \"e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl\" (UID: \"b3b198e2-98d7-47f4-a4c4-7eb370970e04\") " pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl"
Jul 09 22:24:24.850383 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:24.850274    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3b198e2-98d7-47f4-a4c4-7eb370970e04-workload-socket\") pod \"e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl\" (UID: \"b3b198e2-98d7-47f4-a4c4-7eb370970e04\") " pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl"
Jul 09 22:24:24.850383 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:24.850318    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9tz5\" (UniqueName: \"kubernetes.io/projected/b3b198e2-98d7-47f4-a4c4-7eb370970e04-kube-api-access-t9tz5\") pod \"e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl\" (UID: \"b3b198e2-98d7-47f4-a4c4-7eb370970e04\") " pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl"
Jul 09 22:24:24.850722 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:24.850561    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3b198e2-98d7-47f4-a4c4-7eb370970e04-workload-certs\") pod \"e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl\" (UID: \"b3b198e2-98d7-47f4-a4c4-7eb370970e04\") " pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl"
Jul 09 22:24:24.850722 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:24.850655    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3b198e2-98d7-47f4-a4c4-7eb370970e04-credential-socket\") pod \"e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl\" (UID: \"b3b198e2-98d7-47f4-a4c4-7eb370970e04\") " pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl"
Jul 09 22:24:24.850840 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:24.850759    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3b198e2-98d7-47f4-a4c4-7eb370970e04-workload-socket\") pod \"e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl\" (UID: \"b3b198e2-98d7-47f4-a4c4-7eb370970e04\") " pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl"
Jul 09 22:24:24.850840 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:24.850780    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3b198e2-98d7-47f4-a4c4-7eb370970e04-istio-data\") pod \"e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl\" (UID: \"b3b198e2-98d7-47f4-a4c4-7eb370970e04\") " pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl"
Jul 09 22:24:24.851101 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:24.851084    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3b198e2-98d7-47f4-a4c4-7eb370970e04-istiod-ca-cert\") pod \"e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl\" (UID: \"b3b198e2-98d7-47f4-a4c4-7eb370970e04\") " pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl"
Jul 09 22:24:24.852524 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:24.852505    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3b198e2-98d7-47f4-a4c4-7eb370970e04-istio-envoy\") pod \"e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl\" (UID: \"b3b198e2-98d7-47f4-a4c4-7eb370970e04\") " pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl"
Jul 09 22:24:24.852763 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:24.852744    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3b198e2-98d7-47f4-a4c4-7eb370970e04-istio-podinfo\") pod \"e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl\" (UID: \"b3b198e2-98d7-47f4-a4c4-7eb370970e04\") " pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl"
Jul 09 22:24:24.858604 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:24.858582    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3b198e2-98d7-47f4-a4c4-7eb370970e04-istio-token\") pod \"e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl\" (UID: \"b3b198e2-98d7-47f4-a4c4-7eb370970e04\") " pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl"
Jul 09 22:24:24.858744 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:24.858725    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9tz5\" (UniqueName: \"kubernetes.io/projected/b3b198e2-98d7-47f4-a4c4-7eb370970e04-kube-api-access-t9tz5\") pod \"e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl\" (UID: \"b3b198e2-98d7-47f4-a4c4-7eb370970e04\") " pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl"
Jul 09 22:24:24.960828 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:24.960748    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl"
Jul 09 22:24:25.101896 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:25.101852    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl"]
Jul 09 22:24:25.106554 ip-10-0-141-101 kubenswrapper[2576]: W0709 22:24:25.106528    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3b198e2_98d7_47f4_a4c4_7eb370970e04.slice/crio-e9533d1ee7b33363f47773c5f20ea4df80eefc081de00dbee623abafb35d426d WatchSource:0}: Error finding container e9533d1ee7b33363f47773c5f20ea4df80eefc081de00dbee623abafb35d426d: Status 404 returned error can't find the container with id e9533d1ee7b33363f47773c5f20ea4df80eefc081de00dbee623abafb35d426d
Jul 09 22:24:25.109158 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:25.109124    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:24:25.109240 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:25.109204    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:24:25.109240 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:25.109231    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:24:25.916508 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:25.916472    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl" event={"ID":"b3b198e2-98d7-47f4-a4c4-7eb370970e04","Type":"ContainerStarted","Data":"45a37805bd5a6fb468f4e8102d4a309ab57ad694a8dc80a253fc467e8ddf0633"}
Jul 09 22:24:25.916946 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:25.916522    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl" event={"ID":"b3b198e2-98d7-47f4-a4c4-7eb370970e04","Type":"ContainerStarted","Data":"e9533d1ee7b33363f47773c5f20ea4df80eefc081de00dbee623abafb35d426d"}
Jul 09 22:24:25.946652 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:25.946585    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl" podStartSLOduration=1.946563819 podStartE2EDuration="1.946563819s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:24:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:24:25.945716805 +0000 UTC m=+2013.277216908" watchObservedRunningTime="2026-07-09 22:24:25.946563819 +0000 UTC m=+2013.278063898"
Jul 09 22:24:25.961021 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:25.960997    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl"
Jul 09 22:24:26.966522 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:26.966492    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl"
Jul 09 22:24:27.925287 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:27.925254    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl"
Jul 09 22:24:27.926352 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:27.926334    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl"
Jul 09 22:24:40.991374 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:40.991340    2576 generic.go:356] "Generic (PLEG): container finished" podID="b3b198e2-98d7-47f4-a4c4-7eb370970e04" containerID="45a37805bd5a6fb468f4e8102d4a309ab57ad694a8dc80a253fc467e8ddf0633" exitCode=0
Jul 09 22:24:40.991856 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:40.991386    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl" event={"ID":"b3b198e2-98d7-47f4-a4c4-7eb370970e04","Type":"ContainerDied","Data":"45a37805bd5a6fb468f4e8102d4a309ab57ad694a8dc80a253fc467e8ddf0633"}
Jul 09 22:24:40.991856 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:40.991745    2576 scope.go:117] "RemoveContainer" containerID="45a37805bd5a6fb468f4e8102d4a309ab57ad694a8dc80a253fc467e8ddf0633"
Jul 09 22:24:40.992792 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:40.992756    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:24:40.992872 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:40.992830    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:24:40.992872 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:40.992862    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:24:41.998172 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:41.998140    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl" event={"ID":"b3b198e2-98d7-47f4-a4c4-7eb370970e04","Type":"ContainerStarted","Data":"be996956ae6b3507fbbdd77ea94d1df99aacced799c6efa5dbe7a4170fd71493"}
Jul 09 22:24:42.926038 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:42.925997    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl"
Jul 09 22:24:42.961252 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:42.961218    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl"
Jul 09 22:24:42.962333 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:42.962302    2576 patch_prober.go:28] interesting pod/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 09 22:24:42.962474 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:42.962370    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl" podUID="b3b198e2-98d7-47f4-a4c4-7eb370970e04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 09 22:24:43.127547 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:43.127492    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-f4b46590/e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5"]
Jul 09 22:24:43.130228 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:43.130208    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f4b46590/e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5"
Jul 09 22:24:43.133394 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:43.133324    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-f4b46590\"/\"kube-root-ca.crt\""
Jul 09 22:24:43.133394 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:43.133353    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-f4b46590\"/\"default-dockercfg-vcsph\""
Jul 09 22:24:43.134400 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:43.134381    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-f4b46590\"/\"openshift-service-ca.crt\""
Jul 09 22:24:43.135249 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:43.134510    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-f4b46590\"/\"e2e-lifecycle-model-f4b46590-kserve-self-signed-certs\""
Jul 09 22:24:43.147544 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:43.147511    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-f4b46590/e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5"]
Jul 09 22:24:43.222210 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:43.222126    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9chs\" (UniqueName: \"kubernetes.io/projected/b35a195b-e727-43f0-901a-378a2561bcda-kube-api-access-d9chs\") pod \"e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5\" (UID: \"b35a195b-e727-43f0-901a-378a2561bcda\") " pod="ai-tenant-e2e-mt-f4b46590/e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5"
Jul 09 22:24:43.222210 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:43.222160    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b35a195b-e727-43f0-901a-378a2561bcda-tls-certs\") pod \"e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5\" (UID: \"b35a195b-e727-43f0-901a-378a2561bcda\") " pod="ai-tenant-e2e-mt-f4b46590/e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5"
Jul 09 22:24:43.222210 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:43.222181    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b35a195b-e727-43f0-901a-378a2561bcda-home\") pod \"e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5\" (UID: \"b35a195b-e727-43f0-901a-378a2561bcda\") " pod="ai-tenant-e2e-mt-f4b46590/e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5"
Jul 09 22:24:43.222210 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:43.222204    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b35a195b-e727-43f0-901a-378a2561bcda-model-cache\") pod \"e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5\" (UID: \"b35a195b-e727-43f0-901a-378a2561bcda\") " pod="ai-tenant-e2e-mt-f4b46590/e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5"
Jul 09 22:24:43.222456 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:43.222275    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b35a195b-e727-43f0-901a-378a2561bcda-tmp-dir\") pod \"e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5\" (UID: \"b35a195b-e727-43f0-901a-378a2561bcda\") " pod="ai-tenant-e2e-mt-f4b46590/e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5"
Jul 09 22:24:43.222456 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:43.222323    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b35a195b-e727-43f0-901a-378a2561bcda-dshm\") pod \"e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5\" (UID: \"b35a195b-e727-43f0-901a-378a2561bcda\") " pod="ai-tenant-e2e-mt-f4b46590/e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5"
Jul 09 22:24:43.323233 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:43.323196    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9chs\" (UniqueName: \"kubernetes.io/projected/b35a195b-e727-43f0-901a-378a2561bcda-kube-api-access-d9chs\") pod \"e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5\" (UID: \"b35a195b-e727-43f0-901a-378a2561bcda\") " pod="ai-tenant-e2e-mt-f4b46590/e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5"
Jul 09 22:24:43.323233 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:43.323235    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b35a195b-e727-43f0-901a-378a2561bcda-tls-certs\") pod \"e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5\" (UID: \"b35a195b-e727-43f0-901a-378a2561bcda\") " pod="ai-tenant-e2e-mt-f4b46590/e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5"
Jul 09 22:24:43.323466 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:43.323256    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b35a195b-e727-43f0-901a-378a2561bcda-home\") pod \"e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5\" (UID: \"b35a195b-e727-43f0-901a-378a2561bcda\") " pod="ai-tenant-e2e-mt-f4b46590/e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5"
Jul 09 22:24:43.323466 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:43.323285    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b35a195b-e727-43f0-901a-378a2561bcda-model-cache\") pod \"e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5\" (UID: \"b35a195b-e727-43f0-901a-378a2561bcda\") " pod="ai-tenant-e2e-mt-f4b46590/e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5"
Jul 09 22:24:43.323466 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:43.323356    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b35a195b-e727-43f0-901a-378a2561bcda-tmp-dir\") pod \"e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5\" (UID: \"b35a195b-e727-43f0-901a-378a2561bcda\") " pod="ai-tenant-e2e-mt-f4b46590/e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5"
Jul 09 22:24:43.323466 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:43.323385    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b35a195b-e727-43f0-901a-378a2561bcda-dshm\") pod \"e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5\" (UID: \"b35a195b-e727-43f0-901a-378a2561bcda\") " pod="ai-tenant-e2e-mt-f4b46590/e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5"
Jul 09 22:24:43.323690 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:43.323660    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b35a195b-e727-43f0-901a-378a2561bcda-home\") pod \"e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5\" (UID: \"b35a195b-e727-43f0-901a-378a2561bcda\") " pod="ai-tenant-e2e-mt-f4b46590/e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5"
Jul 09 22:24:43.323759 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:43.323727    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b35a195b-e727-43f0-901a-378a2561bcda-model-cache\") pod \"e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5\" (UID: \"b35a195b-e727-43f0-901a-378a2561bcda\") " pod="ai-tenant-e2e-mt-f4b46590/e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5"
Jul 09 22:24:43.323846 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:43.323825    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b35a195b-e727-43f0-901a-378a2561bcda-tmp-dir\") pod \"e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5\" (UID: \"b35a195b-e727-43f0-901a-378a2561bcda\") " pod="ai-tenant-e2e-mt-f4b46590/e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5"
Jul 09 22:24:43.325578 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:43.325559    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b35a195b-e727-43f0-901a-378a2561bcda-dshm\") pod \"e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5\" (UID: \"b35a195b-e727-43f0-901a-378a2561bcda\") " pod="ai-tenant-e2e-mt-f4b46590/e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5"
Jul 09 22:24:43.325845 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:43.325826    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b35a195b-e727-43f0-901a-378a2561bcda-tls-certs\") pod \"e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5\" (UID: \"b35a195b-e727-43f0-901a-378a2561bcda\") " pod="ai-tenant-e2e-mt-f4b46590/e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5"
Jul 09 22:24:43.333148 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:43.333118    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9chs\" (UniqueName: \"kubernetes.io/projected/b35a195b-e727-43f0-901a-378a2561bcda-kube-api-access-d9chs\") pod \"e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5\" (UID: \"b35a195b-e727-43f0-901a-378a2561bcda\") " pod="ai-tenant-e2e-mt-f4b46590/e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5"
Jul 09 22:24:43.443217 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:43.443180    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f4b46590/e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5"
Jul 09 22:24:43.619213 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:43.619164    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-f4b46590/e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5"]
Jul 09 22:24:43.621910 ip-10-0-141-101 kubenswrapper[2576]: W0709 22:24:43.621888    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb35a195b_e727_43f0_901a_378a2561bcda.slice/crio-24c2284174637f3bae6e2d42184ff23dca47ed23974b0ab4a411e19cdb832e50 WatchSource:0}: Error finding container 24c2284174637f3bae6e2d42184ff23dca47ed23974b0ab4a411e19cdb832e50: Status 404 returned error can't find the container with id 24c2284174637f3bae6e2d42184ff23dca47ed23974b0ab4a411e19cdb832e50
Jul 09 22:24:43.961884 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:43.961849    2576 patch_prober.go:28] interesting pod/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 09 22:24:43.962093 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:43.961907    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl" podUID="b3b198e2-98d7-47f4-a4c4-7eb370970e04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 09 22:24:44.009470 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:44.009430    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f4b46590/e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5" event={"ID":"b35a195b-e727-43f0-901a-378a2561bcda","Type":"ContainerStarted","Data":"e0f724ffb2aaaf94a2d12441b9b746aa1e2709b576fec646080efea30f46e57f"}
Jul 09 22:24:44.009656 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:44.009480    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f4b46590/e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5" event={"ID":"b35a195b-e727-43f0-901a-378a2561bcda","Type":"ContainerStarted","Data":"24c2284174637f3bae6e2d42184ff23dca47ed23974b0ab4a411e19cdb832e50"}
Jul 09 22:24:44.035220 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:44.035155    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-f4b46590/e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5" podStartSLOduration=1.035134502 podStartE2EDuration="1.035134502s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:24:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:24:44.032661682 +0000 UTC m=+2031.364161761" watchObservedRunningTime="2026-07-09 22:24:44.035134502 +0000 UTC m=+2031.366634581"
Jul 09 22:24:44.961875 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:44.961836    2576 patch_prober.go:28] interesting pod/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 09 22:24:44.962301 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:44.961894    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl" podUID="b3b198e2-98d7-47f4-a4c4-7eb370970e04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 09 22:24:45.961202 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:45.961156    2576 patch_prober.go:28] interesting pod/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 09 22:24:45.961369 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:45.961242    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl" podUID="b3b198e2-98d7-47f4-a4c4-7eb370970e04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 09 22:24:46.965813 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:46.965782    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl"
Jul 09 22:24:46.966947 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:46.966925    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl"
Jul 09 22:24:53.443948 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:53.443914    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-f4b46590/e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5"
Jul 09 22:24:53.444341 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:53.443983    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-f4b46590/e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5"
Jul 09 22:24:53.456414 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:53.456383    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-f4b46590/e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5"
Jul 09 22:24:54.070029 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:24:54.069999    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-f4b46590/e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5"
Jul 09 22:25:26.254837 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:26.254762    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-f4b46590/e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5"]
Jul 09 22:25:41.274903 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:41.274843    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-f4b46590/e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5" podUID="b35a195b-e727-43f0-901a-378a2561bcda" containerName="main" containerID="cri-o://e0f724ffb2aaaf94a2d12441b9b746aa1e2709b576fec646080efea30f46e57f" gracePeriod=45
Jul 09 22:25:41.513403 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:41.513377    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f4b46590/e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5"
Jul 09 22:25:41.604813 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:41.604734    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b35a195b-e727-43f0-901a-378a2561bcda-tls-certs\") pod \"b35a195b-e727-43f0-901a-378a2561bcda\" (UID: \"b35a195b-e727-43f0-901a-378a2561bcda\") "
Jul 09 22:25:41.604813 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:41.604772    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b35a195b-e727-43f0-901a-378a2561bcda-tmp-dir\") pod \"b35a195b-e727-43f0-901a-378a2561bcda\" (UID: \"b35a195b-e727-43f0-901a-378a2561bcda\") "
Jul 09 22:25:41.604813 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:41.604790    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b35a195b-e727-43f0-901a-378a2561bcda-dshm\") pod \"b35a195b-e727-43f0-901a-378a2561bcda\" (UID: \"b35a195b-e727-43f0-901a-378a2561bcda\") "
Jul 09 22:25:41.605116 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:41.604832    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b35a195b-e727-43f0-901a-378a2561bcda-home\") pod \"b35a195b-e727-43f0-901a-378a2561bcda\" (UID: \"b35a195b-e727-43f0-901a-378a2561bcda\") "
Jul 09 22:25:41.605116 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:41.604884    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b35a195b-e727-43f0-901a-378a2561bcda-model-cache\") pod \"b35a195b-e727-43f0-901a-378a2561bcda\" (UID: \"b35a195b-e727-43f0-901a-378a2561bcda\") "
Jul 09 22:25:41.605116 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:41.604935    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9chs\" (UniqueName: \"kubernetes.io/projected/b35a195b-e727-43f0-901a-378a2561bcda-kube-api-access-d9chs\") pod \"b35a195b-e727-43f0-901a-378a2561bcda\" (UID: \"b35a195b-e727-43f0-901a-378a2561bcda\") "
Jul 09 22:25:41.605116 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:41.605064    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b35a195b-e727-43f0-901a-378a2561bcda-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b35a195b-e727-43f0-901a-378a2561bcda" (UID: "b35a195b-e727-43f0-901a-378a2561bcda"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:25:41.605324 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:41.605157    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b35a195b-e727-43f0-901a-378a2561bcda-home" (OuterVolumeSpecName: "home") pod "b35a195b-e727-43f0-901a-378a2561bcda" (UID: "b35a195b-e727-43f0-901a-378a2561bcda"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:25:41.605324 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:41.605186    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b35a195b-e727-43f0-901a-378a2561bcda-model-cache" (OuterVolumeSpecName: "model-cache") pod "b35a195b-e727-43f0-901a-378a2561bcda" (UID: "b35a195b-e727-43f0-901a-378a2561bcda"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:25:41.605324 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:41.605282    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b35a195b-e727-43f0-901a-378a2561bcda-tmp-dir\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:25:41.605324 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:41.605299    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b35a195b-e727-43f0-901a-378a2561bcda-home\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:25:41.605324 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:41.605310    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b35a195b-e727-43f0-901a-378a2561bcda-model-cache\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:25:41.607023 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:41.606994    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b35a195b-e727-43f0-901a-378a2561bcda-dshm" (OuterVolumeSpecName: "dshm") pod "b35a195b-e727-43f0-901a-378a2561bcda" (UID: "b35a195b-e727-43f0-901a-378a2561bcda"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:25:41.607023 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:41.607005    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b35a195b-e727-43f0-901a-378a2561bcda-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b35a195b-e727-43f0-901a-378a2561bcda" (UID: "b35a195b-e727-43f0-901a-378a2561bcda"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:25:41.607194 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:41.607133    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b35a195b-e727-43f0-901a-378a2561bcda-kube-api-access-d9chs" (OuterVolumeSpecName: "kube-api-access-d9chs") pod "b35a195b-e727-43f0-901a-378a2561bcda" (UID: "b35a195b-e727-43f0-901a-378a2561bcda"). InnerVolumeSpecName "kube-api-access-d9chs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:25:41.706358 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:41.706301    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b35a195b-e727-43f0-901a-378a2561bcda-tls-certs\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:25:41.706358 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:41.706325    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b35a195b-e727-43f0-901a-378a2561bcda-dshm\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:25:41.706358 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:41.706334    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9chs\" (UniqueName: \"kubernetes.io/projected/b35a195b-e727-43f0-901a-378a2561bcda-kube-api-access-d9chs\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:25:42.272377 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:42.272342    2576 generic.go:356] "Generic (PLEG): container finished" podID="b35a195b-e727-43f0-901a-378a2561bcda" containerID="e0f724ffb2aaaf94a2d12441b9b746aa1e2709b576fec646080efea30f46e57f" exitCode=0
Jul 09 22:25:42.272377 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:42.272383    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f4b46590/e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5"
Jul 09 22:25:42.272653 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:42.272409    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f4b46590/e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5" event={"ID":"b35a195b-e727-43f0-901a-378a2561bcda","Type":"ContainerDied","Data":"e0f724ffb2aaaf94a2d12441b9b746aa1e2709b576fec646080efea30f46e57f"}
Jul 09 22:25:42.272653 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:42.272455    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f4b46590/e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5" event={"ID":"b35a195b-e727-43f0-901a-378a2561bcda","Type":"ContainerDied","Data":"24c2284174637f3bae6e2d42184ff23dca47ed23974b0ab4a411e19cdb832e50"}
Jul 09 22:25:42.272653 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:42.272476    2576 scope.go:117] "RemoveContainer" containerID="e0f724ffb2aaaf94a2d12441b9b746aa1e2709b576fec646080efea30f46e57f"
Jul 09 22:25:42.282457 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:42.282277    2576 scope.go:117] "RemoveContainer" containerID="e0f724ffb2aaaf94a2d12441b9b746aa1e2709b576fec646080efea30f46e57f"
Jul 09 22:25:42.282684 ip-10-0-141-101 kubenswrapper[2576]: E0709 22:25:42.282551    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0f724ffb2aaaf94a2d12441b9b746aa1e2709b576fec646080efea30f46e57f\": container with ID starting with e0f724ffb2aaaf94a2d12441b9b746aa1e2709b576fec646080efea30f46e57f not found: ID does not exist" containerID="e0f724ffb2aaaf94a2d12441b9b746aa1e2709b576fec646080efea30f46e57f"
Jul 09 22:25:42.282684 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:42.282585    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0f724ffb2aaaf94a2d12441b9b746aa1e2709b576fec646080efea30f46e57f"} err="failed to get container status \"e0f724ffb2aaaf94a2d12441b9b746aa1e2709b576fec646080efea30f46e57f\": rpc error: code = NotFound desc = could not find container \"e0f724ffb2aaaf94a2d12441b9b746aa1e2709b576fec646080efea30f46e57f\": container with ID starting with e0f724ffb2aaaf94a2d12441b9b746aa1e2709b576fec646080efea30f46e57f not found: ID does not exist"
Jul 09 22:25:42.296897 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:42.296824    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-f4b46590/e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5"]
Jul 09 22:25:42.304563 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:42.304542    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-f4b46590/e2e-lifecycle-model-f4b46590-kserve-7695568db7-pbqp5"]
Jul 09 22:25:43.201085 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:43.201058    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b35a195b-e727-43f0-901a-378a2561bcda" path="/var/lib/kubelet/pods/b35a195b-e727-43f0-901a-378a2561bcda/volumes"
Jul 09 22:25:53.264601 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:53.264553    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27vrn_10510741-9c12-4044-ac11-97958aa1fc35/ovn-acl-logging/0.log"
Jul 09 22:25:53.268728 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:53.268710    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27vrn_10510741-9c12-4044-ac11-97958aa1fc35/ovn-acl-logging/0.log"
Jul 09 22:25:53.990838 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:53.990805    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl"]
Jul 09 22:25:53.991040 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:53.991015    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl" podUID="b3b198e2-98d7-47f4-a4c4-7eb370970e04" containerName="istio-proxy" containerID="cri-o://be996956ae6b3507fbbdd77ea94d1df99aacced799c6efa5dbe7a4170fd71493" gracePeriod=30
Jul 09 22:25:59.248139 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:59.248116    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl"
Jul 09 22:25:59.346509 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:59.346483    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3b198e2-98d7-47f4-a4c4-7eb370970e04-istiod-ca-cert\") pod \"b3b198e2-98d7-47f4-a4c4-7eb370970e04\" (UID: \"b3b198e2-98d7-47f4-a4c4-7eb370970e04\") "
Jul 09 22:25:59.346647 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:59.346521    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9tz5\" (UniqueName: \"kubernetes.io/projected/b3b198e2-98d7-47f4-a4c4-7eb370970e04-kube-api-access-t9tz5\") pod \"b3b198e2-98d7-47f4-a4c4-7eb370970e04\" (UID: \"b3b198e2-98d7-47f4-a4c4-7eb370970e04\") "
Jul 09 22:25:59.346647 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:59.346548    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3b198e2-98d7-47f4-a4c4-7eb370970e04-credential-socket\") pod \"b3b198e2-98d7-47f4-a4c4-7eb370970e04\" (UID: \"b3b198e2-98d7-47f4-a4c4-7eb370970e04\") "
Jul 09 22:25:59.346772 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:59.346687    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3b198e2-98d7-47f4-a4c4-7eb370970e04-istio-envoy\") pod \"b3b198e2-98d7-47f4-a4c4-7eb370970e04\" (UID: \"b3b198e2-98d7-47f4-a4c4-7eb370970e04\") "
Jul 09 22:25:59.346772 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:59.346732    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3b198e2-98d7-47f4-a4c4-7eb370970e04-istio-podinfo\") pod \"b3b198e2-98d7-47f4-a4c4-7eb370970e04\" (UID: \"b3b198e2-98d7-47f4-a4c4-7eb370970e04\") "
Jul 09 22:25:59.346772 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:59.346760    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3b198e2-98d7-47f4-a4c4-7eb370970e04-workload-socket\") pod \"b3b198e2-98d7-47f4-a4c4-7eb370970e04\" (UID: \"b3b198e2-98d7-47f4-a4c4-7eb370970e04\") "
Jul 09 22:25:59.346772 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:59.346768    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3b198e2-98d7-47f4-a4c4-7eb370970e04-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b3b198e2-98d7-47f4-a4c4-7eb370970e04" (UID: "b3b198e2-98d7-47f4-a4c4-7eb370970e04"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:25:59.347000 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:59.346835    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3b198e2-98d7-47f4-a4c4-7eb370970e04-istio-token\") pod \"b3b198e2-98d7-47f4-a4c4-7eb370970e04\" (UID: \"b3b198e2-98d7-47f4-a4c4-7eb370970e04\") "
Jul 09 22:25:59.347000 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:59.346859    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3b198e2-98d7-47f4-a4c4-7eb370970e04-workload-certs\") pod \"b3b198e2-98d7-47f4-a4c4-7eb370970e04\" (UID: \"b3b198e2-98d7-47f4-a4c4-7eb370970e04\") "
Jul 09 22:25:59.347000 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:59.346890    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3b198e2-98d7-47f4-a4c4-7eb370970e04-istio-data\") pod \"b3b198e2-98d7-47f4-a4c4-7eb370970e04\" (UID: \"b3b198e2-98d7-47f4-a4c4-7eb370970e04\") "
Jul 09 22:25:59.347145 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:59.346856    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3b198e2-98d7-47f4-a4c4-7eb370970e04-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b3b198e2-98d7-47f4-a4c4-7eb370970e04" (UID: "b3b198e2-98d7-47f4-a4c4-7eb370970e04"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:25:59.347145 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:59.347051    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3b198e2-98d7-47f4-a4c4-7eb370970e04-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b3b198e2-98d7-47f4-a4c4-7eb370970e04" (UID: "b3b198e2-98d7-47f4-a4c4-7eb370970e04"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:25:59.347145 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:59.347125    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3b198e2-98d7-47f4-a4c4-7eb370970e04-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b3b198e2-98d7-47f4-a4c4-7eb370970e04" (UID: "b3b198e2-98d7-47f4-a4c4-7eb370970e04"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:25:59.347298 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:59.347247    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3b198e2-98d7-47f4-a4c4-7eb370970e04-istiod-ca-cert\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:25:59.347298 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:59.347267    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3b198e2-98d7-47f4-a4c4-7eb370970e04-credential-socket\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:25:59.347298 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:59.347281    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3b198e2-98d7-47f4-a4c4-7eb370970e04-workload-socket\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:25:59.347298 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:59.347295    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3b198e2-98d7-47f4-a4c4-7eb370970e04-workload-certs\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:25:59.347846 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:59.347820    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3b198e2-98d7-47f4-a4c4-7eb370970e04-istio-data" (OuterVolumeSpecName: "istio-data") pod "b3b198e2-98d7-47f4-a4c4-7eb370970e04" (UID: "b3b198e2-98d7-47f4-a4c4-7eb370970e04"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:25:59.348709 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:59.348681    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3b198e2-98d7-47f4-a4c4-7eb370970e04-kube-api-access-t9tz5" (OuterVolumeSpecName: "kube-api-access-t9tz5") pod "b3b198e2-98d7-47f4-a4c4-7eb370970e04" (UID: "b3b198e2-98d7-47f4-a4c4-7eb370970e04"). InnerVolumeSpecName "kube-api-access-t9tz5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:25:59.348795 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:59.348723    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3b198e2-98d7-47f4-a4c4-7eb370970e04-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b3b198e2-98d7-47f4-a4c4-7eb370970e04" (UID: "b3b198e2-98d7-47f4-a4c4-7eb370970e04"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:25:59.348929 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:59.348910    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b3b198e2-98d7-47f4-a4c4-7eb370970e04-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b3b198e2-98d7-47f4-a4c4-7eb370970e04" (UID: "b3b198e2-98d7-47f4-a4c4-7eb370970e04"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 22:25:59.349028 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:59.348995    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3b198e2-98d7-47f4-a4c4-7eb370970e04-istio-token" (OuterVolumeSpecName: "istio-token") pod "b3b198e2-98d7-47f4-a4c4-7eb370970e04" (UID: "b3b198e2-98d7-47f4-a4c4-7eb370970e04"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:25:59.355724 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:59.355700    2576 generic.go:356] "Generic (PLEG): container finished" podID="b3b198e2-98d7-47f4-a4c4-7eb370970e04" containerID="be996956ae6b3507fbbdd77ea94d1df99aacced799c6efa5dbe7a4170fd71493" exitCode=0
Jul 09 22:25:59.355830 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:59.355756    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl"
Jul 09 22:25:59.355830 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:59.355784    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl" event={"ID":"b3b198e2-98d7-47f4-a4c4-7eb370970e04","Type":"ContainerDied","Data":"be996956ae6b3507fbbdd77ea94d1df99aacced799c6efa5dbe7a4170fd71493"}
Jul 09 22:25:59.355909 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:59.355836    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl" event={"ID":"b3b198e2-98d7-47f4-a4c4-7eb370970e04","Type":"ContainerDied","Data":"e9533d1ee7b33363f47773c5f20ea4df80eefc081de00dbee623abafb35d426d"}
Jul 09 22:25:59.355909 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:59.355867    2576 scope.go:117] "RemoveContainer" containerID="be996956ae6b3507fbbdd77ea94d1df99aacced799c6efa5dbe7a4170fd71493"
Jul 09 22:25:59.367106 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:59.367089    2576 scope.go:117] "RemoveContainer" containerID="45a37805bd5a6fb468f4e8102d4a309ab57ad694a8dc80a253fc467e8ddf0633"
Jul 09 22:25:59.374860 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:59.374846    2576 scope.go:117] "RemoveContainer" containerID="be996956ae6b3507fbbdd77ea94d1df99aacced799c6efa5dbe7a4170fd71493"
Jul 09 22:25:59.375205 ip-10-0-141-101 kubenswrapper[2576]: E0709 22:25:59.375179    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be996956ae6b3507fbbdd77ea94d1df99aacced799c6efa5dbe7a4170fd71493\": container with ID starting with be996956ae6b3507fbbdd77ea94d1df99aacced799c6efa5dbe7a4170fd71493 not found: ID does not exist" containerID="be996956ae6b3507fbbdd77ea94d1df99aacced799c6efa5dbe7a4170fd71493"
Jul 09 22:25:59.375293 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:59.375214    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be996956ae6b3507fbbdd77ea94d1df99aacced799c6efa5dbe7a4170fd71493"} err="failed to get container status \"be996956ae6b3507fbbdd77ea94d1df99aacced799c6efa5dbe7a4170fd71493\": rpc error: code = NotFound desc = could not find container \"be996956ae6b3507fbbdd77ea94d1df99aacced799c6efa5dbe7a4170fd71493\": container with ID starting with be996956ae6b3507fbbdd77ea94d1df99aacced799c6efa5dbe7a4170fd71493 not found: ID does not exist"
Jul 09 22:25:59.375293 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:59.375232    2576 scope.go:117] "RemoveContainer" containerID="45a37805bd5a6fb468f4e8102d4a309ab57ad694a8dc80a253fc467e8ddf0633"
Jul 09 22:25:59.375532 ip-10-0-141-101 kubenswrapper[2576]: E0709 22:25:59.375506    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45a37805bd5a6fb468f4e8102d4a309ab57ad694a8dc80a253fc467e8ddf0633\": container with ID starting with 45a37805bd5a6fb468f4e8102d4a309ab57ad694a8dc80a253fc467e8ddf0633 not found: ID does not exist" containerID="45a37805bd5a6fb468f4e8102d4a309ab57ad694a8dc80a253fc467e8ddf0633"
Jul 09 22:25:59.375597 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:59.375542    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45a37805bd5a6fb468f4e8102d4a309ab57ad694a8dc80a253fc467e8ddf0633"} err="failed to get container status \"45a37805bd5a6fb468f4e8102d4a309ab57ad694a8dc80a253fc467e8ddf0633\": rpc error: code = NotFound desc = could not find container \"45a37805bd5a6fb468f4e8102d4a309ab57ad694a8dc80a253fc467e8ddf0633\": container with ID starting with 45a37805bd5a6fb468f4e8102d4a309ab57ad694a8dc80a253fc467e8ddf0633 not found: ID does not exist"
Jul 09 22:25:59.378559 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:59.378540    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl"]
Jul 09 22:25:59.384935 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:59.384916    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-f4b46590-openshift-default-5f5879bdd7-t42bl"]
Jul 09 22:25:59.448403 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:59.448383    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3b198e2-98d7-47f4-a4c4-7eb370970e04-istio-envoy\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:25:59.448403 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:59.448401    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3b198e2-98d7-47f4-a4c4-7eb370970e04-istio-podinfo\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:25:59.448519 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:59.448409    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3b198e2-98d7-47f4-a4c4-7eb370970e04-istio-token\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:25:59.448519 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:59.448417    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3b198e2-98d7-47f4-a4c4-7eb370970e04-istio-data\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:25:59.448519 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:25:59.448426    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9tz5\" (UniqueName: \"kubernetes.io/projected/b3b198e2-98d7-47f4-a4c4-7eb370970e04-kube-api-access-t9tz5\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:26:01.199765 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:01.199737    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3b198e2-98d7-47f4-a4c4-7eb370970e04" path="/var/lib/kubelet/pods/b3b198e2-98d7-47f4-a4c4-7eb370970e04/volumes"
Jul 09 22:26:49.321417 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:49.321337    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z"]
Jul 09 22:26:49.321830 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:49.321657    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b35a195b-e727-43f0-901a-378a2561bcda" containerName="main"
Jul 09 22:26:49.321830 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:49.321668    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b35a195b-e727-43f0-901a-378a2561bcda" containerName="main"
Jul 09 22:26:49.321830 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:49.321678    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3b198e2-98d7-47f4-a4c4-7eb370970e04" containerName="istio-proxy"
Jul 09 22:26:49.321830 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:49.321684    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3b198e2-98d7-47f4-a4c4-7eb370970e04" containerName="istio-proxy"
Jul 09 22:26:49.321830 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:49.321751    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b35a195b-e727-43f0-901a-378a2561bcda" containerName="main"
Jul 09 22:26:49.321830 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:49.321761    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3b198e2-98d7-47f4-a4c4-7eb370970e04" containerName="istio-proxy"
Jul 09 22:26:49.321830 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:49.321769    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3b198e2-98d7-47f4-a4c4-7eb370970e04" containerName="istio-proxy"
Jul 09 22:26:49.324800 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:49.324783    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z"
Jul 09 22:26:49.327581 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:49.327560    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-55e48b-openshift-default-dockercfg-xwjk6\""
Jul 09 22:26:49.337841 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:49.337817    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z"]
Jul 09 22:26:49.428041 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:49.428007    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/241d0668-4068-415b-bbc7-da597e3abaff-istio-token\") pod \"e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z\" (UID: \"241d0668-4068-415b-bbc7-da597e3abaff\") " pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z"
Jul 09 22:26:49.428211 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:49.428066    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/241d0668-4068-415b-bbc7-da597e3abaff-workload-certs\") pod \"e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z\" (UID: \"241d0668-4068-415b-bbc7-da597e3abaff\") " pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z"
Jul 09 22:26:49.428211 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:49.428089    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwrx2\" (UniqueName: \"kubernetes.io/projected/241d0668-4068-415b-bbc7-da597e3abaff-kube-api-access-xwrx2\") pod \"e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z\" (UID: \"241d0668-4068-415b-bbc7-da597e3abaff\") " pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z"
Jul 09 22:26:49.428211 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:49.428125    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/241d0668-4068-415b-bbc7-da597e3abaff-istio-podinfo\") pod \"e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z\" (UID: \"241d0668-4068-415b-bbc7-da597e3abaff\") " pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z"
Jul 09 22:26:49.428211 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:49.428172    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/241d0668-4068-415b-bbc7-da597e3abaff-istio-envoy\") pod \"e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z\" (UID: \"241d0668-4068-415b-bbc7-da597e3abaff\") " pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z"
Jul 09 22:26:49.428211 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:49.428202    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/241d0668-4068-415b-bbc7-da597e3abaff-istio-data\") pod \"e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z\" (UID: \"241d0668-4068-415b-bbc7-da597e3abaff\") " pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z"
Jul 09 22:26:49.428446 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:49.428272    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/241d0668-4068-415b-bbc7-da597e3abaff-credential-socket\") pod \"e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z\" (UID: \"241d0668-4068-415b-bbc7-da597e3abaff\") " pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z"
Jul 09 22:26:49.428446 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:49.428320    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/241d0668-4068-415b-bbc7-da597e3abaff-istiod-ca-cert\") pod \"e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z\" (UID: \"241d0668-4068-415b-bbc7-da597e3abaff\") " pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z"
Jul 09 22:26:49.428446 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:49.428340    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/241d0668-4068-415b-bbc7-da597e3abaff-workload-socket\") pod \"e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z\" (UID: \"241d0668-4068-415b-bbc7-da597e3abaff\") " pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z"
Jul 09 22:26:49.529571 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:49.529539    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/241d0668-4068-415b-bbc7-da597e3abaff-istio-data\") pod \"e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z\" (UID: \"241d0668-4068-415b-bbc7-da597e3abaff\") " pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z"
Jul 09 22:26:49.529736 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:49.529577    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/241d0668-4068-415b-bbc7-da597e3abaff-credential-socket\") pod \"e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z\" (UID: \"241d0668-4068-415b-bbc7-da597e3abaff\") " pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z"
Jul 09 22:26:49.529736 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:49.529600    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/241d0668-4068-415b-bbc7-da597e3abaff-istiod-ca-cert\") pod \"e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z\" (UID: \"241d0668-4068-415b-bbc7-da597e3abaff\") " pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z"
Jul 09 22:26:49.529736 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:49.529624    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/241d0668-4068-415b-bbc7-da597e3abaff-workload-socket\") pod \"e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z\" (UID: \"241d0668-4068-415b-bbc7-da597e3abaff\") " pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z"
Jul 09 22:26:49.529736 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:49.529649    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/241d0668-4068-415b-bbc7-da597e3abaff-istio-token\") pod \"e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z\" (UID: \"241d0668-4068-415b-bbc7-da597e3abaff\") " pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z"
Jul 09 22:26:49.529736 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:49.529681    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/241d0668-4068-415b-bbc7-da597e3abaff-workload-certs\") pod \"e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z\" (UID: \"241d0668-4068-415b-bbc7-da597e3abaff\") " pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z"
Jul 09 22:26:49.529736 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:49.529699    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwrx2\" (UniqueName: \"kubernetes.io/projected/241d0668-4068-415b-bbc7-da597e3abaff-kube-api-access-xwrx2\") pod \"e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z\" (UID: \"241d0668-4068-415b-bbc7-da597e3abaff\") " pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z"
Jul 09 22:26:49.529736 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:49.529720    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/241d0668-4068-415b-bbc7-da597e3abaff-istio-podinfo\") pod \"e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z\" (UID: \"241d0668-4068-415b-bbc7-da597e3abaff\") " pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z"
Jul 09 22:26:49.530139 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:49.529761    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/241d0668-4068-415b-bbc7-da597e3abaff-istio-envoy\") pod \"e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z\" (UID: \"241d0668-4068-415b-bbc7-da597e3abaff\") " pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z"
Jul 09 22:26:49.530139 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:49.530019    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/241d0668-4068-415b-bbc7-da597e3abaff-istio-data\") pod \"e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z\" (UID: \"241d0668-4068-415b-bbc7-da597e3abaff\") " pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z"
Jul 09 22:26:49.530233 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:49.530159    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/241d0668-4068-415b-bbc7-da597e3abaff-credential-socket\") pod \"e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z\" (UID: \"241d0668-4068-415b-bbc7-da597e3abaff\") " pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z"
Jul 09 22:26:49.530284 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:49.530239    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/241d0668-4068-415b-bbc7-da597e3abaff-workload-socket\") pod \"e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z\" (UID: \"241d0668-4068-415b-bbc7-da597e3abaff\") " pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z"
Jul 09 22:26:49.530323 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:49.530282    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/241d0668-4068-415b-bbc7-da597e3abaff-workload-certs\") pod \"e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z\" (UID: \"241d0668-4068-415b-bbc7-da597e3abaff\") " pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z"
Jul 09 22:26:49.530505 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:49.530485    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/241d0668-4068-415b-bbc7-da597e3abaff-istiod-ca-cert\") pod \"e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z\" (UID: \"241d0668-4068-415b-bbc7-da597e3abaff\") " pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z"
Jul 09 22:26:49.532136 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:49.532113    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/241d0668-4068-415b-bbc7-da597e3abaff-istio-envoy\") pod \"e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z\" (UID: \"241d0668-4068-415b-bbc7-da597e3abaff\") " pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z"
Jul 09 22:26:49.532341 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:49.532324    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/241d0668-4068-415b-bbc7-da597e3abaff-istio-podinfo\") pod \"e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z\" (UID: \"241d0668-4068-415b-bbc7-da597e3abaff\") " pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z"
Jul 09 22:26:49.539103 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:49.539079    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwrx2\" (UniqueName: \"kubernetes.io/projected/241d0668-4068-415b-bbc7-da597e3abaff-kube-api-access-xwrx2\") pod \"e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z\" (UID: \"241d0668-4068-415b-bbc7-da597e3abaff\") " pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z"
Jul 09 22:26:49.539191 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:49.539176    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/241d0668-4068-415b-bbc7-da597e3abaff-istio-token\") pod \"e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z\" (UID: \"241d0668-4068-415b-bbc7-da597e3abaff\") " pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z"
Jul 09 22:26:49.634805 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:49.634723    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z"
Jul 09 22:26:49.773321 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:49.773297    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z"]
Jul 09 22:26:49.775588 ip-10-0-141-101 kubenswrapper[2576]: W0709 22:26:49.775563    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod241d0668_4068_415b_bbc7_da597e3abaff.slice/crio-2d72676c38e1d5910dc3880f9e70e71cb932ef268ef493928f0e998c2a79ca08 WatchSource:0}: Error finding container 2d72676c38e1d5910dc3880f9e70e71cb932ef268ef493928f0e998c2a79ca08: Status 404 returned error can't find the container with id 2d72676c38e1d5910dc3880f9e70e71cb932ef268ef493928f0e998c2a79ca08
Jul 09 22:26:49.777641 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:49.777611    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:26:49.777709 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:49.777670    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:26:49.777709 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:49.777698    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:26:50.592782 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:50.592742    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z" event={"ID":"241d0668-4068-415b-bbc7-da597e3abaff","Type":"ContainerStarted","Data":"45d0bec28efc19faf4b3b46b5715b4c1069a6b7b046c4ca71fda158b008c2b38"}
Jul 09 22:26:50.593169 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:50.592845    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z" event={"ID":"241d0668-4068-415b-bbc7-da597e3abaff","Type":"ContainerStarted","Data":"2d72676c38e1d5910dc3880f9e70e71cb932ef268ef493928f0e998c2a79ca08"}
Jul 09 22:26:50.614899 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:50.614854    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z" podStartSLOduration=1.614839584 podStartE2EDuration="1.614839584s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:26:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:26:50.613714483 +0000 UTC m=+2157.945214563" watchObservedRunningTime="2026-07-09 22:26:50.614839584 +0000 UTC m=+2157.946339661"
Jul 09 22:26:50.635924 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:50.635899    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z"
Jul 09 22:26:50.640845 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:50.640824    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z"
Jul 09 22:26:51.597255 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:51.597224    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z"
Jul 09 22:26:51.598081 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:51.598065    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z"
Jul 09 22:26:57.785461 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:57.785430    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm"]
Jul 09 22:26:57.785833 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:57.785758    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3b198e2-98d7-47f4-a4c4-7eb370970e04" containerName="istio-proxy"
Jul 09 22:26:57.785833 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:57.785768    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3b198e2-98d7-47f4-a4c4-7eb370970e04" containerName="istio-proxy"
Jul 09 22:26:57.790229 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:57.790208    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm"
Jul 09 22:26:57.794184 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:57.794164    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-03e1d1-openshift-default-dockercfg-5f9lc\""
Jul 09 22:26:57.810621 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:57.810598    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm"]
Jul 09 22:26:57.893306 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:57.893267    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af536734-211d-4301-86af-fc54d29face6-workload-socket\") pod \"e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm\" (UID: \"af536734-211d-4301-86af-fc54d29face6\") " pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm"
Jul 09 22:26:57.893467 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:57.893325    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af536734-211d-4301-86af-fc54d29face6-istio-podinfo\") pod \"e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm\" (UID: \"af536734-211d-4301-86af-fc54d29face6\") " pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm"
Jul 09 22:26:57.893467 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:57.893348    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af536734-211d-4301-86af-fc54d29face6-istiod-ca-cert\") pod \"e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm\" (UID: \"af536734-211d-4301-86af-fc54d29face6\") " pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm"
Jul 09 22:26:57.893467 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:57.893440    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af536734-211d-4301-86af-fc54d29face6-credential-socket\") pod \"e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm\" (UID: \"af536734-211d-4301-86af-fc54d29face6\") " pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm"
Jul 09 22:26:57.893596 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:57.893486    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af536734-211d-4301-86af-fc54d29face6-istio-envoy\") pod \"e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm\" (UID: \"af536734-211d-4301-86af-fc54d29face6\") " pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm"
Jul 09 22:26:57.893596 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:57.893512    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af536734-211d-4301-86af-fc54d29face6-istio-data\") pod \"e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm\" (UID: \"af536734-211d-4301-86af-fc54d29face6\") " pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm"
Jul 09 22:26:57.893596 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:57.893555    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59qqg\" (UniqueName: \"kubernetes.io/projected/af536734-211d-4301-86af-fc54d29face6-kube-api-access-59qqg\") pod \"e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm\" (UID: \"af536734-211d-4301-86af-fc54d29face6\") " pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm"
Jul 09 22:26:57.893717 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:57.893616    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af536734-211d-4301-86af-fc54d29face6-workload-certs\") pod \"e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm\" (UID: \"af536734-211d-4301-86af-fc54d29face6\") " pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm"
Jul 09 22:26:57.893758 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:57.893704    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af536734-211d-4301-86af-fc54d29face6-istio-token\") pod \"e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm\" (UID: \"af536734-211d-4301-86af-fc54d29face6\") " pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm"
Jul 09 22:26:57.994379 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:57.994348    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af536734-211d-4301-86af-fc54d29face6-workload-socket\") pod \"e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm\" (UID: \"af536734-211d-4301-86af-fc54d29face6\") " pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm"
Jul 09 22:26:57.994535 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:57.994396    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af536734-211d-4301-86af-fc54d29face6-istio-podinfo\") pod \"e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm\" (UID: \"af536734-211d-4301-86af-fc54d29face6\") " pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm"
Jul 09 22:26:57.994535 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:57.994418    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af536734-211d-4301-86af-fc54d29face6-istiod-ca-cert\") pod \"e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm\" (UID: \"af536734-211d-4301-86af-fc54d29face6\") " pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm"
Jul 09 22:26:57.994535 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:57.994451    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af536734-211d-4301-86af-fc54d29face6-credential-socket\") pod \"e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm\" (UID: \"af536734-211d-4301-86af-fc54d29face6\") " pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm"
Jul 09 22:26:57.994535 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:57.994478    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af536734-211d-4301-86af-fc54d29face6-istio-envoy\") pod \"e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm\" (UID: \"af536734-211d-4301-86af-fc54d29face6\") " pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm"
Jul 09 22:26:57.994535 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:57.994499    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af536734-211d-4301-86af-fc54d29face6-istio-data\") pod \"e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm\" (UID: \"af536734-211d-4301-86af-fc54d29face6\") " pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm"
Jul 09 22:26:57.994825 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:57.994536    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59qqg\" (UniqueName: \"kubernetes.io/projected/af536734-211d-4301-86af-fc54d29face6-kube-api-access-59qqg\") pod \"e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm\" (UID: \"af536734-211d-4301-86af-fc54d29face6\") " pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm"
Jul 09 22:26:57.994825 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:57.994585    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af536734-211d-4301-86af-fc54d29face6-workload-certs\") pod \"e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm\" (UID: \"af536734-211d-4301-86af-fc54d29face6\") " pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm"
Jul 09 22:26:57.994825 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:57.994636    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af536734-211d-4301-86af-fc54d29face6-istio-token\") pod \"e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm\" (UID: \"af536734-211d-4301-86af-fc54d29face6\") " pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm"
Jul 09 22:26:57.994825 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:57.994756    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af536734-211d-4301-86af-fc54d29face6-workload-socket\") pod \"e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm\" (UID: \"af536734-211d-4301-86af-fc54d29face6\") " pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm"
Jul 09 22:26:57.994825 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:57.994800    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af536734-211d-4301-86af-fc54d29face6-credential-socket\") pod \"e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm\" (UID: \"af536734-211d-4301-86af-fc54d29face6\") " pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm"
Jul 09 22:26:57.995065 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:57.995050    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af536734-211d-4301-86af-fc54d29face6-istio-data\") pod \"e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm\" (UID: \"af536734-211d-4301-86af-fc54d29face6\") " pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm"
Jul 09 22:26:57.995197 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:57.995176    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af536734-211d-4301-86af-fc54d29face6-workload-certs\") pod \"e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm\" (UID: \"af536734-211d-4301-86af-fc54d29face6\") " pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm"
Jul 09 22:26:57.995262 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:57.995224    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af536734-211d-4301-86af-fc54d29face6-istiod-ca-cert\") pod \"e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm\" (UID: \"af536734-211d-4301-86af-fc54d29face6\") " pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm"
Jul 09 22:26:57.997026 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:57.996926    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af536734-211d-4301-86af-fc54d29face6-istio-envoy\") pod \"e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm\" (UID: \"af536734-211d-4301-86af-fc54d29face6\") " pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm"
Jul 09 22:26:57.997129 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:57.997058    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af536734-211d-4301-86af-fc54d29face6-istio-podinfo\") pod \"e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm\" (UID: \"af536734-211d-4301-86af-fc54d29face6\") " pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm"
Jul 09 22:26:58.003798 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:58.003777    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59qqg\" (UniqueName: \"kubernetes.io/projected/af536734-211d-4301-86af-fc54d29face6-kube-api-access-59qqg\") pod \"e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm\" (UID: \"af536734-211d-4301-86af-fc54d29face6\") " pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm"
Jul 09 22:26:58.003911 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:58.003778    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af536734-211d-4301-86af-fc54d29face6-istio-token\") pod \"e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm\" (UID: \"af536734-211d-4301-86af-fc54d29face6\") " pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm"
Jul 09 22:26:58.101040 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:58.100979    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm"
Jul 09 22:26:58.233489 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:58.233364    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm"]
Jul 09 22:26:58.235901 ip-10-0-141-101 kubenswrapper[2576]: W0709 22:26:58.235870    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf536734_211d_4301_86af_fc54d29face6.slice/crio-cc119b7b788acfa8fd9c53aeed0fb4f8ec3b760692b2fcb2adbe67f39f6b5e2f WatchSource:0}: Error finding container cc119b7b788acfa8fd9c53aeed0fb4f8ec3b760692b2fcb2adbe67f39f6b5e2f: Status 404 returned error can't find the container with id cc119b7b788acfa8fd9c53aeed0fb4f8ec3b760692b2fcb2adbe67f39f6b5e2f
Jul 09 22:26:58.238165 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:58.238128    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:26:58.238268 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:58.238211    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:26:58.238268 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:58.238252    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:26:58.637224 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:58.637188    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm" event={"ID":"af536734-211d-4301-86af-fc54d29face6","Type":"ContainerStarted","Data":"5488d702e0c36063234fc8f4025168b502bf51b0dbf75e80342be650d26cfe39"}
Jul 09 22:26:58.637406 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:58.637249    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm" event={"ID":"af536734-211d-4301-86af-fc54d29face6","Type":"ContainerStarted","Data":"cc119b7b788acfa8fd9c53aeed0fb4f8ec3b760692b2fcb2adbe67f39f6b5e2f"}
Jul 09 22:26:58.659395 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:58.659347    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm" podStartSLOduration=1.6593272620000001 podStartE2EDuration="1.659327262s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:26:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:26:58.657152847 +0000 UTC m=+2165.988652925" watchObservedRunningTime="2026-07-09 22:26:58.659327262 +0000 UTC m=+2165.990827343"
Jul 09 22:26:59.102119 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:59.102083    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm"
Jul 09 22:26:59.106897 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:59.106866    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm"
Jul 09 22:26:59.646535 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:59.646505    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm"
Jul 09 22:26:59.649141 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:26:59.649114    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm"
Jul 09 22:27:06.598555 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:27:06.598476    2576 patch_prober.go:28] interesting pod/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 09 22:27:06.598555 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:27:06.598531    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z" podUID="241d0668-4068-415b-bbc7-da597e3abaff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 09 22:27:06.683401 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:27:06.683369    2576 generic.go:356] "Generic (PLEG): container finished" podID="241d0668-4068-415b-bbc7-da597e3abaff" containerID="45d0bec28efc19faf4b3b46b5715b4c1069a6b7b046c4ca71fda158b008c2b38" exitCode=0
Jul 09 22:27:06.683592 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:27:06.683446    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z" event={"ID":"241d0668-4068-415b-bbc7-da597e3abaff","Type":"ContainerDied","Data":"45d0bec28efc19faf4b3b46b5715b4c1069a6b7b046c4ca71fda158b008c2b38"}
Jul 09 22:27:06.683888 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:27:06.683857    2576 scope.go:117] "RemoveContainer" containerID="45d0bec28efc19faf4b3b46b5715b4c1069a6b7b046c4ca71fda158b008c2b38"
Jul 09 22:27:06.684884 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:27:06.684858    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:27:06.684941 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:27:06.684928    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:27:06.685009 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:27:06.684985    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:27:07.691126 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:27:07.691095    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z" event={"ID":"241d0668-4068-415b-bbc7-da597e3abaff","Type":"ContainerStarted","Data":"3ed303dbc749ef884bfdbb84e69ea1518cdd518d8cd2e6caa4574688aceca60b"}
Jul 09 22:27:08.635003 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:27:08.634941    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z"
Jul 09 22:27:08.635386 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:27:08.635357    2576 patch_prober.go:28] interesting pod/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 09 22:27:08.635520 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:27:08.635423    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z" podUID="241d0668-4068-415b-bbc7-da597e3abaff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 09 22:27:09.635847 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:27:09.635371    2576 patch_prober.go:28] interesting pod/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 09 22:27:09.635847 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:27:09.635449    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z" podUID="241d0668-4068-415b-bbc7-da597e3abaff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 09 22:27:10.644979 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:27:10.635210    2576 patch_prober.go:28] interesting pod/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 09 22:27:10.644979 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:27:10.635271    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z" podUID="241d0668-4068-415b-bbc7-da597e3abaff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 09 22:27:11.636287 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:27:11.635798    2576 patch_prober.go:28] interesting pod/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 09 22:27:11.636287 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:27:11.635862    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z" podUID="241d0668-4068-415b-bbc7-da597e3abaff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 09 22:27:12.639295 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:27:12.639265    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z"
Jul 09 22:27:12.639777 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:27:12.639604    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z"
Jul 09 22:27:12.640277 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:27:12.640258    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z"
Jul 09 22:27:12.726134 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:27:12.726095    2576 generic.go:356] "Generic (PLEG): container finished" podID="af536734-211d-4301-86af-fc54d29face6" containerID="5488d702e0c36063234fc8f4025168b502bf51b0dbf75e80342be650d26cfe39" exitCode=0
Jul 09 22:27:12.726134 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:27:12.726132    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm" event={"ID":"af536734-211d-4301-86af-fc54d29face6","Type":"ContainerDied","Data":"5488d702e0c36063234fc8f4025168b502bf51b0dbf75e80342be650d26cfe39"}
Jul 09 22:27:12.726671 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:27:12.726648    2576 scope.go:117] "RemoveContainer" containerID="5488d702e0c36063234fc8f4025168b502bf51b0dbf75e80342be650d26cfe39"
Jul 09 22:27:12.727699 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:27:12.727672    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:27:12.727765 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:27:12.727750    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:27:12.727807 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:27:12.727793    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:27:13.731798 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:27:13.731750    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm" event={"ID":"af536734-211d-4301-86af-fc54d29face6","Type":"ContainerStarted","Data":"92875400804e8a07e889e20bf0487c46d619d96c5a3c9e13e5e61179b5a5a4c7"}
Jul 09 22:27:14.101642 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:27:14.101606    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm"
Jul 09 22:27:14.102562 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:27:14.102532    2576 patch_prober.go:28] interesting pod/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 09 22:27:14.102695 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:27:14.102594    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm" podUID="af536734-211d-4301-86af-fc54d29face6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 09 22:27:14.647305 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:27:14.647274    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm"
Jul 09 22:27:15.102300 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:27:15.102262    2576 patch_prober.go:28] interesting pod/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 09 22:27:15.102685 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:27:15.102321    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm" podUID="af536734-211d-4301-86af-fc54d29face6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 09 22:27:16.101372 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:27:16.101338    2576 patch_prober.go:28] interesting pod/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 09 22:27:16.101542 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:27:16.101397    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm" podUID="af536734-211d-4301-86af-fc54d29face6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 09 22:27:17.102351 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:27:17.102312    2576 patch_prober.go:28] interesting pod/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 09 22:27:17.102751 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:27:17.102367    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm" podUID="af536734-211d-4301-86af-fc54d29face6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 09 22:27:18.105573 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:27:18.105543    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm"
Jul 09 22:27:18.106490 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:27:18.106469    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm"
Jul 09 22:28:06.099442 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:06.099409    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-03e1d1/test-model-03e1d1-kserve-5bb77f54f7-5b5gm"]
Jul 09 22:28:06.102619 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:06.102601    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-03e1d1/test-model-03e1d1-kserve-5bb77f54f7-5b5gm"
Jul 09 22:28:06.105362 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:06.105339    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-03e1d1\"/\"kube-root-ca.crt\""
Jul 09 22:28:06.106761 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:06.106740    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-03e1d1\"/\"test-model-03e1d1-kserve-self-signed-certs\""
Jul 09 22:28:06.106874 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:06.106750    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-03e1d1\"/\"default-dockercfg-m8hbk\""
Jul 09 22:28:06.106874 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:06.106792    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-03e1d1\"/\"openshift-service-ca.crt\""
Jul 09 22:28:06.112353 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:06.112334    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-03e1d1/test-model-03e1d1-kserve-5bb77f54f7-5b5gm"]
Jul 09 22:28:06.165088 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:06.165058    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a84af93-a2d5-451c-8528-8d063d3e07c2-model-cache\") pod \"test-model-03e1d1-kserve-5bb77f54f7-5b5gm\" (UID: \"9a84af93-a2d5-451c-8528-8d063d3e07c2\") " pod="ai-tenant-e2e-inf-b-03e1d1/test-model-03e1d1-kserve-5bb77f54f7-5b5gm"
Jul 09 22:28:06.165259 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:06.165109    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a84af93-a2d5-451c-8528-8d063d3e07c2-dshm\") pod \"test-model-03e1d1-kserve-5bb77f54f7-5b5gm\" (UID: \"9a84af93-a2d5-451c-8528-8d063d3e07c2\") " pod="ai-tenant-e2e-inf-b-03e1d1/test-model-03e1d1-kserve-5bb77f54f7-5b5gm"
Jul 09 22:28:06.165259 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:06.165137    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a84af93-a2d5-451c-8528-8d063d3e07c2-home\") pod \"test-model-03e1d1-kserve-5bb77f54f7-5b5gm\" (UID: \"9a84af93-a2d5-451c-8528-8d063d3e07c2\") " pod="ai-tenant-e2e-inf-b-03e1d1/test-model-03e1d1-kserve-5bb77f54f7-5b5gm"
Jul 09 22:28:06.165259 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:06.165154    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh45c\" (UniqueName: \"kubernetes.io/projected/9a84af93-a2d5-451c-8528-8d063d3e07c2-kube-api-access-gh45c\") pod \"test-model-03e1d1-kserve-5bb77f54f7-5b5gm\" (UID: \"9a84af93-a2d5-451c-8528-8d063d3e07c2\") " pod="ai-tenant-e2e-inf-b-03e1d1/test-model-03e1d1-kserve-5bb77f54f7-5b5gm"
Jul 09 22:28:06.165259 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:06.165196    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a84af93-a2d5-451c-8528-8d063d3e07c2-tmp-dir\") pod \"test-model-03e1d1-kserve-5bb77f54f7-5b5gm\" (UID: \"9a84af93-a2d5-451c-8528-8d063d3e07c2\") " pod="ai-tenant-e2e-inf-b-03e1d1/test-model-03e1d1-kserve-5bb77f54f7-5b5gm"
Jul 09 22:28:06.165259 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:06.165246    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a84af93-a2d5-451c-8528-8d063d3e07c2-tls-certs\") pod \"test-model-03e1d1-kserve-5bb77f54f7-5b5gm\" (UID: \"9a84af93-a2d5-451c-8528-8d063d3e07c2\") " pod="ai-tenant-e2e-inf-b-03e1d1/test-model-03e1d1-kserve-5bb77f54f7-5b5gm"
Jul 09 22:28:06.266638 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:06.266605    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a84af93-a2d5-451c-8528-8d063d3e07c2-home\") pod \"test-model-03e1d1-kserve-5bb77f54f7-5b5gm\" (UID: \"9a84af93-a2d5-451c-8528-8d063d3e07c2\") " pod="ai-tenant-e2e-inf-b-03e1d1/test-model-03e1d1-kserve-5bb77f54f7-5b5gm"
Jul 09 22:28:06.266638 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:06.266643    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh45c\" (UniqueName: \"kubernetes.io/projected/9a84af93-a2d5-451c-8528-8d063d3e07c2-kube-api-access-gh45c\") pod \"test-model-03e1d1-kserve-5bb77f54f7-5b5gm\" (UID: \"9a84af93-a2d5-451c-8528-8d063d3e07c2\") " pod="ai-tenant-e2e-inf-b-03e1d1/test-model-03e1d1-kserve-5bb77f54f7-5b5gm"
Jul 09 22:28:06.266900 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:06.266672    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a84af93-a2d5-451c-8528-8d063d3e07c2-tmp-dir\") pod \"test-model-03e1d1-kserve-5bb77f54f7-5b5gm\" (UID: \"9a84af93-a2d5-451c-8528-8d063d3e07c2\") " pod="ai-tenant-e2e-inf-b-03e1d1/test-model-03e1d1-kserve-5bb77f54f7-5b5gm"
Jul 09 22:28:06.266900 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:06.266715    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a84af93-a2d5-451c-8528-8d063d3e07c2-tls-certs\") pod \"test-model-03e1d1-kserve-5bb77f54f7-5b5gm\" (UID: \"9a84af93-a2d5-451c-8528-8d063d3e07c2\") " pod="ai-tenant-e2e-inf-b-03e1d1/test-model-03e1d1-kserve-5bb77f54f7-5b5gm"
Jul 09 22:28:06.266900 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:06.266754    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a84af93-a2d5-451c-8528-8d063d3e07c2-model-cache\") pod \"test-model-03e1d1-kserve-5bb77f54f7-5b5gm\" (UID: \"9a84af93-a2d5-451c-8528-8d063d3e07c2\") " pod="ai-tenant-e2e-inf-b-03e1d1/test-model-03e1d1-kserve-5bb77f54f7-5b5gm"
Jul 09 22:28:06.266900 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:06.266808    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a84af93-a2d5-451c-8528-8d063d3e07c2-dshm\") pod \"test-model-03e1d1-kserve-5bb77f54f7-5b5gm\" (UID: \"9a84af93-a2d5-451c-8528-8d063d3e07c2\") " pod="ai-tenant-e2e-inf-b-03e1d1/test-model-03e1d1-kserve-5bb77f54f7-5b5gm"
Jul 09 22:28:06.267154 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:06.267109    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a84af93-a2d5-451c-8528-8d063d3e07c2-home\") pod \"test-model-03e1d1-kserve-5bb77f54f7-5b5gm\" (UID: \"9a84af93-a2d5-451c-8528-8d063d3e07c2\") " pod="ai-tenant-e2e-inf-b-03e1d1/test-model-03e1d1-kserve-5bb77f54f7-5b5gm"
Jul 09 22:28:06.267197 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:06.267154    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a84af93-a2d5-451c-8528-8d063d3e07c2-model-cache\") pod \"test-model-03e1d1-kserve-5bb77f54f7-5b5gm\" (UID: \"9a84af93-a2d5-451c-8528-8d063d3e07c2\") " pod="ai-tenant-e2e-inf-b-03e1d1/test-model-03e1d1-kserve-5bb77f54f7-5b5gm"
Jul 09 22:28:06.267255 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:06.267237    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a84af93-a2d5-451c-8528-8d063d3e07c2-tmp-dir\") pod \"test-model-03e1d1-kserve-5bb77f54f7-5b5gm\" (UID: \"9a84af93-a2d5-451c-8528-8d063d3e07c2\") " pod="ai-tenant-e2e-inf-b-03e1d1/test-model-03e1d1-kserve-5bb77f54f7-5b5gm"
Jul 09 22:28:06.268969 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:06.268934    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a84af93-a2d5-451c-8528-8d063d3e07c2-dshm\") pod \"test-model-03e1d1-kserve-5bb77f54f7-5b5gm\" (UID: \"9a84af93-a2d5-451c-8528-8d063d3e07c2\") " pod="ai-tenant-e2e-inf-b-03e1d1/test-model-03e1d1-kserve-5bb77f54f7-5b5gm"
Jul 09 22:28:06.269300 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:06.269283    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a84af93-a2d5-451c-8528-8d063d3e07c2-tls-certs\") pod \"test-model-03e1d1-kserve-5bb77f54f7-5b5gm\" (UID: \"9a84af93-a2d5-451c-8528-8d063d3e07c2\") " pod="ai-tenant-e2e-inf-b-03e1d1/test-model-03e1d1-kserve-5bb77f54f7-5b5gm"
Jul 09 22:28:06.274973 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:06.274939    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh45c\" (UniqueName: \"kubernetes.io/projected/9a84af93-a2d5-451c-8528-8d063d3e07c2-kube-api-access-gh45c\") pod \"test-model-03e1d1-kserve-5bb77f54f7-5b5gm\" (UID: \"9a84af93-a2d5-451c-8528-8d063d3e07c2\") " pod="ai-tenant-e2e-inf-b-03e1d1/test-model-03e1d1-kserve-5bb77f54f7-5b5gm"
Jul 09 22:28:06.413050 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:06.412951    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-03e1d1/test-model-03e1d1-kserve-5bb77f54f7-5b5gm"
Jul 09 22:28:06.550808 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:06.550773    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-03e1d1/test-model-03e1d1-kserve-5bb77f54f7-5b5gm"]
Jul 09 22:28:06.554133 ip-10-0-141-101 kubenswrapper[2576]: W0709 22:28:06.554105    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a84af93_a2d5_451c_8528_8d063d3e07c2.slice/crio-856c49540ddd3d34304da6ed09a4370c7178bb49cc22e1d5a2256aa7266b77cf WatchSource:0}: Error finding container 856c49540ddd3d34304da6ed09a4370c7178bb49cc22e1d5a2256aa7266b77cf: Status 404 returned error can't find the container with id 856c49540ddd3d34304da6ed09a4370c7178bb49cc22e1d5a2256aa7266b77cf
Jul 09 22:28:07.005607 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:07.005564    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-03e1d1/test-model-03e1d1-kserve-5bb77f54f7-5b5gm" event={"ID":"9a84af93-a2d5-451c-8528-8d063d3e07c2","Type":"ContainerStarted","Data":"3845e4d14b143d500d69ab5e25bb27799493f86c3bfa9515bdc19f2a2bc6e506"}
Jul 09 22:28:07.005794 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:07.005618    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-03e1d1/test-model-03e1d1-kserve-5bb77f54f7-5b5gm" event={"ID":"9a84af93-a2d5-451c-8528-8d063d3e07c2","Type":"ContainerStarted","Data":"856c49540ddd3d34304da6ed09a4370c7178bb49cc22e1d5a2256aa7266b77cf"}
Jul 09 22:28:07.029108 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:07.028837    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-03e1d1/test-model-03e1d1-kserve-5bb77f54f7-5b5gm" podStartSLOduration=1.028819651 podStartE2EDuration="1.028819651s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:28:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:28:07.027405587 +0000 UTC m=+2234.358905668" watchObservedRunningTime="2026-07-09 22:28:07.028819651 +0000 UTC m=+2234.360319732"
Jul 09 22:28:16.413993 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:16.413896    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-03e1d1/test-model-03e1d1-kserve-5bb77f54f7-5b5gm"
Jul 09 22:28:16.413993 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:16.413940    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-03e1d1/test-model-03e1d1-kserve-5bb77f54f7-5b5gm"
Jul 09 22:28:16.426226 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:16.426199    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-03e1d1/test-model-03e1d1-kserve-5bb77f54f7-5b5gm"
Jul 09 22:28:17.064265 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:17.064238    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-03e1d1/test-model-03e1d1-kserve-5bb77f54f7-5b5gm"
Jul 09 22:28:25.490337 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:25.490307    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-03e1d1/test-model-03e1d1-kserve-5bb77f54f7-5b5gm"]
Jul 09 22:28:40.510546 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:40.510472    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-03e1d1/test-model-03e1d1-kserve-5bb77f54f7-5b5gm" podUID="9a84af93-a2d5-451c-8528-8d063d3e07c2" containerName="main" containerID="cri-o://3845e4d14b143d500d69ab5e25bb27799493f86c3bfa9515bdc19f2a2bc6e506" gracePeriod=45
Jul 09 22:28:40.760690 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:40.760636    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-03e1d1/test-model-03e1d1-kserve-5bb77f54f7-5b5gm"
Jul 09 22:28:40.950800 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:40.950764    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a84af93-a2d5-451c-8528-8d063d3e07c2-tls-certs\") pod \"9a84af93-a2d5-451c-8528-8d063d3e07c2\" (UID: \"9a84af93-a2d5-451c-8528-8d063d3e07c2\") "
Jul 09 22:28:40.951023 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:40.950810    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a84af93-a2d5-451c-8528-8d063d3e07c2-home\") pod \"9a84af93-a2d5-451c-8528-8d063d3e07c2\" (UID: \"9a84af93-a2d5-451c-8528-8d063d3e07c2\") "
Jul 09 22:28:40.951023 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:40.950861    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gh45c\" (UniqueName: \"kubernetes.io/projected/9a84af93-a2d5-451c-8528-8d063d3e07c2-kube-api-access-gh45c\") pod \"9a84af93-a2d5-451c-8528-8d063d3e07c2\" (UID: \"9a84af93-a2d5-451c-8528-8d063d3e07c2\") "
Jul 09 22:28:40.951023 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:40.950897    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a84af93-a2d5-451c-8528-8d063d3e07c2-model-cache\") pod \"9a84af93-a2d5-451c-8528-8d063d3e07c2\" (UID: \"9a84af93-a2d5-451c-8528-8d063d3e07c2\") "
Jul 09 22:28:40.951023 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:40.950923    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a84af93-a2d5-451c-8528-8d063d3e07c2-tmp-dir\") pod \"9a84af93-a2d5-451c-8528-8d063d3e07c2\" (UID: \"9a84af93-a2d5-451c-8528-8d063d3e07c2\") "
Jul 09 22:28:40.951023 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:40.951020    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a84af93-a2d5-451c-8528-8d063d3e07c2-dshm\") pod \"9a84af93-a2d5-451c-8528-8d063d3e07c2\" (UID: \"9a84af93-a2d5-451c-8528-8d063d3e07c2\") "
Jul 09 22:28:40.951308 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:40.951214    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a84af93-a2d5-451c-8528-8d063d3e07c2-home" (OuterVolumeSpecName: "home") pod "9a84af93-a2d5-451c-8528-8d063d3e07c2" (UID: "9a84af93-a2d5-451c-8528-8d063d3e07c2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:28:40.951308 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:40.951201    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a84af93-a2d5-451c-8528-8d063d3e07c2-model-cache" (OuterVolumeSpecName: "model-cache") pod "9a84af93-a2d5-451c-8528-8d063d3e07c2" (UID: "9a84af93-a2d5-451c-8528-8d063d3e07c2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:28:40.951393 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:40.951303    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a84af93-a2d5-451c-8528-8d063d3e07c2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9a84af93-a2d5-451c-8528-8d063d3e07c2" (UID: "9a84af93-a2d5-451c-8528-8d063d3e07c2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:28:40.951393 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:40.951300    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a84af93-a2d5-451c-8528-8d063d3e07c2-home\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:28:40.951393 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:40.951366    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a84af93-a2d5-451c-8528-8d063d3e07c2-model-cache\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:28:40.953224 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:40.953194    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a84af93-a2d5-451c-8528-8d063d3e07c2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9a84af93-a2d5-451c-8528-8d063d3e07c2" (UID: "9a84af93-a2d5-451c-8528-8d063d3e07c2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:28:40.953332 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:40.953225    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a84af93-a2d5-451c-8528-8d063d3e07c2-dshm" (OuterVolumeSpecName: "dshm") pod "9a84af93-a2d5-451c-8528-8d063d3e07c2" (UID: "9a84af93-a2d5-451c-8528-8d063d3e07c2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:28:40.953332 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:40.953238    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a84af93-a2d5-451c-8528-8d063d3e07c2-kube-api-access-gh45c" (OuterVolumeSpecName: "kube-api-access-gh45c") pod "9a84af93-a2d5-451c-8528-8d063d3e07c2" (UID: "9a84af93-a2d5-451c-8528-8d063d3e07c2"). InnerVolumeSpecName "kube-api-access-gh45c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:28:41.052579 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:41.052557    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a84af93-a2d5-451c-8528-8d063d3e07c2-dshm\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:28:41.052579 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:41.052579    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a84af93-a2d5-451c-8528-8d063d3e07c2-tls-certs\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:28:41.052729 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:41.052589    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gh45c\" (UniqueName: \"kubernetes.io/projected/9a84af93-a2d5-451c-8528-8d063d3e07c2-kube-api-access-gh45c\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:28:41.052729 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:41.052598    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a84af93-a2d5-451c-8528-8d063d3e07c2-tmp-dir\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:28:41.167302 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:41.167272    2576 generic.go:356] "Generic (PLEG): container finished" podID="9a84af93-a2d5-451c-8528-8d063d3e07c2" containerID="3845e4d14b143d500d69ab5e25bb27799493f86c3bfa9515bdc19f2a2bc6e506" exitCode=0
Jul 09 22:28:41.167434 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:41.167317    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-03e1d1/test-model-03e1d1-kserve-5bb77f54f7-5b5gm"
Jul 09 22:28:41.167434 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:41.167362    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-03e1d1/test-model-03e1d1-kserve-5bb77f54f7-5b5gm" event={"ID":"9a84af93-a2d5-451c-8528-8d063d3e07c2","Type":"ContainerDied","Data":"3845e4d14b143d500d69ab5e25bb27799493f86c3bfa9515bdc19f2a2bc6e506"}
Jul 09 22:28:41.167434 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:41.167403    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-03e1d1/test-model-03e1d1-kserve-5bb77f54f7-5b5gm" event={"ID":"9a84af93-a2d5-451c-8528-8d063d3e07c2","Type":"ContainerDied","Data":"856c49540ddd3d34304da6ed09a4370c7178bb49cc22e1d5a2256aa7266b77cf"}
Jul 09 22:28:41.167434 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:41.167426    2576 scope.go:117] "RemoveContainer" containerID="3845e4d14b143d500d69ab5e25bb27799493f86c3bfa9515bdc19f2a2bc6e506"
Jul 09 22:28:41.176105 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:41.176090    2576 scope.go:117] "RemoveContainer" containerID="3845e4d14b143d500d69ab5e25bb27799493f86c3bfa9515bdc19f2a2bc6e506"
Jul 09 22:28:41.176357 ip-10-0-141-101 kubenswrapper[2576]: E0709 22:28:41.176340    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3845e4d14b143d500d69ab5e25bb27799493f86c3bfa9515bdc19f2a2bc6e506\": container with ID starting with 3845e4d14b143d500d69ab5e25bb27799493f86c3bfa9515bdc19f2a2bc6e506 not found: ID does not exist" containerID="3845e4d14b143d500d69ab5e25bb27799493f86c3bfa9515bdc19f2a2bc6e506"
Jul 09 22:28:41.176403 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:41.176366    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3845e4d14b143d500d69ab5e25bb27799493f86c3bfa9515bdc19f2a2bc6e506"} err="failed to get container status \"3845e4d14b143d500d69ab5e25bb27799493f86c3bfa9515bdc19f2a2bc6e506\": rpc error: code = NotFound desc = could not find container \"3845e4d14b143d500d69ab5e25bb27799493f86c3bfa9515bdc19f2a2bc6e506\": container with ID starting with 3845e4d14b143d500d69ab5e25bb27799493f86c3bfa9515bdc19f2a2bc6e506 not found: ID does not exist"
Jul 09 22:28:41.189227 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:41.189209    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-03e1d1/test-model-03e1d1-kserve-5bb77f54f7-5b5gm"]
Jul 09 22:28:41.200062 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:41.200042    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-03e1d1/test-model-03e1d1-kserve-5bb77f54f7-5b5gm"]
Jul 09 22:28:43.201252 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:28:43.201225    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a84af93-a2d5-451c-8528-8d063d3e07c2" path="/var/lib/kubelet/pods/9a84af93-a2d5-451c-8528-8d063d3e07c2/volumes"
Jul 09 22:29:08.846657 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:08.846626    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z"]
Jul 09 22:29:08.847128 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:08.846838    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z" podUID="241d0668-4068-415b-bbc7-da597e3abaff" containerName="istio-proxy" containerID="cri-o://3ed303dbc749ef884bfdbb84e69ea1518cdd518d8cd2e6caa4574688aceca60b" gracePeriod=30
Jul 09 22:29:12.641733 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:12.641691    2576 patch_prober.go:28] interesting pod/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 09 22:29:12.642220 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:12.641768    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z" podUID="241d0668-4068-415b-bbc7-da597e3abaff" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 09 22:29:14.100025 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:14.100002    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z"
Jul 09 22:29:14.216198 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:14.216126    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/241d0668-4068-415b-bbc7-da597e3abaff-workload-certs\") pod \"241d0668-4068-415b-bbc7-da597e3abaff\" (UID: \"241d0668-4068-415b-bbc7-da597e3abaff\") "
Jul 09 22:29:14.216319 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:14.216202    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/241d0668-4068-415b-bbc7-da597e3abaff-istiod-ca-cert\") pod \"241d0668-4068-415b-bbc7-da597e3abaff\" (UID: \"241d0668-4068-415b-bbc7-da597e3abaff\") "
Jul 09 22:29:14.216319 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:14.216246    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwrx2\" (UniqueName: \"kubernetes.io/projected/241d0668-4068-415b-bbc7-da597e3abaff-kube-api-access-xwrx2\") pod \"241d0668-4068-415b-bbc7-da597e3abaff\" (UID: \"241d0668-4068-415b-bbc7-da597e3abaff\") "
Jul 09 22:29:14.216319 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:14.216272    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/241d0668-4068-415b-bbc7-da597e3abaff-istio-envoy\") pod \"241d0668-4068-415b-bbc7-da597e3abaff\" (UID: \"241d0668-4068-415b-bbc7-da597e3abaff\") "
Jul 09 22:29:14.216472 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:14.216327    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/241d0668-4068-415b-bbc7-da597e3abaff-istio-podinfo\") pod \"241d0668-4068-415b-bbc7-da597e3abaff\" (UID: \"241d0668-4068-415b-bbc7-da597e3abaff\") "
Jul 09 22:29:14.216472 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:14.216354    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/241d0668-4068-415b-bbc7-da597e3abaff-credential-socket\") pod \"241d0668-4068-415b-bbc7-da597e3abaff\" (UID: \"241d0668-4068-415b-bbc7-da597e3abaff\") "
Jul 09 22:29:14.216472 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:14.216378    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/241d0668-4068-415b-bbc7-da597e3abaff-istio-data\") pod \"241d0668-4068-415b-bbc7-da597e3abaff\" (UID: \"241d0668-4068-415b-bbc7-da597e3abaff\") "
Jul 09 22:29:14.216472 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:14.216416    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/241d0668-4068-415b-bbc7-da597e3abaff-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "241d0668-4068-415b-bbc7-da597e3abaff" (UID: "241d0668-4068-415b-bbc7-da597e3abaff"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:29:14.216472 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:14.216427    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/241d0668-4068-415b-bbc7-da597e3abaff-workload-socket\") pod \"241d0668-4068-415b-bbc7-da597e3abaff\" (UID: \"241d0668-4068-415b-bbc7-da597e3abaff\") "
Jul 09 22:29:14.216472 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:14.216467    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/241d0668-4068-415b-bbc7-da597e3abaff-istio-token\") pod \"241d0668-4068-415b-bbc7-da597e3abaff\" (UID: \"241d0668-4068-415b-bbc7-da597e3abaff\") "
Jul 09 22:29:14.216720 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:14.216592    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/241d0668-4068-415b-bbc7-da597e3abaff-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "241d0668-4068-415b-bbc7-da597e3abaff" (UID: "241d0668-4068-415b-bbc7-da597e3abaff"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:29:14.216720 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:14.216685    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/241d0668-4068-415b-bbc7-da597e3abaff-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "241d0668-4068-415b-bbc7-da597e3abaff" (UID: "241d0668-4068-415b-bbc7-da597e3abaff"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:29:14.216858 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:14.216837    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/241d0668-4068-415b-bbc7-da597e3abaff-credential-socket\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:29:14.216919 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:14.216865    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/241d0668-4068-415b-bbc7-da597e3abaff-workload-certs\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:29:14.216919 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:14.216882    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/241d0668-4068-415b-bbc7-da597e3abaff-istiod-ca-cert\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:29:14.217053 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:14.216974    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/241d0668-4068-415b-bbc7-da597e3abaff-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "241d0668-4068-415b-bbc7-da597e3abaff" (UID: "241d0668-4068-415b-bbc7-da597e3abaff"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:29:14.217469 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:14.217441    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/241d0668-4068-415b-bbc7-da597e3abaff-istio-data" (OuterVolumeSpecName: "istio-data") pod "241d0668-4068-415b-bbc7-da597e3abaff" (UID: "241d0668-4068-415b-bbc7-da597e3abaff"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:29:14.218599 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:14.218576    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/241d0668-4068-415b-bbc7-da597e3abaff-istio-token" (OuterVolumeSpecName: "istio-token") pod "241d0668-4068-415b-bbc7-da597e3abaff" (UID: "241d0668-4068-415b-bbc7-da597e3abaff"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:29:14.218702 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:14.218573    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/241d0668-4068-415b-bbc7-da597e3abaff-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "241d0668-4068-415b-bbc7-da597e3abaff" (UID: "241d0668-4068-415b-bbc7-da597e3abaff"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 22:29:14.218702 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:14.218659    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/241d0668-4068-415b-bbc7-da597e3abaff-kube-api-access-xwrx2" (OuterVolumeSpecName: "kube-api-access-xwrx2") pod "241d0668-4068-415b-bbc7-da597e3abaff" (UID: "241d0668-4068-415b-bbc7-da597e3abaff"). InnerVolumeSpecName "kube-api-access-xwrx2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:29:14.218702 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:14.218684    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/241d0668-4068-415b-bbc7-da597e3abaff-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "241d0668-4068-415b-bbc7-da597e3abaff" (UID: "241d0668-4068-415b-bbc7-da597e3abaff"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:29:14.317343 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:14.317319    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/241d0668-4068-415b-bbc7-da597e3abaff-istio-podinfo\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:29:14.317473 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:14.317345    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/241d0668-4068-415b-bbc7-da597e3abaff-istio-data\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:29:14.317473 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:14.317360    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/241d0668-4068-415b-bbc7-da597e3abaff-workload-socket\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:29:14.317473 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:14.317373    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/241d0668-4068-415b-bbc7-da597e3abaff-istio-token\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:29:14.317473 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:14.317395    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwrx2\" (UniqueName: \"kubernetes.io/projected/241d0668-4068-415b-bbc7-da597e3abaff-kube-api-access-xwrx2\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:29:14.317473 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:14.317415    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/241d0668-4068-415b-bbc7-da597e3abaff-istio-envoy\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:29:14.320739 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:14.320717    2576 generic.go:356] "Generic (PLEG): container finished" podID="241d0668-4068-415b-bbc7-da597e3abaff" containerID="3ed303dbc749ef884bfdbb84e69ea1518cdd518d8cd2e6caa4574688aceca60b" exitCode=0
Jul 09 22:29:14.320826 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:14.320759    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z"
Jul 09 22:29:14.320826 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:14.320763    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z" event={"ID":"241d0668-4068-415b-bbc7-da597e3abaff","Type":"ContainerDied","Data":"3ed303dbc749ef884bfdbb84e69ea1518cdd518d8cd2e6caa4574688aceca60b"}
Jul 09 22:29:14.320826 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:14.320802    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z" event={"ID":"241d0668-4068-415b-bbc7-da597e3abaff","Type":"ContainerDied","Data":"2d72676c38e1d5910dc3880f9e70e71cb932ef268ef493928f0e998c2a79ca08"}
Jul 09 22:29:14.320826 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:14.320823    2576 scope.go:117] "RemoveContainer" containerID="3ed303dbc749ef884bfdbb84e69ea1518cdd518d8cd2e6caa4574688aceca60b"
Jul 09 22:29:14.329668 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:14.329653    2576 scope.go:117] "RemoveContainer" containerID="45d0bec28efc19faf4b3b46b5715b4c1069a6b7b046c4ca71fda158b008c2b38"
Jul 09 22:29:14.337179 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:14.337163    2576 scope.go:117] "RemoveContainer" containerID="3ed303dbc749ef884bfdbb84e69ea1518cdd518d8cd2e6caa4574688aceca60b"
Jul 09 22:29:14.337415 ip-10-0-141-101 kubenswrapper[2576]: E0709 22:29:14.337390    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ed303dbc749ef884bfdbb84e69ea1518cdd518d8cd2e6caa4574688aceca60b\": container with ID starting with 3ed303dbc749ef884bfdbb84e69ea1518cdd518d8cd2e6caa4574688aceca60b not found: ID does not exist" containerID="3ed303dbc749ef884bfdbb84e69ea1518cdd518d8cd2e6caa4574688aceca60b"
Jul 09 22:29:14.337468 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:14.337426    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ed303dbc749ef884bfdbb84e69ea1518cdd518d8cd2e6caa4574688aceca60b"} err="failed to get container status \"3ed303dbc749ef884bfdbb84e69ea1518cdd518d8cd2e6caa4574688aceca60b\": rpc error: code = NotFound desc = could not find container \"3ed303dbc749ef884bfdbb84e69ea1518cdd518d8cd2e6caa4574688aceca60b\": container with ID starting with 3ed303dbc749ef884bfdbb84e69ea1518cdd518d8cd2e6caa4574688aceca60b not found: ID does not exist"
Jul 09 22:29:14.337468 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:14.337443    2576 scope.go:117] "RemoveContainer" containerID="45d0bec28efc19faf4b3b46b5715b4c1069a6b7b046c4ca71fda158b008c2b38"
Jul 09 22:29:14.337680 ip-10-0-141-101 kubenswrapper[2576]: E0709 22:29:14.337662    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45d0bec28efc19faf4b3b46b5715b4c1069a6b7b046c4ca71fda158b008c2b38\": container with ID starting with 45d0bec28efc19faf4b3b46b5715b4c1069a6b7b046c4ca71fda158b008c2b38 not found: ID does not exist" containerID="45d0bec28efc19faf4b3b46b5715b4c1069a6b7b046c4ca71fda158b008c2b38"
Jul 09 22:29:14.337716 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:14.337685    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45d0bec28efc19faf4b3b46b5715b4c1069a6b7b046c4ca71fda158b008c2b38"} err="failed to get container status \"45d0bec28efc19faf4b3b46b5715b4c1069a6b7b046c4ca71fda158b008c2b38\": rpc error: code = NotFound desc = could not find container \"45d0bec28efc19faf4b3b46b5715b4c1069a6b7b046c4ca71fda158b008c2b38\": container with ID starting with 45d0bec28efc19faf4b3b46b5715b4c1069a6b7b046c4ca71fda158b008c2b38 not found: ID does not exist"
Jul 09 22:29:14.345334 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:14.345314    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z"]
Jul 09 22:29:14.350749 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:14.350730    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-55e48b-openshift-default-8cfd675f5-szt8z"]
Jul 09 22:29:15.200423 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:15.200391    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="241d0668-4068-415b-bbc7-da597e3abaff" path="/var/lib/kubelet/pods/241d0668-4068-415b-bbc7-da597e3abaff/volumes"
Jul 09 22:29:16.034562 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:16.034530    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm"]
Jul 09 22:29:16.034807 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:16.034779    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm" podUID="af536734-211d-4301-86af-fc54d29face6" containerName="istio-proxy" containerID="cri-o://92875400804e8a07e889e20bf0487c46d619d96c5a3c9e13e5e61179b5a5a4c7" gracePeriod=30
Jul 09 22:29:16.981484 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:16.981448    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp"]
Jul 09 22:29:16.981870 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:16.981803    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="241d0668-4068-415b-bbc7-da597e3abaff" containerName="istio-proxy"
Jul 09 22:29:16.981870 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:16.981815    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="241d0668-4068-415b-bbc7-da597e3abaff" containerName="istio-proxy"
Jul 09 22:29:16.981870 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:16.981824    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a84af93-a2d5-451c-8528-8d063d3e07c2" containerName="main"
Jul 09 22:29:16.981870 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:16.981829    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a84af93-a2d5-451c-8528-8d063d3e07c2" containerName="main"
Jul 09 22:29:16.981870 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:16.981843    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="241d0668-4068-415b-bbc7-da597e3abaff" containerName="istio-proxy"
Jul 09 22:29:16.981870 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:16.981848    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="241d0668-4068-415b-bbc7-da597e3abaff" containerName="istio-proxy"
Jul 09 22:29:16.982121 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:16.981901    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a84af93-a2d5-451c-8528-8d063d3e07c2" containerName="main"
Jul 09 22:29:16.982121 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:16.981910    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="241d0668-4068-415b-bbc7-da597e3abaff" containerName="istio-proxy"
Jul 09 22:29:16.982121 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:16.981916    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="241d0668-4068-415b-bbc7-da597e3abaff" containerName="istio-proxy"
Jul 09 22:29:16.986523 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:16.986501    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp"
Jul 09 22:29:16.990530 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:16.990510    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-eefed0-openshift-default-dockercfg-ldshm\""
Jul 09 22:29:16.997977 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:16.997938    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp"]
Jul 09 22:29:17.138380 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:17.138348    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4404b72-60f0-48d6-885b-8cf9de2b3cce-istio-token\") pod \"e2e-api-a-eefed0-openshift-default-6f8467684f-655pp\" (UID: \"f4404b72-60f0-48d6-885b-8cf9de2b3cce\") " pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp"
Jul 09 22:29:17.138380 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:17.138380    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4404b72-60f0-48d6-885b-8cf9de2b3cce-workload-certs\") pod \"e2e-api-a-eefed0-openshift-default-6f8467684f-655pp\" (UID: \"f4404b72-60f0-48d6-885b-8cf9de2b3cce\") " pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp"
Jul 09 22:29:17.138624 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:17.138441    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4404b72-60f0-48d6-885b-8cf9de2b3cce-istio-data\") pod \"e2e-api-a-eefed0-openshift-default-6f8467684f-655pp\" (UID: \"f4404b72-60f0-48d6-885b-8cf9de2b3cce\") " pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp"
Jul 09 22:29:17.138624 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:17.138475    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4404b72-60f0-48d6-885b-8cf9de2b3cce-istio-podinfo\") pod \"e2e-api-a-eefed0-openshift-default-6f8467684f-655pp\" (UID: \"f4404b72-60f0-48d6-885b-8cf9de2b3cce\") " pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp"
Jul 09 22:29:17.138624 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:17.138584    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm8lq\" (UniqueName: \"kubernetes.io/projected/f4404b72-60f0-48d6-885b-8cf9de2b3cce-kube-api-access-gm8lq\") pod \"e2e-api-a-eefed0-openshift-default-6f8467684f-655pp\" (UID: \"f4404b72-60f0-48d6-885b-8cf9de2b3cce\") " pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp"
Jul 09 22:29:17.138791 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:17.138625    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4404b72-60f0-48d6-885b-8cf9de2b3cce-credential-socket\") pod \"e2e-api-a-eefed0-openshift-default-6f8467684f-655pp\" (UID: \"f4404b72-60f0-48d6-885b-8cf9de2b3cce\") " pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp"
Jul 09 22:29:17.138791 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:17.138685    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4404b72-60f0-48d6-885b-8cf9de2b3cce-workload-socket\") pod \"e2e-api-a-eefed0-openshift-default-6f8467684f-655pp\" (UID: \"f4404b72-60f0-48d6-885b-8cf9de2b3cce\") " pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp"
Jul 09 22:29:17.138791 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:17.138726    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4404b72-60f0-48d6-885b-8cf9de2b3cce-istio-envoy\") pod \"e2e-api-a-eefed0-openshift-default-6f8467684f-655pp\" (UID: \"f4404b72-60f0-48d6-885b-8cf9de2b3cce\") " pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp"
Jul 09 22:29:17.138791 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:17.138755    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4404b72-60f0-48d6-885b-8cf9de2b3cce-istiod-ca-cert\") pod \"e2e-api-a-eefed0-openshift-default-6f8467684f-655pp\" (UID: \"f4404b72-60f0-48d6-885b-8cf9de2b3cce\") " pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp"
Jul 09 22:29:17.239535 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:17.239449    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4404b72-60f0-48d6-885b-8cf9de2b3cce-istio-data\") pod \"e2e-api-a-eefed0-openshift-default-6f8467684f-655pp\" (UID: \"f4404b72-60f0-48d6-885b-8cf9de2b3cce\") " pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp"
Jul 09 22:29:17.239535 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:17.239478    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4404b72-60f0-48d6-885b-8cf9de2b3cce-istio-podinfo\") pod \"e2e-api-a-eefed0-openshift-default-6f8467684f-655pp\" (UID: \"f4404b72-60f0-48d6-885b-8cf9de2b3cce\") " pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp"
Jul 09 22:29:17.239535 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:17.239502    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm8lq\" (UniqueName: \"kubernetes.io/projected/f4404b72-60f0-48d6-885b-8cf9de2b3cce-kube-api-access-gm8lq\") pod \"e2e-api-a-eefed0-openshift-default-6f8467684f-655pp\" (UID: \"f4404b72-60f0-48d6-885b-8cf9de2b3cce\") " pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp"
Jul 09 22:29:17.239535 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:17.239520    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4404b72-60f0-48d6-885b-8cf9de2b3cce-credential-socket\") pod \"e2e-api-a-eefed0-openshift-default-6f8467684f-655pp\" (UID: \"f4404b72-60f0-48d6-885b-8cf9de2b3cce\") " pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp"
Jul 09 22:29:17.239871 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:17.239560    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4404b72-60f0-48d6-885b-8cf9de2b3cce-workload-socket\") pod \"e2e-api-a-eefed0-openshift-default-6f8467684f-655pp\" (UID: \"f4404b72-60f0-48d6-885b-8cf9de2b3cce\") " pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp"
Jul 09 22:29:17.239871 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:17.239598    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4404b72-60f0-48d6-885b-8cf9de2b3cce-istio-envoy\") pod \"e2e-api-a-eefed0-openshift-default-6f8467684f-655pp\" (UID: \"f4404b72-60f0-48d6-885b-8cf9de2b3cce\") " pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp"
Jul 09 22:29:17.239871 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:17.239624    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4404b72-60f0-48d6-885b-8cf9de2b3cce-istiod-ca-cert\") pod \"e2e-api-a-eefed0-openshift-default-6f8467684f-655pp\" (UID: \"f4404b72-60f0-48d6-885b-8cf9de2b3cce\") " pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp"
Jul 09 22:29:17.239871 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:17.239654    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4404b72-60f0-48d6-885b-8cf9de2b3cce-istio-token\") pod \"e2e-api-a-eefed0-openshift-default-6f8467684f-655pp\" (UID: \"f4404b72-60f0-48d6-885b-8cf9de2b3cce\") " pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp"
Jul 09 22:29:17.239871 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:17.239680    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4404b72-60f0-48d6-885b-8cf9de2b3cce-workload-certs\") pod \"e2e-api-a-eefed0-openshift-default-6f8467684f-655pp\" (UID: \"f4404b72-60f0-48d6-885b-8cf9de2b3cce\") " pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp"
Jul 09 22:29:17.240167 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:17.239876    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4404b72-60f0-48d6-885b-8cf9de2b3cce-istio-data\") pod \"e2e-api-a-eefed0-openshift-default-6f8467684f-655pp\" (UID: \"f4404b72-60f0-48d6-885b-8cf9de2b3cce\") " pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp"
Jul 09 22:29:17.240227 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:17.240189    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4404b72-60f0-48d6-885b-8cf9de2b3cce-workload-socket\") pod \"e2e-api-a-eefed0-openshift-default-6f8467684f-655pp\" (UID: \"f4404b72-60f0-48d6-885b-8cf9de2b3cce\") " pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp"
Jul 09 22:29:17.240227 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:17.240207    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4404b72-60f0-48d6-885b-8cf9de2b3cce-credential-socket\") pod \"e2e-api-a-eefed0-openshift-default-6f8467684f-655pp\" (UID: \"f4404b72-60f0-48d6-885b-8cf9de2b3cce\") " pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp"
Jul 09 22:29:17.240361 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:17.240341    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4404b72-60f0-48d6-885b-8cf9de2b3cce-istiod-ca-cert\") pod \"e2e-api-a-eefed0-openshift-default-6f8467684f-655pp\" (UID: \"f4404b72-60f0-48d6-885b-8cf9de2b3cce\") " pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp"
Jul 09 22:29:17.240451 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:17.240431    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4404b72-60f0-48d6-885b-8cf9de2b3cce-workload-certs\") pod \"e2e-api-a-eefed0-openshift-default-6f8467684f-655pp\" (UID: \"f4404b72-60f0-48d6-885b-8cf9de2b3cce\") " pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp"
Jul 09 22:29:17.242055 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:17.242032    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4404b72-60f0-48d6-885b-8cf9de2b3cce-istio-envoy\") pod \"e2e-api-a-eefed0-openshift-default-6f8467684f-655pp\" (UID: \"f4404b72-60f0-48d6-885b-8cf9de2b3cce\") " pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp"
Jul 09 22:29:17.242153 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:17.242131    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4404b72-60f0-48d6-885b-8cf9de2b3cce-istio-podinfo\") pod \"e2e-api-a-eefed0-openshift-default-6f8467684f-655pp\" (UID: \"f4404b72-60f0-48d6-885b-8cf9de2b3cce\") " pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp"
Jul 09 22:29:17.252058 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:17.252040    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4404b72-60f0-48d6-885b-8cf9de2b3cce-istio-token\") pod \"e2e-api-a-eefed0-openshift-default-6f8467684f-655pp\" (UID: \"f4404b72-60f0-48d6-885b-8cf9de2b3cce\") " pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp"
Jul 09 22:29:17.252158 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:17.252098    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm8lq\" (UniqueName: \"kubernetes.io/projected/f4404b72-60f0-48d6-885b-8cf9de2b3cce-kube-api-access-gm8lq\") pod \"e2e-api-a-eefed0-openshift-default-6f8467684f-655pp\" (UID: \"f4404b72-60f0-48d6-885b-8cf9de2b3cce\") " pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp"
Jul 09 22:29:17.296758 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:17.296734    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp"
Jul 09 22:29:17.437043 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:17.437019    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp"]
Jul 09 22:29:17.439256 ip-10-0-141-101 kubenswrapper[2576]: W0709 22:29:17.439230    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4404b72_60f0_48d6_885b_8cf9de2b3cce.slice/crio-64190f9c69ba6297c4e35cb031b9511649f2398ede3a743e7fb974e71f8ce78d WatchSource:0}: Error finding container 64190f9c69ba6297c4e35cb031b9511649f2398ede3a743e7fb974e71f8ce78d: Status 404 returned error can't find the container with id 64190f9c69ba6297c4e35cb031b9511649f2398ede3a743e7fb974e71f8ce78d
Jul 09 22:29:17.441364 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:17.441331    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:29:17.441441 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:17.441396    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:29:17.441441 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:17.441430    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:29:18.108236 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:18.108201    2576 patch_prober.go:28] interesting pod/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 09 22:29:18.108679 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:18.108253    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm" podUID="af536734-211d-4301-86af-fc54d29face6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 09 22:29:18.340887 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:18.340851    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp" event={"ID":"f4404b72-60f0-48d6-885b-8cf9de2b3cce","Type":"ContainerStarted","Data":"1e4f8223bd1da2424826df76e894dd3d45aeccf086237293ca1047c4033f884d"}
Jul 09 22:29:18.341083 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:18.340907    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp" event={"ID":"f4404b72-60f0-48d6-885b-8cf9de2b3cce","Type":"ContainerStarted","Data":"64190f9c69ba6297c4e35cb031b9511649f2398ede3a743e7fb974e71f8ce78d"}
Jul 09 22:29:18.362757 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:18.362661    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp" podStartSLOduration=2.362646359 podStartE2EDuration="2.362646359s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:29:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:29:18.3619983 +0000 UTC m=+2305.693498378" watchObservedRunningTime="2026-07-09 22:29:18.362646359 +0000 UTC m=+2305.694146437"
Jul 09 22:29:19.297552 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:19.297522    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp"
Jul 09 22:29:19.302256 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:19.302233    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp"
Jul 09 22:29:19.346244 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:19.346215    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp"
Jul 09 22:29:19.347127 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:19.347106    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp"
Jul 09 22:29:21.289766 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:21.289742    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm"
Jul 09 22:29:21.357137 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:21.357057    2576 generic.go:356] "Generic (PLEG): container finished" podID="af536734-211d-4301-86af-fc54d29face6" containerID="92875400804e8a07e889e20bf0487c46d619d96c5a3c9e13e5e61179b5a5a4c7" exitCode=0
Jul 09 22:29:21.357137 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:21.357109    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm"
Jul 09 22:29:21.357340 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:21.357140    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm" event={"ID":"af536734-211d-4301-86af-fc54d29face6","Type":"ContainerDied","Data":"92875400804e8a07e889e20bf0487c46d619d96c5a3c9e13e5e61179b5a5a4c7"}
Jul 09 22:29:21.357340 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:21.357188    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm" event={"ID":"af536734-211d-4301-86af-fc54d29face6","Type":"ContainerDied","Data":"cc119b7b788acfa8fd9c53aeed0fb4f8ec3b760692b2fcb2adbe67f39f6b5e2f"}
Jul 09 22:29:21.357340 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:21.357211    2576 scope.go:117] "RemoveContainer" containerID="92875400804e8a07e889e20bf0487c46d619d96c5a3c9e13e5e61179b5a5a4c7"
Jul 09 22:29:21.365717 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:21.365702    2576 scope.go:117] "RemoveContainer" containerID="5488d702e0c36063234fc8f4025168b502bf51b0dbf75e80342be650d26cfe39"
Jul 09 22:29:21.373217 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:21.373200    2576 scope.go:117] "RemoveContainer" containerID="92875400804e8a07e889e20bf0487c46d619d96c5a3c9e13e5e61179b5a5a4c7"
Jul 09 22:29:21.373319 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:21.373303    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af536734-211d-4301-86af-fc54d29face6-credential-socket\") pod \"af536734-211d-4301-86af-fc54d29face6\" (UID: \"af536734-211d-4301-86af-fc54d29face6\") "
Jul 09 22:29:21.373373 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:21.373358    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af536734-211d-4301-86af-fc54d29face6-istiod-ca-cert\") pod \"af536734-211d-4301-86af-fc54d29face6\" (UID: \"af536734-211d-4301-86af-fc54d29face6\") "
Jul 09 22:29:21.373466 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:21.373448    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af536734-211d-4301-86af-fc54d29face6-istio-envoy\") pod \"af536734-211d-4301-86af-fc54d29face6\" (UID: \"af536734-211d-4301-86af-fc54d29face6\") "
Jul 09 22:29:21.373522 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:21.373487    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af536734-211d-4301-86af-fc54d29face6-istio-data\") pod \"af536734-211d-4301-86af-fc54d29face6\" (UID: \"af536734-211d-4301-86af-fc54d29face6\") "
Jul 09 22:29:21.373574 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:21.373537    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59qqg\" (UniqueName: \"kubernetes.io/projected/af536734-211d-4301-86af-fc54d29face6-kube-api-access-59qqg\") pod \"af536734-211d-4301-86af-fc54d29face6\" (UID: \"af536734-211d-4301-86af-fc54d29face6\") "
Jul 09 22:29:21.373574 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:21.373548    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af536734-211d-4301-86af-fc54d29face6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "af536734-211d-4301-86af-fc54d29face6" (UID: "af536734-211d-4301-86af-fc54d29face6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:29:21.373674 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:21.373572    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af536734-211d-4301-86af-fc54d29face6-workload-socket\") pod \"af536734-211d-4301-86af-fc54d29face6\" (UID: \"af536734-211d-4301-86af-fc54d29face6\") "
Jul 09 22:29:21.373674 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:21.373602    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af536734-211d-4301-86af-fc54d29face6-istio-podinfo\") pod \"af536734-211d-4301-86af-fc54d29face6\" (UID: \"af536734-211d-4301-86af-fc54d29face6\") "
Jul 09 22:29:21.373674 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:21.373626    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af536734-211d-4301-86af-fc54d29face6-workload-certs\") pod \"af536734-211d-4301-86af-fc54d29face6\" (UID: \"af536734-211d-4301-86af-fc54d29face6\") "
Jul 09 22:29:21.373674 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:21.373654    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af536734-211d-4301-86af-fc54d29face6-istio-token\") pod \"af536734-211d-4301-86af-fc54d29face6\" (UID: \"af536734-211d-4301-86af-fc54d29face6\") "
Jul 09 22:29:21.373674 ip-10-0-141-101 kubenswrapper[2576]: E0709 22:29:21.373657    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92875400804e8a07e889e20bf0487c46d619d96c5a3c9e13e5e61179b5a5a4c7\": container with ID starting with 92875400804e8a07e889e20bf0487c46d619d96c5a3c9e13e5e61179b5a5a4c7 not found: ID does not exist" containerID="92875400804e8a07e889e20bf0487c46d619d96c5a3c9e13e5e61179b5a5a4c7"
Jul 09 22:29:21.373900 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:21.373689    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92875400804e8a07e889e20bf0487c46d619d96c5a3c9e13e5e61179b5a5a4c7"} err="failed to get container status \"92875400804e8a07e889e20bf0487c46d619d96c5a3c9e13e5e61179b5a5a4c7\": rpc error: code = NotFound desc = could not find container \"92875400804e8a07e889e20bf0487c46d619d96c5a3c9e13e5e61179b5a5a4c7\": container with ID starting with 92875400804e8a07e889e20bf0487c46d619d96c5a3c9e13e5e61179b5a5a4c7 not found: ID does not exist"
Jul 09 22:29:21.373900 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:21.373711    2576 scope.go:117] "RemoveContainer" containerID="5488d702e0c36063234fc8f4025168b502bf51b0dbf75e80342be650d26cfe39"
Jul 09 22:29:21.373900 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:21.373721    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af536734-211d-4301-86af-fc54d29face6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "af536734-211d-4301-86af-fc54d29face6" (UID: "af536734-211d-4301-86af-fc54d29face6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:29:21.374101 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:21.373914    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af536734-211d-4301-86af-fc54d29face6-credential-socket\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:29:21.374101 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:21.373934    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af536734-211d-4301-86af-fc54d29face6-istiod-ca-cert\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:29:21.374101 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:21.373936    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af536734-211d-4301-86af-fc54d29face6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "af536734-211d-4301-86af-fc54d29face6" (UID: "af536734-211d-4301-86af-fc54d29face6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:29:21.374101 ip-10-0-141-101 kubenswrapper[2576]: E0709 22:29:21.374040    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5488d702e0c36063234fc8f4025168b502bf51b0dbf75e80342be650d26cfe39\": container with ID starting with 5488d702e0c36063234fc8f4025168b502bf51b0dbf75e80342be650d26cfe39 not found: ID does not exist" containerID="5488d702e0c36063234fc8f4025168b502bf51b0dbf75e80342be650d26cfe39"
Jul 09 22:29:21.374101 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:21.374059    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5488d702e0c36063234fc8f4025168b502bf51b0dbf75e80342be650d26cfe39"} err="failed to get container status \"5488d702e0c36063234fc8f4025168b502bf51b0dbf75e80342be650d26cfe39\": rpc error: code = NotFound desc = could not find container \"5488d702e0c36063234fc8f4025168b502bf51b0dbf75e80342be650d26cfe39\": container with ID starting with 5488d702e0c36063234fc8f4025168b502bf51b0dbf75e80342be650d26cfe39 not found: ID does not exist"
Jul 09 22:29:21.374390 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:21.374348    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af536734-211d-4301-86af-fc54d29face6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "af536734-211d-4301-86af-fc54d29face6" (UID: "af536734-211d-4301-86af-fc54d29face6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:29:21.374647 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:21.374622    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af536734-211d-4301-86af-fc54d29face6-istio-data" (OuterVolumeSpecName: "istio-data") pod "af536734-211d-4301-86af-fc54d29face6" (UID: "af536734-211d-4301-86af-fc54d29face6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:29:21.375524 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:21.375498    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af536734-211d-4301-86af-fc54d29face6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "af536734-211d-4301-86af-fc54d29face6" (UID: "af536734-211d-4301-86af-fc54d29face6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:29:21.376121 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:21.376097    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/af536734-211d-4301-86af-fc54d29face6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "af536734-211d-4301-86af-fc54d29face6" (UID: "af536734-211d-4301-86af-fc54d29face6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 22:29:21.376431 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:21.376407    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af536734-211d-4301-86af-fc54d29face6-kube-api-access-59qqg" (OuterVolumeSpecName: "kube-api-access-59qqg") pod "af536734-211d-4301-86af-fc54d29face6" (UID: "af536734-211d-4301-86af-fc54d29face6"). InnerVolumeSpecName "kube-api-access-59qqg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:29:21.376494 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:21.376415    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af536734-211d-4301-86af-fc54d29face6-istio-token" (OuterVolumeSpecName: "istio-token") pod "af536734-211d-4301-86af-fc54d29face6" (UID: "af536734-211d-4301-86af-fc54d29face6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:29:21.474939 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:21.474886    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af536734-211d-4301-86af-fc54d29face6-istio-envoy\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:29:21.474939 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:21.474916    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af536734-211d-4301-86af-fc54d29face6-istio-data\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:29:21.474939 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:21.474930    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59qqg\" (UniqueName: \"kubernetes.io/projected/af536734-211d-4301-86af-fc54d29face6-kube-api-access-59qqg\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:29:21.474939 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:21.474943    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af536734-211d-4301-86af-fc54d29face6-workload-socket\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:29:21.475219 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:21.474981    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af536734-211d-4301-86af-fc54d29face6-istio-podinfo\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:29:21.475219 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:21.474994    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af536734-211d-4301-86af-fc54d29face6-workload-certs\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:29:21.475219 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:21.475007    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af536734-211d-4301-86af-fc54d29face6-istio-token\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:29:21.679645 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:21.679616    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm"]
Jul 09 22:29:21.682828 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:21.682802    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-03e1d1-openshift-default-6d8bcf7d59-7jmxm"]
Jul 09 22:29:23.199941 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:23.199910    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af536734-211d-4301-86af-fc54d29face6" path="/var/lib/kubelet/pods/af536734-211d-4301-86af-fc54d29face6/volumes"
Jul 09 22:29:25.597077 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:25.597041    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj"]
Jul 09 22:29:25.597440 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:25.597382    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af536734-211d-4301-86af-fc54d29face6" containerName="istio-proxy"
Jul 09 22:29:25.597440 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:25.597392    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="af536734-211d-4301-86af-fc54d29face6" containerName="istio-proxy"
Jul 09 22:29:25.597510 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:25.597452    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="af536734-211d-4301-86af-fc54d29face6" containerName="istio-proxy"
Jul 09 22:29:25.597510 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:25.597460    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="af536734-211d-4301-86af-fc54d29face6" containerName="istio-proxy"
Jul 09 22:29:25.601831 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:25.601811    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj"
Jul 09 22:29:25.605587 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:25.605568    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-c4e995-openshift-default-dockercfg-t682j\""
Jul 09 22:29:25.616187 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:25.616167    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj"]
Jul 09 22:29:25.708931 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:25.708900    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3348f83-2d15-4eaf-947a-280288cfccc6-credential-socket\") pod \"e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj\" (UID: \"a3348f83-2d15-4eaf-947a-280288cfccc6\") " pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj"
Jul 09 22:29:25.708931 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:25.708936    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3348f83-2d15-4eaf-947a-280288cfccc6-workload-socket\") pod \"e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj\" (UID: \"a3348f83-2d15-4eaf-947a-280288cfccc6\") " pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj"
Jul 09 22:29:25.709193 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:25.708990    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ws5t\" (UniqueName: \"kubernetes.io/projected/a3348f83-2d15-4eaf-947a-280288cfccc6-kube-api-access-4ws5t\") pod \"e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj\" (UID: \"a3348f83-2d15-4eaf-947a-280288cfccc6\") " pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj"
Jul 09 22:29:25.709193 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:25.709033    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3348f83-2d15-4eaf-947a-280288cfccc6-istiod-ca-cert\") pod \"e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj\" (UID: \"a3348f83-2d15-4eaf-947a-280288cfccc6\") " pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj"
Jul 09 22:29:25.709193 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:25.709063    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3348f83-2d15-4eaf-947a-280288cfccc6-istio-token\") pod \"e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj\" (UID: \"a3348f83-2d15-4eaf-947a-280288cfccc6\") " pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj"
Jul 09 22:29:25.709193 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:25.709084    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3348f83-2d15-4eaf-947a-280288cfccc6-istio-envoy\") pod \"e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj\" (UID: \"a3348f83-2d15-4eaf-947a-280288cfccc6\") " pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj"
Jul 09 22:29:25.709193 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:25.709114    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3348f83-2d15-4eaf-947a-280288cfccc6-istio-podinfo\") pod \"e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj\" (UID: \"a3348f83-2d15-4eaf-947a-280288cfccc6\") " pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj"
Jul 09 22:29:25.709193 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:25.709139    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3348f83-2d15-4eaf-947a-280288cfccc6-workload-certs\") pod \"e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj\" (UID: \"a3348f83-2d15-4eaf-947a-280288cfccc6\") " pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj"
Jul 09 22:29:25.709193 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:25.709169    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3348f83-2d15-4eaf-947a-280288cfccc6-istio-data\") pod \"e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj\" (UID: \"a3348f83-2d15-4eaf-947a-280288cfccc6\") " pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj"
Jul 09 22:29:25.810615 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:25.810583    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3348f83-2d15-4eaf-947a-280288cfccc6-istio-podinfo\") pod \"e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj\" (UID: \"a3348f83-2d15-4eaf-947a-280288cfccc6\") " pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj"
Jul 09 22:29:25.810794 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:25.810618    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3348f83-2d15-4eaf-947a-280288cfccc6-workload-certs\") pod \"e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj\" (UID: \"a3348f83-2d15-4eaf-947a-280288cfccc6\") " pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj"
Jul 09 22:29:25.810794 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:25.810660    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3348f83-2d15-4eaf-947a-280288cfccc6-istio-data\") pod \"e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj\" (UID: \"a3348f83-2d15-4eaf-947a-280288cfccc6\") " pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj"
Jul 09 22:29:25.810794 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:25.810713    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3348f83-2d15-4eaf-947a-280288cfccc6-credential-socket\") pod \"e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj\" (UID: \"a3348f83-2d15-4eaf-947a-280288cfccc6\") " pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj"
Jul 09 22:29:25.810944 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:25.810836    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3348f83-2d15-4eaf-947a-280288cfccc6-workload-socket\") pod \"e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj\" (UID: \"a3348f83-2d15-4eaf-947a-280288cfccc6\") " pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj"
Jul 09 22:29:25.810944 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:25.810896    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ws5t\" (UniqueName: \"kubernetes.io/projected/a3348f83-2d15-4eaf-947a-280288cfccc6-kube-api-access-4ws5t\") pod \"e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj\" (UID: \"a3348f83-2d15-4eaf-947a-280288cfccc6\") " pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj"
Jul 09 22:29:25.811080 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:25.810945    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3348f83-2d15-4eaf-947a-280288cfccc6-istiod-ca-cert\") pod \"e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj\" (UID: \"a3348f83-2d15-4eaf-947a-280288cfccc6\") " pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj"
Jul 09 22:29:25.811080 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:25.810997    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3348f83-2d15-4eaf-947a-280288cfccc6-istio-token\") pod \"e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj\" (UID: \"a3348f83-2d15-4eaf-947a-280288cfccc6\") " pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj"
Jul 09 22:29:25.811080 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:25.811024    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3348f83-2d15-4eaf-947a-280288cfccc6-istio-envoy\") pod \"e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj\" (UID: \"a3348f83-2d15-4eaf-947a-280288cfccc6\") " pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj"
Jul 09 22:29:25.811234 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:25.811126    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3348f83-2d15-4eaf-947a-280288cfccc6-istio-data\") pod \"e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj\" (UID: \"a3348f83-2d15-4eaf-947a-280288cfccc6\") " pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj"
Jul 09 22:29:25.811234 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:25.811160    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3348f83-2d15-4eaf-947a-280288cfccc6-workload-certs\") pod \"e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj\" (UID: \"a3348f83-2d15-4eaf-947a-280288cfccc6\") " pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj"
Jul 09 22:29:25.811342 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:25.811312    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3348f83-2d15-4eaf-947a-280288cfccc6-credential-socket\") pod \"e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj\" (UID: \"a3348f83-2d15-4eaf-947a-280288cfccc6\") " pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj"
Jul 09 22:29:25.811458 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:25.811434    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3348f83-2d15-4eaf-947a-280288cfccc6-workload-socket\") pod \"e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj\" (UID: \"a3348f83-2d15-4eaf-947a-280288cfccc6\") " pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj"
Jul 09 22:29:25.811732 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:25.811709    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3348f83-2d15-4eaf-947a-280288cfccc6-istiod-ca-cert\") pod \"e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj\" (UID: \"a3348f83-2d15-4eaf-947a-280288cfccc6\") " pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj"
Jul 09 22:29:25.812987 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:25.812966    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3348f83-2d15-4eaf-947a-280288cfccc6-istio-envoy\") pod \"e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj\" (UID: \"a3348f83-2d15-4eaf-947a-280288cfccc6\") " pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj"
Jul 09 22:29:25.813089 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:25.813009    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3348f83-2d15-4eaf-947a-280288cfccc6-istio-podinfo\") pod \"e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj\" (UID: \"a3348f83-2d15-4eaf-947a-280288cfccc6\") " pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj"
Jul 09 22:29:25.818505 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:25.818486    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3348f83-2d15-4eaf-947a-280288cfccc6-istio-token\") pod \"e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj\" (UID: \"a3348f83-2d15-4eaf-947a-280288cfccc6\") " pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj"
Jul 09 22:29:25.818670 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:25.818652    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ws5t\" (UniqueName: \"kubernetes.io/projected/a3348f83-2d15-4eaf-947a-280288cfccc6-kube-api-access-4ws5t\") pod \"e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj\" (UID: \"a3348f83-2d15-4eaf-947a-280288cfccc6\") " pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj"
Jul 09 22:29:25.912101 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:25.912024    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj"
Jul 09 22:29:26.053080 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:26.053052    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj"]
Jul 09 22:29:26.055301 ip-10-0-141-101 kubenswrapper[2576]: W0709 22:29:26.055274    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3348f83_2d15_4eaf_947a_280288cfccc6.slice/crio-e1f6741d5fd07b8cdb3d652d379dd7e7d8facac13e402d5dfcf6bb7dc506480a WatchSource:0}: Error finding container e1f6741d5fd07b8cdb3d652d379dd7e7d8facac13e402d5dfcf6bb7dc506480a: Status 404 returned error can't find the container with id e1f6741d5fd07b8cdb3d652d379dd7e7d8facac13e402d5dfcf6bb7dc506480a
Jul 09 22:29:26.058020 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:26.057984    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:29:26.058118 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:26.058061    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:29:26.058118 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:26.058100    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:29:26.382065 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:26.382031    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj" event={"ID":"a3348f83-2d15-4eaf-947a-280288cfccc6","Type":"ContainerStarted","Data":"6704f9b6f81f08596f687ef1463e790907ce3f35b3cfa11c0927d23f8531d3cc"}
Jul 09 22:29:26.382248 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:26.382081    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj" event={"ID":"a3348f83-2d15-4eaf-947a-280288cfccc6","Type":"ContainerStarted","Data":"e1f6741d5fd07b8cdb3d652d379dd7e7d8facac13e402d5dfcf6bb7dc506480a"}
Jul 09 22:29:26.403978 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:26.403919    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj" podStartSLOduration=1.403903583 podStartE2EDuration="1.403903583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:29:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:29:26.402208421 +0000 UTC m=+2313.733708511" watchObservedRunningTime="2026-07-09 22:29:26.403903583 +0000 UTC m=+2313.735403661"
Jul 09 22:29:26.913021 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:26.912987    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj"
Jul 09 22:29:27.917920 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:27.917889    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj"
Jul 09 22:29:28.391907 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:28.391879    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj"
Jul 09 22:29:28.392992 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:28.392974    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj"
Jul 09 22:29:33.418372 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:33.418343    2576 generic.go:356] "Generic (PLEG): container finished" podID="f4404b72-60f0-48d6-885b-8cf9de2b3cce" containerID="1e4f8223bd1da2424826df76e894dd3d45aeccf086237293ca1047c4033f884d" exitCode=0
Jul 09 22:29:33.418783 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:33.418400    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp" event={"ID":"f4404b72-60f0-48d6-885b-8cf9de2b3cce","Type":"ContainerDied","Data":"1e4f8223bd1da2424826df76e894dd3d45aeccf086237293ca1047c4033f884d"}
Jul 09 22:29:33.418783 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:33.418688    2576 scope.go:117] "RemoveContainer" containerID="1e4f8223bd1da2424826df76e894dd3d45aeccf086237293ca1047c4033f884d"
Jul 09 22:29:33.419676 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:33.419642    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:29:33.419810 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:33.419727    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:29:33.419810 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:33.419775    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:29:34.346610 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:34.346566    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp"
Jul 09 22:29:34.424373 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:34.424337    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp" event={"ID":"f4404b72-60f0-48d6-885b-8cf9de2b3cce","Type":"ContainerStarted","Data":"8f179bebf3bcc14cb91e19e8497e8f1e1d46e72a20d4dde3813792463cb881a6"}
Jul 09 22:29:35.297898 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:35.297866    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp"
Jul 09 22:29:35.298941 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:35.298913    2576 patch_prober.go:28] interesting pod/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 09 22:29:35.299094 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:35.298978    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp" podUID="f4404b72-60f0-48d6-885b-8cf9de2b3cce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 09 22:29:36.298059 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:36.298015    2576 patch_prober.go:28] interesting pod/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 09 22:29:36.298448 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:36.298090    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp" podUID="f4404b72-60f0-48d6-885b-8cf9de2b3cce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 09 22:29:37.297667 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:37.297631    2576 patch_prober.go:28] interesting pod/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 09 22:29:37.297845 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:37.297690    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp" podUID="f4404b72-60f0-48d6-885b-8cf9de2b3cce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 09 22:29:38.297796 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:38.297752    2576 patch_prober.go:28] interesting pod/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 09 22:29:38.298332 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:38.297865    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp" podUID="f4404b72-60f0-48d6-885b-8cf9de2b3cce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 09 22:29:39.301134 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:39.301106    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp"
Jul 09 22:29:39.301513 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:39.301477    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp"
Jul 09 22:29:39.302191 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:39.302171    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp"
Jul 09 22:29:44.433119 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:44.433078    2576 patch_prober.go:28] interesting pod/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 09 22:29:44.433623 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:44.433150    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj" podUID="a3348f83-2d15-4eaf-947a-280288cfccc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 09 22:29:45.499082 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:45.498990    2576 generic.go:356] "Generic (PLEG): container finished" podID="a3348f83-2d15-4eaf-947a-280288cfccc6" containerID="6704f9b6f81f08596f687ef1463e790907ce3f35b3cfa11c0927d23f8531d3cc" exitCode=0
Jul 09 22:29:45.499082 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:45.499068    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj" event={"ID":"a3348f83-2d15-4eaf-947a-280288cfccc6","Type":"ContainerDied","Data":"6704f9b6f81f08596f687ef1463e790907ce3f35b3cfa11c0927d23f8531d3cc"}
Jul 09 22:29:45.499497 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:45.499408    2576 scope.go:117] "RemoveContainer" containerID="6704f9b6f81f08596f687ef1463e790907ce3f35b3cfa11c0927d23f8531d3cc"
Jul 09 22:29:45.500448 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:45.500419    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:29:45.500562 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:45.500489    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:29:45.500562 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:45.500526    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:29:46.506474 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:46.506442    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj" event={"ID":"a3348f83-2d15-4eaf-947a-280288cfccc6","Type":"ContainerStarted","Data":"ac06fc9cdebdb0722cf7747bf62225398be2bebf490c822eb9c65d547c132651"}
Jul 09 22:29:46.912692 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:46.912653    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj"
Jul 09 22:29:46.912918 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:46.912896    2576 patch_prober.go:28] interesting pod/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 09 22:29:46.913036 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:46.912976    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj" podUID="a3348f83-2d15-4eaf-947a-280288cfccc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 09 22:29:47.878204 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:47.878174    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp"]
Jul 09 22:29:47.878633 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:47.878376    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp" podUID="f4404b72-60f0-48d6-885b-8cf9de2b3cce" containerName="istio-proxy" containerID="cri-o://8f179bebf3bcc14cb91e19e8497e8f1e1d46e72a20d4dde3813792463cb881a6" gracePeriod=30
Jul 09 22:29:47.913179 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:47.913153    2576 patch_prober.go:28] interesting pod/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 09 22:29:47.913311 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:47.913235    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj" podUID="a3348f83-2d15-4eaf-947a-280288cfccc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 09 22:29:48.912573 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:48.912540    2576 patch_prober.go:28] interesting pod/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 09 22:29:48.913053 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:48.912599    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj" podUID="a3348f83-2d15-4eaf-947a-280288cfccc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 09 22:29:49.913351 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:49.913312    2576 patch_prober.go:28] interesting pod/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 09 22:29:49.913743 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:49.913369    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj" podUID="a3348f83-2d15-4eaf-947a-280288cfccc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 09 22:29:50.916100 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:50.916065    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj"
Jul 09 22:29:50.916475 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:50.916326    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj"
Jul 09 22:29:50.917049 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:50.917029    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj"
Jul 09 22:29:53.125154 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:53.125130    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp"
Jul 09 22:29:53.176474 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:53.176404    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4404b72-60f0-48d6-885b-8cf9de2b3cce-workload-certs\") pod \"f4404b72-60f0-48d6-885b-8cf9de2b3cce\" (UID: \"f4404b72-60f0-48d6-885b-8cf9de2b3cce\") "
Jul 09 22:29:53.176474 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:53.176454    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4404b72-60f0-48d6-885b-8cf9de2b3cce-workload-socket\") pod \"f4404b72-60f0-48d6-885b-8cf9de2b3cce\" (UID: \"f4404b72-60f0-48d6-885b-8cf9de2b3cce\") "
Jul 09 22:29:53.176674 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:53.176492    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4404b72-60f0-48d6-885b-8cf9de2b3cce-istiod-ca-cert\") pod \"f4404b72-60f0-48d6-885b-8cf9de2b3cce\" (UID: \"f4404b72-60f0-48d6-885b-8cf9de2b3cce\") "
Jul 09 22:29:53.176674 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:53.176522    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4404b72-60f0-48d6-885b-8cf9de2b3cce-istio-envoy\") pod \"f4404b72-60f0-48d6-885b-8cf9de2b3cce\" (UID: \"f4404b72-60f0-48d6-885b-8cf9de2b3cce\") "
Jul 09 22:29:53.176674 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:53.176544    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4404b72-60f0-48d6-885b-8cf9de2b3cce-credential-socket\") pod \"f4404b72-60f0-48d6-885b-8cf9de2b3cce\" (UID: \"f4404b72-60f0-48d6-885b-8cf9de2b3cce\") "
Jul 09 22:29:53.176674 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:53.176581    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4404b72-60f0-48d6-885b-8cf9de2b3cce-istio-data\") pod \"f4404b72-60f0-48d6-885b-8cf9de2b3cce\" (UID: \"f4404b72-60f0-48d6-885b-8cf9de2b3cce\") "
Jul 09 22:29:53.176674 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:53.176608    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gm8lq\" (UniqueName: \"kubernetes.io/projected/f4404b72-60f0-48d6-885b-8cf9de2b3cce-kube-api-access-gm8lq\") pod \"f4404b72-60f0-48d6-885b-8cf9de2b3cce\" (UID: \"f4404b72-60f0-48d6-885b-8cf9de2b3cce\") "
Jul 09 22:29:53.176674 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:53.176635    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4404b72-60f0-48d6-885b-8cf9de2b3cce-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f4404b72-60f0-48d6-885b-8cf9de2b3cce" (UID: "f4404b72-60f0-48d6-885b-8cf9de2b3cce"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:29:53.176674 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:53.176652    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4404b72-60f0-48d6-885b-8cf9de2b3cce-istio-token\") pod \"f4404b72-60f0-48d6-885b-8cf9de2b3cce\" (UID: \"f4404b72-60f0-48d6-885b-8cf9de2b3cce\") "
Jul 09 22:29:53.176674 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:53.176677    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4404b72-60f0-48d6-885b-8cf9de2b3cce-istio-podinfo\") pod \"f4404b72-60f0-48d6-885b-8cf9de2b3cce\" (UID: \"f4404b72-60f0-48d6-885b-8cf9de2b3cce\") "
Jul 09 22:29:53.177152 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:53.176798    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4404b72-60f0-48d6-885b-8cf9de2b3cce-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f4404b72-60f0-48d6-885b-8cf9de2b3cce" (UID: "f4404b72-60f0-48d6-885b-8cf9de2b3cce"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:29:53.177152 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:53.176894    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4404b72-60f0-48d6-885b-8cf9de2b3cce-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f4404b72-60f0-48d6-885b-8cf9de2b3cce" (UID: "f4404b72-60f0-48d6-885b-8cf9de2b3cce"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:29:53.177152 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:53.176994    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4404b72-60f0-48d6-885b-8cf9de2b3cce-workload-certs\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:29:53.177152 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:53.177013    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4404b72-60f0-48d6-885b-8cf9de2b3cce-workload-socket\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:29:53.177152 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:53.177026    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4404b72-60f0-48d6-885b-8cf9de2b3cce-istiod-ca-cert\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:29:53.177555 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:53.177528    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4404b72-60f0-48d6-885b-8cf9de2b3cce-istio-data" (OuterVolumeSpecName: "istio-data") pod "f4404b72-60f0-48d6-885b-8cf9de2b3cce" (UID: "f4404b72-60f0-48d6-885b-8cf9de2b3cce"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:29:53.177799 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:53.177772    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4404b72-60f0-48d6-885b-8cf9de2b3cce-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f4404b72-60f0-48d6-885b-8cf9de2b3cce" (UID: "f4404b72-60f0-48d6-885b-8cf9de2b3cce"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:29:53.178948 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:53.178903    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f4404b72-60f0-48d6-885b-8cf9de2b3cce-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f4404b72-60f0-48d6-885b-8cf9de2b3cce" (UID: "f4404b72-60f0-48d6-885b-8cf9de2b3cce"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 22:29:53.178948 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:53.178920    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4404b72-60f0-48d6-885b-8cf9de2b3cce-istio-token" (OuterVolumeSpecName: "istio-token") pod "f4404b72-60f0-48d6-885b-8cf9de2b3cce" (UID: "f4404b72-60f0-48d6-885b-8cf9de2b3cce"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:29:53.179123 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:53.179091    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4404b72-60f0-48d6-885b-8cf9de2b3cce-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f4404b72-60f0-48d6-885b-8cf9de2b3cce" (UID: "f4404b72-60f0-48d6-885b-8cf9de2b3cce"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:29:53.179123 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:53.179103    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4404b72-60f0-48d6-885b-8cf9de2b3cce-kube-api-access-gm8lq" (OuterVolumeSpecName: "kube-api-access-gm8lq") pod "f4404b72-60f0-48d6-885b-8cf9de2b3cce" (UID: "f4404b72-60f0-48d6-885b-8cf9de2b3cce"). InnerVolumeSpecName "kube-api-access-gm8lq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:29:53.278295 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:53.278270    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4404b72-60f0-48d6-885b-8cf9de2b3cce-istio-envoy\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:29:53.278295 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:53.278291    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4404b72-60f0-48d6-885b-8cf9de2b3cce-credential-socket\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:29:53.278295 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:53.278300    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4404b72-60f0-48d6-885b-8cf9de2b3cce-istio-data\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:29:53.278524 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:53.278309    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gm8lq\" (UniqueName: \"kubernetes.io/projected/f4404b72-60f0-48d6-885b-8cf9de2b3cce-kube-api-access-gm8lq\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:29:53.278524 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:53.278318    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4404b72-60f0-48d6-885b-8cf9de2b3cce-istio-token\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:29:53.278524 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:53.278326    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4404b72-60f0-48d6-885b-8cf9de2b3cce-istio-podinfo\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:29:53.539785 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:53.539753    2576 generic.go:356] "Generic (PLEG): container finished" podID="f4404b72-60f0-48d6-885b-8cf9de2b3cce" containerID="8f179bebf3bcc14cb91e19e8497e8f1e1d46e72a20d4dde3813792463cb881a6" exitCode=0
Jul 09 22:29:53.539897 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:53.539799    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp"
Jul 09 22:29:53.539897 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:53.539812    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp" event={"ID":"f4404b72-60f0-48d6-885b-8cf9de2b3cce","Type":"ContainerDied","Data":"8f179bebf3bcc14cb91e19e8497e8f1e1d46e72a20d4dde3813792463cb881a6"}
Jul 09 22:29:53.539897 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:53.539861    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp" event={"ID":"f4404b72-60f0-48d6-885b-8cf9de2b3cce","Type":"ContainerDied","Data":"64190f9c69ba6297c4e35cb031b9511649f2398ede3a743e7fb974e71f8ce78d"}
Jul 09 22:29:53.539897 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:53.539884    2576 scope.go:117] "RemoveContainer" containerID="8f179bebf3bcc14cb91e19e8497e8f1e1d46e72a20d4dde3813792463cb881a6"
Jul 09 22:29:53.547765 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:53.547745    2576 scope.go:117] "RemoveContainer" containerID="1e4f8223bd1da2424826df76e894dd3d45aeccf086237293ca1047c4033f884d"
Jul 09 22:29:53.555124 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:53.555096    2576 scope.go:117] "RemoveContainer" containerID="8f179bebf3bcc14cb91e19e8497e8f1e1d46e72a20d4dde3813792463cb881a6"
Jul 09 22:29:53.555398 ip-10-0-141-101 kubenswrapper[2576]: E0709 22:29:53.555373    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f179bebf3bcc14cb91e19e8497e8f1e1d46e72a20d4dde3813792463cb881a6\": container with ID starting with 8f179bebf3bcc14cb91e19e8497e8f1e1d46e72a20d4dde3813792463cb881a6 not found: ID does not exist" containerID="8f179bebf3bcc14cb91e19e8497e8f1e1d46e72a20d4dde3813792463cb881a6"
Jul 09 22:29:53.555467 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:53.555407    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f179bebf3bcc14cb91e19e8497e8f1e1d46e72a20d4dde3813792463cb881a6"} err="failed to get container status \"8f179bebf3bcc14cb91e19e8497e8f1e1d46e72a20d4dde3813792463cb881a6\": rpc error: code = NotFound desc = could not find container \"8f179bebf3bcc14cb91e19e8497e8f1e1d46e72a20d4dde3813792463cb881a6\": container with ID starting with 8f179bebf3bcc14cb91e19e8497e8f1e1d46e72a20d4dde3813792463cb881a6 not found: ID does not exist"
Jul 09 22:29:53.555467 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:53.555426    2576 scope.go:117] "RemoveContainer" containerID="1e4f8223bd1da2424826df76e894dd3d45aeccf086237293ca1047c4033f884d"
Jul 09 22:29:53.555696 ip-10-0-141-101 kubenswrapper[2576]: E0709 22:29:53.555677    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e4f8223bd1da2424826df76e894dd3d45aeccf086237293ca1047c4033f884d\": container with ID starting with 1e4f8223bd1da2424826df76e894dd3d45aeccf086237293ca1047c4033f884d not found: ID does not exist" containerID="1e4f8223bd1da2424826df76e894dd3d45aeccf086237293ca1047c4033f884d"
Jul 09 22:29:53.555829 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:53.555705    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e4f8223bd1da2424826df76e894dd3d45aeccf086237293ca1047c4033f884d"} err="failed to get container status \"1e4f8223bd1da2424826df76e894dd3d45aeccf086237293ca1047c4033f884d\": rpc error: code = NotFound desc = could not find container \"1e4f8223bd1da2424826df76e894dd3d45aeccf086237293ca1047c4033f884d\": container with ID starting with 1e4f8223bd1da2424826df76e894dd3d45aeccf086237293ca1047c4033f884d not found: ID does not exist"
Jul 09 22:29:53.558250 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:53.558232    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp"]
Jul 09 22:29:53.564217 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:53.564197    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-eefed0-openshift-default-6f8467684f-655pp"]
Jul 09 22:29:55.200717 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:55.200683    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4404b72-60f0-48d6-885b-8cf9de2b3cce" path="/var/lib/kubelet/pods/f4404b72-60f0-48d6-885b-8cf9de2b3cce/volumes"
Jul 09 22:29:55.468969 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:55.468874    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj"]
Jul 09 22:29:55.469126 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:55.469084    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj" podUID="a3348f83-2d15-4eaf-947a-280288cfccc6" containerName="istio-proxy" containerID="cri-o://ac06fc9cdebdb0722cf7747bf62225398be2bebf490c822eb9c65d547c132651" gracePeriod=30
Jul 09 22:29:56.296730 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:56.296701    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l"]
Jul 09 22:29:56.297114 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:56.297062    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4404b72-60f0-48d6-885b-8cf9de2b3cce" containerName="istio-proxy"
Jul 09 22:29:56.297114 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:56.297074    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4404b72-60f0-48d6-885b-8cf9de2b3cce" containerName="istio-proxy"
Jul 09 22:29:56.297114 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:56.297085    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4404b72-60f0-48d6-885b-8cf9de2b3cce" containerName="istio-proxy"
Jul 09 22:29:56.297114 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:56.297091    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4404b72-60f0-48d6-885b-8cf9de2b3cce" containerName="istio-proxy"
Jul 09 22:29:56.297114 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:56.297098    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af536734-211d-4301-86af-fc54d29face6" containerName="istio-proxy"
Jul 09 22:29:56.297114 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:56.297104    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="af536734-211d-4301-86af-fc54d29face6" containerName="istio-proxy"
Jul 09 22:29:56.297311 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:56.297150    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4404b72-60f0-48d6-885b-8cf9de2b3cce" containerName="istio-proxy"
Jul 09 22:29:56.300121 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:56.300095    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l"
Jul 09 22:29:56.302872 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:56.302854    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-e4b894-openshift-default-dockercfg-8psfw\""
Jul 09 22:29:56.317595 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:56.317574    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l"]
Jul 09 22:29:56.405052 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:56.405014    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e808772e-4ae2-445c-b21b-9a6ad4727f57-credential-socket\") pod \"e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l\" (UID: \"e808772e-4ae2-445c-b21b-9a6ad4727f57\") " pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l"
Jul 09 22:29:56.405245 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:56.405109    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e808772e-4ae2-445c-b21b-9a6ad4727f57-istio-token\") pod \"e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l\" (UID: \"e808772e-4ae2-445c-b21b-9a6ad4727f57\") " pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l"
Jul 09 22:29:56.405245 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:56.405143    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e808772e-4ae2-445c-b21b-9a6ad4727f57-istiod-ca-cert\") pod \"e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l\" (UID: \"e808772e-4ae2-445c-b21b-9a6ad4727f57\") " pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l"
Jul 09 22:29:56.405245 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:56.405186    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e808772e-4ae2-445c-b21b-9a6ad4727f57-workload-certs\") pod \"e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l\" (UID: \"e808772e-4ae2-445c-b21b-9a6ad4727f57\") " pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l"
Jul 09 22:29:56.405245 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:56.405230    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e808772e-4ae2-445c-b21b-9a6ad4727f57-istio-data\") pod \"e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l\" (UID: \"e808772e-4ae2-445c-b21b-9a6ad4727f57\") " pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l"
Jul 09 22:29:56.405479 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:56.405283    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e808772e-4ae2-445c-b21b-9a6ad4727f57-istio-podinfo\") pod \"e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l\" (UID: \"e808772e-4ae2-445c-b21b-9a6ad4727f57\") " pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l"
Jul 09 22:29:56.405479 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:56.405320    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e808772e-4ae2-445c-b21b-9a6ad4727f57-workload-socket\") pod \"e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l\" (UID: \"e808772e-4ae2-445c-b21b-9a6ad4727f57\") " pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l"
Jul 09 22:29:56.405479 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:56.405351    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg2k8\" (UniqueName: \"kubernetes.io/projected/e808772e-4ae2-445c-b21b-9a6ad4727f57-kube-api-access-lg2k8\") pod \"e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l\" (UID: \"e808772e-4ae2-445c-b21b-9a6ad4727f57\") " pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l"
Jul 09 22:29:56.405479 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:56.405449    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e808772e-4ae2-445c-b21b-9a6ad4727f57-istio-envoy\") pod \"e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l\" (UID: \"e808772e-4ae2-445c-b21b-9a6ad4727f57\") " pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l"
Jul 09 22:29:56.506194 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:56.506159    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e808772e-4ae2-445c-b21b-9a6ad4727f57-istio-token\") pod \"e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l\" (UID: \"e808772e-4ae2-445c-b21b-9a6ad4727f57\") " pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l"
Jul 09 22:29:56.506194 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:56.506198    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e808772e-4ae2-445c-b21b-9a6ad4727f57-istiod-ca-cert\") pod \"e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l\" (UID: \"e808772e-4ae2-445c-b21b-9a6ad4727f57\") " pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l"
Jul 09 22:29:56.506446 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:56.506216    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e808772e-4ae2-445c-b21b-9a6ad4727f57-workload-certs\") pod \"e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l\" (UID: \"e808772e-4ae2-445c-b21b-9a6ad4727f57\") " pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l"
Jul 09 22:29:56.506446 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:56.506353    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e808772e-4ae2-445c-b21b-9a6ad4727f57-istio-data\") pod \"e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l\" (UID: \"e808772e-4ae2-445c-b21b-9a6ad4727f57\") " pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l"
Jul 09 22:29:56.506446 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:56.506399    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e808772e-4ae2-445c-b21b-9a6ad4727f57-istio-podinfo\") pod \"e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l\" (UID: \"e808772e-4ae2-445c-b21b-9a6ad4727f57\") " pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l"
Jul 09 22:29:56.506446 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:56.506444    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e808772e-4ae2-445c-b21b-9a6ad4727f57-workload-socket\") pod \"e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l\" (UID: \"e808772e-4ae2-445c-b21b-9a6ad4727f57\") " pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l"
Jul 09 22:29:56.506659 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:56.506469    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg2k8\" (UniqueName: \"kubernetes.io/projected/e808772e-4ae2-445c-b21b-9a6ad4727f57-kube-api-access-lg2k8\") pod \"e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l\" (UID: \"e808772e-4ae2-445c-b21b-9a6ad4727f57\") " pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l"
Jul 09 22:29:56.506659 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:56.506515    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e808772e-4ae2-445c-b21b-9a6ad4727f57-istio-envoy\") pod \"e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l\" (UID: \"e808772e-4ae2-445c-b21b-9a6ad4727f57\") " pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l"
Jul 09 22:29:56.506659 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:56.506550    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e808772e-4ae2-445c-b21b-9a6ad4727f57-credential-socket\") pod \"e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l\" (UID: \"e808772e-4ae2-445c-b21b-9a6ad4727f57\") " pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l"
Jul 09 22:29:56.506816 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:56.506746    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e808772e-4ae2-445c-b21b-9a6ad4727f57-workload-certs\") pod \"e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l\" (UID: \"e808772e-4ae2-445c-b21b-9a6ad4727f57\") " pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l"
Jul 09 22:29:56.506876 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:56.506830    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e808772e-4ae2-445c-b21b-9a6ad4727f57-workload-socket\") pod \"e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l\" (UID: \"e808772e-4ae2-445c-b21b-9a6ad4727f57\") " pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l"
Jul 09 22:29:56.507011 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:56.506993    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e808772e-4ae2-445c-b21b-9a6ad4727f57-credential-socket\") pod \"e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l\" (UID: \"e808772e-4ae2-445c-b21b-9a6ad4727f57\") " pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l"
Jul 09 22:29:56.507011 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:56.506999    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e808772e-4ae2-445c-b21b-9a6ad4727f57-istiod-ca-cert\") pod \"e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l\" (UID: \"e808772e-4ae2-445c-b21b-9a6ad4727f57\") " pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l"
Jul 09 22:29:56.507124 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:56.506995    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e808772e-4ae2-445c-b21b-9a6ad4727f57-istio-data\") pod \"e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l\" (UID: \"e808772e-4ae2-445c-b21b-9a6ad4727f57\") " pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l"
Jul 09 22:29:56.508790 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:56.508768    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e808772e-4ae2-445c-b21b-9a6ad4727f57-istio-envoy\") pod \"e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l\" (UID: \"e808772e-4ae2-445c-b21b-9a6ad4727f57\") " pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l"
Jul 09 22:29:56.508923 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:56.508904    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e808772e-4ae2-445c-b21b-9a6ad4727f57-istio-podinfo\") pod \"e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l\" (UID: \"e808772e-4ae2-445c-b21b-9a6ad4727f57\") " pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l"
Jul 09 22:29:56.516175 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:56.516148    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e808772e-4ae2-445c-b21b-9a6ad4727f57-istio-token\") pod \"e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l\" (UID: \"e808772e-4ae2-445c-b21b-9a6ad4727f57\") " pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l"
Jul 09 22:29:56.516268 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:56.516171    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg2k8\" (UniqueName: \"kubernetes.io/projected/e808772e-4ae2-445c-b21b-9a6ad4727f57-kube-api-access-lg2k8\") pod \"e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l\" (UID: \"e808772e-4ae2-445c-b21b-9a6ad4727f57\") " pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l"
Jul 09 22:29:56.611105 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:56.611026    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l"
Jul 09 22:29:56.747022 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:56.746976    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l"]
Jul 09 22:29:56.749504 ip-10-0-141-101 kubenswrapper[2576]: W0709 22:29:56.749482    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode808772e_4ae2_445c_b21b_9a6ad4727f57.slice/crio-c5850dd645fd2ab2fed963c548a0dcdf3c416b28a629a8bc8670114652385f51 WatchSource:0}: Error finding container c5850dd645fd2ab2fed963c548a0dcdf3c416b28a629a8bc8670114652385f51: Status 404 returned error can't find the container with id c5850dd645fd2ab2fed963c548a0dcdf3c416b28a629a8bc8670114652385f51
Jul 09 22:29:56.752078 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:56.752046    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:29:56.752163 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:56.752114    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:29:56.752211 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:56.752171    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:29:57.561589 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:57.561559    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l" event={"ID":"e808772e-4ae2-445c-b21b-9a6ad4727f57","Type":"ContainerStarted","Data":"9bf4820d9280cb65d74352ea8bf016fdbbc38f9604885b4828429c5184f4d02d"}
Jul 09 22:29:57.562018 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:57.561612    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l" event={"ID":"e808772e-4ae2-445c-b21b-9a6ad4727f57","Type":"ContainerStarted","Data":"c5850dd645fd2ab2fed963c548a0dcdf3c416b28a629a8bc8670114652385f51"}
Jul 09 22:29:57.585048 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:57.584994    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l" podStartSLOduration=1.5849714609999999 podStartE2EDuration="1.584971461s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:29:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:29:57.583630785 +0000 UTC m=+2344.915130854" watchObservedRunningTime="2026-07-09 22:29:57.584971461 +0000 UTC m=+2344.916471534"
Jul 09 22:29:57.612181 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:57.612153    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l"
Jul 09 22:29:57.617157 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:57.617138    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l"
Jul 09 22:29:58.566761 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:58.566729    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l"
Jul 09 22:29:58.567803 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:29:58.567785    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l"
Jul 09 22:30:00.141170 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:00.141133    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727270-pdzvt"]
Jul 09 22:30:00.141754 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:00.141732    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4404b72-60f0-48d6-885b-8cf9de2b3cce" containerName="istio-proxy"
Jul 09 22:30:00.143589 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:00.143568    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727270-pdzvt"
Jul 09 22:30:00.146967 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:00.146931    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e4b894-29727270-6dmqg"]
Jul 09 22:30:00.147076 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:00.147056    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-t4ml9\""
Jul 09 22:30:00.148924 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:00.148909    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e4b894-29727270-6dmqg"
Jul 09 22:30:00.154439 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:00.154421    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727270-pdzvt"]
Jul 09 22:30:00.161301 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:00.161279    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e4b894-29727270-6dmqg"]
Jul 09 22:30:00.238015 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:00.237986    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzqw5\" (UniqueName: \"kubernetes.io/projected/26d49d68-a209-4638-8e46-eaf75572fef1-kube-api-access-dzqw5\") pod \"maas-api-key-cleanup-e2e-shared-a-e4b894-29727270-6dmqg\" (UID: \"26d49d68-a209-4638-8e46-eaf75572fef1\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e4b894-29727270-6dmqg"
Jul 09 22:30:00.238140 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:00.238019    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jqk7\" (UniqueName: \"kubernetes.io/projected/3b9485dc-0960-4b5c-8fee-7ab822baa0a6-kube-api-access-7jqk7\") pod \"maas-api-key-cleanup-29727270-pdzvt\" (UID: \"3b9485dc-0960-4b5c-8fee-7ab822baa0a6\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727270-pdzvt"
Jul 09 22:30:00.338860 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:00.338824    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzqw5\" (UniqueName: \"kubernetes.io/projected/26d49d68-a209-4638-8e46-eaf75572fef1-kube-api-access-dzqw5\") pod \"maas-api-key-cleanup-e2e-shared-a-e4b894-29727270-6dmqg\" (UID: \"26d49d68-a209-4638-8e46-eaf75572fef1\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e4b894-29727270-6dmqg"
Jul 09 22:30:00.338860 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:00.338862    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jqk7\" (UniqueName: \"kubernetes.io/projected/3b9485dc-0960-4b5c-8fee-7ab822baa0a6-kube-api-access-7jqk7\") pod \"maas-api-key-cleanup-29727270-pdzvt\" (UID: \"3b9485dc-0960-4b5c-8fee-7ab822baa0a6\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727270-pdzvt"
Jul 09 22:30:00.347462 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:00.347435    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jqk7\" (UniqueName: \"kubernetes.io/projected/3b9485dc-0960-4b5c-8fee-7ab822baa0a6-kube-api-access-7jqk7\") pod \"maas-api-key-cleanup-29727270-pdzvt\" (UID: \"3b9485dc-0960-4b5c-8fee-7ab822baa0a6\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727270-pdzvt"
Jul 09 22:30:00.347583 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:00.347533    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzqw5\" (UniqueName: \"kubernetes.io/projected/26d49d68-a209-4638-8e46-eaf75572fef1-kube-api-access-dzqw5\") pod \"maas-api-key-cleanup-e2e-shared-a-e4b894-29727270-6dmqg\" (UID: \"26d49d68-a209-4638-8e46-eaf75572fef1\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e4b894-29727270-6dmqg"
Jul 09 22:30:00.456697 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:00.456632    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727270-pdzvt"
Jul 09 22:30:00.464525 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:00.464505    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e4b894-29727270-6dmqg"
Jul 09 22:30:00.604159 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:00.604013    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727270-pdzvt"]
Jul 09 22:30:00.606587 ip-10-0-141-101 kubenswrapper[2576]: W0709 22:30:00.606542    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b9485dc_0960_4b5c_8fee_7ab822baa0a6.slice/crio-62a63e9b1b006c6ce241ce52dcee55fabb56832e2f1bbccca076b7c6f3ec26f2 WatchSource:0}: Error finding container 62a63e9b1b006c6ce241ce52dcee55fabb56832e2f1bbccca076b7c6f3ec26f2: Status 404 returned error can't find the container with id 62a63e9b1b006c6ce241ce52dcee55fabb56832e2f1bbccca076b7c6f3ec26f2
Jul 09 22:30:00.629501 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:00.629393    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e4b894-29727270-6dmqg"]
Jul 09 22:30:00.639376 ip-10-0-141-101 kubenswrapper[2576]: W0709 22:30:00.639351    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26d49d68_a209_4638_8e46_eaf75572fef1.slice/crio-0bea7d206791602e867ddc68ef7e92d5ac15c2e8b0384115d6782ee55da4ed02 WatchSource:0}: Error finding container 0bea7d206791602e867ddc68ef7e92d5ac15c2e8b0384115d6782ee55da4ed02: Status 404 returned error can't find the container with id 0bea7d206791602e867ddc68ef7e92d5ac15c2e8b0384115d6782ee55da4ed02
Jul 09 22:30:00.728321 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:00.728301    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj"
Jul 09 22:30:00.841625 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:00.841599    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3348f83-2d15-4eaf-947a-280288cfccc6-istio-token\") pod \"a3348f83-2d15-4eaf-947a-280288cfccc6\" (UID: \"a3348f83-2d15-4eaf-947a-280288cfccc6\") "
Jul 09 22:30:00.841625 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:00.841629    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3348f83-2d15-4eaf-947a-280288cfccc6-workload-certs\") pod \"a3348f83-2d15-4eaf-947a-280288cfccc6\" (UID: \"a3348f83-2d15-4eaf-947a-280288cfccc6\") "
Jul 09 22:30:00.841815 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:00.841661    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4ws5t\" (UniqueName: \"kubernetes.io/projected/a3348f83-2d15-4eaf-947a-280288cfccc6-kube-api-access-4ws5t\") pod \"a3348f83-2d15-4eaf-947a-280288cfccc6\" (UID: \"a3348f83-2d15-4eaf-947a-280288cfccc6\") "
Jul 09 22:30:00.841815 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:00.841723    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3348f83-2d15-4eaf-947a-280288cfccc6-istio-data\") pod \"a3348f83-2d15-4eaf-947a-280288cfccc6\" (UID: \"a3348f83-2d15-4eaf-947a-280288cfccc6\") "
Jul 09 22:30:00.841815 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:00.841750    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3348f83-2d15-4eaf-947a-280288cfccc6-credential-socket\") pod \"a3348f83-2d15-4eaf-947a-280288cfccc6\" (UID: \"a3348f83-2d15-4eaf-947a-280288cfccc6\") "
Jul 09 22:30:00.842001 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:00.841870    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3348f83-2d15-4eaf-947a-280288cfccc6-istio-podinfo\") pod \"a3348f83-2d15-4eaf-947a-280288cfccc6\" (UID: \"a3348f83-2d15-4eaf-947a-280288cfccc6\") "
Jul 09 22:30:00.842001 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:00.841898    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3348f83-2d15-4eaf-947a-280288cfccc6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a3348f83-2d15-4eaf-947a-280288cfccc6" (UID: "a3348f83-2d15-4eaf-947a-280288cfccc6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:30:00.842001 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:00.841911    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3348f83-2d15-4eaf-947a-280288cfccc6-istio-envoy\") pod \"a3348f83-2d15-4eaf-947a-280288cfccc6\" (UID: \"a3348f83-2d15-4eaf-947a-280288cfccc6\") "
Jul 09 22:30:00.842001 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:00.841978    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3348f83-2d15-4eaf-947a-280288cfccc6-istiod-ca-cert\") pod \"a3348f83-2d15-4eaf-947a-280288cfccc6\" (UID: \"a3348f83-2d15-4eaf-947a-280288cfccc6\") "
Jul 09 22:30:00.842215 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:00.842025    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3348f83-2d15-4eaf-947a-280288cfccc6-workload-socket\") pod \"a3348f83-2d15-4eaf-947a-280288cfccc6\" (UID: \"a3348f83-2d15-4eaf-947a-280288cfccc6\") "
Jul 09 22:30:00.842215 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:00.842077    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3348f83-2d15-4eaf-947a-280288cfccc6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a3348f83-2d15-4eaf-947a-280288cfccc6" (UID: "a3348f83-2d15-4eaf-947a-280288cfccc6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:30:00.842334 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:00.842299    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3348f83-2d15-4eaf-947a-280288cfccc6-credential-socket\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:30:00.842334 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:00.842315    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3348f83-2d15-4eaf-947a-280288cfccc6-workload-certs\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:30:00.842417 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:00.842349    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3348f83-2d15-4eaf-947a-280288cfccc6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a3348f83-2d15-4eaf-947a-280288cfccc6" (UID: "a3348f83-2d15-4eaf-947a-280288cfccc6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:30:00.842417 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:00.842360    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3348f83-2d15-4eaf-947a-280288cfccc6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a3348f83-2d15-4eaf-947a-280288cfccc6" (UID: "a3348f83-2d15-4eaf-947a-280288cfccc6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:30:00.842684 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:00.842662    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3348f83-2d15-4eaf-947a-280288cfccc6-istio-data" (OuterVolumeSpecName: "istio-data") pod "a3348f83-2d15-4eaf-947a-280288cfccc6" (UID: "a3348f83-2d15-4eaf-947a-280288cfccc6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:30:00.843909 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:00.843880    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3348f83-2d15-4eaf-947a-280288cfccc6-kube-api-access-4ws5t" (OuterVolumeSpecName: "kube-api-access-4ws5t") pod "a3348f83-2d15-4eaf-947a-280288cfccc6" (UID: "a3348f83-2d15-4eaf-947a-280288cfccc6"). InnerVolumeSpecName "kube-api-access-4ws5t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:30:00.844136 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:00.844099    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3348f83-2d15-4eaf-947a-280288cfccc6-istio-token" (OuterVolumeSpecName: "istio-token") pod "a3348f83-2d15-4eaf-947a-280288cfccc6" (UID: "a3348f83-2d15-4eaf-947a-280288cfccc6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:30:00.844346 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:00.844327    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a3348f83-2d15-4eaf-947a-280288cfccc6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a3348f83-2d15-4eaf-947a-280288cfccc6" (UID: "a3348f83-2d15-4eaf-947a-280288cfccc6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 22:30:00.844404 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:00.844376    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3348f83-2d15-4eaf-947a-280288cfccc6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a3348f83-2d15-4eaf-947a-280288cfccc6" (UID: "a3348f83-2d15-4eaf-947a-280288cfccc6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:30:00.943018 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:00.942994    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ws5t\" (UniqueName: \"kubernetes.io/projected/a3348f83-2d15-4eaf-947a-280288cfccc6-kube-api-access-4ws5t\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:30:00.943018 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:00.943014    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3348f83-2d15-4eaf-947a-280288cfccc6-istio-data\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:30:00.943018 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:00.943023    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3348f83-2d15-4eaf-947a-280288cfccc6-istio-podinfo\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:30:00.943192 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:00.943032    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3348f83-2d15-4eaf-947a-280288cfccc6-istio-envoy\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:30:00.943192 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:00.943041    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3348f83-2d15-4eaf-947a-280288cfccc6-istiod-ca-cert\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:30:00.943192 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:00.943049    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3348f83-2d15-4eaf-947a-280288cfccc6-workload-socket\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:30:00.943192 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:00.943059    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3348f83-2d15-4eaf-947a-280288cfccc6-istio-token\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:30:01.583285 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:01.583247    2576 generic.go:356] "Generic (PLEG): container finished" podID="a3348f83-2d15-4eaf-947a-280288cfccc6" containerID="ac06fc9cdebdb0722cf7747bf62225398be2bebf490c822eb9c65d547c132651" exitCode=0
Jul 09 22:30:01.583737 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:01.583306    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj"
Jul 09 22:30:01.583737 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:01.583323    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj" event={"ID":"a3348f83-2d15-4eaf-947a-280288cfccc6","Type":"ContainerDied","Data":"ac06fc9cdebdb0722cf7747bf62225398be2bebf490c822eb9c65d547c132651"}
Jul 09 22:30:01.583737 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:01.583377    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj" event={"ID":"a3348f83-2d15-4eaf-947a-280288cfccc6","Type":"ContainerDied","Data":"e1f6741d5fd07b8cdb3d652d379dd7e7d8facac13e402d5dfcf6bb7dc506480a"}
Jul 09 22:30:01.583737 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:01.583402    2576 scope.go:117] "RemoveContainer" containerID="ac06fc9cdebdb0722cf7747bf62225398be2bebf490c822eb9c65d547c132651"
Jul 09 22:30:01.585054 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:01.585032    2576 generic.go:356] "Generic (PLEG): container finished" podID="26d49d68-a209-4638-8e46-eaf75572fef1" containerID="f237d8f2d8d57f582476e0c0f2e6f5b41acf9e934f27b9a80a94b33f560ac5e9" exitCode=7
Jul 09 22:30:01.585175 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:01.585114    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e4b894-29727270-6dmqg" event={"ID":"26d49d68-a209-4638-8e46-eaf75572fef1","Type":"ContainerDied","Data":"f237d8f2d8d57f582476e0c0f2e6f5b41acf9e934f27b9a80a94b33f560ac5e9"}
Jul 09 22:30:01.585240 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:01.585171    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e4b894-29727270-6dmqg" event={"ID":"26d49d68-a209-4638-8e46-eaf75572fef1","Type":"ContainerStarted","Data":"0bea7d206791602e867ddc68ef7e92d5ac15c2e8b0384115d6782ee55da4ed02"}
Jul 09 22:30:01.585285 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:01.585272    2576 scope.go:117] "RemoveContainer" containerID="f237d8f2d8d57f582476e0c0f2e6f5b41acf9e934f27b9a80a94b33f560ac5e9"
Jul 09 22:30:01.587359 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:01.587325    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727270-pdzvt" event={"ID":"3b9485dc-0960-4b5c-8fee-7ab822baa0a6","Type":"ContainerStarted","Data":"3a9b609b33eb715f38c3e05f7c5b4c41fdafebd7990a86cf13684bfcb7b0bac6"}
Jul 09 22:30:01.587457 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:01.587381    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727270-pdzvt" event={"ID":"3b9485dc-0960-4b5c-8fee-7ab822baa0a6","Type":"ContainerStarted","Data":"62a63e9b1b006c6ce241ce52dcee55fabb56832e2f1bbccca076b7c6f3ec26f2"}
Jul 09 22:30:01.596330 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:01.596315    2576 scope.go:117] "RemoveContainer" containerID="6704f9b6f81f08596f687ef1463e790907ce3f35b3cfa11c0927d23f8531d3cc"
Jul 09 22:30:01.603030 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:01.602982    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727270-pdzvt" podStartSLOduration=1.6029414 podStartE2EDuration="1.6029414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:30:01.601935624 +0000 UTC m=+2348.933435719" watchObservedRunningTime="2026-07-09 22:30:01.6029414 +0000 UTC m=+2348.934441479"
Jul 09 22:30:01.611073 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:01.611058    2576 scope.go:117] "RemoveContainer" containerID="ac06fc9cdebdb0722cf7747bf62225398be2bebf490c822eb9c65d547c132651"
Jul 09 22:30:01.611343 ip-10-0-141-101 kubenswrapper[2576]: E0709 22:30:01.611325    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac06fc9cdebdb0722cf7747bf62225398be2bebf490c822eb9c65d547c132651\": container with ID starting with ac06fc9cdebdb0722cf7747bf62225398be2bebf490c822eb9c65d547c132651 not found: ID does not exist" containerID="ac06fc9cdebdb0722cf7747bf62225398be2bebf490c822eb9c65d547c132651"
Jul 09 22:30:01.611404 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:01.611351    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac06fc9cdebdb0722cf7747bf62225398be2bebf490c822eb9c65d547c132651"} err="failed to get container status \"ac06fc9cdebdb0722cf7747bf62225398be2bebf490c822eb9c65d547c132651\": rpc error: code = NotFound desc = could not find container \"ac06fc9cdebdb0722cf7747bf62225398be2bebf490c822eb9c65d547c132651\": container with ID starting with ac06fc9cdebdb0722cf7747bf62225398be2bebf490c822eb9c65d547c132651 not found: ID does not exist"
Jul 09 22:30:01.611404 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:01.611369    2576 scope.go:117] "RemoveContainer" containerID="6704f9b6f81f08596f687ef1463e790907ce3f35b3cfa11c0927d23f8531d3cc"
Jul 09 22:30:01.611578 ip-10-0-141-101 kubenswrapper[2576]: E0709 22:30:01.611564    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6704f9b6f81f08596f687ef1463e790907ce3f35b3cfa11c0927d23f8531d3cc\": container with ID starting with 6704f9b6f81f08596f687ef1463e790907ce3f35b3cfa11c0927d23f8531d3cc not found: ID does not exist" containerID="6704f9b6f81f08596f687ef1463e790907ce3f35b3cfa11c0927d23f8531d3cc"
Jul 09 22:30:01.611618 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:01.611589    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6704f9b6f81f08596f687ef1463e790907ce3f35b3cfa11c0927d23f8531d3cc"} err="failed to get container status \"6704f9b6f81f08596f687ef1463e790907ce3f35b3cfa11c0927d23f8531d3cc\": rpc error: code = NotFound desc = could not find container \"6704f9b6f81f08596f687ef1463e790907ce3f35b3cfa11c0927d23f8531d3cc\": container with ID starting with 6704f9b6f81f08596f687ef1463e790907ce3f35b3cfa11c0927d23f8531d3cc not found: ID does not exist"
Jul 09 22:30:01.630680 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:01.630654    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj"]
Jul 09 22:30:01.635221 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:01.635198    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-c4e995-openshift-default-6d759d4b47-gv5fj"]
Jul 09 22:30:02.594082 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:02.594049    2576 generic.go:356] "Generic (PLEG): container finished" podID="26d49d68-a209-4638-8e46-eaf75572fef1" containerID="bbf282f0baa956bad097c1aa73935ba7e6fb72776abea3b353126b6d10bfa6dc" exitCode=7
Jul 09 22:30:02.594539 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:02.594137    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e4b894-29727270-6dmqg" event={"ID":"26d49d68-a209-4638-8e46-eaf75572fef1","Type":"ContainerDied","Data":"bbf282f0baa956bad097c1aa73935ba7e6fb72776abea3b353126b6d10bfa6dc"}
Jul 09 22:30:02.594539 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:02.594205    2576 scope.go:117] "RemoveContainer" containerID="f237d8f2d8d57f582476e0c0f2e6f5b41acf9e934f27b9a80a94b33f560ac5e9"
Jul 09 22:30:02.594539 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:02.594348    2576 scope.go:117] "RemoveContainer" containerID="bbf282f0baa956bad097c1aa73935ba7e6fb72776abea3b353126b6d10bfa6dc"
Jul 09 22:30:02.594706 ip-10-0-141-101 kubenswrapper[2576]: E0709 22:30:02.594551    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-a-e4b894-29727270-6dmqg_odh-ai-gateway-infra(26d49d68-a209-4638-8e46-eaf75572fef1)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e4b894-29727270-6dmqg" podUID="26d49d68-a209-4638-8e46-eaf75572fef1"
Jul 09 22:30:03.205661 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:03.205627    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3348f83-2d15-4eaf-947a-280288cfccc6" path="/var/lib/kubelet/pods/a3348f83-2d15-4eaf-947a-280288cfccc6/volumes"
Jul 09 22:30:03.601272 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:03.601247    2576 scope.go:117] "RemoveContainer" containerID="bbf282f0baa956bad097c1aa73935ba7e6fb72776abea3b353126b6d10bfa6dc"
Jul 09 22:30:03.601626 ip-10-0-141-101 kubenswrapper[2576]: E0709 22:30:03.601414    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-a-e4b894-29727270-6dmqg_odh-ai-gateway-infra(26d49d68-a209-4638-8e46-eaf75572fef1)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e4b894-29727270-6dmqg" podUID="26d49d68-a209-4638-8e46-eaf75572fef1"
Jul 09 22:30:04.677893 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:04.677863    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf"]
Jul 09 22:30:04.678367 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:04.678324    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3348f83-2d15-4eaf-947a-280288cfccc6" containerName="istio-proxy"
Jul 09 22:30:04.678367 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:04.678338    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3348f83-2d15-4eaf-947a-280288cfccc6" containerName="istio-proxy"
Jul 09 22:30:04.678367 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:04.678346    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3348f83-2d15-4eaf-947a-280288cfccc6" containerName="istio-proxy"
Jul 09 22:30:04.678367 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:04.678351    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3348f83-2d15-4eaf-947a-280288cfccc6" containerName="istio-proxy"
Jul 09 22:30:04.678589 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:04.678420    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3348f83-2d15-4eaf-947a-280288cfccc6" containerName="istio-proxy"
Jul 09 22:30:04.678589 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:04.678429    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3348f83-2d15-4eaf-947a-280288cfccc6" containerName="istio-proxy"
Jul 09 22:30:04.680893 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:04.680867    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf"
Jul 09 22:30:04.684156 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:04.684121    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-ecf4af-openshift-default-dockercfg-ddzxg\""
Jul 09 22:30:04.710861 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:04.710835    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf"]
Jul 09 22:30:04.774486 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:04.774450    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc543c60-c640-4c87-8734-c8cc23f09bdd-workload-certs\") pod \"e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf\" (UID: \"dc543c60-c640-4c87-8734-c8cc23f09bdd\") " pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf"
Jul 09 22:30:04.774667 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:04.774495    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc543c60-c640-4c87-8734-c8cc23f09bdd-istio-envoy\") pod \"e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf\" (UID: \"dc543c60-c640-4c87-8734-c8cc23f09bdd\") " pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf"
Jul 09 22:30:04.774667 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:04.774531    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc543c60-c640-4c87-8734-c8cc23f09bdd-istiod-ca-cert\") pod \"e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf\" (UID: \"dc543c60-c640-4c87-8734-c8cc23f09bdd\") " pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf"
Jul 09 22:30:04.774667 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:04.774572    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7rp8\" (UniqueName: \"kubernetes.io/projected/dc543c60-c640-4c87-8734-c8cc23f09bdd-kube-api-access-w7rp8\") pod \"e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf\" (UID: \"dc543c60-c640-4c87-8734-c8cc23f09bdd\") " pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf"
Jul 09 22:30:04.774667 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:04.774596    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc543c60-c640-4c87-8734-c8cc23f09bdd-istio-token\") pod \"e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf\" (UID: \"dc543c60-c640-4c87-8734-c8cc23f09bdd\") " pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf"
Jul 09 22:30:04.774667 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:04.774621    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc543c60-c640-4c87-8734-c8cc23f09bdd-istio-podinfo\") pod \"e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf\" (UID: \"dc543c60-c640-4c87-8734-c8cc23f09bdd\") " pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf"
Jul 09 22:30:04.774667 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:04.774638    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc543c60-c640-4c87-8734-c8cc23f09bdd-credential-socket\") pod \"e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf\" (UID: \"dc543c60-c640-4c87-8734-c8cc23f09bdd\") " pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf"
Jul 09 22:30:04.774667 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:04.774658    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc543c60-c640-4c87-8734-c8cc23f09bdd-workload-socket\") pod \"e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf\" (UID: \"dc543c60-c640-4c87-8734-c8cc23f09bdd\") " pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf"
Jul 09 22:30:04.774908 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:04.774728    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc543c60-c640-4c87-8734-c8cc23f09bdd-istio-data\") pod \"e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf\" (UID: \"dc543c60-c640-4c87-8734-c8cc23f09bdd\") " pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf"
Jul 09 22:30:04.876070 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:04.876029    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc543c60-c640-4c87-8734-c8cc23f09bdd-istiod-ca-cert\") pod \"e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf\" (UID: \"dc543c60-c640-4c87-8734-c8cc23f09bdd\") " pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf"
Jul 09 22:30:04.876070 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:04.876078    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7rp8\" (UniqueName: \"kubernetes.io/projected/dc543c60-c640-4c87-8734-c8cc23f09bdd-kube-api-access-w7rp8\") pod \"e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf\" (UID: \"dc543c60-c640-4c87-8734-c8cc23f09bdd\") " pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf"
Jul 09 22:30:04.876333 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:04.876110    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc543c60-c640-4c87-8734-c8cc23f09bdd-istio-token\") pod \"e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf\" (UID: \"dc543c60-c640-4c87-8734-c8cc23f09bdd\") " pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf"
Jul 09 22:30:04.876333 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:04.876147    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc543c60-c640-4c87-8734-c8cc23f09bdd-istio-podinfo\") pod \"e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf\" (UID: \"dc543c60-c640-4c87-8734-c8cc23f09bdd\") " pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf"
Jul 09 22:30:04.876333 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:04.876174    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc543c60-c640-4c87-8734-c8cc23f09bdd-credential-socket\") pod \"e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf\" (UID: \"dc543c60-c640-4c87-8734-c8cc23f09bdd\") " pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf"
Jul 09 22:30:04.876333 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:04.876205    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc543c60-c640-4c87-8734-c8cc23f09bdd-workload-socket\") pod \"e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf\" (UID: \"dc543c60-c640-4c87-8734-c8cc23f09bdd\") " pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf"
Jul 09 22:30:04.876333 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:04.876230    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc543c60-c640-4c87-8734-c8cc23f09bdd-istio-data\") pod \"e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf\" (UID: \"dc543c60-c640-4c87-8734-c8cc23f09bdd\") " pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf"
Jul 09 22:30:04.876333 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:04.876258    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc543c60-c640-4c87-8734-c8cc23f09bdd-workload-certs\") pod \"e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf\" (UID: \"dc543c60-c640-4c87-8734-c8cc23f09bdd\") " pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf"
Jul 09 22:30:04.876333 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:04.876301    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc543c60-c640-4c87-8734-c8cc23f09bdd-istio-envoy\") pod \"e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf\" (UID: \"dc543c60-c640-4c87-8734-c8cc23f09bdd\") " pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf"
Jul 09 22:30:04.876729 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:04.876697    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc543c60-c640-4c87-8734-c8cc23f09bdd-workload-certs\") pod \"e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf\" (UID: \"dc543c60-c640-4c87-8734-c8cc23f09bdd\") " pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf"
Jul 09 22:30:04.876793 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:04.876764    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc543c60-c640-4c87-8734-c8cc23f09bdd-istio-data\") pod \"e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf\" (UID: \"dc543c60-c640-4c87-8734-c8cc23f09bdd\") " pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf"
Jul 09 22:30:04.876830 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:04.876790    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc543c60-c640-4c87-8734-c8cc23f09bdd-workload-socket\") pod \"e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf\" (UID: \"dc543c60-c640-4c87-8734-c8cc23f09bdd\") " pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf"
Jul 09 22:30:04.876830 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:04.876805    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc543c60-c640-4c87-8734-c8cc23f09bdd-istiod-ca-cert\") pod \"e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf\" (UID: \"dc543c60-c640-4c87-8734-c8cc23f09bdd\") " pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf"
Jul 09 22:30:04.876909 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:04.876828    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc543c60-c640-4c87-8734-c8cc23f09bdd-credential-socket\") pod \"e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf\" (UID: \"dc543c60-c640-4c87-8734-c8cc23f09bdd\") " pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf"
Jul 09 22:30:04.878831 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:04.878805    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc543c60-c640-4c87-8734-c8cc23f09bdd-istio-podinfo\") pod \"e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf\" (UID: \"dc543c60-c640-4c87-8734-c8cc23f09bdd\") " pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf"
Jul 09 22:30:04.878943 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:04.878885    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc543c60-c640-4c87-8734-c8cc23f09bdd-istio-envoy\") pod \"e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf\" (UID: \"dc543c60-c640-4c87-8734-c8cc23f09bdd\") " pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf"
Jul 09 22:30:04.884494 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:04.884470    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc543c60-c640-4c87-8734-c8cc23f09bdd-istio-token\") pod \"e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf\" (UID: \"dc543c60-c640-4c87-8734-c8cc23f09bdd\") " pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf"
Jul 09 22:30:04.884633 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:04.884615    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7rp8\" (UniqueName: \"kubernetes.io/projected/dc543c60-c640-4c87-8734-c8cc23f09bdd-kube-api-access-w7rp8\") pod \"e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf\" (UID: \"dc543c60-c640-4c87-8734-c8cc23f09bdd\") " pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf"
Jul 09 22:30:04.991999 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:04.991867    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf"
Jul 09 22:30:05.172625 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:05.172600    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf"]
Jul 09 22:30:05.174780 ip-10-0-141-101 kubenswrapper[2576]: W0709 22:30:05.174754    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc543c60_c640_4c87_8734_c8cc23f09bdd.slice/crio-dc33e69e558cecb83df6173cf03895c3fef71c3fec5205957c7ae65fa94162da WatchSource:0}: Error finding container dc33e69e558cecb83df6173cf03895c3fef71c3fec5205957c7ae65fa94162da: Status 404 returned error can't find the container with id dc33e69e558cecb83df6173cf03895c3fef71c3fec5205957c7ae65fa94162da
Jul 09 22:30:05.176933 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:05.176906    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:30:05.177011 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:05.176982    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:30:05.177061 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:05.177011    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:30:05.612925 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:05.612894    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf" event={"ID":"dc543c60-c640-4c87-8734-c8cc23f09bdd","Type":"ContainerStarted","Data":"6157fb87c06cf52d498fe41b8c496a8a63bd43048958ac663e238bf603b378df"}
Jul 09 22:30:05.613140 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:05.612942    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf" event={"ID":"dc543c60-c640-4c87-8734-c8cc23f09bdd","Type":"ContainerStarted","Data":"dc33e69e558cecb83df6173cf03895c3fef71c3fec5205957c7ae65fa94162da"}
Jul 09 22:30:05.636762 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:05.636701    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf" podStartSLOduration=1.636680491 podStartE2EDuration="1.636680491s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:30:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:30:05.634212256 +0000 UTC m=+2352.965712360" watchObservedRunningTime="2026-07-09 22:30:05.636680491 +0000 UTC m=+2352.968180570"
Jul 09 22:30:05.992611 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:05.992524    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf"
Jul 09 22:30:06.997647 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:06.997617    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf"
Jul 09 22:30:07.622480 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:07.622450    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf"
Jul 09 22:30:07.623297 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:07.623279    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf"
Jul 09 22:30:11.645752 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:11.645666    2576 generic.go:356] "Generic (PLEG): container finished" podID="e808772e-4ae2-445c-b21b-9a6ad4727f57" containerID="9bf4820d9280cb65d74352ea8bf016fdbbc38f9604885b4828429c5184f4d02d" exitCode=0
Jul 09 22:30:11.645752 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:11.645740    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l" event={"ID":"e808772e-4ae2-445c-b21b-9a6ad4727f57","Type":"ContainerDied","Data":"9bf4820d9280cb65d74352ea8bf016fdbbc38f9604885b4828429c5184f4d02d"}
Jul 09 22:30:11.646198 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:11.646133    2576 scope.go:117] "RemoveContainer" containerID="9bf4820d9280cb65d74352ea8bf016fdbbc38f9604885b4828429c5184f4d02d"
Jul 09 22:30:11.647129 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:11.647103    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:30:11.647216 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:11.647168    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:30:11.647216 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:11.647199    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:30:12.656604 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:12.656560    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l" event={"ID":"e808772e-4ae2-445c-b21b-9a6ad4727f57","Type":"ContainerStarted","Data":"44220cea3dda9a0a5bde951e1f2561e415bc3b8e219ed5527f913da259765853"}
Jul 09 22:30:13.566766 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:13.566724    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l"
Jul 09 22:30:13.612094 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:13.612061    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l"
Jul 09 22:30:13.613395 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:13.613368    2576 patch_prober.go:28] interesting pod/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 09 22:30:13.613505 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:13.613417    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l" podUID="e808772e-4ae2-445c-b21b-9a6ad4727f57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 09 22:30:14.611876 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:14.611843    2576 patch_prober.go:28] interesting pod/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 09 22:30:14.612343 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:14.611898    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l" podUID="e808772e-4ae2-445c-b21b-9a6ad4727f57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 09 22:30:15.195265 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:15.195236    2576 scope.go:117] "RemoveContainer" containerID="bbf282f0baa956bad097c1aa73935ba7e6fb72776abea3b353126b6d10bfa6dc"
Jul 09 22:30:15.611423 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:15.611390    2576 patch_prober.go:28] interesting pod/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 09 22:30:15.611648 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:15.611626    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l" podUID="e808772e-4ae2-445c-b21b-9a6ad4727f57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 09 22:30:15.678313 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:15.678268    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e4b894-29727270-6dmqg" event={"ID":"26d49d68-a209-4638-8e46-eaf75572fef1","Type":"ContainerStarted","Data":"e25663698f6101f17a883487619477659f7a75a1cd975ce2252897baf6137801"}
Jul 09 22:30:15.696378 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:15.696332    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e4b894-29727270-6dmqg" podStartSLOduration=15.696317015 podStartE2EDuration="15.696317015s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:30:15.694684565 +0000 UTC m=+2363.026184642" watchObservedRunningTime="2026-07-09 22:30:15.696317015 +0000 UTC m=+2363.027817092"
Jul 09 22:30:16.615726 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:16.615693    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l"
Jul 09 22:30:16.616790 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:16.616770    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l"
Jul 09 22:30:16.705849 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:16.705818    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e4b894-29727270-6dmqg"]
Jul 09 22:30:16.706262 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:16.706021    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e4b894-29727270-6dmqg" podUID="26d49d68-a209-4638-8e46-eaf75572fef1" containerName="cleanup" containerID="cri-o://e25663698f6101f17a883487619477659f7a75a1cd975ce2252897baf6137801" gracePeriod=30
Jul 09 22:30:22.624505 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:22.624468    2576 patch_prober.go:28] interesting pod/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 09 22:30:22.624893 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:22.624521    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf" podUID="dc543c60-c640-4c87-8734-c8cc23f09bdd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 09 22:30:22.711939 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:22.711909    2576 generic.go:356] "Generic (PLEG): container finished" podID="dc543c60-c640-4c87-8734-c8cc23f09bdd" containerID="6157fb87c06cf52d498fe41b8c496a8a63bd43048958ac663e238bf603b378df" exitCode=0
Jul 09 22:30:22.712110 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:22.711984    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf" event={"ID":"dc543c60-c640-4c87-8734-c8cc23f09bdd","Type":"ContainerDied","Data":"6157fb87c06cf52d498fe41b8c496a8a63bd43048958ac663e238bf603b378df"}
Jul 09 22:30:22.712365 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:22.712352    2576 scope.go:117] "RemoveContainer" containerID="6157fb87c06cf52d498fe41b8c496a8a63bd43048958ac663e238bf603b378df"
Jul 09 22:30:22.713317 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:22.713290    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:30:22.713557 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:22.713375    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:30:22.713557 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:22.713418    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 22:30:23.719227 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:23.719196    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf" event={"ID":"dc543c60-c640-4c87-8734-c8cc23f09bdd","Type":"ContainerStarted","Data":"785b6bffeb50a4eef6550e1325cda2f9a5e8dafcf0d35617723f238abf6bfc1f"}
Jul 09 22:30:23.992882 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:23.992774    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf"
Jul 09 22:30:23.993078 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:23.993045    2576 patch_prober.go:28] interesting pod/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 09 22:30:23.993167 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:23.993086    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf" podUID="dc543c60-c640-4c87-8734-c8cc23f09bdd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 09 22:30:24.992983 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:24.992920    2576 patch_prober.go:28] interesting pod/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 09 22:30:24.993473 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:24.993023    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf" podUID="dc543c60-c640-4c87-8734-c8cc23f09bdd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 09 22:30:25.992877 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:25.992844    2576 patch_prober.go:28] interesting pod/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 09 22:30:25.993081 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:25.992910    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf" podUID="dc543c60-c640-4c87-8734-c8cc23f09bdd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 09 22:30:26.992459 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:26.992423    2576 patch_prober.go:28] interesting pod/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 09 22:30:26.992632 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:26.992479    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf" podUID="dc543c60-c640-4c87-8734-c8cc23f09bdd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 09 22:30:28.002176 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:28.002148    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf"
Jul 09 22:30:28.002582 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:28.002521    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf"
Jul 09 22:30:28.003455 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:28.003436    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf"
Jul 09 22:30:46.840159 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:46.840116    2576 generic.go:356] "Generic (PLEG): container finished" podID="26d49d68-a209-4638-8e46-eaf75572fef1" containerID="e25663698f6101f17a883487619477659f7a75a1cd975ce2252897baf6137801" exitCode=137
Jul 09 22:30:46.840614 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:46.840161    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e4b894-29727270-6dmqg" event={"ID":"26d49d68-a209-4638-8e46-eaf75572fef1","Type":"ContainerDied","Data":"e25663698f6101f17a883487619477659f7a75a1cd975ce2252897baf6137801"}
Jul 09 22:30:46.840614 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:46.840246    2576 scope.go:117] "RemoveContainer" containerID="bbf282f0baa956bad097c1aa73935ba7e6fb72776abea3b353126b6d10bfa6dc"
Jul 09 22:30:46.902502 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:46.902479    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e4b894-29727270-6dmqg"
Jul 09 22:30:46.937243 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:46.937219    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzqw5\" (UniqueName: \"kubernetes.io/projected/26d49d68-a209-4638-8e46-eaf75572fef1-kube-api-access-dzqw5\") pod \"26d49d68-a209-4638-8e46-eaf75572fef1\" (UID: \"26d49d68-a209-4638-8e46-eaf75572fef1\") "
Jul 09 22:30:46.939227 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:46.939195    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26d49d68-a209-4638-8e46-eaf75572fef1-kube-api-access-dzqw5" (OuterVolumeSpecName: "kube-api-access-dzqw5") pod "26d49d68-a209-4638-8e46-eaf75572fef1" (UID: "26d49d68-a209-4638-8e46-eaf75572fef1"). InnerVolumeSpecName "kube-api-access-dzqw5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:30:47.038452 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:47.038426    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzqw5\" (UniqueName: \"kubernetes.io/projected/26d49d68-a209-4638-8e46-eaf75572fef1-kube-api-access-dzqw5\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:30:47.846239 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:47.846203    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e4b894-29727270-6dmqg" event={"ID":"26d49d68-a209-4638-8e46-eaf75572fef1","Type":"ContainerDied","Data":"0bea7d206791602e867ddc68ef7e92d5ac15c2e8b0384115d6782ee55da4ed02"}
Jul 09 22:30:47.846635 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:47.846261    2576 scope.go:117] "RemoveContainer" containerID="e25663698f6101f17a883487619477659f7a75a1cd975ce2252897baf6137801"
Jul 09 22:30:47.846635 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:47.846223    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e4b894-29727270-6dmqg"
Jul 09 22:30:47.866945 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:47.866920    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e4b894-29727270-6dmqg"]
Jul 09 22:30:47.870345 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:47.870323    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e4b894-29727270-6dmqg"]
Jul 09 22:30:49.200339 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:49.200305    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26d49d68-a209-4638-8e46-eaf75572fef1" path="/var/lib/kubelet/pods/26d49d68-a209-4638-8e46-eaf75572fef1/volumes"
Jul 09 22:30:53.298054 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:53.298029    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27vrn_10510741-9c12-4044-ac11-97958aa1fc35/ovn-acl-logging/0.log"
Jul 09 22:30:53.299779 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:30:53.299757    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27vrn_10510741-9c12-4044-ac11-97958aa1fc35/ovn-acl-logging/0.log"
Jul 09 22:31:00.011121 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:31:00.011086    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727270-pdzvt"]
Jul 09 22:31:00.011544 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:31:00.011332    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727270-pdzvt" podUID="3b9485dc-0960-4b5c-8fee-7ab822baa0a6" containerName="cleanup" containerID="cri-o://3a9b609b33eb715f38c3e05f7c5b4c41fdafebd7990a86cf13684bfcb7b0bac6" gracePeriod=30
Jul 09 22:31:30.188039 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:31:30.188011    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727270-pdzvt"
Jul 09 22:31:30.320297 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:31:30.320267    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jqk7\" (UniqueName: \"kubernetes.io/projected/3b9485dc-0960-4b5c-8fee-7ab822baa0a6-kube-api-access-7jqk7\") pod \"3b9485dc-0960-4b5c-8fee-7ab822baa0a6\" (UID: \"3b9485dc-0960-4b5c-8fee-7ab822baa0a6\") "
Jul 09 22:31:30.322219 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:31:30.322194    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b9485dc-0960-4b5c-8fee-7ab822baa0a6-kube-api-access-7jqk7" (OuterVolumeSpecName: "kube-api-access-7jqk7") pod "3b9485dc-0960-4b5c-8fee-7ab822baa0a6" (UID: "3b9485dc-0960-4b5c-8fee-7ab822baa0a6"). InnerVolumeSpecName "kube-api-access-7jqk7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:31:30.421108 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:31:30.421068    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jqk7\" (UniqueName: \"kubernetes.io/projected/3b9485dc-0960-4b5c-8fee-7ab822baa0a6-kube-api-access-7jqk7\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:31:31.056234 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:31:31.056192    2576 generic.go:356] "Generic (PLEG): container finished" podID="3b9485dc-0960-4b5c-8fee-7ab822baa0a6" containerID="3a9b609b33eb715f38c3e05f7c5b4c41fdafebd7990a86cf13684bfcb7b0bac6" exitCode=137
Jul 09 22:31:31.056444 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:31:31.056280    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727270-pdzvt"
Jul 09 22:31:31.056444 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:31:31.056283    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727270-pdzvt" event={"ID":"3b9485dc-0960-4b5c-8fee-7ab822baa0a6","Type":"ContainerDied","Data":"3a9b609b33eb715f38c3e05f7c5b4c41fdafebd7990a86cf13684bfcb7b0bac6"}
Jul 09 22:31:31.056444 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:31:31.056407    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727270-pdzvt" event={"ID":"3b9485dc-0960-4b5c-8fee-7ab822baa0a6","Type":"ContainerDied","Data":"62a63e9b1b006c6ce241ce52dcee55fabb56832e2f1bbccca076b7c6f3ec26f2"}
Jul 09 22:31:31.056444 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:31:31.056432    2576 scope.go:117] "RemoveContainer" containerID="3a9b609b33eb715f38c3e05f7c5b4c41fdafebd7990a86cf13684bfcb7b0bac6"
Jul 09 22:31:31.064981 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:31:31.064943    2576 scope.go:117] "RemoveContainer" containerID="3a9b609b33eb715f38c3e05f7c5b4c41fdafebd7990a86cf13684bfcb7b0bac6"
Jul 09 22:31:31.065238 ip-10-0-141-101 kubenswrapper[2576]: E0709 22:31:31.065219    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a9b609b33eb715f38c3e05f7c5b4c41fdafebd7990a86cf13684bfcb7b0bac6\": container with ID starting with 3a9b609b33eb715f38c3e05f7c5b4c41fdafebd7990a86cf13684bfcb7b0bac6 not found: ID does not exist" containerID="3a9b609b33eb715f38c3e05f7c5b4c41fdafebd7990a86cf13684bfcb7b0bac6"
Jul 09 22:31:31.065286 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:31:31.065247    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a9b609b33eb715f38c3e05f7c5b4c41fdafebd7990a86cf13684bfcb7b0bac6"} err="failed to get container status \"3a9b609b33eb715f38c3e05f7c5b4c41fdafebd7990a86cf13684bfcb7b0bac6\": rpc error: code = NotFound desc = could not find container \"3a9b609b33eb715f38c3e05f7c5b4c41fdafebd7990a86cf13684bfcb7b0bac6\": container with ID starting with 3a9b609b33eb715f38c3e05f7c5b4c41fdafebd7990a86cf13684bfcb7b0bac6 not found: ID does not exist"
Jul 09 22:31:31.085009 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:31:31.084978    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727270-pdzvt"]
Jul 09 22:31:31.089532 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:31:31.089507    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727270-pdzvt"]
Jul 09 22:31:31.201043 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:31:31.201007    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b9485dc-0960-4b5c-8fee-7ab822baa0a6" path="/var/lib/kubelet/pods/3b9485dc-0960-4b5c-8fee-7ab822baa0a6/volumes"
Jul 09 22:33:23.465107 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:23.464884    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l"]
Jul 09 22:33:23.465807 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:23.465766    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l" podUID="e808772e-4ae2-445c-b21b-9a6ad4727f57" containerName="istio-proxy" containerID="cri-o://44220cea3dda9a0a5bde951e1f2561e415bc3b8e219ed5527f913da259765853" gracePeriod=30
Jul 09 22:33:28.623904 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:28.623868    2576 generic.go:356] "Generic (PLEG): container finished" podID="e808772e-4ae2-445c-b21b-9a6ad4727f57" containerID="44220cea3dda9a0a5bde951e1f2561e415bc3b8e219ed5527f913da259765853" exitCode=0
Jul 09 22:33:28.624321 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:28.623947    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l" event={"ID":"e808772e-4ae2-445c-b21b-9a6ad4727f57","Type":"ContainerDied","Data":"44220cea3dda9a0a5bde951e1f2561e415bc3b8e219ed5527f913da259765853"}
Jul 09 22:33:28.624321 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:28.624037    2576 scope.go:117] "RemoveContainer" containerID="9bf4820d9280cb65d74352ea8bf016fdbbc38f9604885b4828429c5184f4d02d"
Jul 09 22:33:28.721186 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:28.721156    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l"
Jul 09 22:33:28.774947 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:28.774916    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e808772e-4ae2-445c-b21b-9a6ad4727f57-istio-podinfo\") pod \"e808772e-4ae2-445c-b21b-9a6ad4727f57\" (UID: \"e808772e-4ae2-445c-b21b-9a6ad4727f57\") "
Jul 09 22:33:28.775150 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:28.775008    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e808772e-4ae2-445c-b21b-9a6ad4727f57-credential-socket\") pod \"e808772e-4ae2-445c-b21b-9a6ad4727f57\" (UID: \"e808772e-4ae2-445c-b21b-9a6ad4727f57\") "
Jul 09 22:33:28.775150 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:28.775029    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e808772e-4ae2-445c-b21b-9a6ad4727f57-istio-data\") pod \"e808772e-4ae2-445c-b21b-9a6ad4727f57\" (UID: \"e808772e-4ae2-445c-b21b-9a6ad4727f57\") "
Jul 09 22:33:28.775150 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:28.775061    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e808772e-4ae2-445c-b21b-9a6ad4727f57-istiod-ca-cert\") pod \"e808772e-4ae2-445c-b21b-9a6ad4727f57\" (UID: \"e808772e-4ae2-445c-b21b-9a6ad4727f57\") "
Jul 09 22:33:28.775150 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:28.775108    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e808772e-4ae2-445c-b21b-9a6ad4727f57-workload-certs\") pod \"e808772e-4ae2-445c-b21b-9a6ad4727f57\" (UID: \"e808772e-4ae2-445c-b21b-9a6ad4727f57\") "
Jul 09 22:33:28.775381 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:28.775165    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e808772e-4ae2-445c-b21b-9a6ad4727f57-workload-socket\") pod \"e808772e-4ae2-445c-b21b-9a6ad4727f57\" (UID: \"e808772e-4ae2-445c-b21b-9a6ad4727f57\") "
Jul 09 22:33:28.775381 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:28.775207    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e808772e-4ae2-445c-b21b-9a6ad4727f57-istio-envoy\") pod \"e808772e-4ae2-445c-b21b-9a6ad4727f57\" (UID: \"e808772e-4ae2-445c-b21b-9a6ad4727f57\") "
Jul 09 22:33:28.775381 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:28.775241    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e808772e-4ae2-445c-b21b-9a6ad4727f57-istio-token\") pod \"e808772e-4ae2-445c-b21b-9a6ad4727f57\" (UID: \"e808772e-4ae2-445c-b21b-9a6ad4727f57\") "
Jul 09 22:33:28.775381 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:28.775274    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lg2k8\" (UniqueName: \"kubernetes.io/projected/e808772e-4ae2-445c-b21b-9a6ad4727f57-kube-api-access-lg2k8\") pod \"e808772e-4ae2-445c-b21b-9a6ad4727f57\" (UID: \"e808772e-4ae2-445c-b21b-9a6ad4727f57\") "
Jul 09 22:33:28.775381 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:28.775371    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e808772e-4ae2-445c-b21b-9a6ad4727f57-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e808772e-4ae2-445c-b21b-9a6ad4727f57" (UID: "e808772e-4ae2-445c-b21b-9a6ad4727f57"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:33:28.775630 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:28.775467    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e808772e-4ae2-445c-b21b-9a6ad4727f57-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e808772e-4ae2-445c-b21b-9a6ad4727f57" (UID: "e808772e-4ae2-445c-b21b-9a6ad4727f57"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:33:28.775630 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:28.775472    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e808772e-4ae2-445c-b21b-9a6ad4727f57-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e808772e-4ae2-445c-b21b-9a6ad4727f57" (UID: "e808772e-4ae2-445c-b21b-9a6ad4727f57"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:33:28.775741 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:28.775633    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e808772e-4ae2-445c-b21b-9a6ad4727f57-credential-socket\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:33:28.775741 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:28.775696    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e808772e-4ae2-445c-b21b-9a6ad4727f57-istiod-ca-cert\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:33:28.775741 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:28.775712    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e808772e-4ae2-445c-b21b-9a6ad4727f57-workload-certs\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:33:28.775890 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:28.775735    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e808772e-4ae2-445c-b21b-9a6ad4727f57-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e808772e-4ae2-445c-b21b-9a6ad4727f57" (UID: "e808772e-4ae2-445c-b21b-9a6ad4727f57"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:33:28.776143 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:28.776110    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e808772e-4ae2-445c-b21b-9a6ad4727f57-istio-data" (OuterVolumeSpecName: "istio-data") pod "e808772e-4ae2-445c-b21b-9a6ad4727f57" (UID: "e808772e-4ae2-445c-b21b-9a6ad4727f57"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:33:28.777342 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:28.777314    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e808772e-4ae2-445c-b21b-9a6ad4727f57-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e808772e-4ae2-445c-b21b-9a6ad4727f57" (UID: "e808772e-4ae2-445c-b21b-9a6ad4727f57"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 22:33:28.777433 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:28.777361    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e808772e-4ae2-445c-b21b-9a6ad4727f57-kube-api-access-lg2k8" (OuterVolumeSpecName: "kube-api-access-lg2k8") pod "e808772e-4ae2-445c-b21b-9a6ad4727f57" (UID: "e808772e-4ae2-445c-b21b-9a6ad4727f57"). InnerVolumeSpecName "kube-api-access-lg2k8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:33:28.777832 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:28.777811    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e808772e-4ae2-445c-b21b-9a6ad4727f57-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e808772e-4ae2-445c-b21b-9a6ad4727f57" (UID: "e808772e-4ae2-445c-b21b-9a6ad4727f57"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:33:28.777832 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:28.777823    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e808772e-4ae2-445c-b21b-9a6ad4727f57-istio-token" (OuterVolumeSpecName: "istio-token") pod "e808772e-4ae2-445c-b21b-9a6ad4727f57" (UID: "e808772e-4ae2-445c-b21b-9a6ad4727f57"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:33:28.877162 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:28.877125    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lg2k8\" (UniqueName: \"kubernetes.io/projected/e808772e-4ae2-445c-b21b-9a6ad4727f57-kube-api-access-lg2k8\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:33:28.877162 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:28.877159    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e808772e-4ae2-445c-b21b-9a6ad4727f57-istio-podinfo\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:33:28.877162 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:28.877172    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e808772e-4ae2-445c-b21b-9a6ad4727f57-istio-data\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:33:28.877493 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:28.877184    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e808772e-4ae2-445c-b21b-9a6ad4727f57-workload-socket\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:33:28.877493 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:28.877196    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e808772e-4ae2-445c-b21b-9a6ad4727f57-istio-envoy\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:33:28.877493 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:28.877208    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e808772e-4ae2-445c-b21b-9a6ad4727f57-istio-token\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:33:29.629947 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:29.629913    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l" event={"ID":"e808772e-4ae2-445c-b21b-9a6ad4727f57","Type":"ContainerDied","Data":"c5850dd645fd2ab2fed963c548a0dcdf3c416b28a629a8bc8670114652385f51"}
Jul 09 22:33:29.629947 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:29.629952    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l"
Jul 09 22:33:29.630529 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:29.630011    2576 scope.go:117] "RemoveContainer" containerID="44220cea3dda9a0a5bde951e1f2561e415bc3b8e219ed5527f913da259765853"
Jul 09 22:33:29.650051 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:29.650022    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l"]
Jul 09 22:33:29.654606 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:29.654580    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-e4b894-openshift-default-5c68b87947-2m85l"]
Jul 09 22:33:30.404676 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:30.404645    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf"]
Jul 09 22:33:30.404895 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:30.404856    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf" podUID="dc543c60-c640-4c87-8734-c8cc23f09bdd" containerName="istio-proxy" containerID="cri-o://785b6bffeb50a4eef6550e1325cda2f9a5e8dafcf0d35617723f238abf6bfc1f" gracePeriod=30
Jul 09 22:33:31.208723 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:31.208684    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e808772e-4ae2-445c-b21b-9a6ad4727f57" path="/var/lib/kubelet/pods/e808772e-4ae2-445c-b21b-9a6ad4727f57/volumes"
Jul 09 22:33:31.215583 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:31.215559    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-689f8cfdb9-km4kh_a279158d-2210-4bb4-9444-709b83ccc3eb/authorino/0.log"
Jul 09 22:33:35.660450 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:35.660420    2576 generic.go:356] "Generic (PLEG): container finished" podID="dc543c60-c640-4c87-8734-c8cc23f09bdd" containerID="785b6bffeb50a4eef6550e1325cda2f9a5e8dafcf0d35617723f238abf6bfc1f" exitCode=0
Jul 09 22:33:35.660816 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:35.660488    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf"
Jul 09 22:33:35.660816 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:35.660489    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf" event={"ID":"dc543c60-c640-4c87-8734-c8cc23f09bdd","Type":"ContainerDied","Data":"785b6bffeb50a4eef6550e1325cda2f9a5e8dafcf0d35617723f238abf6bfc1f"}
Jul 09 22:33:35.660816 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:35.660536    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf" event={"ID":"dc543c60-c640-4c87-8734-c8cc23f09bdd","Type":"ContainerDied","Data":"dc33e69e558cecb83df6173cf03895c3fef71c3fec5205957c7ae65fa94162da"}
Jul 09 22:33:35.660816 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:35.660562    2576 scope.go:117] "RemoveContainer" containerID="6157fb87c06cf52d498fe41b8c496a8a63bd43048958ac663e238bf603b378df"
Jul 09 22:33:35.669120 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:35.669089    2576 scope.go:117] "RemoveContainer" containerID="785b6bffeb50a4eef6550e1325cda2f9a5e8dafcf0d35617723f238abf6bfc1f"
Jul 09 22:33:35.676876 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:35.676857    2576 scope.go:117] "RemoveContainer" containerID="6157fb87c06cf52d498fe41b8c496a8a63bd43048958ac663e238bf603b378df"
Jul 09 22:33:35.677139 ip-10-0-141-101 kubenswrapper[2576]: E0709 22:33:35.677120    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6157fb87c06cf52d498fe41b8c496a8a63bd43048958ac663e238bf603b378df\": container with ID starting with 6157fb87c06cf52d498fe41b8c496a8a63bd43048958ac663e238bf603b378df not found: ID does not exist" containerID="6157fb87c06cf52d498fe41b8c496a8a63bd43048958ac663e238bf603b378df"
Jul 09 22:33:35.677215 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:35.677152    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6157fb87c06cf52d498fe41b8c496a8a63bd43048958ac663e238bf603b378df"} err="failed to get container status \"6157fb87c06cf52d498fe41b8c496a8a63bd43048958ac663e238bf603b378df\": rpc error: code = NotFound desc = could not find container \"6157fb87c06cf52d498fe41b8c496a8a63bd43048958ac663e238bf603b378df\": container with ID starting with 6157fb87c06cf52d498fe41b8c496a8a63bd43048958ac663e238bf603b378df not found: ID does not exist"
Jul 09 22:33:35.742127 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:35.742094    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7rp8\" (UniqueName: \"kubernetes.io/projected/dc543c60-c640-4c87-8734-c8cc23f09bdd-kube-api-access-w7rp8\") pod \"dc543c60-c640-4c87-8734-c8cc23f09bdd\" (UID: \"dc543c60-c640-4c87-8734-c8cc23f09bdd\") "
Jul 09 22:33:35.742309 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:35.742138    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc543c60-c640-4c87-8734-c8cc23f09bdd-credential-socket\") pod \"dc543c60-c640-4c87-8734-c8cc23f09bdd\" (UID: \"dc543c60-c640-4c87-8734-c8cc23f09bdd\") "
Jul 09 22:33:35.742309 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:35.742192    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc543c60-c640-4c87-8734-c8cc23f09bdd-istio-token\") pod \"dc543c60-c640-4c87-8734-c8cc23f09bdd\" (UID: \"dc543c60-c640-4c87-8734-c8cc23f09bdd\") "
Jul 09 22:33:35.742427 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:35.742303    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc543c60-c640-4c87-8734-c8cc23f09bdd-workload-socket\") pod \"dc543c60-c640-4c87-8734-c8cc23f09bdd\" (UID: \"dc543c60-c640-4c87-8734-c8cc23f09bdd\") "
Jul 09 22:33:35.742427 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:35.742359    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc543c60-c640-4c87-8734-c8cc23f09bdd-istiod-ca-cert\") pod \"dc543c60-c640-4c87-8734-c8cc23f09bdd\" (UID: \"dc543c60-c640-4c87-8734-c8cc23f09bdd\") "
Jul 09 22:33:35.742536 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:35.742445    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc543c60-c640-4c87-8734-c8cc23f09bdd-istio-podinfo\") pod \"dc543c60-c640-4c87-8734-c8cc23f09bdd\" (UID: \"dc543c60-c640-4c87-8734-c8cc23f09bdd\") "
Jul 09 22:33:35.742536 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:35.742511    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc543c60-c640-4c87-8734-c8cc23f09bdd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dc543c60-c640-4c87-8734-c8cc23f09bdd" (UID: "dc543c60-c640-4c87-8734-c8cc23f09bdd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:33:35.742647 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:35.742522    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc543c60-c640-4c87-8734-c8cc23f09bdd-istio-data\") pod \"dc543c60-c640-4c87-8734-c8cc23f09bdd\" (UID: \"dc543c60-c640-4c87-8734-c8cc23f09bdd\") "
Jul 09 22:33:35.742647 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:35.742576    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc543c60-c640-4c87-8734-c8cc23f09bdd-workload-certs\") pod \"dc543c60-c640-4c87-8734-c8cc23f09bdd\" (UID: \"dc543c60-c640-4c87-8734-c8cc23f09bdd\") "
Jul 09 22:33:35.742647 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:35.742619    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc543c60-c640-4c87-8734-c8cc23f09bdd-istio-envoy\") pod \"dc543c60-c640-4c87-8734-c8cc23f09bdd\" (UID: \"dc543c60-c640-4c87-8734-c8cc23f09bdd\") "
Jul 09 22:33:35.742647 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:35.742619    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc543c60-c640-4c87-8734-c8cc23f09bdd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dc543c60-c640-4c87-8734-c8cc23f09bdd" (UID: "dc543c60-c640-4c87-8734-c8cc23f09bdd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:33:35.742864 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:35.742726    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-df4jq_9218a4f8-3388-4b31-b7f7-92ebdb02576d/manager/0.log"
Jul 09 22:33:35.742942 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:35.742923    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc543c60-c640-4c87-8734-c8cc23f09bdd-credential-socket\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:33:35.743035 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:35.742949    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc543c60-c640-4c87-8734-c8cc23f09bdd-workload-socket\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:33:35.743095 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:35.743079    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc543c60-c640-4c87-8734-c8cc23f09bdd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dc543c60-c640-4c87-8734-c8cc23f09bdd" (UID: "dc543c60-c640-4c87-8734-c8cc23f09bdd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:33:35.743154 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:35.743080    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc543c60-c640-4c87-8734-c8cc23f09bdd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dc543c60-c640-4c87-8734-c8cc23f09bdd" (UID: "dc543c60-c640-4c87-8734-c8cc23f09bdd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:33:35.743699 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:35.743654    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc543c60-c640-4c87-8734-c8cc23f09bdd-istio-data" (OuterVolumeSpecName: "istio-data") pod "dc543c60-c640-4c87-8734-c8cc23f09bdd" (UID: "dc543c60-c640-4c87-8734-c8cc23f09bdd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:33:35.744997 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:35.744948    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc543c60-c640-4c87-8734-c8cc23f09bdd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dc543c60-c640-4c87-8734-c8cc23f09bdd" (UID: "dc543c60-c640-4c87-8734-c8cc23f09bdd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:33:35.745139 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:35.745102    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc543c60-c640-4c87-8734-c8cc23f09bdd-istio-token" (OuterVolumeSpecName: "istio-token") pod "dc543c60-c640-4c87-8734-c8cc23f09bdd" (UID: "dc543c60-c640-4c87-8734-c8cc23f09bdd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:33:35.745246 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:35.745212    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dc543c60-c640-4c87-8734-c8cc23f09bdd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dc543c60-c640-4c87-8734-c8cc23f09bdd" (UID: "dc543c60-c640-4c87-8734-c8cc23f09bdd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 22:33:35.745306 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:35.745245    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc543c60-c640-4c87-8734-c8cc23f09bdd-kube-api-access-w7rp8" (OuterVolumeSpecName: "kube-api-access-w7rp8") pod "dc543c60-c640-4c87-8734-c8cc23f09bdd" (UID: "dc543c60-c640-4c87-8734-c8cc23f09bdd"). InnerVolumeSpecName "kube-api-access-w7rp8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:33:35.843652 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:35.843618    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc543c60-c640-4c87-8734-c8cc23f09bdd-istio-data\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:33:35.843652 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:35.843645    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc543c60-c640-4c87-8734-c8cc23f09bdd-workload-certs\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:33:35.843652 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:35.843654    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc543c60-c640-4c87-8734-c8cc23f09bdd-istio-envoy\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:33:35.843887 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:35.843662    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7rp8\" (UniqueName: \"kubernetes.io/projected/dc543c60-c640-4c87-8734-c8cc23f09bdd-kube-api-access-w7rp8\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:33:35.843887 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:35.843672    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc543c60-c640-4c87-8734-c8cc23f09bdd-istio-token\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:33:35.843887 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:35.843680    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc543c60-c640-4c87-8734-c8cc23f09bdd-istiod-ca-cert\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:33:35.843887 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:35.843688    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc543c60-c640-4c87-8734-c8cc23f09bdd-istio-podinfo\") on node \"ip-10-0-141-101.ec2.internal\" DevicePath \"\""
Jul 09 22:33:35.858432 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:35.858398    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-cx5r7_2433c8e7-20ef-453c-9a58-6e660be175f7/manager/0.log"
Jul 09 22:33:36.109865 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:36.109831    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-l2w25_958185da-7f44-4a72-b425-fb2c0061901f/server/0.log"
Jul 09 22:33:36.231002 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:36.230972    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-pq9r8_0a324cc7-d71c-4d55-83f4-479a7ebbeb6e/manager/0.log"
Jul 09 22:33:36.460440 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:36.460365    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85dfbddc47-n2h8l_6e915a81-51e4-4910-931c-7c743c0939b5/copy-manifests/0.log"
Jul 09 22:33:36.472450 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:36.472420    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85dfbddc47-n2h8l_6e915a81-51e4-4910-931c-7c743c0939b5/manager/0.log"
Jul 09 22:33:36.665822 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:36.665795    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf"
Jul 09 22:33:36.688224 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:36.688194    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf"]
Jul 09 22:33:36.692167 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:36.692140    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-ecf4af-openshift-default-9fbb884ff-xc2sf"]
Jul 09 22:33:37.200309 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:37.200280    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc543c60-c640-4c87-8734-c8cc23f09bdd" path="/var/lib/kubelet/pods/dc543c60-c640-4c87-8734-c8cc23f09bdd/volumes"
Jul 09 22:33:37.907853 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:37.907822    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-689f8cfdb9-km4kh_a279158d-2210-4bb4-9444-709b83ccc3eb/authorino/0.log"
Jul 09 22:33:38.043530 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:38.043500    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-2vpk5_993f9d45-7a82-405d-976e-cbb3be273ead/manager/0.log"
Jul 09 22:33:38.163183 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:38.163105    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-bfdbb_fb19fa9f-5de3-410c-85e1-b368b16b2843/manager/0.log"
Jul 09 22:33:38.280504 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:38.280476    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-r65sc_1adea14a-9e34-4e9a-bf5d-897041459b81/kuadrant-console-plugin/0.log"
Jul 09 22:33:38.399250 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:38.399220    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-vssxp_633464e5-3653-4e43-aecd-d02bce6c2e88/registry-server/0.log"
Jul 09 22:33:38.753792 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:38.753758    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-chkh7_1b58c863-7d8f-47f4-a80d-f7ae73235656/manager/0.log"
Jul 09 22:33:39.445913 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:39.445879    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b6b884787-sj2k9_201e5101-4e2c-4500-8f1e-c91537b9ffd5/kube-auth-proxy/0.log"
Jul 09 22:33:39.567061 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:39.567027    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-m2w97_1e0705e6-7963-4d77-827c-cee07947f167/istio-proxy/1.log"
Jul 09 22:33:39.684872 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:39.684834    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-sjf46_46ec86b5-bc9f-49c4-b9bc-00994f0ae977/payload-pre-processing/0.log"
Jul 09 22:33:40.256733 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:40.256707    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-lcjch_238b2591-3d5d-4e43-a89e-26e4991d2a4a/main/0.log"
Jul 09 22:33:44.982176 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:44.982142    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rgg8m/must-gather-nmfc5"]
Jul 09 22:33:44.982593 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:44.982489    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26d49d68-a209-4638-8e46-eaf75572fef1" containerName="cleanup"
Jul 09 22:33:44.982593 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:44.982501    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="26d49d68-a209-4638-8e46-eaf75572fef1" containerName="cleanup"
Jul 09 22:33:44.982593 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:44.982508    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26d49d68-a209-4638-8e46-eaf75572fef1" containerName="cleanup"
Jul 09 22:33:44.982593 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:44.982514    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="26d49d68-a209-4638-8e46-eaf75572fef1" containerName="cleanup"
Jul 09 22:33:44.982593 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:44.982533    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc543c60-c640-4c87-8734-c8cc23f09bdd" containerName="istio-proxy"
Jul 09 22:33:44.982593 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:44.982541    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc543c60-c640-4c87-8734-c8cc23f09bdd" containerName="istio-proxy"
Jul 09 22:33:44.982593 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:44.982553    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b9485dc-0960-4b5c-8fee-7ab822baa0a6" containerName="cleanup"
Jul 09 22:33:44.982593 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:44.982560    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b9485dc-0960-4b5c-8fee-7ab822baa0a6" containerName="cleanup"
Jul 09 22:33:44.982593 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:44.982578    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e808772e-4ae2-445c-b21b-9a6ad4727f57" containerName="istio-proxy"
Jul 09 22:33:44.982593 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:44.982587    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e808772e-4ae2-445c-b21b-9a6ad4727f57" containerName="istio-proxy"
Jul 09 22:33:44.982593 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:44.982595    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc543c60-c640-4c87-8734-c8cc23f09bdd" containerName="istio-proxy"
Jul 09 22:33:44.982593 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:44.982601    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc543c60-c640-4c87-8734-c8cc23f09bdd" containerName="istio-proxy"
Jul 09 22:33:44.983152 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:44.982610    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e808772e-4ae2-445c-b21b-9a6ad4727f57" containerName="istio-proxy"
Jul 09 22:33:44.983152 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:44.982615    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e808772e-4ae2-445c-b21b-9a6ad4727f57" containerName="istio-proxy"
Jul 09 22:33:44.983152 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:44.982690    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc543c60-c640-4c87-8734-c8cc23f09bdd" containerName="istio-proxy"
Jul 09 22:33:44.983152 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:44.982704    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e808772e-4ae2-445c-b21b-9a6ad4727f57" containerName="istio-proxy"
Jul 09 22:33:44.983152 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:44.982715    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="26d49d68-a209-4638-8e46-eaf75572fef1" containerName="cleanup"
Jul 09 22:33:44.983152 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:44.982725    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc543c60-c640-4c87-8734-c8cc23f09bdd" containerName="istio-proxy"
Jul 09 22:33:44.983152 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:44.982739    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="26d49d68-a209-4638-8e46-eaf75572fef1" containerName="cleanup"
Jul 09 22:33:44.983152 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:44.982749    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b9485dc-0960-4b5c-8fee-7ab822baa0a6" containerName="cleanup"
Jul 09 22:33:44.983152 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:44.982865    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26d49d68-a209-4638-8e46-eaf75572fef1" containerName="cleanup"
Jul 09 22:33:44.983152 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:44.982878    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="26d49d68-a209-4638-8e46-eaf75572fef1" containerName="cleanup"
Jul 09 22:33:44.983152 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:44.982996    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e808772e-4ae2-445c-b21b-9a6ad4727f57" containerName="istio-proxy"
Jul 09 22:33:44.983152 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:44.983014    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="26d49d68-a209-4638-8e46-eaf75572fef1" containerName="cleanup"
Jul 09 22:33:44.987404 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:44.987387    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rgg8m/must-gather-nmfc5"
Jul 09 22:33:44.990263 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:44.990244    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rgg8m\"/\"kube-root-ca.crt\""
Jul 09 22:33:44.991410 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:44.991396    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rgg8m\"/\"openshift-service-ca.crt\""
Jul 09 22:33:44.991481 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:44.991410    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rgg8m\"/\"default-dockercfg-ctdb7\""
Jul 09 22:33:45.007938 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:45.007907    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rgg8m/must-gather-nmfc5"]
Jul 09 22:33:45.128201 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:45.128160    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d59107da-40b4-4000-97c0-4083bbdd1320-must-gather-output\") pod \"must-gather-nmfc5\" (UID: \"d59107da-40b4-4000-97c0-4083bbdd1320\") " pod="openshift-must-gather-rgg8m/must-gather-nmfc5"
Jul 09 22:33:45.128374 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:45.128222    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhcp8\" (UniqueName: \"kubernetes.io/projected/d59107da-40b4-4000-97c0-4083bbdd1320-kube-api-access-fhcp8\") pod \"must-gather-nmfc5\" (UID: \"d59107da-40b4-4000-97c0-4083bbdd1320\") " pod="openshift-must-gather-rgg8m/must-gather-nmfc5"
Jul 09 22:33:45.229422 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:45.229386    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d59107da-40b4-4000-97c0-4083bbdd1320-must-gather-output\") pod \"must-gather-nmfc5\" (UID: \"d59107da-40b4-4000-97c0-4083bbdd1320\") " pod="openshift-must-gather-rgg8m/must-gather-nmfc5"
Jul 09 22:33:45.229593 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:45.229447    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhcp8\" (UniqueName: \"kubernetes.io/projected/d59107da-40b4-4000-97c0-4083bbdd1320-kube-api-access-fhcp8\") pod \"must-gather-nmfc5\" (UID: \"d59107da-40b4-4000-97c0-4083bbdd1320\") " pod="openshift-must-gather-rgg8m/must-gather-nmfc5"
Jul 09 22:33:45.229744 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:45.229726    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d59107da-40b4-4000-97c0-4083bbdd1320-must-gather-output\") pod \"must-gather-nmfc5\" (UID: \"d59107da-40b4-4000-97c0-4083bbdd1320\") " pod="openshift-must-gather-rgg8m/must-gather-nmfc5"
Jul 09 22:33:45.238148 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:45.238081    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhcp8\" (UniqueName: \"kubernetes.io/projected/d59107da-40b4-4000-97c0-4083bbdd1320-kube-api-access-fhcp8\") pod \"must-gather-nmfc5\" (UID: \"d59107da-40b4-4000-97c0-4083bbdd1320\") " pod="openshift-must-gather-rgg8m/must-gather-nmfc5"
Jul 09 22:33:45.296202 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:45.296168    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rgg8m/must-gather-nmfc5"
Jul 09 22:33:45.434345 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:45.434321    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rgg8m/must-gather-nmfc5"]
Jul 09 22:33:45.436529 ip-10-0-141-101 kubenswrapper[2576]: W0709 22:33:45.436495    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd59107da_40b4_4000_97c0_4083bbdd1320.slice/crio-af1f076b43390e8319e8b6cce0cc5e4ca93ccdb2e008d002eb042aa3840b5042 WatchSource:0}: Error finding container af1f076b43390e8319e8b6cce0cc5e4ca93ccdb2e008d002eb042aa3840b5042: Status 404 returned error can't find the container with id af1f076b43390e8319e8b6cce0cc5e4ca93ccdb2e008d002eb042aa3840b5042
Jul 09 22:33:45.438385 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:45.438370    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 22:33:45.719594 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:45.719558    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rgg8m/must-gather-nmfc5" event={"ID":"d59107da-40b4-4000-97c0-4083bbdd1320","Type":"ContainerStarted","Data":"af1f076b43390e8319e8b6cce0cc5e4ca93ccdb2e008d002eb042aa3840b5042"}
Jul 09 22:33:47.736237 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:47.736197    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rgg8m/must-gather-nmfc5" event={"ID":"d59107da-40b4-4000-97c0-4083bbdd1320","Type":"ContainerStarted","Data":"88b61aba4b2ecfcf1087c9c9254d9da165f417d88f9242a8f666a269e823dcb1"}
Jul 09 22:33:47.736771 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:47.736746    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rgg8m/must-gather-nmfc5" event={"ID":"d59107da-40b4-4000-97c0-4083bbdd1320","Type":"ContainerStarted","Data":"b8f83f1d91de256ba60e5a5e631108a2e8f85aff29f01fecb6b1575a740fc909"}
Jul 09 22:33:47.756298 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:47.756228    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rgg8m/must-gather-nmfc5" podStartSLOduration=2.401082476 podStartE2EDuration="3.75620516s" totalImagesPullingTime="1.355122684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:33:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:33:47.753844554 +0000 UTC m=+2575.085344634" watchObservedRunningTime="2026-07-09 22:33:47.75620516 +0000 UTC m=+2575.087705240"
Jul 09 22:33:48.478269 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:48.478238    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fjm26_442ba0c0-0b9e-4918-b8a6-c93618456a92/global-pull-secret-syncer/0.log"
Jul 09 22:33:48.649238 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:48.649208    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fxmvw_06b11cb1-4d06-48b8-a010-c79c999bfec2/konnectivity-agent/0.log"
Jul 09 22:33:48.699242 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:48.699200    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-101.ec2.internal_91fa6d5fff63c7ad729649847f11496f/haproxy/0.log"
Jul 09 22:33:53.513902 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:53.513864    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-689f8cfdb9-km4kh_a279158d-2210-4bb4-9444-709b83ccc3eb/authorino/0.log"
Jul 09 22:33:53.546627 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:53.546538    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-2vpk5_993f9d45-7a82-405d-976e-cbb3be273ead/manager/0.log"
Jul 09 22:33:53.576291 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:53.576262    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-bfdbb_fb19fa9f-5de3-410c-85e1-b368b16b2843/manager/0.log"
Jul 09 22:33:53.624440 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:53.624405    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-r65sc_1adea14a-9e34-4e9a-bf5d-897041459b81/kuadrant-console-plugin/0.log"
Jul 09 22:33:53.667459 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:53.666737    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-vssxp_633464e5-3653-4e43-aecd-d02bce6c2e88/registry-server/0.log"
Jul 09 22:33:53.942761 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:53.942678    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-chkh7_1b58c863-7d8f-47f4-a80d-f7ae73235656/manager/0.log"
Jul 09 22:33:56.097641 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:56.097512    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c85sk_43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1/node-exporter/0.log"
Jul 09 22:33:56.122813 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:56.122790    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c85sk_43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1/kube-rbac-proxy/0.log"
Jul 09 22:33:56.147642 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:56.147607    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c85sk_43c56e56-fb8e-40a6-9df0-0c9aa4fab2e1/init-textfile/0.log"
Jul 09 22:33:58.048583 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:58.048556    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-nlmg4_2cb9c33f-a330-489a-96bb-57a7a6ece91a/networking-console-plugin/0.log"
Jul 09 22:33:58.573626 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:58.573585    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rgg8m/perf-node-gather-daemonset-q4t88"]
Jul 09 22:33:58.581292 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:58.581255    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rgg8m/perf-node-gather-daemonset-q4t88"
Jul 09 22:33:58.596058 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:58.596024    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rgg8m/perf-node-gather-daemonset-q4t88"]
Jul 09 22:33:58.663474 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:58.663426    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xd24\" (UniqueName: \"kubernetes.io/projected/c17b2f41-e1c8-4535-a58a-98a5afb79f8c-kube-api-access-6xd24\") pod \"perf-node-gather-daemonset-q4t88\" (UID: \"c17b2f41-e1c8-4535-a58a-98a5afb79f8c\") " pod="openshift-must-gather-rgg8m/perf-node-gather-daemonset-q4t88"
Jul 09 22:33:58.663669 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:58.663521    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c17b2f41-e1c8-4535-a58a-98a5afb79f8c-lib-modules\") pod \"perf-node-gather-daemonset-q4t88\" (UID: \"c17b2f41-e1c8-4535-a58a-98a5afb79f8c\") " pod="openshift-must-gather-rgg8m/perf-node-gather-daemonset-q4t88"
Jul 09 22:33:58.663669 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:58.663558    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c17b2f41-e1c8-4535-a58a-98a5afb79f8c-proc\") pod \"perf-node-gather-daemonset-q4t88\" (UID: \"c17b2f41-e1c8-4535-a58a-98a5afb79f8c\") " pod="openshift-must-gather-rgg8m/perf-node-gather-daemonset-q4t88"
Jul 09 22:33:58.663770 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:58.663682    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c17b2f41-e1c8-4535-a58a-98a5afb79f8c-sys\") pod \"perf-node-gather-daemonset-q4t88\" (UID: \"c17b2f41-e1c8-4535-a58a-98a5afb79f8c\") " pod="openshift-must-gather-rgg8m/perf-node-gather-daemonset-q4t88"
Jul 09 22:33:58.663770 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:58.663712    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c17b2f41-e1c8-4535-a58a-98a5afb79f8c-podres\") pod \"perf-node-gather-daemonset-q4t88\" (UID: \"c17b2f41-e1c8-4535-a58a-98a5afb79f8c\") " pod="openshift-must-gather-rgg8m/perf-node-gather-daemonset-q4t88"
Jul 09 22:33:58.764475 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:58.764432    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c17b2f41-e1c8-4535-a58a-98a5afb79f8c-sys\") pod \"perf-node-gather-daemonset-q4t88\" (UID: \"c17b2f41-e1c8-4535-a58a-98a5afb79f8c\") " pod="openshift-must-gather-rgg8m/perf-node-gather-daemonset-q4t88"
Jul 09 22:33:58.764687 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:58.764487    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c17b2f41-e1c8-4535-a58a-98a5afb79f8c-podres\") pod \"perf-node-gather-daemonset-q4t88\" (UID: \"c17b2f41-e1c8-4535-a58a-98a5afb79f8c\") " pod="openshift-must-gather-rgg8m/perf-node-gather-daemonset-q4t88"
Jul 09 22:33:58.764687 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:58.764528    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xd24\" (UniqueName: \"kubernetes.io/projected/c17b2f41-e1c8-4535-a58a-98a5afb79f8c-kube-api-access-6xd24\") pod \"perf-node-gather-daemonset-q4t88\" (UID: \"c17b2f41-e1c8-4535-a58a-98a5afb79f8c\") " pod="openshift-must-gather-rgg8m/perf-node-gather-daemonset-q4t88"
Jul 09 22:33:58.764687 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:58.764564    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c17b2f41-e1c8-4535-a58a-98a5afb79f8c-lib-modules\") pod \"perf-node-gather-daemonset-q4t88\" (UID: \"c17b2f41-e1c8-4535-a58a-98a5afb79f8c\") " pod="openshift-must-gather-rgg8m/perf-node-gather-daemonset-q4t88"
Jul 09 22:33:58.764687 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:58.764594    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c17b2f41-e1c8-4535-a58a-98a5afb79f8c-proc\") pod \"perf-node-gather-daemonset-q4t88\" (UID: \"c17b2f41-e1c8-4535-a58a-98a5afb79f8c\") " pod="openshift-must-gather-rgg8m/perf-node-gather-daemonset-q4t88"
Jul 09 22:33:58.764922 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:58.764737    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c17b2f41-e1c8-4535-a58a-98a5afb79f8c-proc\") pod \"perf-node-gather-daemonset-q4t88\" (UID: \"c17b2f41-e1c8-4535-a58a-98a5afb79f8c\") " pod="openshift-must-gather-rgg8m/perf-node-gather-daemonset-q4t88"
Jul 09 22:33:58.764922 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:58.764793    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c17b2f41-e1c8-4535-a58a-98a5afb79f8c-sys\") pod \"perf-node-gather-daemonset-q4t88\" (UID: \"c17b2f41-e1c8-4535-a58a-98a5afb79f8c\") " pod="openshift-must-gather-rgg8m/perf-node-gather-daemonset-q4t88"
Jul 09 22:33:58.764922 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:58.764889    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c17b2f41-e1c8-4535-a58a-98a5afb79f8c-podres\") pod \"perf-node-gather-daemonset-q4t88\" (UID: \"c17b2f41-e1c8-4535-a58a-98a5afb79f8c\") " pod="openshift-must-gather-rgg8m/perf-node-gather-daemonset-q4t88"
Jul 09 22:33:58.765358 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:58.765334    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c17b2f41-e1c8-4535-a58a-98a5afb79f8c-lib-modules\") pod \"perf-node-gather-daemonset-q4t88\" (UID: \"c17b2f41-e1c8-4535-a58a-98a5afb79f8c\") " pod="openshift-must-gather-rgg8m/perf-node-gather-daemonset-q4t88"
Jul 09 22:33:58.776775 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:58.776741    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xd24\" (UniqueName: \"kubernetes.io/projected/c17b2f41-e1c8-4535-a58a-98a5afb79f8c-kube-api-access-6xd24\") pod \"perf-node-gather-daemonset-q4t88\" (UID: \"c17b2f41-e1c8-4535-a58a-98a5afb79f8c\") " pod="openshift-must-gather-rgg8m/perf-node-gather-daemonset-q4t88"
Jul 09 22:33:58.899774 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:58.899686    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rgg8m/perf-node-gather-daemonset-q4t88"
Jul 09 22:33:59.080468 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:59.080436    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rgg8m/perf-node-gather-daemonset-q4t88"]
Jul 09 22:33:59.085654 ip-10-0-141-101 kubenswrapper[2576]: W0709 22:33:59.085608    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc17b2f41_e1c8_4535_a58a_98a5afb79f8c.slice/crio-3351077664d7274b64be74220e2d42619bdf82f887a0a44adce52b16dcc68a3a WatchSource:0}: Error finding container 3351077664d7274b64be74220e2d42619bdf82f887a0a44adce52b16dcc68a3a: Status 404 returned error can't find the container with id 3351077664d7274b64be74220e2d42619bdf82f887a0a44adce52b16dcc68a3a
Jul 09 22:33:59.848065 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:59.848026    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rgg8m/perf-node-gather-daemonset-q4t88" event={"ID":"c17b2f41-e1c8-4535-a58a-98a5afb79f8c","Type":"ContainerStarted","Data":"289311fb3074105a1073afaf62fbfd0ddff047f9e5fbc475631c9cf24e3e378e"}
Jul 09 22:33:59.848377 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:59.848356    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rgg8m/perf-node-gather-daemonset-q4t88" event={"ID":"c17b2f41-e1c8-4535-a58a-98a5afb79f8c","Type":"ContainerStarted","Data":"3351077664d7274b64be74220e2d42619bdf82f887a0a44adce52b16dcc68a3a"}
Jul 09 22:33:59.848605 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:59.848591    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rgg8m/perf-node-gather-daemonset-q4t88"
Jul 09 22:33:59.868437 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:33:59.868367    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rgg8m/perf-node-gather-daemonset-q4t88" podStartSLOduration=1.868345938 podStartE2EDuration="1.868345938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:33:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:33:59.866021241 +0000 UTC m=+2587.197521320" watchObservedRunningTime="2026-07-09 22:33:59.868345938 +0000 UTC m=+2587.199846016"
Jul 09 22:34:01.300080 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:34:01.300053    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gtd7d_541b0dc1-1400-4cbf-96d1-d248a30a012d/dns/0.log"
Jul 09 22:34:01.323375 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:34:01.323350    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gtd7d_541b0dc1-1400-4cbf-96d1-d248a30a012d/kube-rbac-proxy/0.log"
Jul 09 22:34:01.400833 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:34:01.400802    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fvncf_7130e58c-a513-4666-8938-c16760ff494c/dns-node-resolver/0.log"
Jul 09 22:34:01.998624 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:34:01.998591    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qngdz_31a02e15-5a13-4e04-a0ba-8e5667bd9420/node-ca/0.log"
Jul 09 22:34:03.132390 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:34:03.132363    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b6b884787-sj2k9_201e5101-4e2c-4500-8f1e-c91537b9ffd5/kube-auth-proxy/0.log"
Jul 09 22:34:03.169159 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:34:03.169128    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-m2w97_1e0705e6-7963-4d77-827c-cee07947f167/istio-proxy/0.log"
Jul 09 22:34:03.208235 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:34:03.208202    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-m2w97_1e0705e6-7963-4d77-827c-cee07947f167/istio-proxy/1.log"
Jul 09 22:34:03.258312 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:34:03.258273    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-sjf46_46ec86b5-bc9f-49c4-b9bc-00994f0ae977/payload-pre-processing/0.log"
Jul 09 22:34:04.058554 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:34:04.058518    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zxhgh_a98e7087-edbc-4c9e-804e-b6fa45440ffe/serve-healthcheck-canary/0.log"
Jul 09 22:34:04.715421 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:34:04.715395    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xqbg6_44a8d0af-a142-4ca6-8d6e-caee08f1f2e0/kube-rbac-proxy/0.log"
Jul 09 22:34:04.738585 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:34:04.738509    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xqbg6_44a8d0af-a142-4ca6-8d6e-caee08f1f2e0/exporter/0.log"
Jul 09 22:34:04.761931 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:34:04.761903    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xqbg6_44a8d0af-a142-4ca6-8d6e-caee08f1f2e0/extractor/0.log"
Jul 09 22:34:06.863350 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:34:06.863264    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-df4jq_9218a4f8-3388-4b31-b7f7-92ebdb02576d/manager/0.log"
Jul 09 22:34:06.869502 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:34:06.869479    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rgg8m/perf-node-gather-daemonset-q4t88"
Jul 09 22:34:06.994949 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:34:06.994916    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-cx5r7_2433c8e7-20ef-453c-9a58-6e660be175f7/manager/0.log"
Jul 09 22:34:07.113284 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:34:07.113251    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-l2w25_958185da-7f44-4a72-b425-fb2c0061901f/server/0.log"
Jul 09 22:34:07.196602 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:34:07.196523    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-pq9r8_0a324cc7-d71c-4d55-83f4-479a7ebbeb6e/manager/0.log"
Jul 09 22:34:07.345145 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:34:07.345113    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85dfbddc47-n2h8l_6e915a81-51e4-4910-931c-7c743c0939b5/manager/0.log"
Jul 09 22:34:07.368323 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:34:07.368300    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85dfbddc47-n2h8l_6e915a81-51e4-4910-931c-7c743c0939b5/copy-manifests/0.log"
Jul 09 22:34:08.748618 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:34:08.748584    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-p6pq9_e128db91-9318-4d6e-a5eb-289fc54a678d/openshift-lws-operator/0.log"
Jul 09 22:34:09.210827 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:34:09.210792    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b6b884787-sj2k9_201e5101-4e2c-4500-8f1e-c91537b9ffd5/kube-auth-proxy/0.log"
Jul 09 22:34:09.241316 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:34:09.241283    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-m2w97_1e0705e6-7963-4d77-827c-cee07947f167/istio-proxy/0.log"
Jul 09 22:34:09.281577 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:34:09.281539    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-m2w97_1e0705e6-7963-4d77-827c-cee07947f167/istio-proxy/1.log"
Jul 09 22:34:09.320407 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:34:09.320376    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-sjf46_46ec86b5-bc9f-49c4-b9bc-00994f0ae977/payload-pre-processing/0.log"
Jul 09 22:34:10.686605 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:34:10.686578    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b6b884787-sj2k9_201e5101-4e2c-4500-8f1e-c91537b9ffd5/kube-auth-proxy/0.log"
Jul 09 22:34:10.710119 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:34:10.710084    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-m2w97_1e0705e6-7963-4d77-827c-cee07947f167/istio-proxy/0.log"
Jul 09 22:34:10.754087 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:34:10.754055    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-m2w97_1e0705e6-7963-4d77-827c-cee07947f167/istio-proxy/1.log"
Jul 09 22:34:10.797141 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:34:10.797085    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-sjf46_46ec86b5-bc9f-49c4-b9bc-00994f0ae977/payload-pre-processing/0.log"
Jul 09 22:34:15.538291 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:34:15.538206    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7tq48_bc33c68c-1261-400d-991e-308f24c9210b/kube-multus-additional-cni-plugins/0.log"
Jul 09 22:34:15.559851 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:34:15.559825    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7tq48_bc33c68c-1261-400d-991e-308f24c9210b/egress-router-binary-copy/0.log"
Jul 09 22:34:15.580717 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:34:15.580689    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7tq48_bc33c68c-1261-400d-991e-308f24c9210b/cni-plugins/0.log"
Jul 09 22:34:15.603381 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:34:15.603351    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7tq48_bc33c68c-1261-400d-991e-308f24c9210b/bond-cni-plugin/0.log"
Jul 09 22:34:15.624191 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:34:15.624166    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7tq48_bc33c68c-1261-400d-991e-308f24c9210b/routeoverride-cni/0.log"
Jul 09 22:34:15.649330 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:34:15.649303    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7tq48_bc33c68c-1261-400d-991e-308f24c9210b/whereabouts-cni-bincopy/0.log"
Jul 09 22:34:15.675124 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:34:15.675094    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7tq48_bc33c68c-1261-400d-991e-308f24c9210b/whereabouts-cni/0.log"
Jul 09 22:34:16.081767 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:34:16.081728    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-hv6qq_469ca9e2-ec48-4e51-83e0-e1daa87df6d9/kube-multus/0.log"
Jul 09 22:34:16.186716 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:34:16.186691    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-l49xl_b99eef2e-6748-4460-bd07-1f99729b663c/network-metrics-daemon/0.log"
Jul 09 22:34:16.206326 ip-10-0-141-101 kubenswrapper[2576]: I0709 22:34:16.206302    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-l49xl_b99eef2e-6748-4460-bd07-1f99729b663c/kube-rbac-proxy/0.log"