Jul 13 16:40:01.109797 ip-10-0-143-51 systemd[1]: Starting Kubernetes Kubelet...
Jul 13 16:40:03.021546 ip-10-0-143-51 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 16:40:03.021546 ip-10-0-143-51 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 13 16:40:03.021546 ip-10-0-143-51 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 16:40:03.021546 ip-10-0-143-51 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 13 16:40:03.021546 ip-10-0-143-51 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 16:40:03.021546 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.496535    2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 13 16:40:03.021546 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.500868    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 16:40:03.021546 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.500882    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 16:40:03.021546 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.500885    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 16:40:03.021546 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.500888    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 16:40:03.021546 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.500891    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 16:40:03.021546 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.500894    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 16:40:03.021546 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.500897    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 16:40:03.021546 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.500899    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 16:40:02.986343 ip-10-0-143-51 systemd[1]: Started Kubernetes Kubelet.
Jul 13 16:40:03.022669 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.500904    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 16:40:03.022669 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.500908    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 16:40:03.022669 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.500911    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 16:40:03.022669 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.500915    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 16:40:03.022669 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.500918    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 16:40:03.022669 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.500920    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 16:40:03.022669 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.500923    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 16:40:03.022669 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.500926    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 16:40:03.022669 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.500928    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 16:40:03.022669 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.500931    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 16:40:03.022669 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.500933    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 16:40:03.022669 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.500937    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 16:40:03.022669 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.500940    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 16:40:03.022669 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.500943    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 16:40:03.022669 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.500945    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 16:40:03.022669 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.500949    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 16:40:03.022669 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.500952    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 16:40:03.022669 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.500954    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 16:40:03.022669 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.500957    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 16:40:03.023425 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.500960    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 16:40:03.023425 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.500962    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 16:40:03.023425 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.500965    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 16:40:03.023425 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.500967    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 16:40:03.023425 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.500970    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 16:40:03.023425 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.500972    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 16:40:03.023425 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.500975    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 16:40:03.023425 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.500978    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 16:40:03.023425 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.500980    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 16:40:03.023425 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.500983    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 16:40:03.023425 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.500985    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 16:40:03.023425 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.500988    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 16:40:03.023425 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.500990    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 16:40:03.023425 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.500992    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 16:40:03.023425 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.500995    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 16:40:03.023425 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.500997    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 16:40:03.023425 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501000    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 16:40:03.023425 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501003    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 16:40:03.023425 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501006    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 16:40:03.023425 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501008    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 16:40:03.024143 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501011    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 16:40:03.024143 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501013    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 16:40:03.024143 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501016    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 16:40:03.024143 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501018    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 16:40:03.024143 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501021    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 16:40:03.024143 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501024    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 16:40:03.024143 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501026    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 16:40:03.024143 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501029    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 16:40:03.024143 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501032    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 16:40:03.024143 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501034    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 16:40:03.024143 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501037    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 16:40:03.024143 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501039    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 16:40:03.024143 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501042    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 16:40:03.024143 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501044    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 16:40:03.024143 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501047    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 16:40:03.024143 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501051    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 16:40:03.024143 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501053    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 16:40:03.024143 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501056    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 16:40:03.024143 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501059    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 16:40:03.024143 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501061    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 16:40:03.024760 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501064    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 16:40:03.024760 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501066    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 16:40:03.024760 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501068    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 16:40:03.024760 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501071    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 16:40:03.024760 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501074    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 16:40:03.024760 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501076    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 16:40:03.024760 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501080    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 16:40:03.024760 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501085    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 16:40:03.024760 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501088    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 16:40:03.024760 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501091    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 16:40:03.024760 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501093    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 16:40:03.024760 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501096    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 16:40:03.024760 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501098    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 16:40:03.024760 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501101    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 16:40:03.024760 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501103    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 16:40:03.024760 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501106    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 16:40:03.024760 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501110    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 16:40:03.024760 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501113    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 16:40:03.024760 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501116    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 16:40:03.025381 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501118    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 16:40:03.025381 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501121    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 16:40:03.025381 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501124    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 16:40:03.025381 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501127    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 16:40:03.025381 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501129    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 16:40:03.025381 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501132    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 16:40:03.025381 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501134    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 16:40:03.025381 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501137    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 16:40:03.025381 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501140    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 16:40:03.025381 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501142    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 16:40:03.025381 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501145    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 16:40:03.025381 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501148    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 16:40:03.025381 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501151    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 16:40:03.025381 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501869    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 16:40:03.025381 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501876    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 16:40:03.025381 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501879    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 16:40:03.025381 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501883    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 16:40:03.025381 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501887    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 16:40:03.025381 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501889    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 16:40:03.025381 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501892    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 16:40:03.025992 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501896    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 16:40:03.025992 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501900    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 16:40:03.025992 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501903    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 16:40:03.025992 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501906    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 16:40:03.025992 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501908    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 16:40:03.025992 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501911    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 16:40:03.025992 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501914    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 16:40:03.025992 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501917    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 16:40:03.025992 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501920    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 16:40:03.025992 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501923    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 16:40:03.025992 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501926    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 16:40:03.025992 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501928    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 16:40:03.025992 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501932    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 16:40:03.025992 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501937    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 16:40:03.025992 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501940    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 16:40:03.025992 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501943    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 16:40:03.025992 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501945    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 16:40:03.025992 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501948    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 16:40:03.025992 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501951    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 16:40:03.026571 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501953    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 16:40:03.026571 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501956    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 16:40:03.026571 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501959    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 16:40:03.026571 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501961    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 16:40:03.026571 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501964    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 16:40:03.026571 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501966    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 16:40:03.026571 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501969    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 16:40:03.026571 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501972    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 16:40:03.026571 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501975    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 16:40:03.026571 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501978    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 16:40:03.026571 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501980    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 16:40:03.026571 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501983    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 16:40:03.026571 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501985    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 16:40:03.026571 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501987    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 16:40:03.026571 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501990    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 16:40:03.026571 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501992    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 16:40:03.026571 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501995    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 16:40:03.026571 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.501998    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 16:40:03.026571 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502000    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 16:40:03.026571 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502002    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 16:40:03.027172 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502005    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 16:40:03.027172 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502008    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 16:40:03.027172 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502010    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 16:40:03.027172 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502013    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 16:40:03.027172 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502015    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 16:40:03.027172 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502018    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 16:40:03.027172 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502021    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 16:40:03.027172 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502024    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 16:40:03.027172 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502026    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 16:40:03.027172 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502029    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 16:40:03.027172 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502032    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 16:40:03.027172 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502035    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 16:40:03.027172 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502037    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 16:40:03.027172 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502039    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 16:40:03.027172 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502042    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 16:40:03.027172 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502044    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 16:40:03.027172 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502046    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 16:40:03.027172 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502049    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 16:40:03.027172 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502051    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 16:40:03.027172 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502054    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 16:40:03.027848 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502056    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 16:40:03.027848 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502059    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 16:40:03.027848 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502061    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 16:40:03.027848 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502064    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 16:40:03.027848 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502066    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 16:40:03.027848 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502068    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 16:40:03.027848 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502071    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 16:40:03.027848 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502073    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 16:40:03.027848 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502076    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 16:40:03.027848 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502078    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 16:40:03.027848 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502081    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 16:40:03.027848 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502083    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 16:40:03.027848 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502086    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 16:40:03.027848 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502089    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 16:40:03.027848 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502092    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 16:40:03.027848 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502096    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 16:40:03.027848 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502099    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 16:40:03.027848 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502102    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 16:40:03.027848 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502105    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 16:40:03.027848 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502108    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 16:40:03.028428 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502113    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 16:40:03.028428 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502116    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 16:40:03.028428 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502119    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 16:40:03.028428 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502122    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 16:40:03.028428 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502124    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 16:40:03.028428 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502127    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 16:40:03.028428 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502129    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 16:40:03.028428 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502132    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 16:40:03.028428 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502134    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 16:40:03.028428 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502137    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 16:40:03.028428 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502139    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 16:40:03.028428 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502142    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 16:40:03.028428 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.502145    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 16:40:03.028428 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503825    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 16:40:03.028428 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503839    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 16:40:03.028428 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503843    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 16:40:03.028428 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503847    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 16:40:03.028428 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503850    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 16:40:03.028428 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503853    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 16:40:03.028428 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503856    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 16:40:03.029090 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503859    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 16:40:03.029090 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503862    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 16:40:03.029090 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503866    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 16:40:03.029090 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503870    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 16:40:03.029090 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503874    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 16:40:03.029090 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503877    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 16:40:03.029090 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503880    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 16:40:03.029090 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503883    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 16:40:03.029090 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503886    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 16:40:03.029090 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503890    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 16:40:03.029090 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503894    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 16:40:03.029090 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503898    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 16:40:03.029090 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503901    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 16:40:03.029090 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503904    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 16:40:03.029090 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503907    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 16:40:03.029090 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503909    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 16:40:03.029090 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503912    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 16:40:03.029090 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503915    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 16:40:03.029090 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503918    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 16:40:03.029619 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503921    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 16:40:03.029619 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503923    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 16:40:03.029619 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503926    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 16:40:03.029619 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503929    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 16:40:03.029619 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503932    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 16:40:03.029619 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503935    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 16:40:03.029619 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503939    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 16:40:03.029619 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503941    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 16:40:03.029619 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503944    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 16:40:03.029619 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503947    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 16:40:03.029619 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503950    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 16:40:03.029619 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503952    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 16:40:03.029619 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503955    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 16:40:03.029619 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503960    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 16:40:03.029619 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503963    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 16:40:03.029619 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503966    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 16:40:03.029619 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503968    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 16:40:03.029619 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503971    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 16:40:03.029619 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503974    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 16:40:03.029619 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503977    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 16:40:03.030329 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503980    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 16:40:03.030329 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503982    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 16:40:03.030329 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503985    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 16:40:03.030329 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503987    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 16:40:03.030329 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503991    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 16:40:03.030329 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.503995    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 16:40:03.030329 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504000    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 16:40:03.030329 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504004    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 16:40:03.030329 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504007    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 16:40:03.030329 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504010    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 16:40:03.030329 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504013    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 16:40:03.030329 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504016    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 16:40:03.030329 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504018    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 16:40:03.030329 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504021    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 16:40:03.030329 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504024    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 16:40:03.030329 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504028    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 16:40:03.030329 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504030    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 16:40:03.030329 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504033    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 16:40:03.030329 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504035    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 16:40:03.031077 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504038    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 16:40:03.031077 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504041    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 16:40:03.031077 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504044    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 16:40:03.031077 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504046    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 16:40:03.031077 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504050    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 16:40:03.031077 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504053    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 16:40:03.031077 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504057    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 16:40:03.031077 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504060    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 16:40:03.031077 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504063    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 16:40:03.031077 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504065    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 16:40:03.031077 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504068    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 16:40:03.031077 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504070    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 16:40:03.031077 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504073    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 16:40:03.031077 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504076    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 16:40:03.031077 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504078    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 16:40:03.031077 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504081    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 16:40:03.031077 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504083    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 16:40:03.031077 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504086    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 16:40:03.031077 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504089    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 16:40:03.032077 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504092    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 16:40:03.032077 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504094    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 16:40:03.032077 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504097    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 16:40:03.032077 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504100    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 16:40:03.032077 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504102    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 16:40:03.032077 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504105    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 16:40:03.032077 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504108    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 16:40:03.032077 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504110    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 16:40:03.032077 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504113    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 16:40:03.032077 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504117    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 16:40:03.032077 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504120    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 16:40:03.032077 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504123    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 16:40:03.032077 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504125    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 16:40:03.032077 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504127    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 16:40:03.032077 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504130    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 16:40:03.032077 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504206    2573 flags.go:64] FLAG: --address="0.0.0.0"
Jul 13 16:40:03.032077 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504214    2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 13 16:40:03.032077 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504221    2573 flags.go:64] FLAG: --anonymous-auth="true"
Jul 13 16:40:03.032077 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504225    2573 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 13 16:40:03.032077 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504231    2573 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 13 16:40:03.032077 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504235    2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 13 16:40:03.032667 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504239    2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 13 16:40:03.032667 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504244    2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 13 16:40:03.032667 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504247    2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 13 16:40:03.032667 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504250    2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 13 16:40:03.032667 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504254    2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 13 16:40:03.032667 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504257    2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 13 16:40:03.032667 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504261    2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 13 16:40:03.032667 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504264    2573 flags.go:64] FLAG: --cgroup-root=""
Jul 13 16:40:03.032667 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504266    2573 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 13 16:40:03.032667 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504269    2573 flags.go:64] FLAG: --client-ca-file=""
Jul 13 16:40:03.032667 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504272    2573 flags.go:64] FLAG: --cloud-provider="external"
Jul 13 16:40:03.032667 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504276    2573 flags.go:64] FLAG: --cluster-dns="[]"
Jul 13 16:40:03.032667 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504281    2573 flags.go:64] FLAG: --cluster-domain=""
Jul 13 16:40:03.032667 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504284    2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 13 16:40:03.032667 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504287    2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 13 16:40:03.032667 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504290    2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 13 16:40:03.032667 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504293    2573 flags.go:64] FLAG: --container-log-max-files="5"
Jul 13 16:40:03.032667 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504297    2573 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 13 16:40:03.032667 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504300    2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 13 16:40:03.032667 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504303    2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 13 16:40:03.032667 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504307    2573 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 13 16:40:03.032667 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504310    2573 flags.go:64] FLAG: --contention-profiling="false"
Jul 13 16:40:03.032667 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504313    2573 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 13 16:40:03.032667 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504316    2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 13 16:40:03.033799 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504319    2573 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 13 16:40:03.033799 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504322    2573 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 13 16:40:03.033799 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504326    2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 13 16:40:03.033799 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504329    2573 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 13 16:40:03.033799 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504332    2573 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 13 16:40:03.033799 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504335    2573 flags.go:64] FLAG: --enable-load-reader="false"
Jul 13 16:40:03.033799 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504339    2573 flags.go:64] FLAG: --enable-server="true"
Jul 13 16:40:03.033799 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504342    2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 13 16:40:03.033799 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504347    2573 flags.go:64] FLAG: --event-burst="100"
Jul 13 16:40:03.033799 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504350    2573 flags.go:64] FLAG: --event-qps="50"
Jul 13 16:40:03.033799 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504353    2573 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 13 16:40:03.033799 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504356    2573 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 13 16:40:03.033799 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504359    2573 flags.go:64] FLAG: --eviction-hard=""
Jul 13 16:40:03.033799 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504363    2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 13 16:40:03.033799 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504366    2573 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 13 16:40:03.033799 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504369    2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 13 16:40:03.033799 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504372    2573 flags.go:64] FLAG: --eviction-soft=""
Jul 13 16:40:03.033799 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504375    2573 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 13 16:40:03.033799 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504378    2573 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 13 16:40:03.033799 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504380    2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 13 16:40:03.033799 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504384    2573 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 13 16:40:03.033799 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504387    2573 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 13 16:40:03.033799 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504390    2573 flags.go:64] FLAG: --fail-swap-on="true"
Jul 13 16:40:03.033799 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504392    2573 flags.go:64] FLAG: --feature-gates=""
Jul 13 16:40:03.033799 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504396    2573 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 13 16:40:03.034923 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504399    2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 13 16:40:03.034923 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504402    2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 13 16:40:03.034923 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504405    2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 13 16:40:03.034923 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504409    2573 flags.go:64] FLAG: --healthz-port="10248"
Jul 13 16:40:03.034923 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504412    2573 flags.go:64] FLAG: --help="false"
Jul 13 16:40:03.034923 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504415    2573 flags.go:64] FLAG: --hostname-override="ip-10-0-143-51.ec2.internal"
Jul 13 16:40:03.034923 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504418    2573 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 13 16:40:03.034923 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504421    2573 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 13 16:40:03.034923 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504423    2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 13 16:40:03.034923 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504427    2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 13 16:40:03.034923 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504430    2573 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 13 16:40:03.034923 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504433    2573 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 13 16:40:03.034923 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504436    2573 flags.go:64] FLAG: --image-service-endpoint=""
Jul 13 16:40:03.034923 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504440    2573 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 13 16:40:03.034923 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504442    2573 flags.go:64] FLAG: --kube-api-burst="100"
Jul 13 16:40:03.034923 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504445    2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 13 16:40:03.034923 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504449    2573 flags.go:64] FLAG: --kube-api-qps="50"
Jul 13 16:40:03.034923 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504452    2573 flags.go:64] FLAG: --kube-reserved=""
Jul 13 16:40:03.034923 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504455    2573 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 13 16:40:03.034923 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504457    2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 13 16:40:03.034923 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504460    2573 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 13 16:40:03.034923 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504463    2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 13 16:40:03.034923 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504466    2573 flags.go:64] FLAG: --lock-file=""
Jul 13 16:40:03.034923 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504469    2573 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 13 16:40:03.037383 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504472    2573 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 13 16:40:03.037383 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504475    2573 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 13 16:40:03.037383 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504480    2573 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 13 16:40:03.037383 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504483    2573 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 13 16:40:03.037383 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504487    2573 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 13 16:40:03.037383 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504490    2573 flags.go:64] FLAG: --logging-format="text"
Jul 13 16:40:03.037383 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504493    2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 13 16:40:03.037383 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504496    2573 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 13 16:40:03.037383 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504498    2573 flags.go:64] FLAG: --manifest-url=""
Jul 13 16:40:03.037383 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504521    2573 flags.go:64] FLAG: --manifest-url-header=""
Jul 13 16:40:03.037383 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504526    2573 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 13 16:40:03.037383 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504531    2573 flags.go:64] FLAG: --max-open-files="1000000"
Jul 13 16:40:03.037383 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504535    2573 flags.go:64] FLAG: --max-pods="110"
Jul 13 16:40:03.037383 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504538    2573 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 13 16:40:03.037383 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504541    2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 13 16:40:03.037383 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504544    2573 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 13 16:40:03.037383 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504547    2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 13 16:40:03.037383 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504550    2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 13 16:40:03.037383 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504553    2573 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 13 16:40:03.037383 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504556    2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 13 16:40:03.037383 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504564    2573 flags.go:64] FLAG: --node-status-max-images="50"
Jul 13 16:40:03.037383 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504569    2573 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 13 16:40:03.037383 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504572    2573 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 13 16:40:03.037383 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504574    2573 flags.go:64] FLAG: --pod-cidr=""
Jul 13 16:40:03.038395 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504578    2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 13 16:40:03.038395 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504583    2573 flags.go:64] FLAG: --pod-manifest-path=""
Jul 13 16:40:03.038395 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504586    2573 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 13 16:40:03.038395 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504589    2573 flags.go:64] FLAG: --pods-per-core="0"
Jul 13 16:40:03.038395 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504592    2573 flags.go:64] FLAG: --port="10250"
Jul 13 16:40:03.038395 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504595    2573 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 13 16:40:03.038395 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504598    2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03082a7a8222d1d5f"
Jul 13 16:40:03.038395 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504601    2573 flags.go:64] FLAG: --qos-reserved=""
Jul 13 16:40:03.038395 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504604    2573 flags.go:64] FLAG: --read-only-port="10255"
Jul 13 16:40:03.038395 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504607    2573 flags.go:64] FLAG: --register-node="true"
Jul 13 16:40:03.038395 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504610    2573 flags.go:64] FLAG: --register-with-taints=""
Jul 13 16:40:03.038395 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504614    2573 flags.go:64] FLAG: --registry-burst="10"
Jul 13 16:40:03.038395 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504617    2573 flags.go:64] FLAG: --registry-qps="5"
Jul 13 16:40:03.038395 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504620    2573 flags.go:64] FLAG: --reserved-cpus=""
Jul 13 16:40:03.038395 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504623    2573 flags.go:64] FLAG: --reserved-memory=""
Jul 13 16:40:03.038395 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504627    2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 13 16:40:03.038395 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504630    2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 13 16:40:03.038395 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504633    2573 flags.go:64] FLAG: --rotate-certificates="false"
Jul 13 16:40:03.038395 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504636    2573 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 13 16:40:03.038395 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504640    2573 flags.go:64] FLAG: --runonce="false"
Jul 13 16:40:03.038395 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504643    2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 13 16:40:03.038395 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504646    2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 13 16:40:03.038395 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504649    2573 flags.go:64] FLAG: --seccomp-default="false"
Jul 13 16:40:03.038395 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504651    2573 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 13 16:40:03.038395 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504654    2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 13 16:40:03.039528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504657    2573 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 13 16:40:03.039528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504660    2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 13 16:40:03.039528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504664    2573 flags.go:64] FLAG: --storage-driver-password="root"
Jul 13 16:40:03.039528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504666    2573 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 13 16:40:03.039528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504669    2573 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 13 16:40:03.039528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504674    2573 flags.go:64] FLAG: --storage-driver-user="root"
Jul 13 16:40:03.039528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504677    2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 13 16:40:03.039528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504680    2573 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 13 16:40:03.039528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504683    2573 flags.go:64] FLAG: --system-cgroups=""
Jul 13 16:40:03.039528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504686    2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 13 16:40:03.039528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504692    2573 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 13 16:40:03.039528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504695    2573 flags.go:64] FLAG: --tls-cert-file=""
Jul 13 16:40:03.039528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504698    2573 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 13 16:40:03.039528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504702    2573 flags.go:64] FLAG: --tls-min-version=""
Jul 13 16:40:03.039528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504705    2573 flags.go:64] FLAG: --tls-private-key-file=""
Jul 13 16:40:03.039528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504708    2573 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 13 16:40:03.039528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504711    2573 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 13 16:40:03.039528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504714    2573 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 13 16:40:03.039528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504717    2573 flags.go:64] FLAG: --v="2"
Jul 13 16:40:03.039528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504721    2573 flags.go:64] FLAG: --version="false"
Jul 13 16:40:03.039528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504725    2573 flags.go:64] FLAG: --vmodule=""
Jul 13 16:40:03.039528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504729    2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 13 16:40:03.039528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.504732    2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 13 16:40:03.039528 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504842    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 16:40:03.040654 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504847    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 16:40:03.040654 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504850    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 16:40:03.040654 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504855    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 16:40:03.040654 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504858    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 16:40:03.040654 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504861    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 16:40:03.040654 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504864    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 16:40:03.040654 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504867    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 16:40:03.040654 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504869    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 16:40:03.040654 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504872    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 16:40:03.040654 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504875    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 16:40:03.040654 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504877    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 16:40:03.040654 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504880    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 16:40:03.040654 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504882    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 16:40:03.040654 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504886    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 16:40:03.040654 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504889    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 16:40:03.040654 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504891    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 16:40:03.040654 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504894    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 16:40:03.040654 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504897    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 16:40:03.040654 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504900    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 16:40:03.040654 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504902    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 16:40:03.238902 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504905    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 16:40:03.238902 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504907    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 16:40:03.238902 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504910    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 16:40:03.238902 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504912    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 16:40:03.238902 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504915    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 16:40:03.238902 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504917    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 16:40:03.238902 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504920    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 16:40:03.238902 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504923    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 16:40:03.238902 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504925    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 16:40:03.238902 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504928    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 16:40:03.238902 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504931    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 16:40:03.238902 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504934    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 16:40:03.238902 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504937    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 16:40:03.238902 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504939    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 16:40:03.238902 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504943    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 16:40:03.238902 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504946    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 16:40:03.238902 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504949    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 16:40:03.238902 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504951    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 16:40:03.238902 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504954    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 16:40:03.238902 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504956    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 16:40:03.254977 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504959    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 16:40:03.254977 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504962    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 16:40:03.254977 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504964    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 16:40:03.254977 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504967    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 16:40:03.254977 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504970    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 16:40:03.254977 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504974    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 16:40:03.254977 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504976    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 16:40:03.254977 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504979    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 16:40:03.254977 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504981    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 16:40:03.254977 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504984    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 16:40:03.254977 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504987    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 16:40:03.254977 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504989    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 16:40:03.254977 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504992    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 16:40:03.254977 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504994    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 16:40:03.254977 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.504997    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 16:40:03.254977 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.505000    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 16:40:03.254977 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.505002    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 16:40:03.254977 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.505005    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 16:40:03.254977 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.505008    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 16:40:03.254977 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.505010    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 16:40:03.255713 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.505013    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 16:40:03.255713 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.505015    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 16:40:03.255713 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.505018    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 16:40:03.255713 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.505022    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 16:40:03.255713 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.505025    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 16:40:03.255713 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.505027    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 16:40:03.255713 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.505032    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 16:40:03.255713 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.505035    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 16:40:03.255713 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.505037    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 16:40:03.255713 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.505039    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 16:40:03.255713 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.505042    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 16:40:03.255713 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.505046    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 16:40:03.255713 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.505049    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 16:40:03.255713 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.505052    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 16:40:03.255713 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.505056    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 16:40:03.255713 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.505059    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 16:40:03.255713 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.505062    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 16:40:03.255713 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.505066    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 16:40:03.255713 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.505068    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 16:40:03.256345 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.505072    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 16:40:03.256345 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.505076    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 16:40:03.256345 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.505079    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 16:40:03.256345 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.505082    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 16:40:03.256345 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.505085    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 16:40:03.256345 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.505088    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 16:40:03.256345 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.505090    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 16:40:03.256345 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.505094    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 16:40:03.256345 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.505097    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 16:40:03.256345 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.505099    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 16:40:03.256345 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.505102    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 16:40:03.256345 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.505105    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 16:40:03.256345 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.505108    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 16:40:03.256345 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.505111    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 16:40:03.256345 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.505113    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 16:40:03.256345 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.505116    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 16:40:03.256345 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.505119    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 16:40:03.256345 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.505122    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 16:40:03.256345 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.505125    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 16:40:03.256982 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.505817    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 16:40:03.256982 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.513113    2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 13 16:40:03.256982 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.513128    2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 13 16:40:03.256982 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.513145    2573 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 13 16:40:03.256982 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.513151    2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 13 16:40:03.256982 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513221    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 16:40:03.256982 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513226    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 16:40:03.256982 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513230    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 16:40:03.256982 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513233    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 16:40:03.256982 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513235    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 16:40:03.256982 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513238    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 16:40:03.256982 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513241    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 16:40:03.256982 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513244    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 16:40:03.256982 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513246    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 16:40:03.256982 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513249    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 16:40:03.257449 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513252    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 16:40:03.257449 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513254    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 16:40:03.257449 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513257    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 16:40:03.257449 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513260    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 16:40:03.257449 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513262    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 16:40:03.257449 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513265    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 16:40:03.257449 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513268    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 16:40:03.257449 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513270    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 16:40:03.257449 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513273    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 16:40:03.257449 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513277    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 16:40:03.257449 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513280    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 16:40:03.257449 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513284    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 16:40:03.257449 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513287    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 16:40:03.257449 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513289    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 16:40:03.257449 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513292    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 16:40:03.257449 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513294    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 16:40:03.257449 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513300    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 16:40:03.257449 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513303    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 16:40:03.257449 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513305    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 16:40:03.258118 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513309    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 16:40:03.258118 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513311    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 16:40:03.258118 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513314    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 16:40:03.258118 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513317    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 16:40:03.258118 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513319    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 16:40:03.258118 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513322    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 16:40:03.258118 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513324    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 16:40:03.258118 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513327    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 16:40:03.258118 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513330    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 16:40:03.258118 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513333    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 16:40:03.258118 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513336    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 16:40:03.258118 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513338    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 16:40:03.258118 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513341    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 16:40:03.258118 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513343    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 16:40:03.258118 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513346    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 16:40:03.258118 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513348    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 16:40:03.258118 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513351    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 16:40:03.258118 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513353    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 16:40:03.258118 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513356    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 16:40:03.258118 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513359    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 16:40:03.258692 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513363    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 16:40:03.258692 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513366    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 16:40:03.258692 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513369    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 16:40:03.258692 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513372    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 16:40:03.258692 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513375    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 16:40:03.258692 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513378    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 16:40:03.258692 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513380    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 16:40:03.258692 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513383    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 16:40:03.258692 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513385    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 16:40:03.258692 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513389    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 16:40:03.258692 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513393    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 16:40:03.258692 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513397    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 16:40:03.258692 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513401    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 16:40:03.258692 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513406    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 16:40:03.258692 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513409    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 16:40:03.258692 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513412    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 16:40:03.258692 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513415    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 16:40:03.258692 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513418    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 16:40:03.258692 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513421    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 16:40:03.259424 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513424    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 16:40:03.259424 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513427    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 16:40:03.259424 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513429    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 16:40:03.259424 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513432    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 16:40:03.259424 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513435    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 16:40:03.259424 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513437    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 16:40:03.259424 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513440    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 16:40:03.259424 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513442    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 16:40:03.259424 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513445    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 16:40:03.259424 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513447    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 16:40:03.259424 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513450    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 16:40:03.259424 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513453    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 16:40:03.259424 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513455    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 16:40:03.259424 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513458    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 16:40:03.259424 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513460    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 16:40:03.259424 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513463    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 16:40:03.259424 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513465    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 16:40:03.259424 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513468    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 16:40:03.259424 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513470    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 16:40:03.259424 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513473    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 16:40:03.260043 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513476    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 16:40:03.260043 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513478    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 16:40:03.260043 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513482    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 16:40:03.260043 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513486    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 16:40:03.260043 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513489    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 16:40:03.260043 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513491    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 16:40:03.260043 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513494    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 16:40:03.260043 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513497    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 16:40:03.260043 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513500    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 16:40:03.260043 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513517    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 16:40:03.260043 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513521    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 16:40:03.260043 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:01.513528    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 16:40:03.260043 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513681    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 16:40:03.260043 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513687    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 16:40:03.260043 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513690    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 16:40:03.471473 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513693    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 16:40:03.471473 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513696    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 16:40:03.471473 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513698    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 16:40:03.471473 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513701    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 16:40:03.471473 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513704    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 16:40:03.471473 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513706    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 16:40:03.471473 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513709    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 16:40:03.471473 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513711    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 16:40:03.471473 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513714    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 16:40:03.471473 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513716    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 16:40:03.471473 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513719    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 16:40:03.471473 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513722    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 16:40:03.471473 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513724    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 16:40:03.471473 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513727    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 16:40:03.471473 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513729    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 16:40:03.471473 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513732    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 16:40:03.471473 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513735    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 16:40:03.471473 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513737    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 16:40:03.471473 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513740    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 16:40:03.471473 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513744    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 16:40:03.472245 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513746    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 16:40:03.472245 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513750    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 16:40:03.472245 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513753    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 16:40:03.472245 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513755    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 16:40:03.472245 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513758    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 16:40:03.472245 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513761    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 16:40:03.472245 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513763    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 16:40:03.472245 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513766    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 16:40:03.472245 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513769    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 16:40:03.472245 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513771    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 16:40:03.472245 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513774    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 16:40:03.472245 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513776    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 16:40:03.472245 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513779    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 16:40:03.472245 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513783    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 16:40:03.472245 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513787    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 16:40:03.472245 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513789    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 16:40:03.472245 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:01.513792    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 16:40:03.472245 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920010    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 16:40:03.472245 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920013    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 16:40:03.473561 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920015    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 16:40:03.473561 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920018    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 16:40:03.473561 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920020    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 16:40:03.473561 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920023    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 16:40:03.473561 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920025    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 16:40:03.473561 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920028    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 16:40:03.473561 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920031    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 16:40:03.473561 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920033    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 16:40:03.473561 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920036    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 16:40:03.473561 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920038    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 16:40:03.473561 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920041    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 16:40:03.473561 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920043    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 16:40:03.473561 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920048    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 16:40:03.473561 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920052    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 16:40:03.473561 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920057    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 16:40:03.473561 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920060    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 16:40:03.473561 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920063    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 16:40:03.473561 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920066    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 16:40:03.473561 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920068    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 16:40:03.474135 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920071    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 16:40:03.474135 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920074    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 16:40:03.474135 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920077    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 16:40:03.474135 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920079    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 16:40:03.474135 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920082    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 16:40:03.474135 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920085    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 16:40:03.474135 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920087    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 16:40:03.474135 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920090    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 16:40:03.474135 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920092    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 16:40:03.474135 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920095    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 16:40:03.474135 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920097    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 16:40:03.474135 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920100    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 16:40:03.474135 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920102    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 16:40:03.474135 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920105    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 16:40:03.474135 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920107    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 16:40:03.474135 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920110    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 16:40:03.474135 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920112    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 16:40:03.474135 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920115    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 16:40:03.474135 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920117    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 16:40:03.474914 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920120    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 16:40:03.474914 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920122    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 16:40:03.474914 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920125    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 16:40:03.474914 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920127    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 16:40:03.474914 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920130    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 16:40:03.474914 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920132    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 16:40:03.474914 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920136    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 16:40:03.474914 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920138    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 16:40:03.474914 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920142    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 16:40:03.474914 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920145    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 16:40:03.474914 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920147    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 16:40:03.474914 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920150    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 16:40:03.474914 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920152    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 16:40:03.474914 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920156    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 16:40:03.474914 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920160    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 16:40:03.474914 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920163    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 16:40:03.474914 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920166    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 16:40:03.474914 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920169    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 16:40:03.474914 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:02.920172    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 16:40:03.475459 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.920178    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 16:40:03.475459 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.920282    2573 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 13 16:40:03.475459 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.927588    2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 13 16:40:03.475459 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.929531    2573 server.go:1019] "Starting client certificate rotation"
Jul 13 16:40:03.475459 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.929635    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 13 16:40:03.475459 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.929669    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 13 16:40:03.475459 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.932040    2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 13 16:40:03.475459 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.933488    2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 13 16:40:03.475459 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.948891    2573 log.go:25] "Validated CRI v1 runtime API"
Jul 13 16:40:03.475459 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.952147    2573 log.go:25] "Validated CRI v1 image API"
Jul 13 16:40:03.475459 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.952950    2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 13 16:40:03.475459 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.957920    2573 fs.go:135] Filesystem UUIDs: map[3ede6175-d355-4f3c-9a18-45487e76ab99:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a6eb0c63-25f4-4172-b9b6-e3f51b14f3f2:/dev/nvme0n1p4]
Jul 13 16:40:03.476008 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.957937    2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 13 16:40:03.476110 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.963023    2573 manager.go:216] Machine: {Timestamp:2026-07-13 16:40:02.961695 +0000 UTC m=+0.320001816 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3089735 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22b14cb38c08f206c44563c16601be SystemUUID:ec22b14c-b38c-08f2-06c4-4563c16601be BootID:7dca60ad-8e3f-4680-9c2a-8a9382616fdd Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:8c:15:58:df:ed Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:8c:15:58:df:ed Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5e:eb:0a:87:8f:be Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 13 16:40:03.476110 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.963124    2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 13 16:40:03.476110 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.963203    2573 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 13 16:40:03.476110 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.965127    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 13 16:40:03.476110 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.965125    2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 13 16:40:03.476110 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.965151    2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-51.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 13 16:40:03.476110 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.965991    2573 topology_manager.go:138] "Creating topology manager with none policy"
Jul 13 16:40:03.476528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.966002    2573 container_manager_linux.go:309] "Creating device plugin manager"
Jul 13 16:40:03.476528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.966010    2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 13 16:40:03.476528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.966800    2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 13 16:40:03.476528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.968499    2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 13 16:40:03.476528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.973795    2573 state_mem.go:36] "Initialized new in-memory state store"
Jul 13 16:40:03.476528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.973942    2573 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 13 16:40:03.476528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.973970    2573 kubelet.go:486] "Attempting to sync node with API server"
Jul 13 16:40:03.476528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.973980    2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 13 16:40:03.476528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.973992    2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 13 16:40:03.476528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.974001    2573 kubelet.go:398] "Adding apiserver pod source"
Jul 13 16:40:03.476528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.974010    2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 13 16:40:03.476528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.974360    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 13 16:40:03.476528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.974383    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 13 16:40:03.476528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.977558    2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 13 16:40:03.476528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.979743    2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 13 16:40:03.476528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.979774    2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 13 16:40:03.476528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.979935    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 13 16:40:03.476528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.979947    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 13 16:40:03.476528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.979953    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 13 16:40:03.476528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.979958    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 13 16:40:03.476528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.979966    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 13 16:40:03.476528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.979972    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 13 16:40:03.476528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.980384    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 13 16:40:03.476528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.980390    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 13 16:40:03.476528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.980397    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 13 16:40:03.476528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.980403    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 13 16:40:03.476528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.980412    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 13 16:40:03.476528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.980420    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 13 16:40:03.476528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.981855    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 13 16:40:03.476528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.981864    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 13 16:40:03.476528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.985374    2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-51.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 13 16:40:03.476528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.985404    2573 server.go:1268] "Started kubelet"
Jul 13 16:40:03.476528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.985453    2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 13 16:40:03.476528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.985638    2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 13 16:40:03.476528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.985688    2573 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 13 16:40:03.476528 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:02.986032    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-51.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 13 16:40:03.476528 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:02.986033    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 13 16:40:03.476528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.987700    2573 server.go:310] "Adding debug handlers to kubelet server"
Jul 13 16:40:03.476528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.991575    2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 13 16:40:03.476528 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.991921    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b72sr"
Jul 13 16:40:03.477653 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:02.992531    2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 13 16:40:03.477653 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.995838    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b72sr"
Jul 13 16:40:03.477653 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.997645    2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 13 16:40:03.477653 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.997661    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 13 16:40:03.477653 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:02.997734    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-51.ec2.internal\" not found"
Jul 13 16:40:03.477653 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:02.997203    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-51.ec2.internal.18c1e6e60329e256  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-51.ec2.internal,UID:ip-10-0-143-51.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-51.ec2.internal,},FirstTimestamp:2026-07-13 16:40:02.985370198 +0000 UTC m=+0.343677015,LastTimestamp:2026-07-13 16:40:02.985370198 +0000 UTC m=+0.343677015,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-51.ec2.internal,}"
Jul 13 16:40:03.477653 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.998385    2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 13 16:40:03.477653 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.998400    2573 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 13 16:40:03.477653 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.998414    2573 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 13 16:40:03.477653 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.998511    2573 reconstruct.go:97] "Volume reconstruction finished"
Jul 13 16:40:03.477653 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.998521    2573 reconciler.go:29] "Reconciler: start to sync state"
Jul 13 16:40:03.477653 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.998538    2573 factory.go:55] Registering systemd factory
Jul 13 16:40:03.477653 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.998554    2573 factory.go:223] Registration of the systemd container factory successfully
Jul 13 16:40:03.477653 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.998749    2573 factory.go:153] Registering CRI-O factory
Jul 13 16:40:03.477653 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.998758    2573 factory.go:223] Registration of the crio container factory successfully
Jul 13 16:40:03.477653 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.998803    2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 13 16:40:03.477653 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.998826    2573 factory.go:103] Registering Raw factory
Jul 13 16:40:03.477653 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.998839    2573 manager.go:1196] Started watching for new ooms in manager
Jul 13 16:40:03.477653 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:02.999241    2573 manager.go:349] Starting recovery of all containers
Jul 13 16:40:03.477653 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:03.002886    2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-51.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 13 16:40:03.477653 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:03.003005    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 13 16:40:03.477653 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.006085    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 13 16:40:03.477653 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.012821    2573 manager.go:354] Recovery completed
Jul 13 16:40:03.477653 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.017137    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 16:40:03.477653 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.018992    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-51.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 16:40:03.477653 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.019024    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-51.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 16:40:03.477653 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.019042    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-51.ec2.internal" event="NodeHasSufficientPID"
Jul 13 16:40:03.477653 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.020083    2573 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 13 16:40:03.477653 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.020094    2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 13 16:40:03.477653 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.020113    2573 state_mem.go:36] "Initialized new in-memory state store"
Jul 13 16:40:03.477653 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.020143    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 16:40:03.477653 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.021221    2573 policy_none.go:49] "None policy: Start"
Jul 13 16:40:03.477653 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.021235    2573 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 13 16:40:03.477653 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.021248    2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 13 16:40:03.478900 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.021487    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-51.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 16:40:03.478900 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.021522    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-51.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 16:40:03.478900 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.021547    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-51.ec2.internal" event="NodeHasSufficientPID"
Jul 13 16:40:03.478900 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.028249    2573 policy_none.go:47] "Start"
Jul 13 16:40:03.478900 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.067454    2573 manager.go:337] "Starting Device Plugin manager"
Jul 13 16:40:03.478900 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:03.067699    2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 13 16:40:03.478900 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.067711    2573 server.go:87] "Starting device plugin registration server"
Jul 13 16:40:03.478900 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.068005    2573 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 13 16:40:03.478900 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.068017    2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 13 16:40:03.478900 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.068381    2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 13 16:40:03.478900 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.068447    2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 13 16:40:03.478900 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.068455    2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 13 16:40:03.478900 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:03.069061    2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 13 16:40:03.478900 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:03.069113    2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-51.ec2.internal\" not found"
Jul 13 16:40:03.478900 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.140681    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 13 16:40:03.478900 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.140748    2573 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 13 16:40:03.478900 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.140793    2573 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 13 16:40:03.478900 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:03.140830    2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 13 16:40:03.478900 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.143526    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 16:40:03.478900 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.168776    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 16:40:03.478900 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.169649    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-51.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 16:40:03.478900 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.169678    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-51.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 16:40:03.478900 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.169688    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-51.ec2.internal" event="NodeHasSufficientPID"
Jul 13 16:40:03.478900 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.169712    2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-51.ec2.internal"
Jul 13 16:40:03.478900 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.178811    2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-51.ec2.internal"
Jul 13 16:40:03.478900 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:03.178830    2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-51.ec2.internal\": node \"ip-10-0-143-51.ec2.internal\" not found"
Jul 13 16:40:03.478900 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:03.198946    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-51.ec2.internal\" not found"
Jul 13 16:40:03.478900 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.241950    2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-51.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-51.ec2.internal"]
Jul 13 16:40:03.478900 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.242039    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 16:40:03.478900 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.243056    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-51.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 16:40:03.478900 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.243093    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-51.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 16:40:03.478900 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.243107    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-51.ec2.internal" event="NodeHasSufficientPID"
Jul 13 16:40:03.478900 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.244928    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 16:40:03.478900 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.245039    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-51.ec2.internal"
Jul 13 16:40:03.478900 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.245082    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 16:40:03.478900 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.245694    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-51.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 16:40:03.478900 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.245733    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-51.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 16:40:03.479914 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.245698    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-51.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 16:40:03.479914 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.245748    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-51.ec2.internal" event="NodeHasSufficientPID"
Jul 13 16:40:03.479914 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.245758    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-51.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 16:40:03.479914 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.245769    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-51.ec2.internal" event="NodeHasSufficientPID"
Jul 13 16:40:03.479914 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.247111    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-51.ec2.internal"
Jul 13 16:40:03.479914 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.247134    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 16:40:03.479914 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.247820    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-51.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 16:40:03.479914 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.247848    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-51.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 16:40:03.479914 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.247862    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-51.ec2.internal" event="NodeHasSufficientPID"
Jul 13 16:40:03.479914 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:03.286683    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-51.ec2.internal\" not found" node="ip-10-0-143-51.ec2.internal"
Jul 13 16:40:03.479914 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:03.291317    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-51.ec2.internal\" not found" node="ip-10-0-143-51.ec2.internal"
Jul 13 16:40:03.479914 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:03.299238    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-51.ec2.internal\" not found"
Jul 13 16:40:03.479914 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.300388    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a7643480c8e2c0cb0879d052b686dab7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-51.ec2.internal\" (UID: \"a7643480c8e2c0cb0879d052b686dab7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-51.ec2.internal"
Jul 13 16:40:03.479914 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.300411    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7643480c8e2c0cb0879d052b686dab7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-51.ec2.internal\" (UID: \"a7643480c8e2c0cb0879d052b686dab7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-51.ec2.internal"
Jul 13 16:40:03.479914 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.300429    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/058d270930df0d9f694c82e607f9f3bc-config\") pod \"kube-apiserver-proxy-ip-10-0-143-51.ec2.internal\" (UID: \"058d270930df0d9f694c82e607f9f3bc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-51.ec2.internal"
Jul 13 16:40:03.479914 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:03.400791    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-51.ec2.internal\" not found"
Jul 13 16:40:03.479914 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.400843    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a7643480c8e2c0cb0879d052b686dab7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-51.ec2.internal\" (UID: \"a7643480c8e2c0cb0879d052b686dab7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-51.ec2.internal"
Jul 13 16:40:03.479914 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.400868    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7643480c8e2c0cb0879d052b686dab7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-51.ec2.internal\" (UID: \"a7643480c8e2c0cb0879d052b686dab7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-51.ec2.internal"
Jul 13 16:40:03.479914 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.400891    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/058d270930df0d9f694c82e607f9f3bc-config\") pod \"kube-apiserver-proxy-ip-10-0-143-51.ec2.internal\" (UID: \"058d270930df0d9f694c82e607f9f3bc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-51.ec2.internal"
Jul 13 16:40:03.479914 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.400923    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7643480c8e2c0cb0879d052b686dab7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-51.ec2.internal\" (UID: \"a7643480c8e2c0cb0879d052b686dab7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-51.ec2.internal"
Jul 13 16:40:03.577199 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.400929    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/058d270930df0d9f694c82e607f9f3bc-config\") pod \"kube-apiserver-proxy-ip-10-0-143-51.ec2.internal\" (UID: \"058d270930df0d9f694c82e607f9f3bc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-51.ec2.internal"
Jul 13 16:40:03.577199 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.400927    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a7643480c8e2c0cb0879d052b686dab7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-51.ec2.internal\" (UID: \"a7643480c8e2c0cb0879d052b686dab7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-51.ec2.internal"
Jul 13 16:40:03.577199 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:03.501554    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-51.ec2.internal\" not found"
Jul 13 16:40:03.686059 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.595815    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-51.ec2.internal"
Jul 13 16:40:03.686059 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:03.602229    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-51.ec2.internal\" not found"
Jul 13 16:40:03.788509 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:03.702563    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-51.ec2.internal\" not found"
Jul 13 16:40:03.802912 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:03.802883    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-51.ec2.internal\" not found"
Jul 13 16:40:03.882331 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.882307    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-51.ec2.internal"
Jul 13 16:40:03.903827 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:03.903798    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-51.ec2.internal\" not found"
Jul 13 16:40:03.927923 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.927891    2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 13 16:40:03.928060 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.928043    2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 13 16:40:03.999598 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:03.999576    2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 16:40:04.002091 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:04.002061    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-12 16:35:02 +0000 UTC" deadline="2028-04-24 23:09:57.526804044 +0000 UTC"
Jul 13 16:40:04.002150 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:04.002093    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15630h29m53.524714915s"
Jul 13 16:40:04.004219 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:04.004206    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-51.ec2.internal\" not found"
Jul 13 16:40:04.104464 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:04.104384    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-51.ec2.internal\" not found"
Jul 13 16:40:04.198043 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:04.198015    2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 16:40:04.205478 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:04.205457    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-51.ec2.internal\" not found"
Jul 13 16:40:04.305977 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:04.305942    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-51.ec2.internal\" not found"
Jul 13 16:40:04.372950 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:04.372899    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod058d270930df0d9f694c82e607f9f3bc.slice/crio-5804cbcd8695a6d8a69cbcbbf469154d177de2b48f9f3671e480b574ab59a590 WatchSource:0}: Error finding container 5804cbcd8695a6d8a69cbcbbf469154d177de2b48f9f3671e480b574ab59a590: Status 404 returned error can't find the container with id 5804cbcd8695a6d8a69cbcbbf469154d177de2b48f9f3671e480b574ab59a590
Jul 13 16:40:04.373133 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:04.373113    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7643480c8e2c0cb0879d052b686dab7.slice/crio-cf6445393a72f0cea68235802613007d0a1fc2e22440baa105c46ef0002efde4 WatchSource:0}: Error finding container cf6445393a72f0cea68235802613007d0a1fc2e22440baa105c46ef0002efde4: Status 404 returned error can't find the container with id cf6445393a72f0cea68235802613007d0a1fc2e22440baa105c46ef0002efde4
Jul 13 16:40:04.377946 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:04.377930    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 16:40:04.406385 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:04.406363    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-51.ec2.internal\" not found"
Jul 13 16:40:04.499694 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:04.499665    2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 16:40:04.598121 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:04.598084    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-51.ec2.internal"
Jul 13 16:40:04.610631 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:04.610606    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 13 16:40:04.611757 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:04.611745    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-51.ec2.internal"
Jul 13 16:40:04.631612 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:04.631561    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 13 16:40:04.976010 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:04.975924    2573 apiserver.go:52] "Watching apiserver"
Jul 13 16:40:04.985870 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:04.985842    2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 13 16:40:04.986229 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:04.986206    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-gfcfp","openshift-network-operator/iptables-alerter-zfg7r","openshift-ovn-kubernetes/ovnkube-node-tnxdg","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djz8z","openshift-cluster-node-tuning-operator/tuned-fcmkh","openshift-dns/node-resolver-q72ql","openshift-image-registry/node-ca-hcgx8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-51.ec2.internal","openshift-network-diagnostics/network-check-target-5xx8s","kube-system/global-pull-secret-syncer-mhds4","kube-system/konnectivity-agent-6nkfx","kube-system/kube-apiserver-proxy-ip-10-0-143-51.ec2.internal","openshift-multus/multus-6bz7r","openshift-multus/multus-additional-cni-plugins-sfcgf"]
Jul 13 16:40:04.989982 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:04.989959    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hcgx8"
Jul 13 16:40:04.991926 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:04.991906    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:04.992776 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:04.992759    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 13 16:40:04.992776 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:04.992765    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pfxhh\""
Jul 13 16:40:04.992902 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:04.992778    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 13 16:40:04.992902 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:04.992765    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 13 16:40:04.994156 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:04.994138    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:04.994504 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:04.994352    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 13 16:40:04.994504 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:04.994368    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 13 16:40:04.994611 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:04.994506    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 13 16:40:04.994659 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:04.994615    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9rw5l\""
Jul 13 16:40:04.994746 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:04.994716    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 13 16:40:04.996333 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:04.996316    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djz8z"
Jul 13 16:40:04.996695 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:04.996678    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 13 16:40:04.996945 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:04.996927    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 13 16:40:04.997042 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:04.997008    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 13 16:40:04.997117 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:04.997106    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 13 16:40:04.997177 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:04.997165    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 13 16:40:04.998082 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:04.997957    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 13 16:40:04.998082 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:04.998054    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mr84s\""
Jul 13 16:40:04.998082 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:04.998065    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 13 16:40:04.998580 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:04.998549    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 13 16:40:04.998669 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:04.998642    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fcmkh"
Jul 13 16:40:04.998993 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:04.998968    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 13 16:40:04.999085 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:04.999002    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5qcxg\""
Jul 13 16:40:04.999085 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:04.999017    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 13 16:40:05.000919 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.000901    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q72ql"
Jul 13 16:40:05.001010 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.000944    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 13 16:40:05.001066 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.001037    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 13 16:40:05.001121 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.001084    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-trf2l\""
Jul 13 16:40:05.003117 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.003101    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5xx8s"
Jul 13 16:40:05.003186 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:05.003168    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5xx8s" podUID="eb203ef3-2445-43bb-a0aa-e5476ac8d12e"
Jul 13 16:40:05.003789 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.003770    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 13 16:40:05.003887 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.003831    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 13 16:40:05.003958 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.003919    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qgh8c\""
Jul 13 16:40:05.005266 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.005250    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gfcfp"
Jul 13 16:40:05.005354 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:05.005301    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gfcfp" podUID="76ecb854-ac06-45b1-b386-ea01c15fb5e2"
Jul 13 16:40:05.007457 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.007439    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zfg7r"
Jul 13 16:40:05.009689 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.009663    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhds4"
Jul 13 16:40:05.009784 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:05.009742    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhds4" podUID="d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf"
Jul 13 16:40:05.010089 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.010064    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 13 16:40:05.010089 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.010086    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 13 16:40:05.010190 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.010080    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fl5bb\""
Jul 13 16:40:05.010346 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.010334    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 13 16:40:05.011865 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.011852    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6nkfx"
Jul 13 16:40:05.012219 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.012200    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 13 16:40:05.014197 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.014180    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sfcgf"
Jul 13 16:40:05.015445 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.015071    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 13 16:40:05.015445 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.015175    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-p5hp7\""
Jul 13 16:40:05.016510 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.016061    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 13 16:40:05.017325 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.017306    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 13 16:40:05.017579 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.017558    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 13 16:40:05.017662 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.017626    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9zdps\""
Jul 13 16:40:05.038950 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.038931    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-65svb"
Jul 13 16:40:05.045687 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.045670    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-65svb"
Jul 13 16:40:05.088069 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.088035    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/45267697-f81d-45c0-98c5-0caf91de14ed-system-cni-dir\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.088249 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.088079    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e1fb6130-2ab7-40f5-831c-ea95ff241f37-host-run-netns\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.088249 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.088111    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1fb6130-2ab7-40f5-831c-ea95ff241f37-etc-openvswitch\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.088249 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.088136    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d863890b-a985-41a6-89ae-2bc3cc732840-etc-sysconfig\") pod \"tuned-fcmkh\" (UID: \"d863890b-a985-41a6-89ae-2bc3cc732840\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmkh"
Jul 13 16:40:05.088249 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.088159    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/45267697-f81d-45c0-98c5-0caf91de14ed-cni-binary-copy\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.088249 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.088181    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e1fb6130-2ab7-40f5-831c-ea95ff241f37-node-log\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.088249 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.088210    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e1fb6130-2ab7-40f5-831c-ea95ff241f37-ovnkube-config\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.088546 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.088250    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d863890b-a985-41a6-89ae-2bc3cc732840-etc-sysctl-conf\") pod \"tuned-fcmkh\" (UID: \"d863890b-a985-41a6-89ae-2bc3cc732840\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmkh"
Jul 13 16:40:05.088546 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.088312    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/45267697-f81d-45c0-98c5-0caf91de14ed-cnibin\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.088546 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.088331    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e1fb6130-2ab7-40f5-831c-ea95ff241f37-ovnkube-script-lib\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.088546 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.088347    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d863890b-a985-41a6-89ae-2bc3cc732840-etc-sysctl-d\") pod \"tuned-fcmkh\" (UID: \"d863890b-a985-41a6-89ae-2bc3cc732840\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmkh"
Jul 13 16:40:05.088546 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.088366    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/45267697-f81d-45c0-98c5-0caf91de14ed-multus-daemon-config\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.088546 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.088386    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d863890b-a985-41a6-89ae-2bc3cc732840-sys\") pod \"tuned-fcmkh\" (UID: \"d863890b-a985-41a6-89ae-2bc3cc732840\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmkh"
Jul 13 16:40:05.088546 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.088424    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/45267697-f81d-45c0-98c5-0caf91de14ed-multus-cni-dir\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.088546 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.088467    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/45267697-f81d-45c0-98c5-0caf91de14ed-multus-socket-dir-parent\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.088546 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.088501    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/45267697-f81d-45c0-98c5-0caf91de14ed-host-var-lib-cni-multus\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.088546 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.088524    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e1fb6130-2ab7-40f5-831c-ea95ff241f37-log-socket\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.088964 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.088569    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d1ff3622-f6d0-46bb-afe7-f3366fa19ed7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-djz8z\" (UID: \"d1ff3622-f6d0-46bb-afe7-f3366fa19ed7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djz8z"
Jul 13 16:40:05.088964 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.088622    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d1ff3622-f6d0-46bb-afe7-f3366fa19ed7-device-dir\") pod \"aws-ebs-csi-driver-node-djz8z\" (UID: \"d1ff3622-f6d0-46bb-afe7-f3366fa19ed7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djz8z"
Jul 13 16:40:05.088964 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.088646    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d863890b-a985-41a6-89ae-2bc3cc732840-etc-systemd\") pod \"tuned-fcmkh\" (UID: \"d863890b-a985-41a6-89ae-2bc3cc732840\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmkh"
Jul 13 16:40:05.088964 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.088679    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d863890b-a985-41a6-89ae-2bc3cc732840-run\") pod \"tuned-fcmkh\" (UID: \"d863890b-a985-41a6-89ae-2bc3cc732840\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmkh"
Jul 13 16:40:05.088964 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.088702    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e1fb6130-2ab7-40f5-831c-ea95ff241f37-host-cni-netd\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.088964 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.088773    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znq5p\" (UniqueName: \"kubernetes.io/projected/e1fb6130-2ab7-40f5-831c-ea95ff241f37-kube-api-access-znq5p\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.088964 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.088817    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d1ff3622-f6d0-46bb-afe7-f3366fa19ed7-etc-selinux\") pod \"aws-ebs-csi-driver-node-djz8z\" (UID: \"d1ff3622-f6d0-46bb-afe7-f3366fa19ed7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djz8z"
Jul 13 16:40:05.088964 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.088873    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d863890b-a985-41a6-89ae-2bc3cc732840-var-lib-kubelet\") pod \"tuned-fcmkh\" (UID: \"d863890b-a985-41a6-89ae-2bc3cc732840\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmkh"
Jul 13 16:40:05.088964 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.088922    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d863890b-a985-41a6-89ae-2bc3cc732840-tmp\") pod \"tuned-fcmkh\" (UID: \"d863890b-a985-41a6-89ae-2bc3cc732840\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmkh"
Jul 13 16:40:05.088964 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.088961    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e1fb6130-2ab7-40f5-831c-ea95ff241f37-systemd-units\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.089403 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.088991    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1fb6130-2ab7-40f5-831c-ea95ff241f37-var-lib-openvswitch\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.089403 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.089017    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d863890b-a985-41a6-89ae-2bc3cc732840-etc-tuned\") pod \"tuned-fcmkh\" (UID: \"d863890b-a985-41a6-89ae-2bc3cc732840\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmkh"
Jul 13 16:40:05.089403 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.089049    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/45267697-f81d-45c0-98c5-0caf91de14ed-multus-conf-dir\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.089403 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.089086    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e1fb6130-2ab7-40f5-831c-ea95ff241f37-host-cni-bin\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.089403 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.089114    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stkqk\" (UniqueName: \"kubernetes.io/projected/d863890b-a985-41a6-89ae-2bc3cc732840-kube-api-access-stkqk\") pod \"tuned-fcmkh\" (UID: \"d863890b-a985-41a6-89ae-2bc3cc732840\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmkh"
Jul 13 16:40:05.089403 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.089140    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/45267697-f81d-45c0-98c5-0caf91de14ed-host-run-k8s-cni-cncf-io\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.089403 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.089167    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/45267697-f81d-45c0-98c5-0caf91de14ed-hostroot\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.089403 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.089189    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/45267697-f81d-45c0-98c5-0caf91de14ed-host-run-multus-certs\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.089403 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.089226    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1fb6130-2ab7-40f5-831c-ea95ff241f37-host-run-ovn-kubernetes\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.089403 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.089256    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d863890b-a985-41a6-89ae-2bc3cc732840-etc-modprobe-d\") pod \"tuned-fcmkh\" (UID: \"d863890b-a985-41a6-89ae-2bc3cc732840\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmkh"
Jul 13 16:40:05.089403 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.089299    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d863890b-a985-41a6-89ae-2bc3cc732840-etc-kubernetes\") pod \"tuned-fcmkh\" (UID: \"d863890b-a985-41a6-89ae-2bc3cc732840\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmkh"
Jul 13 16:40:05.089403 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.089322    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2f5f1928-0c10-44c3-a8fb-bcc9b13606fe-serviceca\") pod \"node-ca-hcgx8\" (UID: \"2f5f1928-0c10-44c3-a8fb-bcc9b13606fe\") " pod="openshift-image-registry/node-ca-hcgx8"
Jul 13 16:40:05.089403 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.089353    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/45267697-f81d-45c0-98c5-0caf91de14ed-os-release\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.089403 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.089381    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/45267697-f81d-45c0-98c5-0caf91de14ed-host-var-lib-kubelet\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.089982 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.089407    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrcp7\" (UniqueName: \"kubernetes.io/projected/45267697-f81d-45c0-98c5-0caf91de14ed-kube-api-access-jrcp7\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.089982 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.089428    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1fb6130-2ab7-40f5-831c-ea95ff241f37-run-openvswitch\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.089982 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.089464    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e1fb6130-2ab7-40f5-831c-ea95ff241f37-run-ovn\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.089982 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.089505    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d1ff3622-f6d0-46bb-afe7-f3366fa19ed7-registration-dir\") pod \"aws-ebs-csi-driver-node-djz8z\" (UID: \"d1ff3622-f6d0-46bb-afe7-f3366fa19ed7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djz8z"
Jul 13 16:40:05.089982 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.089522    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d863890b-a985-41a6-89ae-2bc3cc732840-host\") pod \"tuned-fcmkh\" (UID: \"d863890b-a985-41a6-89ae-2bc3cc732840\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmkh"
Jul 13 16:40:05.089982 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.089539    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/45267697-f81d-45c0-98c5-0caf91de14ed-host-var-lib-cni-bin\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.089982 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.089557    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1fb6130-2ab7-40f5-831c-ea95ff241f37-host-kubelet\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.089982 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.089578    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e1fb6130-2ab7-40f5-831c-ea95ff241f37-host-slash\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.089982 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.089602    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e1fb6130-2ab7-40f5-831c-ea95ff241f37-ovn-node-metrics-cert\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.089982 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.089634    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/45267697-f81d-45c0-98c5-0caf91de14ed-host-run-netns\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.089982 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.089671    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d863890b-a985-41a6-89ae-2bc3cc732840-lib-modules\") pod \"tuned-fcmkh\" (UID: \"d863890b-a985-41a6-89ae-2bc3cc732840\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmkh"
Jul 13 16:40:05.089982 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.089696    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45267697-f81d-45c0-98c5-0caf91de14ed-etc-kubernetes\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.089982 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.089735    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1fb6130-2ab7-40f5-831c-ea95ff241f37-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.089982 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.089773    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2f5f1928-0c10-44c3-a8fb-bcc9b13606fe-host\") pod \"node-ca-hcgx8\" (UID: \"2f5f1928-0c10-44c3-a8fb-bcc9b13606fe\") " pod="openshift-image-registry/node-ca-hcgx8"
Jul 13 16:40:05.090622 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.089794    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e1fb6130-2ab7-40f5-831c-ea95ff241f37-run-systemd\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.090622 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.089812    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e1fb6130-2ab7-40f5-831c-ea95ff241f37-env-overrides\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.090622 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.089843    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d1ff3622-f6d0-46bb-afe7-f3366fa19ed7-socket-dir\") pod \"aws-ebs-csi-driver-node-djz8z\" (UID: \"d1ff3622-f6d0-46bb-afe7-f3366fa19ed7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djz8z"
Jul 13 16:40:05.090622 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.089880    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d1ff3622-f6d0-46bb-afe7-f3366fa19ed7-sys-fs\") pod \"aws-ebs-csi-driver-node-djz8z\" (UID: \"d1ff3622-f6d0-46bb-afe7-f3366fa19ed7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djz8z"
Jul 13 16:40:05.090622 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.089918    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79sgr\" (UniqueName: \"kubernetes.io/projected/d1ff3622-f6d0-46bb-afe7-f3366fa19ed7-kube-api-access-79sgr\") pod \"aws-ebs-csi-driver-node-djz8z\" (UID: \"d1ff3622-f6d0-46bb-afe7-f3366fa19ed7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djz8z"
Jul 13 16:40:05.090622 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.089954    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hts4\" (UniqueName: \"kubernetes.io/projected/2f5f1928-0c10-44c3-a8fb-bcc9b13606fe-kube-api-access-9hts4\") pod \"node-ca-hcgx8\" (UID: \"2f5f1928-0c10-44c3-a8fb-bcc9b13606fe\") " pod="openshift-image-registry/node-ca-hcgx8"
Jul 13 16:40:05.099261 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.099240    2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 13 16:40:05.145411 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.145353    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-51.ec2.internal" event={"ID":"a7643480c8e2c0cb0879d052b686dab7","Type":"ContainerStarted","Data":"cf6445393a72f0cea68235802613007d0a1fc2e22440baa105c46ef0002efde4"}
Jul 13 16:40:05.146585 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.146560    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-51.ec2.internal" event={"ID":"058d270930df0d9f694c82e607f9f3bc","Type":"ContainerStarted","Data":"5804cbcd8695a6d8a69cbcbbf469154d177de2b48f9f3671e480b574ab59a590"}
Jul 13 16:40:05.190456 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.190420    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1fb6130-2ab7-40f5-831c-ea95ff241f37-run-openvswitch\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.190456 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.190457    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e1fb6130-2ab7-40f5-831c-ea95ff241f37-run-ovn\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.190658 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.190482    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d1ff3622-f6d0-46bb-afe7-f3366fa19ed7-registration-dir\") pod \"aws-ebs-csi-driver-node-djz8z\" (UID: \"d1ff3622-f6d0-46bb-afe7-f3366fa19ed7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djz8z"
Jul 13 16:40:05.190658 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.190548    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d1ff3622-f6d0-46bb-afe7-f3366fa19ed7-registration-dir\") pod \"aws-ebs-csi-driver-node-djz8z\" (UID: \"d1ff3622-f6d0-46bb-afe7-f3366fa19ed7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djz8z"
Jul 13 16:40:05.190658 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.190558    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1fb6130-2ab7-40f5-831c-ea95ff241f37-run-openvswitch\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.190658 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.190599    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e1fb6130-2ab7-40f5-831c-ea95ff241f37-run-ovn\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.190658 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.190613    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d863890b-a985-41a6-89ae-2bc3cc732840-host\") pod \"tuned-fcmkh\" (UID: \"d863890b-a985-41a6-89ae-2bc3cc732840\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmkh"
Jul 13 16:40:05.190658 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.190642    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/45267697-f81d-45c0-98c5-0caf91de14ed-host-var-lib-cni-bin\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.190967 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.190673    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1fb6130-2ab7-40f5-831c-ea95ff241f37-host-kubelet\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.190967 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.190699    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e1fb6130-2ab7-40f5-831c-ea95ff241f37-host-slash\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.190967 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.190738    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e1fb6130-2ab7-40f5-831c-ea95ff241f37-ovn-node-metrics-cert\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.190967 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.190747    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d863890b-a985-41a6-89ae-2bc3cc732840-host\") pod \"tuned-fcmkh\" (UID: \"d863890b-a985-41a6-89ae-2bc3cc732840\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmkh"
Jul 13 16:40:05.190967 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.190765    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf-dbus\") pod \"global-pull-secret-syncer-mhds4\" (UID: \"d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf\") " pod="kube-system/global-pull-secret-syncer-mhds4"
Jul 13 16:40:05.190967 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.190790    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0209e3f3-bff2-4755-9766-4f0455e937e4-cni-binary-copy\") pod \"multus-additional-cni-plugins-sfcgf\" (UID: \"0209e3f3-bff2-4755-9766-4f0455e937e4\") " pod="openshift-multus/multus-additional-cni-plugins-sfcgf"
Jul 13 16:40:05.190967 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.190798    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1fb6130-2ab7-40f5-831c-ea95ff241f37-host-kubelet\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.190967 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.190814    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/45267697-f81d-45c0-98c5-0caf91de14ed-host-run-netns\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.190967 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.190837    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d863890b-a985-41a6-89ae-2bc3cc732840-lib-modules\") pod \"tuned-fcmkh\" (UID: \"d863890b-a985-41a6-89ae-2bc3cc732840\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmkh"
Jul 13 16:40:05.190967 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.190839    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/45267697-f81d-45c0-98c5-0caf91de14ed-host-var-lib-cni-bin\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.190967 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.190860    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45267697-f81d-45c0-98c5-0caf91de14ed-etc-kubernetes\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.190967 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.190898    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e1fb6130-2ab7-40f5-831c-ea95ff241f37-host-slash\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.190967 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.190909    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45267697-f81d-45c0-98c5-0caf91de14ed-etc-kubernetes\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.190967 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.190925    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1fb6130-2ab7-40f5-831c-ea95ff241f37-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.190967 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.190957    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b22f51b8-4e55-461c-ab1c-1ea6fece1733-host-slash\") pod \"iptables-alerter-zfg7r\" (UID: \"b22f51b8-4e55-461c-ab1c-1ea6fece1733\") " pod="openshift-network-operator/iptables-alerter-zfg7r"
Jul 13 16:40:05.191624 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.190982    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0209e3f3-bff2-4755-9766-4f0455e937e4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sfcgf\" (UID: \"0209e3f3-bff2-4755-9766-4f0455e937e4\") " pod="openshift-multus/multus-additional-cni-plugins-sfcgf"
Jul 13 16:40:05.191624 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.191021    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a530403-3ff8-4783-a8b2-6ff27c771aff-tmp-dir\") pod \"node-resolver-q72ql\" (UID: \"1a530403-3ff8-4783-a8b2-6ff27c771aff\") " pod="openshift-dns/node-resolver-q72ql"
Jul 13 16:40:05.191624 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.191043    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8261c78d-17e9-4ff0-a118-395dedbc2838-konnectivity-ca\") pod \"konnectivity-agent-6nkfx\" (UID: \"8261c78d-17e9-4ff0-a118-395dedbc2838\") " pod="kube-system/konnectivity-agent-6nkfx"
Jul 13 16:40:05.191624 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.191068    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d863890b-a985-41a6-89ae-2bc3cc732840-lib-modules\") pod \"tuned-fcmkh\" (UID: \"d863890b-a985-41a6-89ae-2bc3cc732840\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmkh"
Jul 13 16:40:05.191624 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.191085    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76ecb854-ac06-45b1-b386-ea01c15fb5e2-metrics-certs\") pod \"network-metrics-daemon-gfcfp\" (UID: \"76ecb854-ac06-45b1-b386-ea01c15fb5e2\") " pod="openshift-multus/network-metrics-daemon-gfcfp"
Jul 13 16:40:05.191624 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.191115    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2f5f1928-0c10-44c3-a8fb-bcc9b13606fe-host\") pod \"node-ca-hcgx8\" (UID: \"2f5f1928-0c10-44c3-a8fb-bcc9b13606fe\") " pod="openshift-image-registry/node-ca-hcgx8"
Jul 13 16:40:05.191624 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.191155    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2f5f1928-0c10-44c3-a8fb-bcc9b13606fe-host\") pod \"node-ca-hcgx8\" (UID: \"2f5f1928-0c10-44c3-a8fb-bcc9b13606fe\") " pod="openshift-image-registry/node-ca-hcgx8"
Jul 13 16:40:05.191624 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.191208    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1fb6130-2ab7-40f5-831c-ea95ff241f37-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.191624 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.191212    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e1fb6130-2ab7-40f5-831c-ea95ff241f37-run-systemd\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.191624 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.191238    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e1fb6130-2ab7-40f5-831c-ea95ff241f37-env-overrides\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.191624 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.191248    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/45267697-f81d-45c0-98c5-0caf91de14ed-host-run-netns\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.191624 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.191285    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxs9w\" (UniqueName: \"kubernetes.io/projected/eb203ef3-2445-43bb-a0aa-e5476ac8d12e-kube-api-access-jxs9w\") pod \"network-check-target-5xx8s\" (UID: \"eb203ef3-2445-43bb-a0aa-e5476ac8d12e\") " pod="openshift-network-diagnostics/network-check-target-5xx8s"
Jul 13 16:40:05.191624 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.191313    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d1ff3622-f6d0-46bb-afe7-f3366fa19ed7-socket-dir\") pod \"aws-ebs-csi-driver-node-djz8z\" (UID: \"d1ff3622-f6d0-46bb-afe7-f3366fa19ed7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djz8z"
Jul 13 16:40:05.191624 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.191348    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e1fb6130-2ab7-40f5-831c-ea95ff241f37-run-systemd\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.192280 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.191387    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d1ff3622-f6d0-46bb-afe7-f3366fa19ed7-sys-fs\") pod \"aws-ebs-csi-driver-node-djz8z\" (UID: \"d1ff3622-f6d0-46bb-afe7-f3366fa19ed7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djz8z"
Jul 13 16:40:05.192280 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.191427    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79sgr\" (UniqueName: \"kubernetes.io/projected/d1ff3622-f6d0-46bb-afe7-f3366fa19ed7-kube-api-access-79sgr\") pod \"aws-ebs-csi-driver-node-djz8z\" (UID: \"d1ff3622-f6d0-46bb-afe7-f3366fa19ed7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djz8z"
Jul 13 16:40:05.192280 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.191454    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d1ff3622-f6d0-46bb-afe7-f3366fa19ed7-sys-fs\") pod \"aws-ebs-csi-driver-node-djz8z\" (UID: \"d1ff3622-f6d0-46bb-afe7-f3366fa19ed7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djz8z"
Jul 13 16:40:05.192280 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.191449    2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 13 16:40:05.192280 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.191498    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hts4\" (UniqueName: \"kubernetes.io/projected/2f5f1928-0c10-44c3-a8fb-bcc9b13606fe-kube-api-access-9hts4\") pod \"node-ca-hcgx8\" (UID: \"2f5f1928-0c10-44c3-a8fb-bcc9b13606fe\") " pod="openshift-image-registry/node-ca-hcgx8"
Jul 13 16:40:05.192280 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.191531    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b22f51b8-4e55-461c-ab1c-1ea6fece1733-iptables-alerter-script\") pod \"iptables-alerter-zfg7r\" (UID: \"b22f51b8-4e55-461c-ab1c-1ea6fece1733\") " pod="openshift-network-operator/iptables-alerter-zfg7r"
Jul 13 16:40:05.192280 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.191567    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0209e3f3-bff2-4755-9766-4f0455e937e4-os-release\") pod \"multus-additional-cni-plugins-sfcgf\" (UID: \"0209e3f3-bff2-4755-9766-4f0455e937e4\") " pod="openshift-multus/multus-additional-cni-plugins-sfcgf"
Jul 13 16:40:05.192280 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.191552    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d1ff3622-f6d0-46bb-afe7-f3366fa19ed7-socket-dir\") pod \"aws-ebs-csi-driver-node-djz8z\" (UID: \"d1ff3622-f6d0-46bb-afe7-f3366fa19ed7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djz8z"
Jul 13 16:40:05.192280 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.191594    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/45267697-f81d-45c0-98c5-0caf91de14ed-system-cni-dir\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.192280 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.191618    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e1fb6130-2ab7-40f5-831c-ea95ff241f37-host-run-netns\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.192280 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.191657    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1fb6130-2ab7-40f5-831c-ea95ff241f37-etc-openvswitch\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.192280 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.191688    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf-original-pull-secret\") pod \"global-pull-secret-syncer-mhds4\" (UID: \"d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf\") " pod="kube-system/global-pull-secret-syncer-mhds4"
Jul 13 16:40:05.192280 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.191713    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8261c78d-17e9-4ff0-a118-395dedbc2838-agent-certs\") pod \"konnectivity-agent-6nkfx\" (UID: \"8261c78d-17e9-4ff0-a118-395dedbc2838\") " pod="kube-system/konnectivity-agent-6nkfx"
Jul 13 16:40:05.192280 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.191754    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btp5z\" (UniqueName: \"kubernetes.io/projected/76ecb854-ac06-45b1-b386-ea01c15fb5e2-kube-api-access-btp5z\") pod \"network-metrics-daemon-gfcfp\" (UID: \"76ecb854-ac06-45b1-b386-ea01c15fb5e2\") " pod="openshift-multus/network-metrics-daemon-gfcfp"
Jul 13 16:40:05.192945 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.191795    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d863890b-a985-41a6-89ae-2bc3cc732840-etc-sysconfig\") pod \"tuned-fcmkh\" (UID: \"d863890b-a985-41a6-89ae-2bc3cc732840\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmkh"
Jul 13 16:40:05.192945 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.191828    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/45267697-f81d-45c0-98c5-0caf91de14ed-cni-binary-copy\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.192945 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.191842    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e1fb6130-2ab7-40f5-831c-ea95ff241f37-host-run-netns\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.192945 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.191852    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/45267697-f81d-45c0-98c5-0caf91de14ed-system-cni-dir\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.192945 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.191852    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e1fb6130-2ab7-40f5-831c-ea95ff241f37-node-log\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.192945 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.191886    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e1fb6130-2ab7-40f5-831c-ea95ff241f37-env-overrides\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.192945 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.191895    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d863890b-a985-41a6-89ae-2bc3cc732840-etc-sysconfig\") pod \"tuned-fcmkh\" (UID: \"d863890b-a985-41a6-89ae-2bc3cc732840\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmkh"
Jul 13 16:40:05.192945 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.191893    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e1fb6130-2ab7-40f5-831c-ea95ff241f37-ovnkube-config\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.192945 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.191932    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d863890b-a985-41a6-89ae-2bc3cc732840-etc-sysctl-conf\") pod \"tuned-fcmkh\" (UID: \"d863890b-a985-41a6-89ae-2bc3cc732840\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmkh"
Jul 13 16:40:05.192945 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.191935    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1fb6130-2ab7-40f5-831c-ea95ff241f37-etc-openvswitch\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.192945 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.191958    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/45267697-f81d-45c0-98c5-0caf91de14ed-cnibin\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.192945 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.191985    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e1fb6130-2ab7-40f5-831c-ea95ff241f37-ovnkube-script-lib\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.192945 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.191987    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e1fb6130-2ab7-40f5-831c-ea95ff241f37-node-log\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.192945 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.192013    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0209e3f3-bff2-4755-9766-4f0455e937e4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sfcgf\" (UID: \"0209e3f3-bff2-4755-9766-4f0455e937e4\") " pod="openshift-multus/multus-additional-cni-plugins-sfcgf"
Jul 13 16:40:05.192945 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.192058    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d863890b-a985-41a6-89ae-2bc3cc732840-etc-sysctl-conf\") pod \"tuned-fcmkh\" (UID: \"d863890b-a985-41a6-89ae-2bc3cc732840\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmkh"
Jul 13 16:40:05.193749 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.192066    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/45267697-f81d-45c0-98c5-0caf91de14ed-cnibin\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.193749 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.192095    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d863890b-a985-41a6-89ae-2bc3cc732840-etc-sysctl-d\") pod \"tuned-fcmkh\" (UID: \"d863890b-a985-41a6-89ae-2bc3cc732840\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmkh"
Jul 13 16:40:05.193749 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.192251    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/45267697-f81d-45c0-98c5-0caf91de14ed-multus-daemon-config\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.193749 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.192284    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d863890b-a985-41a6-89ae-2bc3cc732840-sys\") pod \"tuned-fcmkh\" (UID: \"d863890b-a985-41a6-89ae-2bc3cc732840\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmkh"
Jul 13 16:40:05.193749 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.193003    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e1fb6130-2ab7-40f5-831c-ea95ff241f37-ovnkube-script-lib\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.193749 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.193094    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d863890b-a985-41a6-89ae-2bc3cc732840-sys\") pod \"tuned-fcmkh\" (UID: \"d863890b-a985-41a6-89ae-2bc3cc732840\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmkh"
Jul 13 16:40:05.193749 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.193351    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/45267697-f81d-45c0-98c5-0caf91de14ed-cni-binary-copy\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.193749 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.193379    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e1fb6130-2ab7-40f5-831c-ea95ff241f37-ovnkube-config\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.193749 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.193422    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d863890b-a985-41a6-89ae-2bc3cc732840-etc-sysctl-d\") pod \"tuned-fcmkh\" (UID: \"d863890b-a985-41a6-89ae-2bc3cc732840\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmkh"
Jul 13 16:40:05.193749 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.193507    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/45267697-f81d-45c0-98c5-0caf91de14ed-multus-cni-dir\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.193749 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.193565    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/45267697-f81d-45c0-98c5-0caf91de14ed-multus-socket-dir-parent\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.193749 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.193583    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/45267697-f81d-45c0-98c5-0caf91de14ed-multus-daemon-config\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.193749 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.193602    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/45267697-f81d-45c0-98c5-0caf91de14ed-host-var-lib-cni-multus\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.193749 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.193655    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e1fb6130-2ab7-40f5-831c-ea95ff241f37-log-socket\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.193749 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.193692    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lscjc\" (UniqueName: \"kubernetes.io/projected/b22f51b8-4e55-461c-ab1c-1ea6fece1733-kube-api-access-lscjc\") pod \"iptables-alerter-zfg7r\" (UID: \"b22f51b8-4e55-461c-ab1c-1ea6fece1733\") " pod="openshift-network-operator/iptables-alerter-zfg7r"
Jul 13 16:40:05.194388 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.193654    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/45267697-f81d-45c0-98c5-0caf91de14ed-host-var-lib-cni-multus\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.194388 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.193780    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0209e3f3-bff2-4755-9766-4f0455e937e4-cnibin\") pod \"multus-additional-cni-plugins-sfcgf\" (UID: \"0209e3f3-bff2-4755-9766-4f0455e937e4\") " pod="openshift-multus/multus-additional-cni-plugins-sfcgf"
Jul 13 16:40:05.194388 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.193814    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/45267697-f81d-45c0-98c5-0caf91de14ed-multus-cni-dir\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.194388 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.193863    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e1fb6130-2ab7-40f5-831c-ea95ff241f37-log-socket\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.194388 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.193883    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/45267697-f81d-45c0-98c5-0caf91de14ed-multus-socket-dir-parent\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.194388 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.193815    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc28g\" (UniqueName: \"kubernetes.io/projected/1a530403-3ff8-4783-a8b2-6ff27c771aff-kube-api-access-xc28g\") pod \"node-resolver-q72ql\" (UID: \"1a530403-3ff8-4783-a8b2-6ff27c771aff\") " pod="openshift-dns/node-resolver-q72ql"
Jul 13 16:40:05.194388 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.193927    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d1ff3622-f6d0-46bb-afe7-f3366fa19ed7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-djz8z\" (UID: \"d1ff3622-f6d0-46bb-afe7-f3366fa19ed7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djz8z"
Jul 13 16:40:05.194388 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.193990    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d1ff3622-f6d0-46bb-afe7-f3366fa19ed7-device-dir\") pod \"aws-ebs-csi-driver-node-djz8z\" (UID: \"d1ff3622-f6d0-46bb-afe7-f3366fa19ed7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djz8z"
Jul 13 16:40:05.194388 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.194019    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d1ff3622-f6d0-46bb-afe7-f3366fa19ed7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-djz8z\" (UID: \"d1ff3622-f6d0-46bb-afe7-f3366fa19ed7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djz8z"
Jul 13 16:40:05.194388 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.194159    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d863890b-a985-41a6-89ae-2bc3cc732840-etc-systemd\") pod \"tuned-fcmkh\" (UID: \"d863890b-a985-41a6-89ae-2bc3cc732840\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmkh"
Jul 13 16:40:05.194388 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.194210    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d863890b-a985-41a6-89ae-2bc3cc732840-run\") pod \"tuned-fcmkh\" (UID: \"d863890b-a985-41a6-89ae-2bc3cc732840\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmkh"
Jul 13 16:40:05.194388 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.194269    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e1fb6130-2ab7-40f5-831c-ea95ff241f37-host-cni-netd\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.194388 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.194302    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znq5p\" (UniqueName: \"kubernetes.io/projected/e1fb6130-2ab7-40f5-831c-ea95ff241f37-kube-api-access-znq5p\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.194388 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.194333    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0209e3f3-bff2-4755-9766-4f0455e937e4-system-cni-dir\") pod \"multus-additional-cni-plugins-sfcgf\" (UID: \"0209e3f3-bff2-4755-9766-4f0455e937e4\") " pod="openshift-multus/multus-additional-cni-plugins-sfcgf"
Jul 13 16:40:05.195045 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.194385    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d863890b-a985-41a6-89ae-2bc3cc732840-run\") pod \"tuned-fcmkh\" (UID: \"d863890b-a985-41a6-89ae-2bc3cc732840\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmkh"
Jul 13 16:40:05.195045 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.194429    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d1ff3622-f6d0-46bb-afe7-f3366fa19ed7-device-dir\") pod \"aws-ebs-csi-driver-node-djz8z\" (UID: \"d1ff3622-f6d0-46bb-afe7-f3366fa19ed7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djz8z"
Jul 13 16:40:05.195045 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.194468    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d863890b-a985-41a6-89ae-2bc3cc732840-etc-systemd\") pod \"tuned-fcmkh\" (UID: \"d863890b-a985-41a6-89ae-2bc3cc732840\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmkh"
Jul 13 16:40:05.195045 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.194514    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e1fb6130-2ab7-40f5-831c-ea95ff241f37-host-cni-netd\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.195045 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.194824    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d1ff3622-f6d0-46bb-afe7-f3366fa19ed7-etc-selinux\") pod \"aws-ebs-csi-driver-node-djz8z\" (UID: \"d1ff3622-f6d0-46bb-afe7-f3366fa19ed7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djz8z"
Jul 13 16:40:05.195045 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.194867    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d863890b-a985-41a6-89ae-2bc3cc732840-var-lib-kubelet\") pod \"tuned-fcmkh\" (UID: \"d863890b-a985-41a6-89ae-2bc3cc732840\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmkh"
Jul 13 16:40:05.195045 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.194898    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d863890b-a985-41a6-89ae-2bc3cc732840-tmp\") pod \"tuned-fcmkh\" (UID: \"d863890b-a985-41a6-89ae-2bc3cc732840\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmkh"
Jul 13 16:40:05.195045 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.194968    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wpn7\" (UniqueName: \"kubernetes.io/projected/0209e3f3-bff2-4755-9766-4f0455e937e4-kube-api-access-8wpn7\") pod \"multus-additional-cni-plugins-sfcgf\" (UID: \"0209e3f3-bff2-4755-9766-4f0455e937e4\") " pod="openshift-multus/multus-additional-cni-plugins-sfcgf"
Jul 13 16:40:05.195045 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.195003    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1a530403-3ff8-4783-a8b2-6ff27c771aff-hosts-file\") pod \"node-resolver-q72ql\" (UID: \"1a530403-3ff8-4783-a8b2-6ff27c771aff\") " pod="openshift-dns/node-resolver-q72ql"
Jul 13 16:40:05.195045 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.195034    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e1fb6130-2ab7-40f5-831c-ea95ff241f37-systemd-units\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.195489 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.195060    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1fb6130-2ab7-40f5-831c-ea95ff241f37-var-lib-openvswitch\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.195489 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.195136    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0209e3f3-bff2-4755-9766-4f0455e937e4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sfcgf\" (UID: \"0209e3f3-bff2-4755-9766-4f0455e937e4\") " pod="openshift-multus/multus-additional-cni-plugins-sfcgf"
Jul 13 16:40:05.195489 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.195163    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d863890b-a985-41a6-89ae-2bc3cc732840-etc-tuned\") pod \"tuned-fcmkh\" (UID: \"d863890b-a985-41a6-89ae-2bc3cc732840\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmkh"
Jul 13 16:40:05.195489 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.195192    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/45267697-f81d-45c0-98c5-0caf91de14ed-multus-conf-dir\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.195489 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.195229    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e1fb6130-2ab7-40f5-831c-ea95ff241f37-host-cni-bin\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.195489 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.195262    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stkqk\" (UniqueName: \"kubernetes.io/projected/d863890b-a985-41a6-89ae-2bc3cc732840-kube-api-access-stkqk\") pod \"tuned-fcmkh\" (UID: \"d863890b-a985-41a6-89ae-2bc3cc732840\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmkh"
Jul 13 16:40:05.195489 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.195287    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/45267697-f81d-45c0-98c5-0caf91de14ed-host-run-k8s-cni-cncf-io\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.195489 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.195316    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/45267697-f81d-45c0-98c5-0caf91de14ed-hostroot\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.195489 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.195432    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/45267697-f81d-45c0-98c5-0caf91de14ed-host-run-multus-certs\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.195489 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.195463    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1fb6130-2ab7-40f5-831c-ea95ff241f37-host-run-ovn-kubernetes\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.195938 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.195496    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf-kubelet-config\") pod \"global-pull-secret-syncer-mhds4\" (UID: \"d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf\") " pod="kube-system/global-pull-secret-syncer-mhds4"
Jul 13 16:40:05.195938 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.195523    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d863890b-a985-41a6-89ae-2bc3cc732840-etc-modprobe-d\") pod \"tuned-fcmkh\" (UID: \"d863890b-a985-41a6-89ae-2bc3cc732840\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmkh"
Jul 13 16:40:05.195938 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.195553    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d863890b-a985-41a6-89ae-2bc3cc732840-etc-kubernetes\") pod \"tuned-fcmkh\" (UID: \"d863890b-a985-41a6-89ae-2bc3cc732840\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmkh"
Jul 13 16:40:05.195938 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.195583    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2f5f1928-0c10-44c3-a8fb-bcc9b13606fe-serviceca\") pod \"node-ca-hcgx8\" (UID: \"2f5f1928-0c10-44c3-a8fb-bcc9b13606fe\") " pod="openshift-image-registry/node-ca-hcgx8"
Jul 13 16:40:05.195938 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.195613    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/45267697-f81d-45c0-98c5-0caf91de14ed-os-release\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.195938 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.195637    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/45267697-f81d-45c0-98c5-0caf91de14ed-host-var-lib-kubelet\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.195938 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.195666    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrcp7\" (UniqueName: \"kubernetes.io/projected/45267697-f81d-45c0-98c5-0caf91de14ed-kube-api-access-jrcp7\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.196251 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.196200    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/45267697-f81d-45c0-98c5-0caf91de14ed-hostroot\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.196298 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.196248    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1fb6130-2ab7-40f5-831c-ea95ff241f37-var-lib-openvswitch\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.196742 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.196695    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/45267697-f81d-45c0-98c5-0caf91de14ed-host-var-lib-kubelet\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.196928 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.196855    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d863890b-a985-41a6-89ae-2bc3cc732840-etc-modprobe-d\") pod \"tuned-fcmkh\" (UID: \"d863890b-a985-41a6-89ae-2bc3cc732840\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmkh"
Jul 13 16:40:05.196928 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.196866    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/45267697-f81d-45c0-98c5-0caf91de14ed-host-run-multus-certs\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.197041 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.196931    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d863890b-a985-41a6-89ae-2bc3cc732840-etc-kubernetes\") pod \"tuned-fcmkh\" (UID: \"d863890b-a985-41a6-89ae-2bc3cc732840\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmkh"
Jul 13 16:40:05.197041 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.196937    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/45267697-f81d-45c0-98c5-0caf91de14ed-host-run-k8s-cni-cncf-io\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.197041 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.196976    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e1fb6130-2ab7-40f5-831c-ea95ff241f37-systemd-units\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.197041 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.197014    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d1ff3622-f6d0-46bb-afe7-f3366fa19ed7-etc-selinux\") pod \"aws-ebs-csi-driver-node-djz8z\" (UID: \"d1ff3622-f6d0-46bb-afe7-f3366fa19ed7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djz8z"
Jul 13 16:40:05.197041 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.197038    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/45267697-f81d-45c0-98c5-0caf91de14ed-os-release\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.197250 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.197056    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1fb6130-2ab7-40f5-831c-ea95ff241f37-host-run-ovn-kubernetes\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.197250 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.197088    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e1fb6130-2ab7-40f5-831c-ea95ff241f37-host-cni-bin\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.197250 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.197094    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2f5f1928-0c10-44c3-a8fb-bcc9b13606fe-serviceca\") pod \"node-ca-hcgx8\" (UID: \"2f5f1928-0c10-44c3-a8fb-bcc9b13606fe\") " pod="openshift-image-registry/node-ca-hcgx8"
Jul 13 16:40:05.197250 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.197110    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d863890b-a985-41a6-89ae-2bc3cc732840-var-lib-kubelet\") pod \"tuned-fcmkh\" (UID: \"d863890b-a985-41a6-89ae-2bc3cc732840\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmkh"
Jul 13 16:40:05.197250 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.197131    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/45267697-f81d-45c0-98c5-0caf91de14ed-multus-conf-dir\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.197460 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.197308    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e1fb6130-2ab7-40f5-831c-ea95ff241f37-ovn-node-metrics-cert\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.199222 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.199015    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d863890b-a985-41a6-89ae-2bc3cc732840-tmp\") pod \"tuned-fcmkh\" (UID: \"d863890b-a985-41a6-89ae-2bc3cc732840\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmkh"
Jul 13 16:40:05.199222 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.199149    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d863890b-a985-41a6-89ae-2bc3cc732840-etc-tuned\") pod \"tuned-fcmkh\" (UID: \"d863890b-a985-41a6-89ae-2bc3cc732840\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmkh"
Jul 13 16:40:05.203276 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.203254    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79sgr\" (UniqueName: \"kubernetes.io/projected/d1ff3622-f6d0-46bb-afe7-f3366fa19ed7-kube-api-access-79sgr\") pod \"aws-ebs-csi-driver-node-djz8z\" (UID: \"d1ff3622-f6d0-46bb-afe7-f3366fa19ed7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djz8z"
Jul 13 16:40:05.203732 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.203703    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hts4\" (UniqueName: \"kubernetes.io/projected/2f5f1928-0c10-44c3-a8fb-bcc9b13606fe-kube-api-access-9hts4\") pod \"node-ca-hcgx8\" (UID: \"2f5f1928-0c10-44c3-a8fb-bcc9b13606fe\") " pod="openshift-image-registry/node-ca-hcgx8"
Jul 13 16:40:05.209712 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.209685    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znq5p\" (UniqueName: \"kubernetes.io/projected/e1fb6130-2ab7-40f5-831c-ea95ff241f37-kube-api-access-znq5p\") pod \"ovnkube-node-tnxdg\" (UID: \"e1fb6130-2ab7-40f5-831c-ea95ff241f37\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.210290 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.210231    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrcp7\" (UniqueName: \"kubernetes.io/projected/45267697-f81d-45c0-98c5-0caf91de14ed-kube-api-access-jrcp7\") pod \"multus-6bz7r\" (UID: \"45267697-f81d-45c0-98c5-0caf91de14ed\") " pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.210813 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.210790    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stkqk\" (UniqueName: \"kubernetes.io/projected/d863890b-a985-41a6-89ae-2bc3cc732840-kube-api-access-stkqk\") pod \"tuned-fcmkh\" (UID: \"d863890b-a985-41a6-89ae-2bc3cc732840\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmkh"
Jul 13 16:40:05.296899 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.296801    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1a530403-3ff8-4783-a8b2-6ff27c771aff-hosts-file\") pod \"node-resolver-q72ql\" (UID: \"1a530403-3ff8-4783-a8b2-6ff27c771aff\") " pod="openshift-dns/node-resolver-q72ql"
Jul 13 16:40:05.296899 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.296856    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0209e3f3-bff2-4755-9766-4f0455e937e4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sfcgf\" (UID: \"0209e3f3-bff2-4755-9766-4f0455e937e4\") " pod="openshift-multus/multus-additional-cni-plugins-sfcgf"
Jul 13 16:40:05.296899 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.296888    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf-kubelet-config\") pod \"global-pull-secret-syncer-mhds4\" (UID: \"d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf\") " pod="kube-system/global-pull-secret-syncer-mhds4"
Jul 13 16:40:05.297179 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.296911    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf-dbus\") pod \"global-pull-secret-syncer-mhds4\" (UID: \"d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf\") " pod="kube-system/global-pull-secret-syncer-mhds4"
Jul 13 16:40:05.297179 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.296927    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0209e3f3-bff2-4755-9766-4f0455e937e4-cni-binary-copy\") pod \"multus-additional-cni-plugins-sfcgf\" (UID: \"0209e3f3-bff2-4755-9766-4f0455e937e4\") " pod="openshift-multus/multus-additional-cni-plugins-sfcgf"
Jul 13 16:40:05.297179 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.296952    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b22f51b8-4e55-461c-ab1c-1ea6fece1733-host-slash\") pod \"iptables-alerter-zfg7r\" (UID: \"b22f51b8-4e55-461c-ab1c-1ea6fece1733\") " pod="openshift-network-operator/iptables-alerter-zfg7r"
Jul 13 16:40:05.297179 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.296977    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0209e3f3-bff2-4755-9766-4f0455e937e4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sfcgf\" (UID: \"0209e3f3-bff2-4755-9766-4f0455e937e4\") " pod="openshift-multus/multus-additional-cni-plugins-sfcgf"
Jul 13 16:40:05.297179 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.297003    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a530403-3ff8-4783-a8b2-6ff27c771aff-tmp-dir\") pod \"node-resolver-q72ql\" (UID: \"1a530403-3ff8-4783-a8b2-6ff27c771aff\") " pod="openshift-dns/node-resolver-q72ql"
Jul 13 16:40:05.297179 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.297026    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8261c78d-17e9-4ff0-a118-395dedbc2838-konnectivity-ca\") pod \"konnectivity-agent-6nkfx\" (UID: \"8261c78d-17e9-4ff0-a118-395dedbc2838\") " pod="kube-system/konnectivity-agent-6nkfx"
Jul 13 16:40:05.297179 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.297049    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76ecb854-ac06-45b1-b386-ea01c15fb5e2-metrics-certs\") pod \"network-metrics-daemon-gfcfp\" (UID: \"76ecb854-ac06-45b1-b386-ea01c15fb5e2\") " pod="openshift-multus/network-metrics-daemon-gfcfp"
Jul 13 16:40:05.297179 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.297077    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxs9w\" (UniqueName: \"kubernetes.io/projected/eb203ef3-2445-43bb-a0aa-e5476ac8d12e-kube-api-access-jxs9w\") pod \"network-check-target-5xx8s\" (UID: \"eb203ef3-2445-43bb-a0aa-e5476ac8d12e\") " pod="openshift-network-diagnostics/network-check-target-5xx8s"
Jul 13 16:40:05.297179 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.297107    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b22f51b8-4e55-461c-ab1c-1ea6fece1733-iptables-alerter-script\") pod \"iptables-alerter-zfg7r\" (UID: \"b22f51b8-4e55-461c-ab1c-1ea6fece1733\") " pod="openshift-network-operator/iptables-alerter-zfg7r"
Jul 13 16:40:05.297179 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.297168    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0209e3f3-bff2-4755-9766-4f0455e937e4-os-release\") pod \"multus-additional-cni-plugins-sfcgf\" (UID: \"0209e3f3-bff2-4755-9766-4f0455e937e4\") " pod="openshift-multus/multus-additional-cni-plugins-sfcgf"
Jul 13 16:40:05.297758 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.297197    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf-original-pull-secret\") pod \"global-pull-secret-syncer-mhds4\" (UID: \"d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf\") " pod="kube-system/global-pull-secret-syncer-mhds4"
Jul 13 16:40:05.297758 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.297224    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8261c78d-17e9-4ff0-a118-395dedbc2838-agent-certs\") pod \"konnectivity-agent-6nkfx\" (UID: \"8261c78d-17e9-4ff0-a118-395dedbc2838\") " pod="kube-system/konnectivity-agent-6nkfx"
Jul 13 16:40:05.297758 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.297251    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btp5z\" (UniqueName: \"kubernetes.io/projected/76ecb854-ac06-45b1-b386-ea01c15fb5e2-kube-api-access-btp5z\") pod \"network-metrics-daemon-gfcfp\" (UID: \"76ecb854-ac06-45b1-b386-ea01c15fb5e2\") " pod="openshift-multus/network-metrics-daemon-gfcfp"
Jul 13 16:40:05.297758 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.297283    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0209e3f3-bff2-4755-9766-4f0455e937e4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sfcgf\" (UID: \"0209e3f3-bff2-4755-9766-4f0455e937e4\") " pod="openshift-multus/multus-additional-cni-plugins-sfcgf"
Jul 13 16:40:05.297758 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.297309    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lscjc\" (UniqueName: \"kubernetes.io/projected/b22f51b8-4e55-461c-ab1c-1ea6fece1733-kube-api-access-lscjc\") pod \"iptables-alerter-zfg7r\" (UID: \"b22f51b8-4e55-461c-ab1c-1ea6fece1733\") " pod="openshift-network-operator/iptables-alerter-zfg7r"
Jul 13 16:40:05.297758 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.297331    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0209e3f3-bff2-4755-9766-4f0455e937e4-cnibin\") pod \"multus-additional-cni-plugins-sfcgf\" (UID: \"0209e3f3-bff2-4755-9766-4f0455e937e4\") " pod="openshift-multus/multus-additional-cni-plugins-sfcgf"
Jul 13 16:40:05.297758 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.297356    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc28g\" (UniqueName: \"kubernetes.io/projected/1a530403-3ff8-4783-a8b2-6ff27c771aff-kube-api-access-xc28g\") pod \"node-resolver-q72ql\" (UID: \"1a530403-3ff8-4783-a8b2-6ff27c771aff\") " pod="openshift-dns/node-resolver-q72ql"
Jul 13 16:40:05.297758 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.297386    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0209e3f3-bff2-4755-9766-4f0455e937e4-system-cni-dir\") pod \"multus-additional-cni-plugins-sfcgf\" (UID: \"0209e3f3-bff2-4755-9766-4f0455e937e4\") " pod="openshift-multus/multus-additional-cni-plugins-sfcgf"
Jul 13 16:40:05.297758 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.297415    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wpn7\" (UniqueName: \"kubernetes.io/projected/0209e3f3-bff2-4755-9766-4f0455e937e4-kube-api-access-8wpn7\") pod \"multus-additional-cni-plugins-sfcgf\" (UID: \"0209e3f3-bff2-4755-9766-4f0455e937e4\") " pod="openshift-multus/multus-additional-cni-plugins-sfcgf"
Jul 13 16:40:05.298220 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.297810    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1a530403-3ff8-4783-a8b2-6ff27c771aff-hosts-file\") pod \"node-resolver-q72ql\" (UID: \"1a530403-3ff8-4783-a8b2-6ff27c771aff\") " pod="openshift-dns/node-resolver-q72ql"
Jul 13 16:40:05.298339 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.298313    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0209e3f3-bff2-4755-9766-4f0455e937e4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sfcgf\" (UID: \"0209e3f3-bff2-4755-9766-4f0455e937e4\") " pod="openshift-multus/multus-additional-cni-plugins-sfcgf"
Jul 13 16:40:05.298470 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.298408    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0209e3f3-bff2-4755-9766-4f0455e937e4-os-release\") pod \"multus-additional-cni-plugins-sfcgf\" (UID: \"0209e3f3-bff2-4755-9766-4f0455e937e4\") " pod="openshift-multus/multus-additional-cni-plugins-sfcgf"
Jul 13 16:40:05.298859 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.298763    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf-dbus\") pod \"global-pull-secret-syncer-mhds4\" (UID: \"d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf\") " pod="kube-system/global-pull-secret-syncer-mhds4"
Jul 13 16:40:05.298859 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.298837    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf-kubelet-config\") pod \"global-pull-secret-syncer-mhds4\" (UID: \"d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf\") " pod="kube-system/global-pull-secret-syncer-mhds4"
Jul 13 16:40:05.299002 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.298951    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0209e3f3-bff2-4755-9766-4f0455e937e4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sfcgf\" (UID: \"0209e3f3-bff2-4755-9766-4f0455e937e4\") " pod="openshift-multus/multus-additional-cni-plugins-sfcgf"
Jul 13 16:40:05.299078 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:05.299060    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 16:40:05.299164 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:05.299151    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76ecb854-ac06-45b1-b386-ea01c15fb5e2-metrics-certs podName:76ecb854-ac06-45b1-b386-ea01c15fb5e2 nodeName:}" failed. No retries permitted until 2026-07-13 16:40:05.799128313 +0000 UTC m=+3.157435134 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/76ecb854-ac06-45b1-b386-ea01c15fb5e2-metrics-certs") pod "network-metrics-daemon-gfcfp" (UID: "76ecb854-ac06-45b1-b386-ea01c15fb5e2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 16:40:05.299230 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.299213    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a530403-3ff8-4783-a8b2-6ff27c771aff-tmp-dir\") pod \"node-resolver-q72ql\" (UID: \"1a530403-3ff8-4783-a8b2-6ff27c771aff\") " pod="openshift-dns/node-resolver-q72ql"
Jul 13 16:40:05.299999 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.299322    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0209e3f3-bff2-4755-9766-4f0455e937e4-cni-binary-copy\") pod \"multus-additional-cni-plugins-sfcgf\" (UID: \"0209e3f3-bff2-4755-9766-4f0455e937e4\") " pod="openshift-multus/multus-additional-cni-plugins-sfcgf"
Jul 13 16:40:05.299999 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.299370    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0209e3f3-bff2-4755-9766-4f0455e937e4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sfcgf\" (UID: \"0209e3f3-bff2-4755-9766-4f0455e937e4\") " pod="openshift-multus/multus-additional-cni-plugins-sfcgf"
Jul 13 16:40:05.299999 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.299433    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0209e3f3-bff2-4755-9766-4f0455e937e4-cnibin\") pod \"multus-additional-cni-plugins-sfcgf\" (UID: \"0209e3f3-bff2-4755-9766-4f0455e937e4\") " pod="openshift-multus/multus-additional-cni-plugins-sfcgf"
Jul 13 16:40:05.299999 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.299481    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0209e3f3-bff2-4755-9766-4f0455e937e4-system-cni-dir\") pod \"multus-additional-cni-plugins-sfcgf\" (UID: \"0209e3f3-bff2-4755-9766-4f0455e937e4\") " pod="openshift-multus/multus-additional-cni-plugins-sfcgf"
Jul 13 16:40:05.299999 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.299539    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b22f51b8-4e55-461c-ab1c-1ea6fece1733-host-slash\") pod \"iptables-alerter-zfg7r\" (UID: \"b22f51b8-4e55-461c-ab1c-1ea6fece1733\") " pod="openshift-network-operator/iptables-alerter-zfg7r"
Jul 13 16:40:05.299999 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:05.299551    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 16:40:05.299999 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.298956    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b22f51b8-4e55-461c-ab1c-1ea6fece1733-iptables-alerter-script\") pod \"iptables-alerter-zfg7r\" (UID: \"b22f51b8-4e55-461c-ab1c-1ea6fece1733\") " pod="openshift-network-operator/iptables-alerter-zfg7r"
Jul 13 16:40:05.299999 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:05.299622    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf-original-pull-secret podName:d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf nodeName:}" failed. No retries permitted until 2026-07-13 16:40:05.799603484 +0000 UTC m=+3.157910290 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf-original-pull-secret") pod "global-pull-secret-syncer-mhds4" (UID: "d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf") : object "kube-system"/"original-pull-secret" not registered
Jul 13 16:40:05.299999 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.299677    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8261c78d-17e9-4ff0-a118-395dedbc2838-konnectivity-ca\") pod \"konnectivity-agent-6nkfx\" (UID: \"8261c78d-17e9-4ff0-a118-395dedbc2838\") " pod="kube-system/konnectivity-agent-6nkfx"
Jul 13 16:40:05.300964 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.300788    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hcgx8"
Jul 13 16:40:05.302126 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.302083    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8261c78d-17e9-4ff0-a118-395dedbc2838-agent-certs\") pod \"konnectivity-agent-6nkfx\" (UID: \"8261c78d-17e9-4ff0-a118-395dedbc2838\") " pod="kube-system/konnectivity-agent-6nkfx"
Jul 13 16:40:05.305695 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.305511    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6bz7r"
Jul 13 16:40:05.305695 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:05.305590    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 16:40:05.305695 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:05.305611    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 16:40:05.305695 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:05.305623    2573 projected.go:196] Error preparing data for projected volume kube-api-access-jxs9w for pod openshift-network-diagnostics/network-check-target-5xx8s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 16:40:05.305695 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:05.305692    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb203ef3-2445-43bb-a0aa-e5476ac8d12e-kube-api-access-jxs9w podName:eb203ef3-2445-43bb-a0aa-e5476ac8d12e nodeName:}" failed. No retries permitted until 2026-07-13 16:40:05.805673329 +0000 UTC m=+3.163980136 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jxs9w" (UniqueName: "kubernetes.io/projected/eb203ef3-2445-43bb-a0aa-e5476ac8d12e-kube-api-access-jxs9w") pod "network-check-target-5xx8s" (UID: "eb203ef3-2445-43bb-a0aa-e5476ac8d12e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 16:40:05.309778 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.309584    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wpn7\" (UniqueName: \"kubernetes.io/projected/0209e3f3-bff2-4755-9766-4f0455e937e4-kube-api-access-8wpn7\") pod \"multus-additional-cni-plugins-sfcgf\" (UID: \"0209e3f3-bff2-4755-9766-4f0455e937e4\") " pod="openshift-multus/multus-additional-cni-plugins-sfcgf"
Jul 13 16:40:05.309778 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.309644    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btp5z\" (UniqueName: \"kubernetes.io/projected/76ecb854-ac06-45b1-b386-ea01c15fb5e2-kube-api-access-btp5z\") pod \"network-metrics-daemon-gfcfp\" (UID: \"76ecb854-ac06-45b1-b386-ea01c15fb5e2\") " pod="openshift-multus/network-metrics-daemon-gfcfp"
Jul 13 16:40:05.310150 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.310126    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lscjc\" (UniqueName: \"kubernetes.io/projected/b22f51b8-4e55-461c-ab1c-1ea6fece1733-kube-api-access-lscjc\") pod \"iptables-alerter-zfg7r\" (UID: \"b22f51b8-4e55-461c-ab1c-1ea6fece1733\") " pod="openshift-network-operator/iptables-alerter-zfg7r"
Jul 13 16:40:05.310354 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.310314    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc28g\" (UniqueName: \"kubernetes.io/projected/1a530403-3ff8-4783-a8b2-6ff27c771aff-kube-api-access-xc28g\") pod \"node-resolver-q72ql\" (UID: \"1a530403-3ff8-4783-a8b2-6ff27c771aff\") " pod="openshift-dns/node-resolver-q72ql"
Jul 13 16:40:05.313547 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.313524    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:05.314191 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:05.314160    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f5f1928_0c10_44c3_a8fb_bcc9b13606fe.slice/crio-131a82444ffaa57d20adc33f5858fa42702452dbfff0be5feb8aa336ad2d6618 WatchSource:0}: Error finding container 131a82444ffaa57d20adc33f5858fa42702452dbfff0be5feb8aa336ad2d6618: Status 404 returned error can't find the container with id 131a82444ffaa57d20adc33f5858fa42702452dbfff0be5feb8aa336ad2d6618
Jul 13 16:40:05.319309 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.319114    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djz8z"
Jul 13 16:40:05.320310 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:05.319705    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45267697_f81d_45c0_98c5_0caf91de14ed.slice/crio-76f0ad4e7a4b8ece7e393b1b215f1e76c138428eabb647b1d9947ddb837b6e9f WatchSource:0}: Error finding container 76f0ad4e7a4b8ece7e393b1b215f1e76c138428eabb647b1d9947ddb837b6e9f: Status 404 returned error can't find the container with id 76f0ad4e7a4b8ece7e393b1b215f1e76c138428eabb647b1d9947ddb837b6e9f
Jul 13 16:40:05.324847 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.324831    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fcmkh"
Jul 13 16:40:05.329503 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:05.329464    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1fb6130_2ab7_40f5_831c_ea95ff241f37.slice/crio-49d652edeb518fc6163ee946c0092320106e457ed83f24231e950ff730e1cd43 WatchSource:0}: Error finding container 49d652edeb518fc6163ee946c0092320106e457ed83f24231e950ff730e1cd43: Status 404 returned error can't find the container with id 49d652edeb518fc6163ee946c0092320106e457ed83f24231e950ff730e1cd43
Jul 13 16:40:05.330546 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.330392    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q72ql"
Jul 13 16:40:05.336615 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.336597    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zfg7r"
Jul 13 16:40:05.341293 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.341267    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6nkfx"
Jul 13 16:40:05.341617 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:05.341595    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1ff3622_f6d0_46bb_afe7_f3366fa19ed7.slice/crio-23e6be645f862847da1de4c538804bdc40879112b087a25ae4464fdac278642a WatchSource:0}: Error finding container 23e6be645f862847da1de4c538804bdc40879112b087a25ae4464fdac278642a: Status 404 returned error can't find the container with id 23e6be645f862847da1de4c538804bdc40879112b087a25ae4464fdac278642a
Jul 13 16:40:05.341832 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:05.341809    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd863890b_a985_41a6_89ae_2bc3cc732840.slice/crio-26004ce43621ab527b0a3c9d3e27f7c0555097f1e544a7e95bb8ac96f843589c WatchSource:0}: Error finding container 26004ce43621ab527b0a3c9d3e27f7c0555097f1e544a7e95bb8ac96f843589c: Status 404 returned error can't find the container with id 26004ce43621ab527b0a3c9d3e27f7c0555097f1e544a7e95bb8ac96f843589c
Jul 13 16:40:05.345944 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.345711    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sfcgf"
Jul 13 16:40:05.351881 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:05.351854    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a530403_3ff8_4783_a8b2_6ff27c771aff.slice/crio-a2c03998d602fac735b6803d26fef330aad94701b5ca449104d146b1932388c3 WatchSource:0}: Error finding container a2c03998d602fac735b6803d26fef330aad94701b5ca449104d146b1932388c3: Status 404 returned error can't find the container with id a2c03998d602fac735b6803d26fef330aad94701b5ca449104d146b1932388c3
Jul 13 16:40:05.360047 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:05.360019    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0209e3f3_bff2_4755_9766_4f0455e937e4.slice/crio-646a33147c1beed657ef80c1fe7b7f339456fcd15e6a86797b19678aaaa7b513 WatchSource:0}: Error finding container 646a33147c1beed657ef80c1fe7b7f339456fcd15e6a86797b19678aaaa7b513: Status 404 returned error can't find the container with id 646a33147c1beed657ef80c1fe7b7f339456fcd15e6a86797b19678aaaa7b513
Jul 13 16:40:05.525985 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.525785    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 16:40:05.800565 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.800528    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76ecb854-ac06-45b1-b386-ea01c15fb5e2-metrics-certs\") pod \"network-metrics-daemon-gfcfp\" (UID: \"76ecb854-ac06-45b1-b386-ea01c15fb5e2\") " pod="openshift-multus/network-metrics-daemon-gfcfp"
Jul 13 16:40:05.800750 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.800596    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf-original-pull-secret\") pod \"global-pull-secret-syncer-mhds4\" (UID: \"d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf\") " pod="kube-system/global-pull-secret-syncer-mhds4"
Jul 13 16:40:05.800750 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:05.800691    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 16:40:05.800846 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:05.800777    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76ecb854-ac06-45b1-b386-ea01c15fb5e2-metrics-certs podName:76ecb854-ac06-45b1-b386-ea01c15fb5e2 nodeName:}" failed. No retries permitted until 2026-07-13 16:40:06.800759119 +0000 UTC m=+4.159065922 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/76ecb854-ac06-45b1-b386-ea01c15fb5e2-metrics-certs") pod "network-metrics-daemon-gfcfp" (UID: "76ecb854-ac06-45b1-b386-ea01c15fb5e2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 16:40:05.800846 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:05.800696    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 16:40:05.800928 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:05.800855    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf-original-pull-secret podName:d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf nodeName:}" failed. No retries permitted until 2026-07-13 16:40:06.800842597 +0000 UTC m=+4.159149412 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf-original-pull-secret") pod "global-pull-secret-syncer-mhds4" (UID: "d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf") : object "kube-system"/"original-pull-secret" not registered
Jul 13 16:40:05.901023 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:05.900988    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxs9w\" (UniqueName: \"kubernetes.io/projected/eb203ef3-2445-43bb-a0aa-e5476ac8d12e-kube-api-access-jxs9w\") pod \"network-check-target-5xx8s\" (UID: \"eb203ef3-2445-43bb-a0aa-e5476ac8d12e\") " pod="openshift-network-diagnostics/network-check-target-5xx8s"
Jul 13 16:40:05.901246 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:05.901199    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 16:40:05.901246 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:05.901239    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 16:40:05.901246 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:05.901254    2573 projected.go:196] Error preparing data for projected volume kube-api-access-jxs9w for pod openshift-network-diagnostics/network-check-target-5xx8s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 16:40:05.901445 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:05.901326    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb203ef3-2445-43bb-a0aa-e5476ac8d12e-kube-api-access-jxs9w podName:eb203ef3-2445-43bb-a0aa-e5476ac8d12e nodeName:}" failed. No retries permitted until 2026-07-13 16:40:06.901305901 +0000 UTC m=+4.259612715 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jxs9w" (UniqueName: "kubernetes.io/projected/eb203ef3-2445-43bb-a0aa-e5476ac8d12e-kube-api-access-jxs9w") pod "network-check-target-5xx8s" (UID: "eb203ef3-2445-43bb-a0aa-e5476ac8d12e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 16:40:06.049288 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:06.049228    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 16:35:05 +0000 UTC" deadline="2028-02-12 00:53:21.125580493 +0000 UTC"
Jul 13 16:40:06.049288 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:06.049290    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13880h13m15.076298032s"
Jul 13 16:40:06.149973 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:06.149888    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sfcgf" event={"ID":"0209e3f3-bff2-4755-9766-4f0455e937e4","Type":"ContainerStarted","Data":"646a33147c1beed657ef80c1fe7b7f339456fcd15e6a86797b19678aaaa7b513"}
Jul 13 16:40:06.151511 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:06.151476    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zfg7r" event={"ID":"b22f51b8-4e55-461c-ab1c-1ea6fece1733","Type":"ContainerStarted","Data":"8dd57d7f3374d37451e57c3c9e93079416ada9af4214713ee6f0b9b9f1999152"}
Jul 13 16:40:06.152835 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:06.152808    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fcmkh" event={"ID":"d863890b-a985-41a6-89ae-2bc3cc732840","Type":"ContainerStarted","Data":"26004ce43621ab527b0a3c9d3e27f7c0555097f1e544a7e95bb8ac96f843589c"}
Jul 13 16:40:06.154258 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:06.154238    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djz8z" event={"ID":"d1ff3622-f6d0-46bb-afe7-f3366fa19ed7","Type":"ContainerStarted","Data":"23e6be645f862847da1de4c538804bdc40879112b087a25ae4464fdac278642a"}
Jul 13 16:40:06.155669 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:06.155635    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg" event={"ID":"e1fb6130-2ab7-40f5-831c-ea95ff241f37","Type":"ContainerStarted","Data":"49d652edeb518fc6163ee946c0092320106e457ed83f24231e950ff730e1cd43"}
Jul 13 16:40:06.157353 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:06.157323    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6bz7r" event={"ID":"45267697-f81d-45c0-98c5-0caf91de14ed","Type":"ContainerStarted","Data":"76f0ad4e7a4b8ece7e393b1b215f1e76c138428eabb647b1d9947ddb837b6e9f"}
Jul 13 16:40:06.158554 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:06.158530    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6nkfx" event={"ID":"8261c78d-17e9-4ff0-a118-395dedbc2838","Type":"ContainerStarted","Data":"b1ca65bd8ff19b59cebbb951a815e4abaf846654a7a4baaf451cff7386fabd78"}
Jul 13 16:40:06.160052 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:06.160028    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q72ql" event={"ID":"1a530403-3ff8-4783-a8b2-6ff27c771aff","Type":"ContainerStarted","Data":"a2c03998d602fac735b6803d26fef330aad94701b5ca449104d146b1932388c3"}
Jul 13 16:40:06.161299 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:06.161278    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hcgx8" event={"ID":"2f5f1928-0c10-44c3-a8fb-bcc9b13606fe","Type":"ContainerStarted","Data":"131a82444ffaa57d20adc33f5858fa42702452dbfff0be5feb8aa336ad2d6618"}
Jul 13 16:40:06.808061 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:06.808012    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76ecb854-ac06-45b1-b386-ea01c15fb5e2-metrics-certs\") pod \"network-metrics-daemon-gfcfp\" (UID: \"76ecb854-ac06-45b1-b386-ea01c15fb5e2\") " pod="openshift-multus/network-metrics-daemon-gfcfp"
Jul 13 16:40:06.808227 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:06.808085    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf-original-pull-secret\") pod \"global-pull-secret-syncer-mhds4\" (UID: \"d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf\") " pod="kube-system/global-pull-secret-syncer-mhds4"
Jul 13 16:40:06.808306 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:06.808234    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 16:40:06.808306 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:06.808298    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf-original-pull-secret podName:d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf nodeName:}" failed. No retries permitted until 2026-07-13 16:40:08.808280744 +0000 UTC m=+6.166587550 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf-original-pull-secret") pod "global-pull-secret-syncer-mhds4" (UID: "d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf") : object "kube-system"/"original-pull-secret" not registered
Jul 13 16:40:06.808761 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:06.808702    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 16:40:06.808859 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:06.808787    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76ecb854-ac06-45b1-b386-ea01c15fb5e2-metrics-certs podName:76ecb854-ac06-45b1-b386-ea01c15fb5e2 nodeName:}" failed. No retries permitted until 2026-07-13 16:40:08.808762873 +0000 UTC m=+6.167069679 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/76ecb854-ac06-45b1-b386-ea01c15fb5e2-metrics-certs") pod "network-metrics-daemon-gfcfp" (UID: "76ecb854-ac06-45b1-b386-ea01c15fb5e2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 16:40:06.908643 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:06.908596    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxs9w\" (UniqueName: \"kubernetes.io/projected/eb203ef3-2445-43bb-a0aa-e5476ac8d12e-kube-api-access-jxs9w\") pod \"network-check-target-5xx8s\" (UID: \"eb203ef3-2445-43bb-a0aa-e5476ac8d12e\") " pod="openshift-network-diagnostics/network-check-target-5xx8s"
Jul 13 16:40:06.908820 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:06.908794    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 16:40:06.908820 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:06.908819    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 16:40:06.909001 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:06.908834    2573 projected.go:196] Error preparing data for projected volume kube-api-access-jxs9w for pod openshift-network-diagnostics/network-check-target-5xx8s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 16:40:06.909001 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:06.908896    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb203ef3-2445-43bb-a0aa-e5476ac8d12e-kube-api-access-jxs9w podName:eb203ef3-2445-43bb-a0aa-e5476ac8d12e nodeName:}" failed. No retries permitted until 2026-07-13 16:40:08.908877804 +0000 UTC m=+6.267184609 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jxs9w" (UniqueName: "kubernetes.io/projected/eb203ef3-2445-43bb-a0aa-e5476ac8d12e-kube-api-access-jxs9w") pod "network-check-target-5xx8s" (UID: "eb203ef3-2445-43bb-a0aa-e5476ac8d12e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 16:40:07.049839 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:07.049799    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 16:35:05 +0000 UTC" deadline="2027-12-21 13:11:57.005740875 +0000 UTC"
Jul 13 16:40:07.049947 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:07.049841    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12620h31m49.955904711s"
Jul 13 16:40:07.144932 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:07.142936    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5xx8s"
Jul 13 16:40:07.144932 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:07.143261    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5xx8s" podUID="eb203ef3-2445-43bb-a0aa-e5476ac8d12e"
Jul 13 16:40:07.154390 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:07.148478    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhds4"
Jul 13 16:40:07.154390 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:07.148631    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhds4" podUID="d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf"
Jul 13 16:40:07.154390 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:07.148841    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gfcfp"
Jul 13 16:40:07.154390 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:07.150513    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gfcfp" podUID="76ecb854-ac06-45b1-b386-ea01c15fb5e2"
Jul 13 16:40:08.174311 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:08.173318    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-51.ec2.internal" event={"ID":"a7643480c8e2c0cb0879d052b686dab7","Type":"ContainerStarted","Data":"03ca5617df116073fa0a07665b417e636f532697cfa9bd1db486eadb70d4844b"}
Jul 13 16:40:08.180095 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:08.179672    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-51.ec2.internal" event={"ID":"058d270930df0d9f694c82e607f9f3bc","Type":"ContainerStarted","Data":"29dff0c91486bf0522146414dbd2681d02c4fae166ba05915c174aace857539c"}
Jul 13 16:40:08.826478 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:08.825532    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76ecb854-ac06-45b1-b386-ea01c15fb5e2-metrics-certs\") pod \"network-metrics-daemon-gfcfp\" (UID: \"76ecb854-ac06-45b1-b386-ea01c15fb5e2\") " pod="openshift-multus/network-metrics-daemon-gfcfp"
Jul 13 16:40:08.826478 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:08.825604    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf-original-pull-secret\") pod \"global-pull-secret-syncer-mhds4\" (UID: \"d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf\") " pod="kube-system/global-pull-secret-syncer-mhds4"
Jul 13 16:40:08.826478 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:08.825789    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 16:40:08.826478 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:08.825898    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf-original-pull-secret podName:d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf nodeName:}" failed. No retries permitted until 2026-07-13 16:40:12.825834711 +0000 UTC m=+10.184141537 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf-original-pull-secret") pod "global-pull-secret-syncer-mhds4" (UID: "d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf") : object "kube-system"/"original-pull-secret" not registered
Jul 13 16:40:08.826478 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:08.826296    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 16:40:08.826478 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:08.826345    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76ecb854-ac06-45b1-b386-ea01c15fb5e2-metrics-certs podName:76ecb854-ac06-45b1-b386-ea01c15fb5e2 nodeName:}" failed. No retries permitted until 2026-07-13 16:40:12.82632974 +0000 UTC m=+10.184636545 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/76ecb854-ac06-45b1-b386-ea01c15fb5e2-metrics-certs") pod "network-metrics-daemon-gfcfp" (UID: "76ecb854-ac06-45b1-b386-ea01c15fb5e2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 16:40:08.927257 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:08.926357    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxs9w\" (UniqueName: \"kubernetes.io/projected/eb203ef3-2445-43bb-a0aa-e5476ac8d12e-kube-api-access-jxs9w\") pod \"network-check-target-5xx8s\" (UID: \"eb203ef3-2445-43bb-a0aa-e5476ac8d12e\") " pod="openshift-network-diagnostics/network-check-target-5xx8s"
Jul 13 16:40:08.927257 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:08.926610    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 16:40:08.927257 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:08.926637    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 16:40:08.927257 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:08.926651    2573 projected.go:196] Error preparing data for projected volume kube-api-access-jxs9w for pod openshift-network-diagnostics/network-check-target-5xx8s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 16:40:08.927257 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:08.926764    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb203ef3-2445-43bb-a0aa-e5476ac8d12e-kube-api-access-jxs9w podName:eb203ef3-2445-43bb-a0aa-e5476ac8d12e nodeName:}" failed. No retries permitted until 2026-07-13 16:40:12.926744042 +0000 UTC m=+10.285050868 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jxs9w" (UniqueName: "kubernetes.io/projected/eb203ef3-2445-43bb-a0aa-e5476ac8d12e-kube-api-access-jxs9w") pod "network-check-target-5xx8s" (UID: "eb203ef3-2445-43bb-a0aa-e5476ac8d12e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 16:40:09.141795 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:09.141625    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5xx8s"
Jul 13 16:40:09.141976 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:09.141805    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5xx8s" podUID="eb203ef3-2445-43bb-a0aa-e5476ac8d12e"
Jul 13 16:40:09.141976 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:09.141855    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhds4"
Jul 13 16:40:09.142096 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:09.141980    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhds4" podUID="d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf"
Jul 13 16:40:09.142096 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:09.141994    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gfcfp"
Jul 13 16:40:09.142301 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:09.142089    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gfcfp" podUID="76ecb854-ac06-45b1-b386-ea01c15fb5e2"
Jul 13 16:40:11.141279 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:11.141204    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5xx8s"
Jul 13 16:40:11.141279 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:11.141246    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gfcfp"
Jul 13 16:40:11.141813 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:11.141340    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5xx8s" podUID="eb203ef3-2445-43bb-a0aa-e5476ac8d12e"
Jul 13 16:40:11.141813 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:11.141404    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gfcfp" podUID="76ecb854-ac06-45b1-b386-ea01c15fb5e2"
Jul 13 16:40:11.141813 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:11.141453    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhds4"
Jul 13 16:40:11.141813 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:11.141528    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhds4" podUID="d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf"
Jul 13 16:40:12.862451 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:12.862415    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76ecb854-ac06-45b1-b386-ea01c15fb5e2-metrics-certs\") pod \"network-metrics-daemon-gfcfp\" (UID: \"76ecb854-ac06-45b1-b386-ea01c15fb5e2\") " pod="openshift-multus/network-metrics-daemon-gfcfp"
Jul 13 16:40:12.862940 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:12.862475    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf-original-pull-secret\") pod \"global-pull-secret-syncer-mhds4\" (UID: \"d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf\") " pod="kube-system/global-pull-secret-syncer-mhds4"
Jul 13 16:40:12.862940 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:12.862556    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 16:40:12.862940 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:12.862568    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 16:40:12.862940 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:12.862608    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf-original-pull-secret podName:d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf nodeName:}" failed. No retries permitted until 2026-07-13 16:40:20.862592714 +0000 UTC m=+18.220899534 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf-original-pull-secret") pod "global-pull-secret-syncer-mhds4" (UID: "d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf") : object "kube-system"/"original-pull-secret" not registered
Jul 13 16:40:12.862940 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:12.862633    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76ecb854-ac06-45b1-b386-ea01c15fb5e2-metrics-certs podName:76ecb854-ac06-45b1-b386-ea01c15fb5e2 nodeName:}" failed. No retries permitted until 2026-07-13 16:40:20.862614737 +0000 UTC m=+18.220921560 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/76ecb854-ac06-45b1-b386-ea01c15fb5e2-metrics-certs") pod "network-metrics-daemon-gfcfp" (UID: "76ecb854-ac06-45b1-b386-ea01c15fb5e2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 16:40:12.963908 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:12.963870    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxs9w\" (UniqueName: \"kubernetes.io/projected/eb203ef3-2445-43bb-a0aa-e5476ac8d12e-kube-api-access-jxs9w\") pod \"network-check-target-5xx8s\" (UID: \"eb203ef3-2445-43bb-a0aa-e5476ac8d12e\") " pod="openshift-network-diagnostics/network-check-target-5xx8s"
Jul 13 16:40:12.964091 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:12.964030    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 16:40:12.964091 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:12.964054    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 16:40:12.964091 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:12.964067    2573 projected.go:196] Error preparing data for projected volume kube-api-access-jxs9w for pod openshift-network-diagnostics/network-check-target-5xx8s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 16:40:12.964234 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:12.964124    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb203ef3-2445-43bb-a0aa-e5476ac8d12e-kube-api-access-jxs9w podName:eb203ef3-2445-43bb-a0aa-e5476ac8d12e nodeName:}" failed. No retries permitted until 2026-07-13 16:40:20.96410596 +0000 UTC m=+18.322412784 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jxs9w" (UniqueName: "kubernetes.io/projected/eb203ef3-2445-43bb-a0aa-e5476ac8d12e-kube-api-access-jxs9w") pod "network-check-target-5xx8s" (UID: "eb203ef3-2445-43bb-a0aa-e5476ac8d12e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 16:40:13.145506 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:13.145404    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhds4"
Jul 13 16:40:13.145506 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:13.145428    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5xx8s"
Jul 13 16:40:13.145794 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:13.145517    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhds4" podUID="d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf"
Jul 13 16:40:13.145794 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:13.145522    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gfcfp"
Jul 13 16:40:13.145794 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:13.145617    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5xx8s" podUID="eb203ef3-2445-43bb-a0aa-e5476ac8d12e"
Jul 13 16:40:13.145794 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:13.145711    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gfcfp" podUID="76ecb854-ac06-45b1-b386-ea01c15fb5e2"
Jul 13 16:40:13.191520 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:13.191476    2573 generic.go:356] "Generic (PLEG): container finished" podID="a7643480c8e2c0cb0879d052b686dab7" containerID="03ca5617df116073fa0a07665b417e636f532697cfa9bd1db486eadb70d4844b" exitCode=0
Jul 13 16:40:13.191689 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:13.191530    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-51.ec2.internal" event={"ID":"a7643480c8e2c0cb0879d052b686dab7","Type":"ContainerDied","Data":"03ca5617df116073fa0a07665b417e636f532697cfa9bd1db486eadb70d4844b"}
Jul 13 16:40:13.208990 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:13.208675    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-51.ec2.internal" podStartSLOduration=9.208655949 podStartE2EDuration="9.208655949s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 16:40:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:40:08.207235445 +0000 UTC m=+5.565542272" watchObservedRunningTime="2026-07-13 16:40:13.208655949 +0000 UTC m=+10.566962777"
Jul 13 16:40:15.141751 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:15.141582    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5xx8s"
Jul 13 16:40:15.141751 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:15.141603    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhds4"
Jul 13 16:40:15.141751 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:15.141620    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gfcfp"
Jul 13 16:40:15.142311 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:15.141827    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gfcfp" podUID="76ecb854-ac06-45b1-b386-ea01c15fb5e2"
Jul 13 16:40:15.142311 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:15.141921    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhds4" podUID="d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf"
Jul 13 16:40:15.142456 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:15.141711    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5xx8s" podUID="eb203ef3-2445-43bb-a0aa-e5476ac8d12e"
Jul 13 16:40:17.141428 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:17.141392    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gfcfp"
Jul 13 16:40:17.141909 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:17.141437    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhds4"
Jul 13 16:40:17.141909 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:17.141392    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5xx8s"
Jul 13 16:40:17.141909 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:17.141519    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gfcfp" podUID="76ecb854-ac06-45b1-b386-ea01c15fb5e2"
Jul 13 16:40:17.141909 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:17.141626    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5xx8s" podUID="eb203ef3-2445-43bb-a0aa-e5476ac8d12e"
Jul 13 16:40:17.141909 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:17.141769    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhds4" podUID="d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf"
Jul 13 16:40:19.141675 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:19.141647    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhds4"
Jul 13 16:40:19.141675 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:19.141671    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5xx8s"
Jul 13 16:40:19.142124 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:19.141790    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhds4" podUID="d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf"
Jul 13 16:40:19.142124 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:19.141842    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5xx8s" podUID="eb203ef3-2445-43bb-a0aa-e5476ac8d12e"
Jul 13 16:40:19.142124 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:19.141872    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gfcfp"
Jul 13 16:40:19.142124 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:19.141947    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gfcfp" podUID="76ecb854-ac06-45b1-b386-ea01c15fb5e2"
Jul 13 16:40:20.921400 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:20.921356    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf-original-pull-secret\") pod \"global-pull-secret-syncer-mhds4\" (UID: \"d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf\") " pod="kube-system/global-pull-secret-syncer-mhds4"
Jul 13 16:40:20.921853 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:20.921438    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76ecb854-ac06-45b1-b386-ea01c15fb5e2-metrics-certs\") pod \"network-metrics-daemon-gfcfp\" (UID: \"76ecb854-ac06-45b1-b386-ea01c15fb5e2\") " pod="openshift-multus/network-metrics-daemon-gfcfp"
Jul 13 16:40:20.921853 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:20.921514    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 16:40:20.921853 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:20.921524    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 16:40:20.921853 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:20.921577    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf-original-pull-secret podName:d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf nodeName:}" failed. No retries permitted until 2026-07-13 16:40:36.921558408 +0000 UTC m=+34.279865216 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf-original-pull-secret") pod "global-pull-secret-syncer-mhds4" (UID: "d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf") : object "kube-system"/"original-pull-secret" not registered
Jul 13 16:40:20.921853 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:20.921596    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76ecb854-ac06-45b1-b386-ea01c15fb5e2-metrics-certs podName:76ecb854-ac06-45b1-b386-ea01c15fb5e2 nodeName:}" failed. No retries permitted until 2026-07-13 16:40:36.921586682 +0000 UTC m=+34.279893486 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/76ecb854-ac06-45b1-b386-ea01c15fb5e2-metrics-certs") pod "network-metrics-daemon-gfcfp" (UID: "76ecb854-ac06-45b1-b386-ea01c15fb5e2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 16:40:21.022647 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:21.022611    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxs9w\" (UniqueName: \"kubernetes.io/projected/eb203ef3-2445-43bb-a0aa-e5476ac8d12e-kube-api-access-jxs9w\") pod \"network-check-target-5xx8s\" (UID: \"eb203ef3-2445-43bb-a0aa-e5476ac8d12e\") " pod="openshift-network-diagnostics/network-check-target-5xx8s"
Jul 13 16:40:21.022822 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:21.022802    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 16:40:21.022881 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:21.022831    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 16:40:21.022881 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:21.022846    2573 projected.go:196] Error preparing data for projected volume kube-api-access-jxs9w for pod openshift-network-diagnostics/network-check-target-5xx8s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 16:40:21.022959 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:21.022904    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb203ef3-2445-43bb-a0aa-e5476ac8d12e-kube-api-access-jxs9w podName:eb203ef3-2445-43bb-a0aa-e5476ac8d12e nodeName:}" failed. No retries permitted until 2026-07-13 16:40:37.022890198 +0000 UTC m=+34.381197001 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jxs9w" (UniqueName: "kubernetes.io/projected/eb203ef3-2445-43bb-a0aa-e5476ac8d12e-kube-api-access-jxs9w") pod "network-check-target-5xx8s" (UID: "eb203ef3-2445-43bb-a0aa-e5476ac8d12e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 16:40:21.141511 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:21.141448    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gfcfp"
Jul 13 16:40:21.141686 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:21.141463    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5xx8s"
Jul 13 16:40:21.141686 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:21.141587    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhds4"
Jul 13 16:40:21.141686 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:21.141583    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gfcfp" podUID="76ecb854-ac06-45b1-b386-ea01c15fb5e2"
Jul 13 16:40:21.141835 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:21.141716    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5xx8s" podUID="eb203ef3-2445-43bb-a0aa-e5476ac8d12e"
Jul 13 16:40:21.141835 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:21.141811    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhds4" podUID="d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf"
Jul 13 16:40:23.143992 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:23.143168    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5xx8s"
Jul 13 16:40:23.143992 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:23.143314    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5xx8s" podUID="eb203ef3-2445-43bb-a0aa-e5476ac8d12e"
Jul 13 16:40:23.143992 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:23.143384    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gfcfp"
Jul 13 16:40:23.143992 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:23.143493    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gfcfp" podUID="76ecb854-ac06-45b1-b386-ea01c15fb5e2"
Jul 13 16:40:23.145146 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:23.144664    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhds4"
Jul 13 16:40:23.145146 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:23.144866    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhds4" podUID="d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf"
Jul 13 16:40:25.141800 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:25.141572    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5xx8s"
Jul 13 16:40:25.142448 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:25.141572    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gfcfp"
Jul 13 16:40:25.142448 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:25.141908    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5xx8s" podUID="eb203ef3-2445-43bb-a0aa-e5476ac8d12e"
Jul 13 16:40:25.142448 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:25.142014    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gfcfp" podUID="76ecb854-ac06-45b1-b386-ea01c15fb5e2"
Jul 13 16:40:25.142448 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:25.141605    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhds4"
Jul 13 16:40:25.142448 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:25.142099    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhds4" podUID="d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf"
Jul 13 16:40:25.213667 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:25.213644    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-51.ec2.internal" event={"ID":"a7643480c8e2c0cb0879d052b686dab7","Type":"ContainerStarted","Data":"307d34a0d5274fb19c9c18cf519d82c5bc1a19193ebb8d3b7a592aa8be68a292"}
Jul 13 16:40:25.215236 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:25.215210    2573 generic.go:356] "Generic (PLEG): container finished" podID="0209e3f3-bff2-4755-9766-4f0455e937e4" containerID="0e922aab3a24064d9d8afe13136d6af009f76dfffa5a68b0dbcb64164355fd33" exitCode=0
Jul 13 16:40:25.215323 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:25.215300    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sfcgf" event={"ID":"0209e3f3-bff2-4755-9766-4f0455e937e4","Type":"ContainerDied","Data":"0e922aab3a24064d9d8afe13136d6af009f76dfffa5a68b0dbcb64164355fd33"}
Jul 13 16:40:25.216930 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:25.216904    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fcmkh" event={"ID":"d863890b-a985-41a6-89ae-2bc3cc732840","Type":"ContainerStarted","Data":"1a6cfa0531742bfa0ede9b29e550750d65c9919b2e0453b383d569035d9b73c0"}
Jul 13 16:40:25.218309 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:25.218286    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djz8z" event={"ID":"d1ff3622-f6d0-46bb-afe7-f3366fa19ed7","Type":"ContainerStarted","Data":"f37a1c5e0380767e01e128ad0d2692e9432789871444bffb501b6545ca265840"}
Jul 13 16:40:25.219980 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:25.219964    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnxdg_e1fb6130-2ab7-40f5-831c-ea95ff241f37/ovn-acl-logging/0.log"
Jul 13 16:40:25.220265 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:25.220245    2573 generic.go:356] "Generic (PLEG): container finished" podID="e1fb6130-2ab7-40f5-831c-ea95ff241f37" containerID="1e48cf59c5b1fbf986e6d35697ae1ab408d861936b090171eafdb69d271780cc" exitCode=1
Jul 13 16:40:25.220343 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:25.220266    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg" event={"ID":"e1fb6130-2ab7-40f5-831c-ea95ff241f37","Type":"ContainerStarted","Data":"067db4e80af45457b815471e99f286eaebeb83ba2a3dff7ae1e3be993ed5887f"}
Jul 13 16:40:25.220343 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:25.220327    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg" event={"ID":"e1fb6130-2ab7-40f5-831c-ea95ff241f37","Type":"ContainerDied","Data":"1e48cf59c5b1fbf986e6d35697ae1ab408d861936b090171eafdb69d271780cc"}
Jul 13 16:40:25.220435 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:25.220378    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg" event={"ID":"e1fb6130-2ab7-40f5-831c-ea95ff241f37","Type":"ContainerStarted","Data":"1eee681c7255bec6538474183d52fde34ab02b073cc288b3f81bb33fd542fc5f"}
Jul 13 16:40:25.222016 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:25.221993    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6bz7r" event={"ID":"45267697-f81d-45c0-98c5-0caf91de14ed","Type":"ContainerStarted","Data":"ce473b7ba1c4a65878486bbd2ecebb2f4e69dfbe6b42f9dbae1af88ed6020992"}
Jul 13 16:40:25.223156 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:25.223139    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6nkfx" event={"ID":"8261c78d-17e9-4ff0-a118-395dedbc2838","Type":"ContainerStarted","Data":"6929e54eeeab6d60088a9032fdca9a7c5b7389375c2ba05f1409248e2362c5ee"}
Jul 13 16:40:25.224530 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:25.224508    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q72ql" event={"ID":"1a530403-3ff8-4783-a8b2-6ff27c771aff","Type":"ContainerStarted","Data":"19b03fe5da8bbd946876b04bc1e392d66e921e61d053a8900958e8375760fb84"}
Jul 13 16:40:25.225806 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:25.225785    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hcgx8" event={"ID":"2f5f1928-0c10-44c3-a8fb-bcc9b13606fe","Type":"ContainerStarted","Data":"ecd16638d6e4d305c336f26d2d03936169f8c9ce6be97c133c872a5b122ecf2b"}
Jul 13 16:40:25.229766 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:25.229712    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-51.ec2.internal" podStartSLOduration=21.229701379 podStartE2EDuration="21.229701379s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 16:40:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:40:25.229225409 +0000 UTC m=+22.587532235" watchObservedRunningTime="2026-07-13 16:40:25.229701379 +0000 UTC m=+22.588008203"
Jul 13 16:40:25.244844 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:25.244799    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-q72ql" podStartSLOduration=7.255195009 podStartE2EDuration="22.244781983s" totalImagesPullingTime="14.989586974s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 16:40:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:40:25.24463976 +0000 UTC m=+22.602946584" watchObservedRunningTime="2026-07-13 16:40:25.244781983 +0000 UTC m=+22.603088809"
Jul 13 16:40:25.286035 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:25.285856    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6bz7r" podStartSLOduration=2.964917948 podStartE2EDuration="22.285841765s" totalImagesPullingTime="19.320923817s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 16:40:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:40:25.28565871 +0000 UTC m=+22.643965536" watchObservedRunningTime="2026-07-13 16:40:25.285841765 +0000 UTC m=+22.644148587"
Jul 13 16:40:25.318170 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:25.318129    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-fcmkh" podStartSLOduration=3.05485954 podStartE2EDuration="22.318110308s" totalImagesPullingTime="19.263250768s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 16:40:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:40:25.317526362 +0000 UTC m=+22.675833188" watchObservedRunningTime="2026-07-13 16:40:25.318110308 +0000 UTC m=+22.676417134"
Jul 13 16:40:25.347606 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:25.347550    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6nkfx" podStartSLOduration=3.109242924 podStartE2EDuration="22.347532728s" totalImagesPullingTime="19.238289804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:40:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:40:25.34639261 +0000 UTC m=+22.704699439" watchObservedRunningTime="2026-07-13 16:40:25.347532728 +0000 UTC m=+22.705839552"
Jul 13 16:40:25.367463 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:25.367415    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hcgx8" podStartSLOduration=3.077529636 podStartE2EDuration="22.367398106s" totalImagesPullingTime="19.28986847s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 16:40:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:40:25.367021994 +0000 UTC m=+22.725328820" watchObservedRunningTime="2026-07-13 16:40:25.367398106 +0000 UTC m=+22.725704932"
Jul 13 16:40:25.466006 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:25.465983    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:25.542990 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:25.542958    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:26.033536 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:26.033509    2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 13 16:40:26.082269 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:26.082162    2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-13T16:40:26.033530726Z","UUID":"a5b81b48-da36-497e-80ea-18e7b414300c","Handler":null,"Name":"","Endpoint":""}
Jul 13 16:40:26.083651 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:26.083631    2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 13 16:40:26.083783 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:26.083670    2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 13 16:40:26.231420 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:26.231339    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zfg7r" event={"ID":"b22f51b8-4e55-461c-ab1c-1ea6fece1733","Type":"ContainerStarted","Data":"9eff313f0c2cf577a32135f0f5e335cb525ab769ca1a2c303e4ede23703d5879"}
Jul 13 16:40:26.233595 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:26.233568    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djz8z" event={"ID":"d1ff3622-f6d0-46bb-afe7-f3366fa19ed7","Type":"ContainerStarted","Data":"891276c7b734e874466671b083a2cf098d9408d421cdc52878b1e69e5d8a6ab2"}
Jul 13 16:40:26.236998 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:26.236976    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnxdg_e1fb6130-2ab7-40f5-831c-ea95ff241f37/ovn-acl-logging/0.log"
Jul 13 16:40:26.237541 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:26.237516    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg" event={"ID":"e1fb6130-2ab7-40f5-831c-ea95ff241f37","Type":"ContainerStarted","Data":"f7cc75f7182af8473e0d2d9ed836d322580264ae077338faeaf0eaf45ae95cdd"}
Jul 13 16:40:26.237646 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:26.237590    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg" event={"ID":"e1fb6130-2ab7-40f5-831c-ea95ff241f37","Type":"ContainerStarted","Data":"56fb50436c8930b9c66f564b51f4484e292f8121b35f871c5a42990fcf1eb34c"}
Jul 13 16:40:26.237646 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:26.237640    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg" event={"ID":"e1fb6130-2ab7-40f5-831c-ea95ff241f37","Type":"ContainerStarted","Data":"06d38fe96f5f247cdde9d68afd0f62bb6fb91e2d232d964e78837ea382b74f82"}
Jul 13 16:40:26.248167 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:26.248125    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zfg7r" podStartSLOduration=4.000417531 podStartE2EDuration="23.248106974s" totalImagesPullingTime="19.247689443s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 16:40:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:40:26.247363244 +0000 UTC m=+23.605670069" watchObservedRunningTime="2026-07-13 16:40:26.248106974 +0000 UTC m=+23.606413800"
Jul 13 16:40:26.366993 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:26.366964    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:26.466785 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:26.466751    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:26.524993 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:26.524923    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:26.861637 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:26.861538    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:26.929712 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:26.929680    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:27.011851 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:27.011804    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:27.067742 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:27.067704    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:27.141071 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:27.141005    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5xx8s"
Jul 13 16:40:27.141220 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:27.141008    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gfcfp"
Jul 13 16:40:27.141220 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:27.141129    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5xx8s" podUID="eb203ef3-2445-43bb-a0aa-e5476ac8d12e"
Jul 13 16:40:27.141331 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:27.141256    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gfcfp" podUID="76ecb854-ac06-45b1-b386-ea01c15fb5e2"
Jul 13 16:40:27.141331 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:27.141008    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhds4"
Jul 13 16:40:27.141434 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:27.141375    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhds4" podUID="d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf"
Jul 13 16:40:28.022681 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:28.022397    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6nkfx"
Jul 13 16:40:28.023192 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:28.022987    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6nkfx"
Jul 13 16:40:28.053818 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:28.053792    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:28.135756 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:28.135702    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:28.227849 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:28.227814    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:28.243519 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:28.243492    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djz8z" event={"ID":"d1ff3622-f6d0-46bb-afe7-f3366fa19ed7","Type":"ContainerStarted","Data":"0b8954a01b6509d8c24ce27ed4bced884a7908f7f9a198d0c2d5fe766fe6a68a"}
Jul 13 16:40:28.246882 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:28.246858    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnxdg_e1fb6130-2ab7-40f5-831c-ea95ff241f37/ovn-acl-logging/0.log"
Jul 13 16:40:28.247303 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:28.247278    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg" event={"ID":"e1fb6130-2ab7-40f5-831c-ea95ff241f37","Type":"ContainerStarted","Data":"f2789edc52b1b0704c7b79ceeab22012205191b30cea22ee2d39674db1def974"}
Jul 13 16:40:28.247532 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:28.247511    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6nkfx"
Jul 13 16:40:28.248059 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:28.248039    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6nkfx"
Jul 13 16:40:28.262520 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:28.262476    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djz8z" podStartSLOduration=3.7911878249999997 podStartE2EDuration="25.262460831s" totalImagesPullingTime="21.471273006s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 16:40:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:40:28.261744454 +0000 UTC m=+25.620051308" watchObservedRunningTime="2026-07-13 16:40:28.262460831 +0000 UTC m=+25.620767657"
Jul 13 16:40:28.290799 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:28.290740    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:28.348944 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:28.348921    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:28.630927 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:28.630858    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:28.732302 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:28.732271    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:29.142046 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:29.142014    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5xx8s"
Jul 13 16:40:29.142046 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:29.142039    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhds4"
Jul 13 16:40:29.142512 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:29.142018    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gfcfp"
Jul 13 16:40:29.142512 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:29.142140    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5xx8s" podUID="eb203ef3-2445-43bb-a0aa-e5476ac8d12e"
Jul 13 16:40:29.142512 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:29.142228    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhds4" podUID="d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf"
Jul 13 16:40:29.142512 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:29.142336    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gfcfp" podUID="76ecb854-ac06-45b1-b386-ea01c15fb5e2"
Jul 13 16:40:30.255219 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:30.255042    2573 generic.go:356] "Generic (PLEG): container finished" podID="0209e3f3-bff2-4755-9766-4f0455e937e4" containerID="48c5b7b8d5b7826620a0d54d0cc36d7544c90068e0a2ae446e6046b92bd43032" exitCode=0
Jul 13 16:40:30.255991 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:30.255127    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sfcgf" event={"ID":"0209e3f3-bff2-4755-9766-4f0455e937e4","Type":"ContainerDied","Data":"48c5b7b8d5b7826620a0d54d0cc36d7544c90068e0a2ae446e6046b92bd43032"}
Jul 13 16:40:30.259029 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:30.259011    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnxdg_e1fb6130-2ab7-40f5-831c-ea95ff241f37/ovn-acl-logging/0.log"
Jul 13 16:40:30.259321 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:30.259299    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg" event={"ID":"e1fb6130-2ab7-40f5-831c-ea95ff241f37","Type":"ContainerStarted","Data":"7218f35ed08ac5874aaa3f9383ccdefa504baab9ba42daec8e884dc5242552a5"}
Jul 13 16:40:30.259771 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:30.259743    2573 scope.go:117] "RemoveContainer" containerID="1e48cf59c5b1fbf986e6d35697ae1ab408d861936b090171eafdb69d271780cc"
Jul 13 16:40:31.141535 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:31.141463    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5xx8s"
Jul 13 16:40:31.141535 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:31.141482    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gfcfp"
Jul 13 16:40:31.141834 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:31.141583    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5xx8s" podUID="eb203ef3-2445-43bb-a0aa-e5476ac8d12e"
Jul 13 16:40:31.141834 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:31.141654    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gfcfp" podUID="76ecb854-ac06-45b1-b386-ea01c15fb5e2"
Jul 13 16:40:31.141834 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:31.141735    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhds4"
Jul 13 16:40:31.141834 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:31.141815    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhds4" podUID="d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf"
Jul 13 16:40:31.264623 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:31.264599    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnxdg_e1fb6130-2ab7-40f5-831c-ea95ff241f37/ovn-acl-logging/0.log"
Jul 13 16:40:31.265067 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:31.264953    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg" event={"ID":"e1fb6130-2ab7-40f5-831c-ea95ff241f37","Type":"ContainerStarted","Data":"6d7a7f053ecb15f1c3790d7a8af84b3fc96b3f6288dcedc9f18c15018ee2e4f7"}
Jul 13 16:40:31.265131 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:31.265112    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:31.265202 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:31.265190    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:31.265260 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:31.265245    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:31.281762 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:31.281732    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:31.283651 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:31.283629    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:40:31.298922 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:31.298882    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg" podStartSLOduration=8.998809209000001 podStartE2EDuration="28.298869085s" totalImagesPullingTime="19.300059876s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 16:40:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:40:31.297272969 +0000 UTC m=+28.655579794" watchObservedRunningTime="2026-07-13 16:40:31.298869085 +0000 UTC m=+28.657175910"
Jul 13 16:40:31.867565 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:31.867387    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gfcfp"]
Jul 13 16:40:31.867754 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:31.867659    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gfcfp"
Jul 13 16:40:31.867799 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:31.867765    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gfcfp" podUID="76ecb854-ac06-45b1-b386-ea01c15fb5e2"
Jul 13 16:40:31.870258 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:31.870234    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mhds4"]
Jul 13 16:40:31.870361 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:31.870329    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhds4"
Jul 13 16:40:31.870424 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:31.870408    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhds4" podUID="d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf"
Jul 13 16:40:31.871032 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:31.871010    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5xx8s"]
Jul 13 16:40:31.871120 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:31.871102    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5xx8s"
Jul 13 16:40:31.871188 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:31.871168    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5xx8s" podUID="eb203ef3-2445-43bb-a0aa-e5476ac8d12e"
Jul 13 16:40:32.269232 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:32.269204    2573 generic.go:356] "Generic (PLEG): container finished" podID="0209e3f3-bff2-4755-9766-4f0455e937e4" containerID="bfb9e9da0ccf2a05845ab1e7c52322e2664878315119bd1c5728bd1efa36f889" exitCode=0
Jul 13 16:40:32.269615 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:32.269300    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sfcgf" event={"ID":"0209e3f3-bff2-4755-9766-4f0455e937e4","Type":"ContainerDied","Data":"bfb9e9da0ccf2a05845ab1e7c52322e2664878315119bd1c5728bd1efa36f889"}
Jul 13 16:40:33.144524 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:33.144495    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gfcfp"
Jul 13 16:40:33.144698 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:33.144503    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5xx8s"
Jul 13 16:40:33.144698 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:33.144617    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gfcfp" podUID="76ecb854-ac06-45b1-b386-ea01c15fb5e2"
Jul 13 16:40:33.144698 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:33.144655    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5xx8s" podUID="eb203ef3-2445-43bb-a0aa-e5476ac8d12e"
Jul 13 16:40:34.141600 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:34.141527    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhds4"
Jul 13 16:40:34.142179 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:34.141626    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhds4" podUID="d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf"
Jul 13 16:40:34.276495 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:34.276461    2573 generic.go:356] "Generic (PLEG): container finished" podID="0209e3f3-bff2-4755-9766-4f0455e937e4" containerID="5294ef9e06bd649de0b01a4ddcefe940dab9e164dbcce0629ba3d8ea146d81f7" exitCode=0
Jul 13 16:40:34.276641 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:34.276538    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sfcgf" event={"ID":"0209e3f3-bff2-4755-9766-4f0455e937e4","Type":"ContainerDied","Data":"5294ef9e06bd649de0b01a4ddcefe940dab9e164dbcce0629ba3d8ea146d81f7"}
Jul 13 16:40:35.145738 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:35.145696    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gfcfp"
Jul 13 16:40:35.146365 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:35.145698    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5xx8s"
Jul 13 16:40:35.146365 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:35.145856    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gfcfp" podUID="76ecb854-ac06-45b1-b386-ea01c15fb5e2"
Jul 13 16:40:35.146365 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:35.145905    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5xx8s" podUID="eb203ef3-2445-43bb-a0aa-e5476ac8d12e"
Jul 13 16:40:35.929635 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:35.929604    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:36.009661 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:36.009636    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:36.142012 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:36.141981    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhds4"
Jul 13 16:40:36.142176 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:36.142110    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhds4" podUID="d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf"
Jul 13 16:40:36.201751 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:36.201653    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:36.260555 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:36.260490    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:36.578957 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:36.578926    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:36.679302 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:36.679262    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:36.942979 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:36.942903    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76ecb854-ac06-45b1-b386-ea01c15fb5e2-metrics-certs\") pod \"network-metrics-daemon-gfcfp\" (UID: \"76ecb854-ac06-45b1-b386-ea01c15fb5e2\") " pod="openshift-multus/network-metrics-daemon-gfcfp"
Jul 13 16:40:36.942979 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:36.942947    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf-original-pull-secret\") pod \"global-pull-secret-syncer-mhds4\" (UID: \"d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf\") " pod="kube-system/global-pull-secret-syncer-mhds4"
Jul 13 16:40:36.943164 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:36.943068    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 16:40:36.943164 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:36.943136    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76ecb854-ac06-45b1-b386-ea01c15fb5e2-metrics-certs podName:76ecb854-ac06-45b1-b386-ea01c15fb5e2 nodeName:}" failed. No retries permitted until 2026-07-13 16:41:08.943121581 +0000 UTC m=+66.301428387 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/76ecb854-ac06-45b1-b386-ea01c15fb5e2-metrics-certs") pod "network-metrics-daemon-gfcfp" (UID: "76ecb854-ac06-45b1-b386-ea01c15fb5e2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 16:40:36.943257 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:36.943068    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 16:40:36.943257 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:36.943249    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf-original-pull-secret podName:d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf nodeName:}" failed. No retries permitted until 2026-07-13 16:41:08.943226177 +0000 UTC m=+66.301532985 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf-original-pull-secret") pod "global-pull-secret-syncer-mhds4" (UID: "d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf") : object "kube-system"/"original-pull-secret" not registered
Jul 13 16:40:37.042639 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:37.042610    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:37.043651 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:37.043634    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxs9w\" (UniqueName: \"kubernetes.io/projected/eb203ef3-2445-43bb-a0aa-e5476ac8d12e-kube-api-access-jxs9w\") pod \"network-check-target-5xx8s\" (UID: \"eb203ef3-2445-43bb-a0aa-e5476ac8d12e\") " pod="openshift-network-diagnostics/network-check-target-5xx8s"
Jul 13 16:40:37.043763 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:37.043750    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 16:40:37.043808 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:37.043768    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 16:40:37.043808 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:37.043776    2573 projected.go:196] Error preparing data for projected volume kube-api-access-jxs9w for pod openshift-network-diagnostics/network-check-target-5xx8s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 16:40:37.043874 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:37.043836    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb203ef3-2445-43bb-a0aa-e5476ac8d12e-kube-api-access-jxs9w podName:eb203ef3-2445-43bb-a0aa-e5476ac8d12e nodeName:}" failed. No retries permitted until 2026-07-13 16:41:09.043824638 +0000 UTC m=+66.402131440 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jxs9w" (UniqueName: "kubernetes.io/projected/eb203ef3-2445-43bb-a0aa-e5476ac8d12e-kube-api-access-jxs9w") pod "network-check-target-5xx8s" (UID: "eb203ef3-2445-43bb-a0aa-e5476ac8d12e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 16:40:37.140619 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:37.140584    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:37.144484 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:37.144464    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gfcfp"
Jul 13 16:40:37.144584 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:37.144565    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gfcfp" podUID="76ecb854-ac06-45b1-b386-ea01c15fb5e2"
Jul 13 16:40:37.144627 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:37.144590    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5xx8s"
Jul 13 16:40:37.144659 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:37.144636    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5xx8s" podUID="eb203ef3-2445-43bb-a0aa-e5476ac8d12e"
Jul 13 16:40:37.293837 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:37.293805    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q72ql_1a530403-3ff8-4783-a8b2-6ff27c771aff/dns-node-resolver/0.log"
Jul 13 16:40:37.340906 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:37.340842    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:37.440951 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:37.440912    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:37.540321 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:37.540285    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:37.685409 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:37.685321    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:38.099774 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.099746    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hcgx8_2f5f1928-0c10-44c3-a8fb-bcc9b13606fe/node-ca/0.log"
Jul 13 16:40:38.141904 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.141872    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhds4"
Jul 13 16:40:38.142065 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:38.141998    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhds4" podUID="d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf"
Jul 13 16:40:38.418155 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.418079    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-51.ec2.internal" event="NodeReady"
Jul 13 16:40:38.418591 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.418226    2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 13 16:40:38.456175 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.456142    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5759ccdd67-hqwxn"]
Jul 13 16:40:38.485323 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.485299    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-b6bxq"]
Jul 13 16:40:38.485483 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.485430    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5759ccdd67-hqwxn"
Jul 13 16:40:38.488009 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.487986    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 13 16:40:38.488767 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.488748    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6ng2j\""
Jul 13 16:40:38.488891 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.488872    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 13 16:40:38.489004 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.488874    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 13 16:40:38.495738 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.495703    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 13 16:40:38.499211 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.499191    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5df2r"]
Jul 13 16:40:38.499337 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.499314    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b6bxq"
Jul 13 16:40:38.501820 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.501793    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mgdqr\""
Jul 13 16:40:38.501916 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.501796    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 13 16:40:38.501916 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.501904    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 13 16:40:38.517491 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.517467    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5759ccdd67-hqwxn"]
Jul 13 16:40:38.517613 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.517504    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5df2r"]
Jul 13 16:40:38.517613 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.517525    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b6bxq"]
Jul 13 16:40:38.517613 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.517546    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5df2r"
Jul 13 16:40:38.517807 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.517551    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vd6k8"]
Jul 13 16:40:38.520343 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.520321    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 13 16:40:38.520447 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.520323    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 13 16:40:38.520447 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.520372    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-76zsq\""
Jul 13 16:40:38.520447 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.520323    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 13 16:40:38.537764 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.537743    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vd6k8"]
Jul 13 16:40:38.537889 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.537841    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vd6k8"
Jul 13 16:40:38.540709 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.540689    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 13 16:40:38.540833 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.540757    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 13 16:40:38.540833 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.540776    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ntdf5\""
Jul 13 16:40:38.540833 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.540785    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 13 16:40:38.541033 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.540759    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 13 16:40:38.554954 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.554927    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-image-registry-private-configuration\") pod \"image-registry-5759ccdd67-hqwxn\" (UID: \"a72e4071-c03c-44a6-a4b9-fe42565c2ca4\") " pod="openshift-image-registry/image-registry-5759ccdd67-hqwxn"
Jul 13 16:40:38.555059 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.554996    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-registry-certificates\") pod \"image-registry-5759ccdd67-hqwxn\" (UID: \"a72e4071-c03c-44a6-a4b9-fe42565c2ca4\") " pod="openshift-image-registry/image-registry-5759ccdd67-hqwxn"
Jul 13 16:40:38.555059 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.555026    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-installation-pull-secrets\") pod \"image-registry-5759ccdd67-hqwxn\" (UID: \"a72e4071-c03c-44a6-a4b9-fe42565c2ca4\") " pod="openshift-image-registry/image-registry-5759ccdd67-hqwxn"
Jul 13 16:40:38.555059 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.555052    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb5zl\" (UniqueName: \"kubernetes.io/projected/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-kube-api-access-xb5zl\") pod \"image-registry-5759ccdd67-hqwxn\" (UID: \"a72e4071-c03c-44a6-a4b9-fe42565c2ca4\") " pod="openshift-image-registry/image-registry-5759ccdd67-hqwxn"
Jul 13 16:40:38.555193 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.555071    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-registry-tls\") pod \"image-registry-5759ccdd67-hqwxn\" (UID: \"a72e4071-c03c-44a6-a4b9-fe42565c2ca4\") " pod="openshift-image-registry/image-registry-5759ccdd67-hqwxn"
Jul 13 16:40:38.555193 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.555135    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-ca-trust-extracted\") pod \"image-registry-5759ccdd67-hqwxn\" (UID: \"a72e4071-c03c-44a6-a4b9-fe42565c2ca4\") " pod="openshift-image-registry/image-registry-5759ccdd67-hqwxn"
Jul 13 16:40:38.555193 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.555163    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-trusted-ca\") pod \"image-registry-5759ccdd67-hqwxn\" (UID: \"a72e4071-c03c-44a6-a4b9-fe42565c2ca4\") " pod="openshift-image-registry/image-registry-5759ccdd67-hqwxn"
Jul 13 16:40:38.555193 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.555190    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-bound-sa-token\") pod \"image-registry-5759ccdd67-hqwxn\" (UID: \"a72e4071-c03c-44a6-a4b9-fe42565c2ca4\") " pod="openshift-image-registry/image-registry-5759ccdd67-hqwxn"
Jul 13 16:40:38.590243 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.590213    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:38.653072 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.653028    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:38.656012 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.655990    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-image-registry-private-configuration\") pod \"image-registry-5759ccdd67-hqwxn\" (UID: \"a72e4071-c03c-44a6-a4b9-fe42565c2ca4\") " pod="openshift-image-registry/image-registry-5759ccdd67-hqwxn"
Jul 13 16:40:38.656139 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.656026    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsxtn\" (UniqueName: \"kubernetes.io/projected/d7bcf65d-d075-4398-9822-afe9da65a227-kube-api-access-fsxtn\") pod \"ingress-canary-5df2r\" (UID: \"d7bcf65d-d075-4398-9822-afe9da65a227\") " pod="openshift-ingress-canary/ingress-canary-5df2r"
Jul 13 16:40:38.656139 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.656081    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-registry-certificates\") pod \"image-registry-5759ccdd67-hqwxn\" (UID: \"a72e4071-c03c-44a6-a4b9-fe42565c2ca4\") " pod="openshift-image-registry/image-registry-5759ccdd67-hqwxn"
Jul 13 16:40:38.656139 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.656106    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb23cc9b-372e-498c-ac0a-3629e62a6a76-tmp-dir\") pod \"dns-default-b6bxq\" (UID: \"bb23cc9b-372e-498c-ac0a-3629e62a6a76\") " pod="openshift-dns/dns-default-b6bxq"
Jul 13 16:40:38.656139 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.656129    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgktk\" (UniqueName: \"kubernetes.io/projected/bb23cc9b-372e-498c-ac0a-3629e62a6a76-kube-api-access-qgktk\") pod \"dns-default-b6bxq\" (UID: \"bb23cc9b-372e-498c-ac0a-3629e62a6a76\") " pod="openshift-dns/dns-default-b6bxq"
Jul 13 16:40:38.656291 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.656156    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5b79688-1d51-4578-8a99-3df1c0a55218-data-volume\") pod \"insights-runtime-extractor-vd6k8\" (UID: \"e5b79688-1d51-4578-8a99-3df1c0a55218\") " pod="openshift-insights/insights-runtime-extractor-vd6k8"
Jul 13 16:40:38.656291 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.656247    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-installation-pull-secrets\") pod \"image-registry-5759ccdd67-hqwxn\" (UID: \"a72e4071-c03c-44a6-a4b9-fe42565c2ca4\") " pod="openshift-image-registry/image-registry-5759ccdd67-hqwxn"
Jul 13 16:40:38.656384 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.656291    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb5zl\" (UniqueName: \"kubernetes.io/projected/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-kube-api-access-xb5zl\") pod \"image-registry-5759ccdd67-hqwxn\" (UID: \"a72e4071-c03c-44a6-a4b9-fe42565c2ca4\") " pod="openshift-image-registry/image-registry-5759ccdd67-hqwxn"
Jul 13 16:40:38.656384 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.656321    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bb23cc9b-372e-498c-ac0a-3629e62a6a76-config-volume\") pod \"dns-default-b6bxq\" (UID: \"bb23cc9b-372e-498c-ac0a-3629e62a6a76\") " pod="openshift-dns/dns-default-b6bxq"
Jul 13 16:40:38.656384 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.656356    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-registry-tls\") pod \"image-registry-5759ccdd67-hqwxn\" (UID: \"a72e4071-c03c-44a6-a4b9-fe42565c2ca4\") " pod="openshift-image-registry/image-registry-5759ccdd67-hqwxn"
Jul 13 16:40:38.656384 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.656376    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb23cc9b-372e-498c-ac0a-3629e62a6a76-metrics-tls\") pod \"dns-default-b6bxq\" (UID: \"bb23cc9b-372e-498c-ac0a-3629e62a6a76\") " pod="openshift-dns/dns-default-b6bxq"
Jul 13 16:40:38.656538 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.656399    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e5b79688-1d51-4578-8a99-3df1c0a55218-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vd6k8\" (UID: \"e5b79688-1d51-4578-8a99-3df1c0a55218\") " pod="openshift-insights/insights-runtime-extractor-vd6k8"
Jul 13 16:40:38.656538 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.656422    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d7bcf65d-d075-4398-9822-afe9da65a227-cert\") pod \"ingress-canary-5df2r\" (UID: \"d7bcf65d-d075-4398-9822-afe9da65a227\") " pod="openshift-ingress-canary/ingress-canary-5df2r"
Jul 13 16:40:38.656538 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.656442    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twqws\" (UniqueName: \"kubernetes.io/projected/e5b79688-1d51-4578-8a99-3df1c0a55218-kube-api-access-twqws\") pod \"insights-runtime-extractor-vd6k8\" (UID: \"e5b79688-1d51-4578-8a99-3df1c0a55218\") " pod="openshift-insights/insights-runtime-extractor-vd6k8"
Jul 13 16:40:38.656538 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.656484    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-ca-trust-extracted\") pod \"image-registry-5759ccdd67-hqwxn\" (UID: \"a72e4071-c03c-44a6-a4b9-fe42565c2ca4\") " pod="openshift-image-registry/image-registry-5759ccdd67-hqwxn"
Jul 13 16:40:38.656538 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.656517    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e5b79688-1d51-4578-8a99-3df1c0a55218-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vd6k8\" (UID: \"e5b79688-1d51-4578-8a99-3df1c0a55218\") " pod="openshift-insights/insights-runtime-extractor-vd6k8"
Jul 13 16:40:38.656760 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.656542    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-trusted-ca\") pod \"image-registry-5759ccdd67-hqwxn\" (UID: \"a72e4071-c03c-44a6-a4b9-fe42565c2ca4\") " pod="openshift-image-registry/image-registry-5759ccdd67-hqwxn"
Jul 13 16:40:38.656760 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.656562    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-bound-sa-token\") pod \"image-registry-5759ccdd67-hqwxn\" (UID: \"a72e4071-c03c-44a6-a4b9-fe42565c2ca4\") " pod="openshift-image-registry/image-registry-5759ccdd67-hqwxn"
Jul 13 16:40:38.656760 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.656596    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e5b79688-1d51-4578-8a99-3df1c0a55218-crio-socket\") pod \"insights-runtime-extractor-vd6k8\" (UID: \"e5b79688-1d51-4578-8a99-3df1c0a55218\") " pod="openshift-insights/insights-runtime-extractor-vd6k8"
Jul 13 16:40:38.656760 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:38.656693    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 16:40:38.656760 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:38.656709    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5759ccdd67-hqwxn: secret "image-registry-tls" not found
Jul 13 16:40:38.657015 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:38.656783    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-registry-tls podName:a72e4071-c03c-44a6-a4b9-fe42565c2ca4 nodeName:}" failed. No retries permitted until 2026-07-13 16:40:39.156761441 +0000 UTC m=+36.515068247 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-registry-tls") pod "image-registry-5759ccdd67-hqwxn" (UID: "a72e4071-c03c-44a6-a4b9-fe42565c2ca4") : secret "image-registry-tls" not found
Jul 13 16:40:38.657015 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.656810    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-registry-certificates\") pod \"image-registry-5759ccdd67-hqwxn\" (UID: \"a72e4071-c03c-44a6-a4b9-fe42565c2ca4\") " pod="openshift-image-registry/image-registry-5759ccdd67-hqwxn"
Jul 13 16:40:38.657015 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.656939    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-ca-trust-extracted\") pod \"image-registry-5759ccdd67-hqwxn\" (UID: \"a72e4071-c03c-44a6-a4b9-fe42565c2ca4\") " pod="openshift-image-registry/image-registry-5759ccdd67-hqwxn"
Jul 13 16:40:38.657562 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.657542    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-trusted-ca\") pod \"image-registry-5759ccdd67-hqwxn\" (UID: \"a72e4071-c03c-44a6-a4b9-fe42565c2ca4\") " pod="openshift-image-registry/image-registry-5759ccdd67-hqwxn"
Jul 13 16:40:38.660523 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.660411    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-installation-pull-secrets\") pod \"image-registry-5759ccdd67-hqwxn\" (UID: \"a72e4071-c03c-44a6-a4b9-fe42565c2ca4\") " pod="openshift-image-registry/image-registry-5759ccdd67-hqwxn"
Jul 13 16:40:38.660609 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.660434    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-image-registry-private-configuration\") pod \"image-registry-5759ccdd67-hqwxn\" (UID: \"a72e4071-c03c-44a6-a4b9-fe42565c2ca4\") " pod="openshift-image-registry/image-registry-5759ccdd67-hqwxn"
Jul 13 16:40:38.664938 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.664919    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb5zl\" (UniqueName: \"kubernetes.io/projected/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-kube-api-access-xb5zl\") pod \"image-registry-5759ccdd67-hqwxn\" (UID: \"a72e4071-c03c-44a6-a4b9-fe42565c2ca4\") " pod="openshift-image-registry/image-registry-5759ccdd67-hqwxn"
Jul 13 16:40:38.669044 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.668998    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-bound-sa-token\") pod \"image-registry-5759ccdd67-hqwxn\" (UID: \"a72e4071-c03c-44a6-a4b9-fe42565c2ca4\") " pod="openshift-image-registry/image-registry-5759ccdd67-hqwxn"
Jul 13 16:40:38.757173 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.757137    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb23cc9b-372e-498c-ac0a-3629e62a6a76-metrics-tls\") pod \"dns-default-b6bxq\" (UID: \"bb23cc9b-372e-498c-ac0a-3629e62a6a76\") " pod="openshift-dns/dns-default-b6bxq"
Jul 13 16:40:38.757173 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.757175    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e5b79688-1d51-4578-8a99-3df1c0a55218-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vd6k8\" (UID: \"e5b79688-1d51-4578-8a99-3df1c0a55218\") " pod="openshift-insights/insights-runtime-extractor-vd6k8"
Jul 13 16:40:38.757357 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.757196    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d7bcf65d-d075-4398-9822-afe9da65a227-cert\") pod \"ingress-canary-5df2r\" (UID: \"d7bcf65d-d075-4398-9822-afe9da65a227\") " pod="openshift-ingress-canary/ingress-canary-5df2r"
Jul 13 16:40:38.757357 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.757221    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twqws\" (UniqueName: \"kubernetes.io/projected/e5b79688-1d51-4578-8a99-3df1c0a55218-kube-api-access-twqws\") pod \"insights-runtime-extractor-vd6k8\" (UID: \"e5b79688-1d51-4578-8a99-3df1c0a55218\") " pod="openshift-insights/insights-runtime-extractor-vd6k8"
Jul 13 16:40:38.757357 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:38.757298    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 16:40:38.757459 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.757354    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e5b79688-1d51-4578-8a99-3df1c0a55218-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vd6k8\" (UID: \"e5b79688-1d51-4578-8a99-3df1c0a55218\") " pod="openshift-insights/insights-runtime-extractor-vd6k8"
Jul 13 16:40:38.757459 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:38.757371    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb23cc9b-372e-498c-ac0a-3629e62a6a76-metrics-tls podName:bb23cc9b-372e-498c-ac0a-3629e62a6a76 nodeName:}" failed. No retries permitted until 2026-07-13 16:40:39.257351504 +0000 UTC m=+36.615658321 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bb23cc9b-372e-498c-ac0a-3629e62a6a76-metrics-tls") pod "dns-default-b6bxq" (UID: "bb23cc9b-372e-498c-ac0a-3629e62a6a76") : secret "dns-default-metrics-tls" not found
Jul 13 16:40:38.757459 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.757411    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e5b79688-1d51-4578-8a99-3df1c0a55218-crio-socket\") pod \"insights-runtime-extractor-vd6k8\" (UID: \"e5b79688-1d51-4578-8a99-3df1c0a55218\") " pod="openshift-insights/insights-runtime-extractor-vd6k8"
Jul 13 16:40:38.757459 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:38.757436    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 16:40:38.757633 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.757448    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsxtn\" (UniqueName: \"kubernetes.io/projected/d7bcf65d-d075-4398-9822-afe9da65a227-kube-api-access-fsxtn\") pod \"ingress-canary-5df2r\" (UID: \"d7bcf65d-d075-4398-9822-afe9da65a227\") " pod="openshift-ingress-canary/ingress-canary-5df2r"
Jul 13 16:40:38.757633 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:38.757502    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5b79688-1d51-4578-8a99-3df1c0a55218-insights-runtime-extractor-tls podName:e5b79688-1d51-4578-8a99-3df1c0a55218 nodeName:}" failed. No retries permitted until 2026-07-13 16:40:39.257481099 +0000 UTC m=+36.615787921 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e5b79688-1d51-4578-8a99-3df1c0a55218-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vd6k8" (UID: "e5b79688-1d51-4578-8a99-3df1c0a55218") : secret "insights-runtime-extractor-tls" not found
Jul 13 16:40:38.757633 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.757564    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb23cc9b-372e-498c-ac0a-3629e62a6a76-tmp-dir\") pod \"dns-default-b6bxq\" (UID: \"bb23cc9b-372e-498c-ac0a-3629e62a6a76\") " pod="openshift-dns/dns-default-b6bxq"
Jul 13 16:40:38.757633 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.757592    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgktk\" (UniqueName: \"kubernetes.io/projected/bb23cc9b-372e-498c-ac0a-3629e62a6a76-kube-api-access-qgktk\") pod \"dns-default-b6bxq\" (UID: \"bb23cc9b-372e-498c-ac0a-3629e62a6a76\") " pod="openshift-dns/dns-default-b6bxq"
Jul 13 16:40:38.757633 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.757619    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5b79688-1d51-4578-8a99-3df1c0a55218-data-volume\") pod \"insights-runtime-extractor-vd6k8\" (UID: \"e5b79688-1d51-4578-8a99-3df1c0a55218\") " pod="openshift-insights/insights-runtime-extractor-vd6k8"
Jul 13 16:40:38.757881 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.757644    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e5b79688-1d51-4578-8a99-3df1c0a55218-crio-socket\") pod \"insights-runtime-extractor-vd6k8\" (UID: \"e5b79688-1d51-4578-8a99-3df1c0a55218\") " pod="openshift-insights/insights-runtime-extractor-vd6k8"
Jul 13 16:40:38.757881 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.757668    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bb23cc9b-372e-498c-ac0a-3629e62a6a76-config-volume\") pod \"dns-default-b6bxq\" (UID: \"bb23cc9b-372e-498c-ac0a-3629e62a6a76\") " pod="openshift-dns/dns-default-b6bxq"
Jul 13 16:40:38.757881 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.757801    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e5b79688-1d51-4578-8a99-3df1c0a55218-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vd6k8\" (UID: \"e5b79688-1d51-4578-8a99-3df1c0a55218\") " pod="openshift-insights/insights-runtime-extractor-vd6k8"
Jul 13 16:40:38.757881 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.757878    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb23cc9b-372e-498c-ac0a-3629e62a6a76-tmp-dir\") pod \"dns-default-b6bxq\" (UID: \"bb23cc9b-372e-498c-ac0a-3629e62a6a76\") " pod="openshift-dns/dns-default-b6bxq"
Jul 13 16:40:38.758048 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.757906    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5b79688-1d51-4578-8a99-3df1c0a55218-data-volume\") pod \"insights-runtime-extractor-vd6k8\" (UID: \"e5b79688-1d51-4578-8a99-3df1c0a55218\") " pod="openshift-insights/insights-runtime-extractor-vd6k8"
Jul 13 16:40:38.758092 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.758084    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bb23cc9b-372e-498c-ac0a-3629e62a6a76-config-volume\") pod \"dns-default-b6bxq\" (UID: \"bb23cc9b-372e-498c-ac0a-3629e62a6a76\") " pod="openshift-dns/dns-default-b6bxq"
Jul 13 16:40:38.759833 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.759815    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d7bcf65d-d075-4398-9822-afe9da65a227-cert\") pod \"ingress-canary-5df2r\" (UID: \"d7bcf65d-d075-4398-9822-afe9da65a227\") " pod="openshift-ingress-canary/ingress-canary-5df2r"
Jul 13 16:40:38.766222 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.766202    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsxtn\" (UniqueName: \"kubernetes.io/projected/d7bcf65d-d075-4398-9822-afe9da65a227-kube-api-access-fsxtn\") pod \"ingress-canary-5df2r\" (UID: \"d7bcf65d-d075-4398-9822-afe9da65a227\") " pod="openshift-ingress-canary/ingress-canary-5df2r"
Jul 13 16:40:38.766429 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.766412    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twqws\" (UniqueName: \"kubernetes.io/projected/e5b79688-1d51-4578-8a99-3df1c0a55218-kube-api-access-twqws\") pod \"insights-runtime-extractor-vd6k8\" (UID: \"e5b79688-1d51-4578-8a99-3df1c0a55218\") " pod="openshift-insights/insights-runtime-extractor-vd6k8"
Jul 13 16:40:38.766579 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.766563    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgktk\" (UniqueName: \"kubernetes.io/projected/bb23cc9b-372e-498c-ac0a-3629e62a6a76-kube-api-access-qgktk\") pod \"dns-default-b6bxq\" (UID: \"bb23cc9b-372e-498c-ac0a-3629e62a6a76\") " pod="openshift-dns/dns-default-b6bxq"
Jul 13 16:40:38.827091 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.827054    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5df2r"
Jul 13 16:40:38.894091 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.894062    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-p2m8b"]
Jul 13 16:40:38.906174 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.906148    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-p2m8b"]
Jul 13 16:40:38.906302 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.906219    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-p2m8b"
Jul 13 16:40:38.908675 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.908652    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 13 16:40:38.908812 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.908674    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 13 16:40:38.908893 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.908877    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 13 16:40:38.910160 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.910144    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-zn294\""
Jul 13 16:40:38.910500 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.910469    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 13 16:40:38.928313 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.928287    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:38.987363 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:38.987314    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:39.000216 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:39.000192    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5df2r"]
Jul 13 16:40:39.060527 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:39.060501    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1a563711-ac5b-463d-b341-8b67fadede74-signing-key\") pod \"service-ca-79f68b9f4f-p2m8b\" (UID: \"1a563711-ac5b-463d-b341-8b67fadede74\") " pod="openshift-service-ca/service-ca-79f68b9f4f-p2m8b"
Jul 13 16:40:39.060621 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:39.060544    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlhw6\" (UniqueName: \"kubernetes.io/projected/1a563711-ac5b-463d-b341-8b67fadede74-kube-api-access-nlhw6\") pod \"service-ca-79f68b9f4f-p2m8b\" (UID: \"1a563711-ac5b-463d-b341-8b67fadede74\") " pod="openshift-service-ca/service-ca-79f68b9f4f-p2m8b"
Jul 13 16:40:39.060621 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:39.060583    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1a563711-ac5b-463d-b341-8b67fadede74-signing-cabundle\") pod \"service-ca-79f68b9f4f-p2m8b\" (UID: \"1a563711-ac5b-463d-b341-8b67fadede74\") " pod="openshift-service-ca/service-ca-79f68b9f4f-p2m8b"
Jul 13 16:40:39.076591 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:39.076565    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7bcf65d_d075_4398_9822_afe9da65a227.slice/crio-9e009c1645e3b222e6ccfe66ab1e34c995a799c0dbab7f17e15666fcbcd59802 WatchSource:0}: Error finding container 9e009c1645e3b222e6ccfe66ab1e34c995a799c0dbab7f17e15666fcbcd59802: Status 404 returned error can't find the container with id 9e009c1645e3b222e6ccfe66ab1e34c995a799c0dbab7f17e15666fcbcd59802
Jul 13 16:40:39.144195 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:39.144167    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gfcfp"
Jul 13 16:40:39.144370 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:39.144350    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5xx8s"
Jul 13 16:40:39.148288 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:39.148269    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 13 16:40:39.148764 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:39.148749    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-79qpb\""
Jul 13 16:40:39.149181 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:39.149163    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 13 16:40:39.149313 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:39.149261    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 13 16:40:39.149313 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:39.149261    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-whvdd\""
Jul 13 16:40:39.161248 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:39.161226    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1a563711-ac5b-463d-b341-8b67fadede74-signing-key\") pod \"service-ca-79f68b9f4f-p2m8b\" (UID: \"1a563711-ac5b-463d-b341-8b67fadede74\") " pod="openshift-service-ca/service-ca-79f68b9f4f-p2m8b"
Jul 13 16:40:39.161341 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:39.161261    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlhw6\" (UniqueName: \"kubernetes.io/projected/1a563711-ac5b-463d-b341-8b67fadede74-kube-api-access-nlhw6\") pod \"service-ca-79f68b9f4f-p2m8b\" (UID: \"1a563711-ac5b-463d-b341-8b67fadede74\") " pod="openshift-service-ca/service-ca-79f68b9f4f-p2m8b"
Jul 13 16:40:39.161341 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:39.161292    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-registry-tls\") pod \"image-registry-5759ccdd67-hqwxn\" (UID: \"a72e4071-c03c-44a6-a4b9-fe42565c2ca4\") " pod="openshift-image-registry/image-registry-5759ccdd67-hqwxn"
Jul 13 16:40:39.161446 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:39.161388    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 16:40:39.161446 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:39.161401    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5759ccdd67-hqwxn: secret "image-registry-tls" not found
Jul 13 16:40:39.161446 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:39.161410    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1a563711-ac5b-463d-b341-8b67fadede74-signing-cabundle\") pod \"service-ca-79f68b9f4f-p2m8b\" (UID: \"1a563711-ac5b-463d-b341-8b67fadede74\") " pod="openshift-service-ca/service-ca-79f68b9f4f-p2m8b"
Jul 13 16:40:39.161574 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:39.161465    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-registry-tls podName:a72e4071-c03c-44a6-a4b9-fe42565c2ca4 nodeName:}" failed. No retries permitted until 2026-07-13 16:40:40.161445297 +0000 UTC m=+37.519752116 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-registry-tls") pod "image-registry-5759ccdd67-hqwxn" (UID: "a72e4071-c03c-44a6-a4b9-fe42565c2ca4") : secret "image-registry-tls" not found
Jul 13 16:40:39.162100 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:39.162077    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1a563711-ac5b-463d-b341-8b67fadede74-signing-cabundle\") pod \"service-ca-79f68b9f4f-p2m8b\" (UID: \"1a563711-ac5b-463d-b341-8b67fadede74\") " pod="openshift-service-ca/service-ca-79f68b9f4f-p2m8b"
Jul 13 16:40:39.164781 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:39.164763    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1a563711-ac5b-463d-b341-8b67fadede74-signing-key\") pod \"service-ca-79f68b9f4f-p2m8b\" (UID: \"1a563711-ac5b-463d-b341-8b67fadede74\") " pod="openshift-service-ca/service-ca-79f68b9f4f-p2m8b"
Jul 13 16:40:39.175667 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:39.175606    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlhw6\" (UniqueName: \"kubernetes.io/projected/1a563711-ac5b-463d-b341-8b67fadede74-kube-api-access-nlhw6\") pod \"service-ca-79f68b9f4f-p2m8b\" (UID: \"1a563711-ac5b-463d-b341-8b67fadede74\") " pod="openshift-service-ca/service-ca-79f68b9f4f-p2m8b"
Jul 13 16:40:39.215053 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:39.215031    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-p2m8b"
Jul 13 16:40:39.262617 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:39.262583    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb23cc9b-372e-498c-ac0a-3629e62a6a76-metrics-tls\") pod \"dns-default-b6bxq\" (UID: \"bb23cc9b-372e-498c-ac0a-3629e62a6a76\") " pod="openshift-dns/dns-default-b6bxq"
Jul 13 16:40:39.262737 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:39.262629    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e5b79688-1d51-4578-8a99-3df1c0a55218-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vd6k8\" (UID: \"e5b79688-1d51-4578-8a99-3df1c0a55218\") " pod="openshift-insights/insights-runtime-extractor-vd6k8"
Jul 13 16:40:39.262796 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:39.262746    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 16:40:39.262796 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:39.262756    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 16:40:39.262921 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:39.262800    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5b79688-1d51-4578-8a99-3df1c0a55218-insights-runtime-extractor-tls podName:e5b79688-1d51-4578-8a99-3df1c0a55218 nodeName:}" failed. No retries permitted until 2026-07-13 16:40:40.262784942 +0000 UTC m=+37.621091761 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e5b79688-1d51-4578-8a99-3df1c0a55218-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vd6k8" (UID: "e5b79688-1d51-4578-8a99-3df1c0a55218") : secret "insights-runtime-extractor-tls" not found
Jul 13 16:40:39.262921 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:39.262834    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb23cc9b-372e-498c-ac0a-3629e62a6a76-metrics-tls podName:bb23cc9b-372e-498c-ac0a-3629e62a6a76 nodeName:}" failed. No retries permitted until 2026-07-13 16:40:40.262815351 +0000 UTC m=+37.621122179 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bb23cc9b-372e-498c-ac0a-3629e62a6a76-metrics-tls") pod "dns-default-b6bxq" (UID: "bb23cc9b-372e-498c-ac0a-3629e62a6a76") : secret "dns-default-metrics-tls" not found
Jul 13 16:40:39.292600 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:39.292565    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sfcgf" event={"ID":"0209e3f3-bff2-4755-9766-4f0455e937e4","Type":"ContainerStarted","Data":"399f29376227f3b7c6880905ed17022e196c8056c50b14b2c8a01258262e960f"}
Jul 13 16:40:39.295554 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:39.295372    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5df2r" event={"ID":"d7bcf65d-d075-4398-9822-afe9da65a227","Type":"ContainerStarted","Data":"9e009c1645e3b222e6ccfe66ab1e34c995a799c0dbab7f17e15666fcbcd59802"}
Jul 13 16:40:39.384956 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:39.384926    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-p2m8b"]
Jul 13 16:40:39.427786 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:39.427587    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a563711_ac5b_463d_b341_8b67fadede74.slice/crio-c80249b1423f9a2ea5ac3d6c5306781e3934217e65462e23455f8a1dbc656505 WatchSource:0}: Error finding container c80249b1423f9a2ea5ac3d6c5306781e3934217e65462e23455f8a1dbc656505: Status 404 returned error can't find the container with id c80249b1423f9a2ea5ac3d6c5306781e3934217e65462e23455f8a1dbc656505
Jul 13 16:40:40.141939 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:40.141908    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhds4"
Jul 13 16:40:40.145042 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:40.145016    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 13 16:40:40.169829 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:40.169798    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-registry-tls\") pod \"image-registry-5759ccdd67-hqwxn\" (UID: \"a72e4071-c03c-44a6-a4b9-fe42565c2ca4\") " pod="openshift-image-registry/image-registry-5759ccdd67-hqwxn"
Jul 13 16:40:40.169993 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:40.169974    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 16:40:40.169993 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:40.169991    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5759ccdd67-hqwxn: secret "image-registry-tls" not found
Jul 13 16:40:40.170105 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:40.170050    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-registry-tls podName:a72e4071-c03c-44a6-a4b9-fe42565c2ca4 nodeName:}" failed. No retries permitted until 2026-07-13 16:40:42.170029401 +0000 UTC m=+39.528336224 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-registry-tls") pod "image-registry-5759ccdd67-hqwxn" (UID: "a72e4071-c03c-44a6-a4b9-fe42565c2ca4") : secret "image-registry-tls" not found
Jul 13 16:40:40.270825 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:40.270788    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb23cc9b-372e-498c-ac0a-3629e62a6a76-metrics-tls\") pod \"dns-default-b6bxq\" (UID: \"bb23cc9b-372e-498c-ac0a-3629e62a6a76\") " pod="openshift-dns/dns-default-b6bxq"
Jul 13 16:40:40.270980 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:40.270847    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e5b79688-1d51-4578-8a99-3df1c0a55218-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vd6k8\" (UID: \"e5b79688-1d51-4578-8a99-3df1c0a55218\") " pod="openshift-insights/insights-runtime-extractor-vd6k8"
Jul 13 16:40:40.270980 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:40.270963    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 16:40:40.270980 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:40.270976    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 16:40:40.271142 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:40.271041    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb23cc9b-372e-498c-ac0a-3629e62a6a76-metrics-tls podName:bb23cc9b-372e-498c-ac0a-3629e62a6a76 nodeName:}" failed. No retries permitted until 2026-07-13 16:40:42.271021327 +0000 UTC m=+39.629328131 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bb23cc9b-372e-498c-ac0a-3629e62a6a76-metrics-tls") pod "dns-default-b6bxq" (UID: "bb23cc9b-372e-498c-ac0a-3629e62a6a76") : secret "dns-default-metrics-tls" not found
Jul 13 16:40:40.271142 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:40.271061    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5b79688-1d51-4578-8a99-3df1c0a55218-insights-runtime-extractor-tls podName:e5b79688-1d51-4578-8a99-3df1c0a55218 nodeName:}" failed. No retries permitted until 2026-07-13 16:40:42.271052587 +0000 UTC m=+39.629359394 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e5b79688-1d51-4578-8a99-3df1c0a55218-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vd6k8" (UID: "e5b79688-1d51-4578-8a99-3df1c0a55218") : secret "insights-runtime-extractor-tls" not found
Jul 13 16:40:40.298341 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:40.298310    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:40.299307 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:40.299248    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-p2m8b" event={"ID":"1a563711-ac5b-463d-b341-8b67fadede74","Type":"ContainerStarted","Data":"c80249b1423f9a2ea5ac3d6c5306781e3934217e65462e23455f8a1dbc656505"}
Jul 13 16:40:40.302395 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:40.302369    2573 generic.go:356] "Generic (PLEG): container finished" podID="0209e3f3-bff2-4755-9766-4f0455e937e4" containerID="399f29376227f3b7c6880905ed17022e196c8056c50b14b2c8a01258262e960f" exitCode=0
Jul 13 16:40:40.302490 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:40.302417    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sfcgf" event={"ID":"0209e3f3-bff2-4755-9766-4f0455e937e4","Type":"ContainerDied","Data":"399f29376227f3b7c6880905ed17022e196c8056c50b14b2c8a01258262e960f"}
Jul 13 16:40:41.308307 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:41.308268    2573 generic.go:356] "Generic (PLEG): container finished" podID="0209e3f3-bff2-4755-9766-4f0455e937e4" containerID="42c567039b8f35adfe1456a03ce0b009f65323bfcb0172b0973c5acc47257a0f" exitCode=0
Jul 13 16:40:41.308834 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:41.308341    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sfcgf" event={"ID":"0209e3f3-bff2-4755-9766-4f0455e937e4","Type":"ContainerDied","Data":"42c567039b8f35adfe1456a03ce0b009f65323bfcb0172b0973c5acc47257a0f"}
Jul 13 16:40:42.022846 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:42.022806    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:42.108624 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:42.108592    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:42.187251 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:42.187220    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-registry-tls\") pod \"image-registry-5759ccdd67-hqwxn\" (UID: \"a72e4071-c03c-44a6-a4b9-fe42565c2ca4\") " pod="openshift-image-registry/image-registry-5759ccdd67-hqwxn"
Jul 13 16:40:42.187395 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:42.187339    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 16:40:42.187395 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:42.187353    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5759ccdd67-hqwxn: secret "image-registry-tls" not found
Jul 13 16:40:42.187462 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:42.187406    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-registry-tls podName:a72e4071-c03c-44a6-a4b9-fe42565c2ca4 nodeName:}" failed. No retries permitted until 2026-07-13 16:40:46.187389548 +0000 UTC m=+43.545696353 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-registry-tls") pod "image-registry-5759ccdd67-hqwxn" (UID: "a72e4071-c03c-44a6-a4b9-fe42565c2ca4") : secret "image-registry-tls" not found
Jul 13 16:40:42.288499 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:42.288444    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb23cc9b-372e-498c-ac0a-3629e62a6a76-metrics-tls\") pod \"dns-default-b6bxq\" (UID: \"bb23cc9b-372e-498c-ac0a-3629e62a6a76\") " pod="openshift-dns/dns-default-b6bxq"
Jul 13 16:40:42.288499 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:42.288493    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e5b79688-1d51-4578-8a99-3df1c0a55218-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vd6k8\" (UID: \"e5b79688-1d51-4578-8a99-3df1c0a55218\") " pod="openshift-insights/insights-runtime-extractor-vd6k8"
Jul 13 16:40:42.288626 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:42.288578    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 16:40:42.288663 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:42.288634    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb23cc9b-372e-498c-ac0a-3629e62a6a76-metrics-tls podName:bb23cc9b-372e-498c-ac0a-3629e62a6a76 nodeName:}" failed. No retries permitted until 2026-07-13 16:40:46.288619764 +0000 UTC m=+43.646926567 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bb23cc9b-372e-498c-ac0a-3629e62a6a76-metrics-tls") pod "dns-default-b6bxq" (UID: "bb23cc9b-372e-498c-ac0a-3629e62a6a76") : secret "dns-default-metrics-tls" not found
Jul 13 16:40:42.288703 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:42.288582    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 16:40:42.288756 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:42.288714    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5b79688-1d51-4578-8a99-3df1c0a55218-insights-runtime-extractor-tls podName:e5b79688-1d51-4578-8a99-3df1c0a55218 nodeName:}" failed. No retries permitted until 2026-07-13 16:40:46.288701742 +0000 UTC m=+43.647008559 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e5b79688-1d51-4578-8a99-3df1c0a55218-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vd6k8" (UID: "e5b79688-1d51-4578-8a99-3df1c0a55218") : secret "insights-runtime-extractor-tls" not found
Jul 13 16:40:43.192704 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:43.192669    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:43.314263 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:43.314219    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5df2r" event={"ID":"d7bcf65d-d075-4398-9822-afe9da65a227","Type":"ContainerStarted","Data":"e1047548d794299724da66f678158c23bbc0e94141f8488cc0bbe445f610ecf9"}
Jul 13 16:40:43.315768 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:43.315742    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-p2m8b" event={"ID":"1a563711-ac5b-463d-b341-8b67fadede74","Type":"ContainerStarted","Data":"8b0275ececc1569540d0bd424cadbb5e937480b70a32bc84782cafa158efee32"}
Jul 13 16:40:43.318959 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:43.318938    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sfcgf" event={"ID":"0209e3f3-bff2-4755-9766-4f0455e937e4","Type":"ContainerStarted","Data":"84f02272ca0f75eda3bd56027af3fe15a17d40bf635c3eb3d9218ef67981612e"}
Jul 13 16:40:43.333807 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:43.333716    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5df2r" podStartSLOduration=1.800729317 podStartE2EDuration="5.333701791s" totalImagesPullingTime="3.532972474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:40:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:40:43.332990365 +0000 UTC m=+40.691297190" watchObservedRunningTime="2026-07-13 16:40:43.333701791 +0000 UTC m=+40.692008615"
Jul 13 16:40:43.355913 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:43.355873    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-sfcgf" podStartSLOduration=9.660736446 podStartE2EDuration="40.355859666s" totalImagesPullingTime="30.69512322s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 16:40:03 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:40:43.35488062 +0000 UTC m=+40.713187446" watchObservedRunningTime="2026-07-13 16:40:43.355859666 +0000 UTC m=+40.714166490"
Jul 13 16:40:43.371954 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:43.371911    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-p2m8b" podStartSLOduration=2.166930763 podStartE2EDuration="5.37189797s" totalImagesPullingTime="3.204967207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:40:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:40:43.371367244 +0000 UTC m=+40.729674070" watchObservedRunningTime="2026-07-13 16:40:43.37189797 +0000 UTC m=+40.730204802"
Jul 13 16:40:43.872802 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:43.872771    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:44.046971 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:44.046938    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:44.143412 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:44.143322    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:44.218211 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:44.218177    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:44.291369 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:44.291338    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:44.491173 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:44.491141    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:44.945289 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:44.945213    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:45.537458 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:45.537419    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:45.938919 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:45.938845    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:46.220550 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:46.220517    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-registry-tls\") pod \"image-registry-5759ccdd67-hqwxn\" (UID: \"a72e4071-c03c-44a6-a4b9-fe42565c2ca4\") " pod="openshift-image-registry/image-registry-5759ccdd67-hqwxn"
Jul 13 16:40:46.220706 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:46.220669    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 16:40:46.220706 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:46.220685    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5759ccdd67-hqwxn: secret "image-registry-tls" not found
Jul 13 16:40:46.220798 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:46.220759    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-registry-tls podName:a72e4071-c03c-44a6-a4b9-fe42565c2ca4 nodeName:}" failed. No retries permitted until 2026-07-13 16:40:54.220740688 +0000 UTC m=+51.579047507 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-registry-tls") pod "image-registry-5759ccdd67-hqwxn" (UID: "a72e4071-c03c-44a6-a4b9-fe42565c2ca4") : secret "image-registry-tls" not found
Jul 13 16:40:46.321192 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:46.321162    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb23cc9b-372e-498c-ac0a-3629e62a6a76-metrics-tls\") pod \"dns-default-b6bxq\" (UID: \"bb23cc9b-372e-498c-ac0a-3629e62a6a76\") " pod="openshift-dns/dns-default-b6bxq"
Jul 13 16:40:46.321336 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:46.321204    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e5b79688-1d51-4578-8a99-3df1c0a55218-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vd6k8\" (UID: \"e5b79688-1d51-4578-8a99-3df1c0a55218\") " pod="openshift-insights/insights-runtime-extractor-vd6k8"
Jul 13 16:40:46.321379 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:46.321337    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 16:40:46.321379 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:46.321352    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 16:40:46.321434 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:46.321418    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb23cc9b-372e-498c-ac0a-3629e62a6a76-metrics-tls podName:bb23cc9b-372e-498c-ac0a-3629e62a6a76 nodeName:}" failed. No retries permitted until 2026-07-13 16:40:54.321397462 +0000 UTC m=+51.679704271 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bb23cc9b-372e-498c-ac0a-3629e62a6a76-metrics-tls") pod "dns-default-b6bxq" (UID: "bb23cc9b-372e-498c-ac0a-3629e62a6a76") : secret "dns-default-metrics-tls" not found
Jul 13 16:40:46.321471 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:40:46.321442    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5b79688-1d51-4578-8a99-3df1c0a55218-insights-runtime-extractor-tls podName:e5b79688-1d51-4578-8a99-3df1c0a55218 nodeName:}" failed. No retries permitted until 2026-07-13 16:40:54.321433027 +0000 UTC m=+51.679739834 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e5b79688-1d51-4578-8a99-3df1c0a55218-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vd6k8" (UID: "e5b79688-1d51-4578-8a99-3df1c0a55218") : secret "insights-runtime-extractor-tls" not found
Jul 13 16:40:46.343048 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:46.343015    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:46.738537 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:46.738507    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:46.940674 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:46.940628    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:47.337363 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:47.337325    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:47.739247 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:47.739220    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:47.840059 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:47.840030    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:48.135091 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:48.135018    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:48.545592 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:48.545561    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:48.606430 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:48.606394    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:48.756123 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:48.756094    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:49.428372 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:49.428345    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:49.528349 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:49.528320    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:49.941372 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:49.941336    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:50.269301 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:50.269264    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:50.378043 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:50.378015    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:50.815196 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:50.815165    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:51.143942 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:51.143859    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:51.348145 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:51.348109    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:51.748062 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:51.748033    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:52.425435 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:52.425402    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:52.539857 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:52.539824    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:52.744997 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:52.744966    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:52.943263 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:52.943236    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:53.339443 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:53.339412    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:53.796309 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:53.796283    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:53.899360 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:53.899335    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:53.998433 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:53.998396    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:54.101145 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:54.101075    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:54.285320 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:54.285272    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-registry-tls\") pod \"image-registry-5759ccdd67-hqwxn\" (UID: \"a72e4071-c03c-44a6-a4b9-fe42565c2ca4\") " pod="openshift-image-registry/image-registry-5759ccdd67-hqwxn"
Jul 13 16:40:54.288584 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:54.288552    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-registry-tls\") pod \"image-registry-5759ccdd67-hqwxn\" (UID: \"a72e4071-c03c-44a6-a4b9-fe42565c2ca4\") " pod="openshift-image-registry/image-registry-5759ccdd67-hqwxn"
Jul 13 16:40:54.338948 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:54.338921    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:54.386191 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:54.386129    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb23cc9b-372e-498c-ac0a-3629e62a6a76-metrics-tls\") pod \"dns-default-b6bxq\" (UID: \"bb23cc9b-372e-498c-ac0a-3629e62a6a76\") " pod="openshift-dns/dns-default-b6bxq"
Jul 13 16:40:54.386191 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:54.386168    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e5b79688-1d51-4578-8a99-3df1c0a55218-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vd6k8\" (UID: \"e5b79688-1d51-4578-8a99-3df1c0a55218\") " pod="openshift-insights/insights-runtime-extractor-vd6k8"
Jul 13 16:40:54.388484 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:54.388463    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e5b79688-1d51-4578-8a99-3df1c0a55218-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vd6k8\" (UID: \"e5b79688-1d51-4578-8a99-3df1c0a55218\") " pod="openshift-insights/insights-runtime-extractor-vd6k8"
Jul 13 16:40:54.388573 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:54.388473    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb23cc9b-372e-498c-ac0a-3629e62a6a76-metrics-tls\") pod \"dns-default-b6bxq\" (UID: \"bb23cc9b-372e-498c-ac0a-3629e62a6a76\") " pod="openshift-dns/dns-default-b6bxq"
Jul 13 16:40:54.400544 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:54.400525    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5759ccdd67-hqwxn"
Jul 13 16:40:54.408301 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:54.408286    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b6bxq"
Jul 13 16:40:54.448161 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:54.448108    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vd6k8"
Jul 13 16:40:54.459516 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:54.459417    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:54.539760 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:54.539709    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5759ccdd67-hqwxn"]
Jul 13 16:40:54.543802 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:54.543776    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda72e4071_c03c_44a6_a4b9_fe42565c2ca4.slice/crio-288225c3010df7c5af63f2cd7d1fde3c0b1232ae58e0df2a0b4cf4e32e86d0b5 WatchSource:0}: Error finding container 288225c3010df7c5af63f2cd7d1fde3c0b1232ae58e0df2a0b4cf4e32e86d0b5: Status 404 returned error can't find the container with id 288225c3010df7c5af63f2cd7d1fde3c0b1232ae58e0df2a0b4cf4e32e86d0b5
Jul 13 16:40:54.556068 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:54.556037    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b6bxq"]
Jul 13 16:40:54.560237 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:54.560205    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb23cc9b_372e_498c_ac0a_3629e62a6a76.slice/crio-59cc2390ef93511e75d7891e4dfe3e320a69c455a3bcdbce9f3ea12850e9cf0b WatchSource:0}: Error finding container 59cc2390ef93511e75d7891e4dfe3e320a69c455a3bcdbce9f3ea12850e9cf0b: Status 404 returned error can't find the container with id 59cc2390ef93511e75d7891e4dfe3e320a69c455a3bcdbce9f3ea12850e9cf0b
Jul 13 16:40:54.576417 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:54.576391    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vd6k8"]
Jul 13 16:40:54.579593 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:40:54.579568    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5b79688_1d51_4578_8a99_3df1c0a55218.slice/crio-e93983331ae5637c7255fc3a9d18df0edc85748756c985ffd5bc91bad6d97ab7 WatchSource:0}: Error finding container e93983331ae5637c7255fc3a9d18df0edc85748756c985ffd5bc91bad6d97ab7: Status 404 returned error can't find the container with id e93983331ae5637c7255fc3a9d18df0edc85748756c985ffd5bc91bad6d97ab7
Jul 13 16:40:54.923071 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:54.923042    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:55.022561 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:55.022536    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:55.122027 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:55.121998    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:55.177247 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:55.177153    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:55.292217 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:55.292138    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:55.351607 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:55.351533    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b6bxq" event={"ID":"bb23cc9b-372e-498c-ac0a-3629e62a6a76","Type":"ContainerStarted","Data":"59cc2390ef93511e75d7891e4dfe3e320a69c455a3bcdbce9f3ea12850e9cf0b"}
Jul 13 16:40:55.354925 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:55.354786    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5759ccdd67-hqwxn" event={"ID":"a72e4071-c03c-44a6-a4b9-fe42565c2ca4","Type":"ContainerStarted","Data":"361de23f8be1c5c393132b74c8517624db976740447a0c81e5e399c7cf545d7f"}
Jul 13 16:40:55.354925 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:55.354840    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5759ccdd67-hqwxn" event={"ID":"a72e4071-c03c-44a6-a4b9-fe42565c2ca4","Type":"ContainerStarted","Data":"288225c3010df7c5af63f2cd7d1fde3c0b1232ae58e0df2a0b4cf4e32e86d0b5"}
Jul 13 16:40:55.354925 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:55.354893    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5759ccdd67-hqwxn"
Jul 13 16:40:55.357228 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:55.357133    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vd6k8" event={"ID":"e5b79688-1d51-4578-8a99-3df1c0a55218","Type":"ContainerStarted","Data":"e93983331ae5637c7255fc3a9d18df0edc85748756c985ffd5bc91bad6d97ab7"}
Jul 13 16:40:55.375598 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:55.375286    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5759ccdd67-hqwxn" podStartSLOduration=27.375267801 podStartE2EDuration="27.375267801s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:40:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:40:55.373768665 +0000 UTC m=+52.732075491" watchObservedRunningTime="2026-07-13 16:40:55.375267801 +0000 UTC m=+52.733574627"
Jul 13 16:40:55.378162 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:55.378112    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:55.481244 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:55.481111    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:55.703940 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:55.703844    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:55.804468 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:55.804391    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:57.015443 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:57.015412    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:57.115838 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:57.115805    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:57.175886 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:57.175851    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:40:59.370133 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:59.370099    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vd6k8" event={"ID":"e5b79688-1d51-4578-8a99-3df1c0a55218","Type":"ContainerStarted","Data":"c543562a353de9db23fb3e8e4f8d84840b557aeac1161d86831914275ab24a15"}
Jul 13 16:40:59.371712 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:59.371685    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b6bxq" event={"ID":"bb23cc9b-372e-498c-ac0a-3629e62a6a76","Type":"ContainerStarted","Data":"0058c61fe5247ff52b6d36a195997ad2c4755321e289e23fd6ca8553b37a81ae"}
Jul 13 16:40:59.371852 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:59.371749    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b6bxq" event={"ID":"bb23cc9b-372e-498c-ac0a-3629e62a6a76","Type":"ContainerStarted","Data":"efb934215284c4d5c0dca03775c9bb2a61f6f6bd7b26b5f6bdf684fdaa974ed9"}
Jul 13 16:40:59.371913 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:59.371901    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-b6bxq"
Jul 13 16:40:59.391084 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:40:59.391036    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-b6bxq" podStartSLOduration=17.338877359 podStartE2EDuration="21.391019916s" totalImagesPullingTime="4.052142557s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:40:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:40:59.389589072 +0000 UTC m=+56.747895898" watchObservedRunningTime="2026-07-13 16:40:59.391019916 +0000 UTC m=+56.749326741"
Jul 13 16:41:00.376456 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:00.376425    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vd6k8" event={"ID":"e5b79688-1d51-4578-8a99-3df1c0a55218","Type":"ContainerStarted","Data":"0e81f733968aa90e30df492f1db36cb8a1aab3fa1c3d3ddf0ecf86d00f4664e3"}
Jul 13 16:41:01.983890 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:01.983856    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f68f8748b-xvs72"]
Jul 13 16:41:01.986836 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:01.986812    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f68f8748b-xvs72"
Jul 13 16:41:01.989338 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:01.989314    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 13 16:41:01.990417 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:01.990379    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 13 16:41:01.990972 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:01.990792    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 13 16:41:01.990972 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:01.990919    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 13 16:41:01.991835 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:01.991818    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f985d7868-q6xnd"]
Jul 13 16:41:01.993885 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:01.993866    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f657cb5c8-tc8wz"]
Jul 13 16:41:01.994032 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:01.994013    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f985d7868-q6xnd"
Jul 13 16:41:01.995629 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:01.995609    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f657cb5c8-tc8wz"
Jul 13 16:41:01.998776 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:01.998757    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 13 16:41:01.999141 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:01.999123    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 13 16:41:01.999348 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:01.999335    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-fzmxp\""
Jul 13 16:41:01.999609 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:01.999591    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 13 16:41:01.999700 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:01.999618    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 13 16:41:02.000544 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.000514    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 13 16:41:02.006602 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.006534    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f68f8748b-xvs72"]
Jul 13 16:41:02.008317 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.008280    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f657cb5c8-tc8wz"]
Jul 13 16:41:02.027657 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.027630    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f985d7868-q6xnd"]
Jul 13 16:41:02.028772 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.028753    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5759ccdd67-hqwxn"]
Jul 13 16:41:02.089619 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.089586    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:02.090903 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.090874    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7d9b796d7f-mbznk"]
Jul 13 16:41:02.092864 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.092846    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d9b796d7f-mbznk"
Jul 13 16:41:02.115556 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.115533    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d9b796d7f-mbznk"]
Jul 13 16:41:02.147354 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.147325    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqp52\" (UniqueName: \"kubernetes.io/projected/be505c25-b426-45d1-812c-348a484f57f0-kube-api-access-gqp52\") pod \"cluster-proxy-proxy-agent-7f985d7868-q6xnd\" (UID: \"be505c25-b426-45d1-812c-348a484f57f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f985d7868-q6xnd"
Jul 13 16:41:02.147498 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.147374    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/be505c25-b426-45d1-812c-348a484f57f0-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7f985d7868-q6xnd\" (UID: \"be505c25-b426-45d1-812c-348a484f57f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f985d7868-q6xnd"
Jul 13 16:41:02.147570 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.147498    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/be505c25-b426-45d1-812c-348a484f57f0-hub\") pod \"cluster-proxy-proxy-agent-7f985d7868-q6xnd\" (UID: \"be505c25-b426-45d1-812c-348a484f57f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f985d7868-q6xnd"
Jul 13 16:41:02.147570 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.147536    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mc5f\" (UniqueName: \"kubernetes.io/projected/bac48843-f8ff-4c2f-ae15-1aa50abbabf9-kube-api-access-5mc5f\") pod \"klusterlet-addon-workmgr-6f68f8748b-xvs72\" (UID: \"bac48843-f8ff-4c2f-ae15-1aa50abbabf9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f68f8748b-xvs72"
Jul 13 16:41:02.147681 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.147583    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bac48843-f8ff-4c2f-ae15-1aa50abbabf9-klusterlet-config\") pod \"klusterlet-addon-workmgr-6f68f8748b-xvs72\" (UID: \"bac48843-f8ff-4c2f-ae15-1aa50abbabf9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f68f8748b-xvs72"
Jul 13 16:41:02.147681 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.147612    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2491d326-8a60-4cb3-9b69-53411f853fa7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6f657cb5c8-tc8wz\" (UID: \"2491d326-8a60-4cb3-9b69-53411f853fa7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f657cb5c8-tc8wz"
Jul 13 16:41:02.147681 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.147662    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/be505c25-b426-45d1-812c-348a484f57f0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7f985d7868-q6xnd\" (UID: \"be505c25-b426-45d1-812c-348a484f57f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f985d7868-q6xnd"
Jul 13 16:41:02.147846 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.147695    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/be505c25-b426-45d1-812c-348a484f57f0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7f985d7868-q6xnd\" (UID: \"be505c25-b426-45d1-812c-348a484f57f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f985d7868-q6xnd"
Jul 13 16:41:02.147846 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.147769    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/be505c25-b426-45d1-812c-348a484f57f0-ca\") pod \"cluster-proxy-proxy-agent-7f985d7868-q6xnd\" (UID: \"be505c25-b426-45d1-812c-348a484f57f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f985d7868-q6xnd"
Jul 13 16:41:02.147846 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.147807    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bac48843-f8ff-4c2f-ae15-1aa50abbabf9-tmp\") pod \"klusterlet-addon-workmgr-6f68f8748b-xvs72\" (UID: \"bac48843-f8ff-4c2f-ae15-1aa50abbabf9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f68f8748b-xvs72"
Jul 13 16:41:02.147991 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.147845    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6528\" (UniqueName: \"kubernetes.io/projected/2491d326-8a60-4cb3-9b69-53411f853fa7-kube-api-access-s6528\") pod \"managed-serviceaccount-addon-agent-6f657cb5c8-tc8wz\" (UID: \"2491d326-8a60-4cb3-9b69-53411f853fa7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f657cb5c8-tc8wz"
Jul 13 16:41:02.174551 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.174517    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:02.248414 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.248329    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqp52\" (UniqueName: \"kubernetes.io/projected/be505c25-b426-45d1-812c-348a484f57f0-kube-api-access-gqp52\") pod \"cluster-proxy-proxy-agent-7f985d7868-q6xnd\" (UID: \"be505c25-b426-45d1-812c-348a484f57f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f985d7868-q6xnd"
Jul 13 16:41:02.248414 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.248380    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/19c39259-8805-4c8c-90b3-14573e27468b-bound-sa-token\") pod \"image-registry-7d9b796d7f-mbznk\" (UID: \"19c39259-8805-4c8c-90b3-14573e27468b\") " pod="openshift-image-registry/image-registry-7d9b796d7f-mbznk"
Jul 13 16:41:02.248622 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.248529    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/19c39259-8805-4c8c-90b3-14573e27468b-image-registry-private-configuration\") pod \"image-registry-7d9b796d7f-mbznk\" (UID: \"19c39259-8805-4c8c-90b3-14573e27468b\") " pod="openshift-image-registry/image-registry-7d9b796d7f-mbznk"
Jul 13 16:41:02.248622 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.248571    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/be505c25-b426-45d1-812c-348a484f57f0-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7f985d7868-q6xnd\" (UID: \"be505c25-b426-45d1-812c-348a484f57f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f985d7868-q6xnd"
Jul 13 16:41:02.248743 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.248640    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/19c39259-8805-4c8c-90b3-14573e27468b-trusted-ca\") pod \"image-registry-7d9b796d7f-mbznk\" (UID: \"19c39259-8805-4c8c-90b3-14573e27468b\") " pod="openshift-image-registry/image-registry-7d9b796d7f-mbznk"
Jul 13 16:41:02.248743 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.248686    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/be505c25-b426-45d1-812c-348a484f57f0-hub\") pod \"cluster-proxy-proxy-agent-7f985d7868-q6xnd\" (UID: \"be505c25-b426-45d1-812c-348a484f57f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f985d7868-q6xnd"
Jul 13 16:41:02.248743 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.248709    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/19c39259-8805-4c8c-90b3-14573e27468b-registry-certificates\") pod \"image-registry-7d9b796d7f-mbznk\" (UID: \"19c39259-8805-4c8c-90b3-14573e27468b\") " pod="openshift-image-registry/image-registry-7d9b796d7f-mbznk"
Jul 13 16:41:02.248902 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.248757    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mc5f\" (UniqueName: \"kubernetes.io/projected/bac48843-f8ff-4c2f-ae15-1aa50abbabf9-kube-api-access-5mc5f\") pod \"klusterlet-addon-workmgr-6f68f8748b-xvs72\" (UID: \"bac48843-f8ff-4c2f-ae15-1aa50abbabf9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f68f8748b-xvs72"
Jul 13 16:41:02.248902 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.248804    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bac48843-f8ff-4c2f-ae15-1aa50abbabf9-klusterlet-config\") pod \"klusterlet-addon-workmgr-6f68f8748b-xvs72\" (UID: \"bac48843-f8ff-4c2f-ae15-1aa50abbabf9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f68f8748b-xvs72"
Jul 13 16:41:02.248902 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.248831    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2491d326-8a60-4cb3-9b69-53411f853fa7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6f657cb5c8-tc8wz\" (UID: \"2491d326-8a60-4cb3-9b69-53411f853fa7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f657cb5c8-tc8wz"
Jul 13 16:41:02.248902 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.248863    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/be505c25-b426-45d1-812c-348a484f57f0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7f985d7868-q6xnd\" (UID: \"be505c25-b426-45d1-812c-348a484f57f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f985d7868-q6xnd"
Jul 13 16:41:02.248902 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.248893    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/19c39259-8805-4c8c-90b3-14573e27468b-registry-tls\") pod \"image-registry-7d9b796d7f-mbznk\" (UID: \"19c39259-8805-4c8c-90b3-14573e27468b\") " pod="openshift-image-registry/image-registry-7d9b796d7f-mbznk"
Jul 13 16:41:02.249154 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.248925    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/be505c25-b426-45d1-812c-348a484f57f0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7f985d7868-q6xnd\" (UID: \"be505c25-b426-45d1-812c-348a484f57f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f985d7868-q6xnd"
Jul 13 16:41:02.249154 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.248955    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqltq\" (UniqueName: \"kubernetes.io/projected/19c39259-8805-4c8c-90b3-14573e27468b-kube-api-access-dqltq\") pod \"image-registry-7d9b796d7f-mbznk\" (UID: \"19c39259-8805-4c8c-90b3-14573e27468b\") " pod="openshift-image-registry/image-registry-7d9b796d7f-mbznk"
Jul 13 16:41:02.249154 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.248990    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/be505c25-b426-45d1-812c-348a484f57f0-ca\") pod \"cluster-proxy-proxy-agent-7f985d7868-q6xnd\" (UID: \"be505c25-b426-45d1-812c-348a484f57f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f985d7868-q6xnd"
Jul 13 16:41:02.249154 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.249015    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bac48843-f8ff-4c2f-ae15-1aa50abbabf9-tmp\") pod \"klusterlet-addon-workmgr-6f68f8748b-xvs72\" (UID: \"bac48843-f8ff-4c2f-ae15-1aa50abbabf9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f68f8748b-xvs72"
Jul 13 16:41:02.249154 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.249099    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6528\" (UniqueName: \"kubernetes.io/projected/2491d326-8a60-4cb3-9b69-53411f853fa7-kube-api-access-s6528\") pod \"managed-serviceaccount-addon-agent-6f657cb5c8-tc8wz\" (UID: \"2491d326-8a60-4cb3-9b69-53411f853fa7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f657cb5c8-tc8wz"
Jul 13 16:41:02.249154 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.249144    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/19c39259-8805-4c8c-90b3-14573e27468b-ca-trust-extracted\") pod \"image-registry-7d9b796d7f-mbznk\" (UID: \"19c39259-8805-4c8c-90b3-14573e27468b\") " pod="openshift-image-registry/image-registry-7d9b796d7f-mbznk"
Jul 13 16:41:02.249445 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.249171    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/19c39259-8805-4c8c-90b3-14573e27468b-installation-pull-secrets\") pod \"image-registry-7d9b796d7f-mbznk\" (UID: \"19c39259-8805-4c8c-90b3-14573e27468b\") " pod="openshift-image-registry/image-registry-7d9b796d7f-mbznk"
Jul 13 16:41:02.249445 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.249303    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bac48843-f8ff-4c2f-ae15-1aa50abbabf9-tmp\") pod \"klusterlet-addon-workmgr-6f68f8748b-xvs72\" (UID: \"bac48843-f8ff-4c2f-ae15-1aa50abbabf9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f68f8748b-xvs72"
Jul 13 16:41:02.249445 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.249389    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/be505c25-b426-45d1-812c-348a484f57f0-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7f985d7868-q6xnd\" (UID: \"be505c25-b426-45d1-812c-348a484f57f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f985d7868-q6xnd"
Jul 13 16:41:02.251829 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.251806    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/be505c25-b426-45d1-812c-348a484f57f0-hub\") pod \"cluster-proxy-proxy-agent-7f985d7868-q6xnd\" (UID: \"be505c25-b426-45d1-812c-348a484f57f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f985d7868-q6xnd"
Jul 13 16:41:02.252045 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.252024    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/be505c25-b426-45d1-812c-348a484f57f0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7f985d7868-q6xnd\" (UID: \"be505c25-b426-45d1-812c-348a484f57f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f985d7868-q6xnd"
Jul 13 16:41:02.252174 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.252144    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bac48843-f8ff-4c2f-ae15-1aa50abbabf9-klusterlet-config\") pod \"klusterlet-addon-workmgr-6f68f8748b-xvs72\" (UID: \"bac48843-f8ff-4c2f-ae15-1aa50abbabf9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f68f8748b-xvs72"
Jul 13 16:41:02.252550 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.252524    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/be505c25-b426-45d1-812c-348a484f57f0-ca\") pod \"cluster-proxy-proxy-agent-7f985d7868-q6xnd\" (UID: \"be505c25-b426-45d1-812c-348a484f57f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f985d7868-q6xnd"
Jul 13 16:41:02.252826 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.252801    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2491d326-8a60-4cb3-9b69-53411f853fa7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6f657cb5c8-tc8wz\" (UID: \"2491d326-8a60-4cb3-9b69-53411f853fa7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f657cb5c8-tc8wz"
Jul 13 16:41:02.252899 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.252855    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/be505c25-b426-45d1-812c-348a484f57f0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7f985d7868-q6xnd\" (UID: \"be505c25-b426-45d1-812c-348a484f57f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f985d7868-q6xnd"
Jul 13 16:41:02.262785 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.262756    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqp52\" (UniqueName: \"kubernetes.io/projected/be505c25-b426-45d1-812c-348a484f57f0-kube-api-access-gqp52\") pod \"cluster-proxy-proxy-agent-7f985d7868-q6xnd\" (UID: \"be505c25-b426-45d1-812c-348a484f57f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f985d7868-q6xnd"
Jul 13 16:41:02.263892 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.263869    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mc5f\" (UniqueName: \"kubernetes.io/projected/bac48843-f8ff-4c2f-ae15-1aa50abbabf9-kube-api-access-5mc5f\") pod \"klusterlet-addon-workmgr-6f68f8748b-xvs72\" (UID: \"bac48843-f8ff-4c2f-ae15-1aa50abbabf9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f68f8748b-xvs72"
Jul 13 16:41:02.263987 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.263928    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6528\" (UniqueName: \"kubernetes.io/projected/2491d326-8a60-4cb3-9b69-53411f853fa7-kube-api-access-s6528\") pod \"managed-serviceaccount-addon-agent-6f657cb5c8-tc8wz\" (UID: \"2491d326-8a60-4cb3-9b69-53411f853fa7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f657cb5c8-tc8wz"
Jul 13 16:41:02.274970 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.274946    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:02.298025 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.298003    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f68f8748b-xvs72"
Jul 13 16:41:02.314480 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.314459    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f985d7868-q6xnd"
Jul 13 16:41:02.322120 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.322097    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f657cb5c8-tc8wz"
Jul 13 16:41:02.349929 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.349904    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/19c39259-8805-4c8c-90b3-14573e27468b-registry-tls\") pod \"image-registry-7d9b796d7f-mbznk\" (UID: \"19c39259-8805-4c8c-90b3-14573e27468b\") " pod="openshift-image-registry/image-registry-7d9b796d7f-mbznk"
Jul 13 16:41:02.350045 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.349946    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqltq\" (UniqueName: \"kubernetes.io/projected/19c39259-8805-4c8c-90b3-14573e27468b-kube-api-access-dqltq\") pod \"image-registry-7d9b796d7f-mbznk\" (UID: \"19c39259-8805-4c8c-90b3-14573e27468b\") " pod="openshift-image-registry/image-registry-7d9b796d7f-mbznk"
Jul 13 16:41:02.350045 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.349986    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/19c39259-8805-4c8c-90b3-14573e27468b-ca-trust-extracted\") pod \"image-registry-7d9b796d7f-mbznk\" (UID: \"19c39259-8805-4c8c-90b3-14573e27468b\") " pod="openshift-image-registry/image-registry-7d9b796d7f-mbznk"
Jul 13 16:41:02.350045 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.350014    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/19c39259-8805-4c8c-90b3-14573e27468b-installation-pull-secrets\") pod \"image-registry-7d9b796d7f-mbznk\" (UID: \"19c39259-8805-4c8c-90b3-14573e27468b\") " pod="openshift-image-registry/image-registry-7d9b796d7f-mbznk"
Jul 13 16:41:02.350045 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.350043    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/19c39259-8805-4c8c-90b3-14573e27468b-bound-sa-token\") pod \"image-registry-7d9b796d7f-mbznk\" (UID: \"19c39259-8805-4c8c-90b3-14573e27468b\") " pod="openshift-image-registry/image-registry-7d9b796d7f-mbznk"
Jul 13 16:41:02.350383 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.350078    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/19c39259-8805-4c8c-90b3-14573e27468b-image-registry-private-configuration\") pod \"image-registry-7d9b796d7f-mbznk\" (UID: \"19c39259-8805-4c8c-90b3-14573e27468b\") " pod="openshift-image-registry/image-registry-7d9b796d7f-mbznk"
Jul 13 16:41:02.350383 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.350128    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/19c39259-8805-4c8c-90b3-14573e27468b-trusted-ca\") pod \"image-registry-7d9b796d7f-mbznk\" (UID: \"19c39259-8805-4c8c-90b3-14573e27468b\") " pod="openshift-image-registry/image-registry-7d9b796d7f-mbznk"
Jul 13 16:41:02.350383 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.350171    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/19c39259-8805-4c8c-90b3-14573e27468b-registry-certificates\") pod \"image-registry-7d9b796d7f-mbznk\" (UID: \"19c39259-8805-4c8c-90b3-14573e27468b\") " pod="openshift-image-registry/image-registry-7d9b796d7f-mbznk"
Jul 13 16:41:02.350565 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.350451    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/19c39259-8805-4c8c-90b3-14573e27468b-ca-trust-extracted\") pod \"image-registry-7d9b796d7f-mbznk\" (UID: \"19c39259-8805-4c8c-90b3-14573e27468b\") " pod="openshift-image-registry/image-registry-7d9b796d7f-mbznk"
Jul 13 16:41:02.351014 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.350986    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/19c39259-8805-4c8c-90b3-14573e27468b-registry-certificates\") pod \"image-registry-7d9b796d7f-mbznk\" (UID: \"19c39259-8805-4c8c-90b3-14573e27468b\") " pod="openshift-image-registry/image-registry-7d9b796d7f-mbznk"
Jul 13 16:41:02.351209 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.351184    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/19c39259-8805-4c8c-90b3-14573e27468b-trusted-ca\") pod \"image-registry-7d9b796d7f-mbznk\" (UID: \"19c39259-8805-4c8c-90b3-14573e27468b\") " pod="openshift-image-registry/image-registry-7d9b796d7f-mbznk"
Jul 13 16:41:02.352976 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.352942    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/19c39259-8805-4c8c-90b3-14573e27468b-installation-pull-secrets\") pod \"image-registry-7d9b796d7f-mbznk\" (UID: \"19c39259-8805-4c8c-90b3-14573e27468b\") " pod="openshift-image-registry/image-registry-7d9b796d7f-mbznk"
Jul 13 16:41:02.353055 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.353010    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/19c39259-8805-4c8c-90b3-14573e27468b-image-registry-private-configuration\") pod \"image-registry-7d9b796d7f-mbznk\" (UID: \"19c39259-8805-4c8c-90b3-14573e27468b\") " pod="openshift-image-registry/image-registry-7d9b796d7f-mbznk"
Jul 13 16:41:02.353194 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.353175    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/19c39259-8805-4c8c-90b3-14573e27468b-registry-tls\") pod \"image-registry-7d9b796d7f-mbznk\" (UID: \"19c39259-8805-4c8c-90b3-14573e27468b\") " pod="openshift-image-registry/image-registry-7d9b796d7f-mbznk"
Jul 13 16:41:02.362681 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.362655    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/19c39259-8805-4c8c-90b3-14573e27468b-bound-sa-token\") pod \"image-registry-7d9b796d7f-mbznk\" (UID: \"19c39259-8805-4c8c-90b3-14573e27468b\") " pod="openshift-image-registry/image-registry-7d9b796d7f-mbznk"
Jul 13 16:41:02.363494 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.363476    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqltq\" (UniqueName: \"kubernetes.io/projected/19c39259-8805-4c8c-90b3-14573e27468b-kube-api-access-dqltq\") pod \"image-registry-7d9b796d7f-mbznk\" (UID: \"19c39259-8805-4c8c-90b3-14573e27468b\") " pod="openshift-image-registry/image-registry-7d9b796d7f-mbznk"
Jul 13 16:41:02.387233 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.387197    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:02.411366 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.411339    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d9b796d7f-mbznk"
Jul 13 16:41:02.474175 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:02.474146    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:03.037632 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:03.037605    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:03.203614 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:03.203528    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f657cb5c8-tc8wz"]
Jul 13 16:41:03.206952 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:41:03.206913    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2491d326_8a60_4cb3_9b69_53411f853fa7.slice/crio-282b23d4b5d9ae4630c92433b1e5d2efc78ceb0977e6d8a9b20fffcad648612a WatchSource:0}: Error finding container 282b23d4b5d9ae4630c92433b1e5d2efc78ceb0977e6d8a9b20fffcad648612a: Status 404 returned error can't find the container with id 282b23d4b5d9ae4630c92433b1e5d2efc78ceb0977e6d8a9b20fffcad648612a
Jul 13 16:41:03.230319 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:03.230293    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f68f8748b-xvs72"]
Jul 13 16:41:03.233277 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:03.233254    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d9b796d7f-mbznk"]
Jul 13 16:41:03.233975 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:41:03.233891    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbac48843_f8ff_4c2f_ae15_1aa50abbabf9.slice/crio-70ca04a866c232b66fcef24a8c139dea8ef5b5b4542273e205a3617237c71915 WatchSource:0}: Error finding container 70ca04a866c232b66fcef24a8c139dea8ef5b5b4542273e205a3617237c71915: Status 404 returned error can't find the container with id 70ca04a866c232b66fcef24a8c139dea8ef5b5b4542273e205a3617237c71915
Jul 13 16:41:03.236477 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:41:03.236449    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19c39259_8805_4c8c_90b3_14573e27468b.slice/crio-6f2bccbc5752110f608316d9671147ffba4ac8f003743c4c201abc24c42bd932 WatchSource:0}: Error finding container 6f2bccbc5752110f608316d9671147ffba4ac8f003743c4c201abc24c42bd932: Status 404 returned error can't find the container with id 6f2bccbc5752110f608316d9671147ffba4ac8f003743c4c201abc24c42bd932
Jul 13 16:41:03.236567 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:03.236536    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f985d7868-q6xnd"]
Jul 13 16:41:03.239869 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:41:03.239848    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe505c25_b426_45d1_812c_348a484f57f0.slice/crio-c75caf7efbcd9d400c182dfb523406ddb495566be82f1e3f2e3604de618c008d WatchSource:0}: Error finding container c75caf7efbcd9d400c182dfb523406ddb495566be82f1e3f2e3604de618c008d: Status 404 returned error can't find the container with id c75caf7efbcd9d400c182dfb523406ddb495566be82f1e3f2e3604de618c008d
Jul 13 16:41:03.286957 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:03.286934    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tnxdg"
Jul 13 16:41:03.387264 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:03.387228    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d9b796d7f-mbznk" event={"ID":"19c39259-8805-4c8c-90b3-14573e27468b","Type":"ContainerStarted","Data":"e879fa5099c2a8830ca31e3e440fea69585cbb08f66fb78df16a61fbcd722734"}
Jul 13 16:41:03.387449 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:03.387286    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d9b796d7f-mbznk" event={"ID":"19c39259-8805-4c8c-90b3-14573e27468b","Type":"ContainerStarted","Data":"6f2bccbc5752110f608316d9671147ffba4ac8f003743c4c201abc24c42bd932"}
Jul 13 16:41:03.387449 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:03.387336    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7d9b796d7f-mbznk"
Jul 13 16:41:03.388501 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:03.388478    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f68f8748b-xvs72" event={"ID":"bac48843-f8ff-4c2f-ae15-1aa50abbabf9","Type":"ContainerStarted","Data":"70ca04a866c232b66fcef24a8c139dea8ef5b5b4542273e205a3617237c71915"}
Jul 13 16:41:03.389678 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:03.389657    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f657cb5c8-tc8wz" event={"ID":"2491d326-8a60-4cb3-9b69-53411f853fa7","Type":"ContainerStarted","Data":"282b23d4b5d9ae4630c92433b1e5d2efc78ceb0977e6d8a9b20fffcad648612a"}
Jul 13 16:41:03.390896 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:03.390874    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f985d7868-q6xnd" event={"ID":"be505c25-b426-45d1-812c-348a484f57f0","Type":"ContainerStarted","Data":"c75caf7efbcd9d400c182dfb523406ddb495566be82f1e3f2e3604de618c008d"}
Jul 13 16:41:03.395789 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:03.395765    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vd6k8" event={"ID":"e5b79688-1d51-4578-8a99-3df1c0a55218","Type":"ContainerStarted","Data":"7edf962014c2adda1052656dd2c597aa38306ada69c919543b962ad85f13deed"}
Jul 13 16:41:03.407631 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:03.407586    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7d9b796d7f-mbznk" podStartSLOduration=1.40757225 podStartE2EDuration="1.40757225s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:41:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:41:03.406565616 +0000 UTC m=+60.764872455" watchObservedRunningTime="2026-07-13 16:41:03.40757225 +0000 UTC m=+60.765879053"
Jul 13 16:41:03.429981 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:03.429929    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vd6k8" podStartSLOduration=17.320604991 podStartE2EDuration="25.429914117s" totalImagesPullingTime="8.109309126s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 16:40:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:41:03.429561537 +0000 UTC m=+60.787868363" watchObservedRunningTime="2026-07-13 16:41:03.429914117 +0000 UTC m=+60.788220933"
Jul 13 16:41:03.430894 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:03.430865    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:03.532609 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:03.532572    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:04.104394 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:04.104355    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:04.205229 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:04.205039    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:04.266365 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:04.266330    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:04.630682 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:04.630606    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:04.730633 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:04.730602    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:07.722956 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:07.722882    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:07.796337 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:07.796290    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:07.963266 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:07.963232    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:09.008526 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:09.008500    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf-original-pull-secret\") pod \"global-pull-secret-syncer-mhds4\" (UID: \"d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf\") " pod="kube-system/global-pull-secret-syncer-mhds4"
Jul 13 16:41:09.008891 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:09.008601    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76ecb854-ac06-45b1-b386-ea01c15fb5e2-metrics-certs\") pod \"network-metrics-daemon-gfcfp\" (UID: \"76ecb854-ac06-45b1-b386-ea01c15fb5e2\") " pod="openshift-multus/network-metrics-daemon-gfcfp"
Jul 13 16:41:09.011035 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:09.011016    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 13 16:41:09.011121 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:09.011039    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 13 16:41:09.020871 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:09.020850    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf-original-pull-secret\") pod \"global-pull-secret-syncer-mhds4\" (UID: \"d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf\") " pod="kube-system/global-pull-secret-syncer-mhds4"
Jul 13 16:41:09.021370 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:09.021349    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76ecb854-ac06-45b1-b386-ea01c15fb5e2-metrics-certs\") pod \"network-metrics-daemon-gfcfp\" (UID: \"76ecb854-ac06-45b1-b386-ea01c15fb5e2\") " pod="openshift-multus/network-metrics-daemon-gfcfp"
Jul 13 16:41:09.109262 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:09.109230    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxs9w\" (UniqueName: \"kubernetes.io/projected/eb203ef3-2445-43bb-a0aa-e5476ac8d12e-kube-api-access-jxs9w\") pod \"network-check-target-5xx8s\" (UID: \"eb203ef3-2445-43bb-a0aa-e5476ac8d12e\") " pod="openshift-network-diagnostics/network-check-target-5xx8s"
Jul 13 16:41:09.111918 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:09.111867    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 13 16:41:09.122044 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:09.121966    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 13 16:41:09.132502 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:09.132480    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxs9w\" (UniqueName: \"kubernetes.io/projected/eb203ef3-2445-43bb-a0aa-e5476ac8d12e-kube-api-access-jxs9w\") pod \"network-check-target-5xx8s\" (UID: \"eb203ef3-2445-43bb-a0aa-e5476ac8d12e\") " pod="openshift-network-diagnostics/network-check-target-5xx8s"
Jul 13 16:41:09.158019 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:09.157999    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-79qpb\""
Jul 13 16:41:09.164284 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:09.164265    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gfcfp"
Jul 13 16:41:09.164480 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:09.164462    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-whvdd\""
Jul 13 16:41:09.171831 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:09.171501    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5xx8s"
Jul 13 16:41:09.253176 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:09.252810    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhds4"
Jul 13 16:41:09.326243 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:09.326078    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5xx8s"]
Jul 13 16:41:09.349015 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:09.348990    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gfcfp"]
Jul 13 16:41:09.351268 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:41:09.351245    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76ecb854_ac06_45b1_b386_ea01c15fb5e2.slice/crio-b0b12adc180e5b9aba70bc650fbbae236790e25f499816051238bdf5a92075ed WatchSource:0}: Error finding container b0b12adc180e5b9aba70bc650fbbae236790e25f499816051238bdf5a92075ed: Status 404 returned error can't find the container with id b0b12adc180e5b9aba70bc650fbbae236790e25f499816051238bdf5a92075ed
Jul 13 16:41:09.378489 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:09.378448    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-b6bxq"
Jul 13 16:41:09.410204 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:09.410178    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mhds4"]
Jul 13 16:41:09.420081 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:41:09.420046    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3c1aff9_17f5_4a81_abb5_6a8705b1a2cf.slice/crio-2d527e5f2a946e1160126313987ea002d2ea3ebcaa7bb8994fb049ba344d7b9e WatchSource:0}: Error finding container 2d527e5f2a946e1160126313987ea002d2ea3ebcaa7bb8994fb049ba344d7b9e: Status 404 returned error can't find the container with id 2d527e5f2a946e1160126313987ea002d2ea3ebcaa7bb8994fb049ba344d7b9e
Jul 13 16:41:09.424335 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:09.424300    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f657cb5c8-tc8wz" event={"ID":"2491d326-8a60-4cb3-9b69-53411f853fa7","Type":"ContainerStarted","Data":"7ac047bf6d8422d48c5bca84a0b2b47f571a4b9485c1cb81a79117c1b214ec63"}
Jul 13 16:41:09.426374 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:09.426351    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f985d7868-q6xnd" event={"ID":"be505c25-b426-45d1-812c-348a484f57f0","Type":"ContainerStarted","Data":"76bec9da7f914d18977e424ff99521cb813cfac42d1c46bac8b9be75a804112f"}
Jul 13 16:41:09.426466 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:09.426385    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f985d7868-q6xnd" event={"ID":"be505c25-b426-45d1-812c-348a484f57f0","Type":"ContainerStarted","Data":"afd23e20cddbac4a91752fb1f44c87f682a12d2729b98d89d01a0c6800483cf1"}
Jul 13 16:41:09.426466 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:09.426404    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f985d7868-q6xnd" event={"ID":"be505c25-b426-45d1-812c-348a484f57f0","Type":"ContainerStarted","Data":"f593071f7dec29d210e4babd9b93538a71969abcaacff5347f8ae31c641fd508"}
Jul 13 16:41:09.427529 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:09.427505    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5xx8s" event={"ID":"eb203ef3-2445-43bb-a0aa-e5476ac8d12e","Type":"ContainerStarted","Data":"f3552aa50f1803e0f62afd56b00e1a301562d21e2f8c5aae8af7c948b358acc0"}
Jul 13 16:41:09.428765 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:09.428745    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gfcfp" event={"ID":"76ecb854-ac06-45b1-b386-ea01c15fb5e2","Type":"ContainerStarted","Data":"b0b12adc180e5b9aba70bc650fbbae236790e25f499816051238bdf5a92075ed"}
Jul 13 16:41:09.430246 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:09.430225    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f68f8748b-xvs72" event={"ID":"bac48843-f8ff-4c2f-ae15-1aa50abbabf9","Type":"ContainerStarted","Data":"4983d47def119ec8be384a7834209d2fc940a4eabb54f9494f5a14b2d6dffcf8"}
Jul 13 16:41:09.430446 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:09.430421    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f68f8748b-xvs72"
Jul 13 16:41:09.431787 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:09.431764    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f68f8748b-xvs72"
Jul 13 16:41:09.443485 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:09.443439    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f657cb5c8-tc8wz" podStartSLOduration=2.646024257 podStartE2EDuration="8.443422256s" totalImagesPullingTime="5.797397999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:41:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:41:09.442896947 +0000 UTC m=+66.801203774" watchObservedRunningTime="2026-07-13 16:41:09.443422256 +0000 UTC m=+66.801729083"
Jul 13 16:41:09.462923 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:09.462883    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f985d7868-q6xnd" podStartSLOduration=2.6778369509999997 podStartE2EDuration="8.462868727s" totalImagesPullingTime="5.785031776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:41:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:41:09.461688047 +0000 UTC m=+66.819994871" watchObservedRunningTime="2026-07-13 16:41:09.462868727 +0000 UTC m=+66.821175552"
Jul 13 16:41:09.478678 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:09.478632    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f68f8748b-xvs72" podStartSLOduration=2.694212216 podStartE2EDuration="8.478618465s" totalImagesPullingTime="5.784406249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:41:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:41:09.477913588 +0000 UTC m=+66.836220413" watchObservedRunningTime="2026-07-13 16:41:09.478618465 +0000 UTC m=+66.836925290"
Jul 13 16:41:10.436028 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:10.435991    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mhds4" event={"ID":"d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf","Type":"ContainerStarted","Data":"2d527e5f2a946e1160126313987ea002d2ea3ebcaa7bb8994fb049ba344d7b9e"}
Jul 13 16:41:10.920081 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:10.919827    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:11.020394 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:11.020338    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:11.121680 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:11.121647    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:11.185415 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:11.185307    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:12.036032 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:12.035991    2573 patch_prober.go:28] interesting pod/image-registry-5759ccdd67-hqwxn container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 13 16:41:12.036456 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:12.036062    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5759ccdd67-hqwxn" podUID="a72e4071-c03c-44a6-a4b9-fe42565c2ca4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 16:41:15.355278 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:15.355230    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:15.429120 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:15.429094    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:15.454220 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:15.454192    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5xx8s" event={"ID":"eb203ef3-2445-43bb-a0aa-e5476ac8d12e","Type":"ContainerStarted","Data":"1d36ff506fe70b23992d4522abd96a1ca53e8c4e8fc3e863e3aee702d668e9f4"}
Jul 13 16:41:15.454375 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:15.454277    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5xx8s"
Jul 13 16:41:15.455573 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:15.455545    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mhds4" event={"ID":"d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf","Type":"ContainerStarted","Data":"b6dec9d290b733f4a93035405384335e0b1813275de0abb3eb49d43300bd371e"}
Jul 13 16:41:15.457310 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:15.457289    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gfcfp" event={"ID":"76ecb854-ac06-45b1-b386-ea01c15fb5e2","Type":"ContainerStarted","Data":"01002cb0f072f9e515a933572188abb16946db4bf75a4bf207908084b63f1cb5"}
Jul 13 16:41:15.457393 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:15.457324    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gfcfp" event={"ID":"76ecb854-ac06-45b1-b386-ea01c15fb5e2","Type":"ContainerStarted","Data":"8e2e114b9f6d223afd7e747de48a0df1cff638d86fd377545bae2a42a28a34da"}
Jul 13 16:41:15.470570 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:15.470525    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5xx8s" podStartSLOduration=67.351373078 podStartE2EDuration="1m12.470510376s" totalImagesPullingTime="5.119137298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:40:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:41:15.470427566 +0000 UTC m=+72.828734421" watchObservedRunningTime="2026-07-13 16:41:15.470510376 +0000 UTC m=+72.828817202"
Jul 13 16:41:15.488686 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:15.488646    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gfcfp" podStartSLOduration=67.399335953 podStartE2EDuration="1m12.48863546s" totalImagesPullingTime="5.089299507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:40:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:41:15.487846678 +0000 UTC m=+72.846153504" watchObservedRunningTime="2026-07-13 16:41:15.48863546 +0000 UTC m=+72.846942285"
Jul 13 16:41:15.507193 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:15.507156    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mhds4" podStartSLOduration=67.458541966 podStartE2EDuration="1m12.507142674s" totalImagesPullingTime="5.048600708s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 16:40:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:41:15.506022072 +0000 UTC m=+72.864328896" watchObservedRunningTime="2026-07-13 16:41:15.507142674 +0000 UTC m=+72.865449498"
Jul 13 16:41:15.596219 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:15.596190    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:15.699355 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:15.699295    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:15.801246 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:15.801220    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:15.880415 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:15.880383    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:16.056425 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:16.056395    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:18.507244 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:18.507214    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:18.608735 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:18.608691    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:18.904253 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:18.904174    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:19.470530 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:19.470488    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:19.567590 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:19.567554    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:19.668401 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:19.668373    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:20.355032 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:20.355002    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:20.412681 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:20.412651    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:20.959631 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:20.959600    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:21.179742 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:21.179693    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:21.237694 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:21.237661    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nwqs5"]
Jul 13 16:41:21.240296 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:21.240274    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nwqs5"
Jul 13 16:41:21.244192 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:21.244169    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 13 16:41:21.245160 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:21.245141    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 13 16:41:21.245262 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:21.245242    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bgr75\""
Jul 13 16:41:21.245381 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:21.245350    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 13 16:41:21.245837 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:21.245515    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 13 16:41:21.245837 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:21.245594    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 13 16:41:21.246022 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:21.245941    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 13 16:41:21.269864 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:21.269840    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:21.300440 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:21.300412    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/13951a00-4d7c-43d6-8f05-90bfaaa5e2e1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nwqs5\" (UID: \"13951a00-4d7c-43d6-8f05-90bfaaa5e2e1\") " pod="openshift-monitoring/node-exporter-nwqs5"
Jul 13 16:41:21.300581 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:21.300462    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/13951a00-4d7c-43d6-8f05-90bfaaa5e2e1-metrics-client-ca\") pod \"node-exporter-nwqs5\" (UID: \"13951a00-4d7c-43d6-8f05-90bfaaa5e2e1\") " pod="openshift-monitoring/node-exporter-nwqs5"
Jul 13 16:41:21.300581 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:21.300533    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/13951a00-4d7c-43d6-8f05-90bfaaa5e2e1-node-exporter-accelerators-collector-config\") pod \"node-exporter-nwqs5\" (UID: \"13951a00-4d7c-43d6-8f05-90bfaaa5e2e1\") " pod="openshift-monitoring/node-exporter-nwqs5"
Jul 13 16:41:21.300690 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:21.300577    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/13951a00-4d7c-43d6-8f05-90bfaaa5e2e1-node-exporter-wtmp\") pod \"node-exporter-nwqs5\" (UID: \"13951a00-4d7c-43d6-8f05-90bfaaa5e2e1\") " pod="openshift-monitoring/node-exporter-nwqs5"
Jul 13 16:41:21.300690 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:21.300602    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/13951a00-4d7c-43d6-8f05-90bfaaa5e2e1-root\") pod \"node-exporter-nwqs5\" (UID: \"13951a00-4d7c-43d6-8f05-90bfaaa5e2e1\") " pod="openshift-monitoring/node-exporter-nwqs5"
Jul 13 16:41:21.300690 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:21.300617    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/13951a00-4d7c-43d6-8f05-90bfaaa5e2e1-node-exporter-textfile\") pod \"node-exporter-nwqs5\" (UID: \"13951a00-4d7c-43d6-8f05-90bfaaa5e2e1\") " pod="openshift-monitoring/node-exporter-nwqs5"
Jul 13 16:41:21.300690 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:21.300677    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/13951a00-4d7c-43d6-8f05-90bfaaa5e2e1-node-exporter-tls\") pod \"node-exporter-nwqs5\" (UID: \"13951a00-4d7c-43d6-8f05-90bfaaa5e2e1\") " pod="openshift-monitoring/node-exporter-nwqs5"
Jul 13 16:41:21.300915 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:21.300711    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/13951a00-4d7c-43d6-8f05-90bfaaa5e2e1-sys\") pod \"node-exporter-nwqs5\" (UID: \"13951a00-4d7c-43d6-8f05-90bfaaa5e2e1\") " pod="openshift-monitoring/node-exporter-nwqs5"
Jul 13 16:41:21.300915 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:21.300755    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5trfk\" (UniqueName: \"kubernetes.io/projected/13951a00-4d7c-43d6-8f05-90bfaaa5e2e1-kube-api-access-5trfk\") pod \"node-exporter-nwqs5\" (UID: \"13951a00-4d7c-43d6-8f05-90bfaaa5e2e1\") " pod="openshift-monitoring/node-exporter-nwqs5"
Jul 13 16:41:21.377785 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:21.377753    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:21.401695 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:21.401663    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5trfk\" (UniqueName: \"kubernetes.io/projected/13951a00-4d7c-43d6-8f05-90bfaaa5e2e1-kube-api-access-5trfk\") pod \"node-exporter-nwqs5\" (UID: \"13951a00-4d7c-43d6-8f05-90bfaaa5e2e1\") " pod="openshift-monitoring/node-exporter-nwqs5"
Jul 13 16:41:21.401819 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:21.401716    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/13951a00-4d7c-43d6-8f05-90bfaaa5e2e1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nwqs5\" (UID: \"13951a00-4d7c-43d6-8f05-90bfaaa5e2e1\") " pod="openshift-monitoring/node-exporter-nwqs5"
Jul 13 16:41:21.401819 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:21.401774    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/13951a00-4d7c-43d6-8f05-90bfaaa5e2e1-metrics-client-ca\") pod \"node-exporter-nwqs5\" (UID: \"13951a00-4d7c-43d6-8f05-90bfaaa5e2e1\") " pod="openshift-monitoring/node-exporter-nwqs5"
Jul 13 16:41:21.401819 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:21.401804    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/13951a00-4d7c-43d6-8f05-90bfaaa5e2e1-node-exporter-accelerators-collector-config\") pod \"node-exporter-nwqs5\" (UID: \"13951a00-4d7c-43d6-8f05-90bfaaa5e2e1\") " pod="openshift-monitoring/node-exporter-nwqs5"
Jul 13 16:41:21.401969 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:21.401840    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/13951a00-4d7c-43d6-8f05-90bfaaa5e2e1-node-exporter-wtmp\") pod \"node-exporter-nwqs5\" (UID: \"13951a00-4d7c-43d6-8f05-90bfaaa5e2e1\") " pod="openshift-monitoring/node-exporter-nwqs5"
Jul 13 16:41:21.401969 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:21.401864    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/13951a00-4d7c-43d6-8f05-90bfaaa5e2e1-root\") pod \"node-exporter-nwqs5\" (UID: \"13951a00-4d7c-43d6-8f05-90bfaaa5e2e1\") " pod="openshift-monitoring/node-exporter-nwqs5"
Jul 13 16:41:21.401969 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:21.401889    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/13951a00-4d7c-43d6-8f05-90bfaaa5e2e1-node-exporter-textfile\") pod \"node-exporter-nwqs5\" (UID: \"13951a00-4d7c-43d6-8f05-90bfaaa5e2e1\") " pod="openshift-monitoring/node-exporter-nwqs5"
Jul 13 16:41:21.401969 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:21.401919    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/13951a00-4d7c-43d6-8f05-90bfaaa5e2e1-node-exporter-tls\") pod \"node-exporter-nwqs5\" (UID: \"13951a00-4d7c-43d6-8f05-90bfaaa5e2e1\") " pod="openshift-monitoring/node-exporter-nwqs5"
Jul 13 16:41:21.401969 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:21.401952    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/13951a00-4d7c-43d6-8f05-90bfaaa5e2e1-sys\") pod \"node-exporter-nwqs5\" (UID: \"13951a00-4d7c-43d6-8f05-90bfaaa5e2e1\") " pod="openshift-monitoring/node-exporter-nwqs5"
Jul 13 16:41:21.402206 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:21.402031    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/13951a00-4d7c-43d6-8f05-90bfaaa5e2e1-sys\") pod \"node-exporter-nwqs5\" (UID: \"13951a00-4d7c-43d6-8f05-90bfaaa5e2e1\") " pod="openshift-monitoring/node-exporter-nwqs5"
Jul 13 16:41:21.402206 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:21.402037    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/13951a00-4d7c-43d6-8f05-90bfaaa5e2e1-root\") pod \"node-exporter-nwqs5\" (UID: \"13951a00-4d7c-43d6-8f05-90bfaaa5e2e1\") " pod="openshift-monitoring/node-exporter-nwqs5"
Jul 13 16:41:21.402206 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:21.402180    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/13951a00-4d7c-43d6-8f05-90bfaaa5e2e1-node-exporter-wtmp\") pod \"node-exporter-nwqs5\" (UID: \"13951a00-4d7c-43d6-8f05-90bfaaa5e2e1\") " pod="openshift-monitoring/node-exporter-nwqs5"
Jul 13 16:41:21.402413 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:21.402344    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/13951a00-4d7c-43d6-8f05-90bfaaa5e2e1-node-exporter-textfile\") pod \"node-exporter-nwqs5\" (UID: \"13951a00-4d7c-43d6-8f05-90bfaaa5e2e1\") " pod="openshift-monitoring/node-exporter-nwqs5"
Jul 13 16:41:21.402490 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:21.402466    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/13951a00-4d7c-43d6-8f05-90bfaaa5e2e1-metrics-client-ca\") pod \"node-exporter-nwqs5\" (UID: \"13951a00-4d7c-43d6-8f05-90bfaaa5e2e1\") " pod="openshift-monitoring/node-exporter-nwqs5"
Jul 13 16:41:21.402760 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:21.402738    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/13951a00-4d7c-43d6-8f05-90bfaaa5e2e1-node-exporter-accelerators-collector-config\") pod \"node-exporter-nwqs5\" (UID: \"13951a00-4d7c-43d6-8f05-90bfaaa5e2e1\") " pod="openshift-monitoring/node-exporter-nwqs5"
Jul 13 16:41:21.404188 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:21.404165    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/13951a00-4d7c-43d6-8f05-90bfaaa5e2e1-node-exporter-tls\") pod \"node-exporter-nwqs5\" (UID: \"13951a00-4d7c-43d6-8f05-90bfaaa5e2e1\") " pod="openshift-monitoring/node-exporter-nwqs5"
Jul 13 16:41:21.404369 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:21.404352    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/13951a00-4d7c-43d6-8f05-90bfaaa5e2e1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nwqs5\" (UID: \"13951a00-4d7c-43d6-8f05-90bfaaa5e2e1\") " pod="openshift-monitoring/node-exporter-nwqs5"
Jul 13 16:41:21.411701 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:21.411680    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5trfk\" (UniqueName: \"kubernetes.io/projected/13951a00-4d7c-43d6-8f05-90bfaaa5e2e1-kube-api-access-5trfk\") pod \"node-exporter-nwqs5\" (UID: \"13951a00-4d7c-43d6-8f05-90bfaaa5e2e1\") " pod="openshift-monitoring/node-exporter-nwqs5"
Jul 13 16:41:21.552228 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:21.552148    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nwqs5"
Jul 13 16:41:21.561854 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:41:21.561828    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13951a00_4d7c_43d6_8f05_90bfaaa5e2e1.slice/crio-fa115696fc052f06ac2b4e7ffe2bef7972340a28cbe29073d27c48d1f9c64943 WatchSource:0}: Error finding container fa115696fc052f06ac2b4e7ffe2bef7972340a28cbe29073d27c48d1f9c64943: Status 404 returned error can't find the container with id fa115696fc052f06ac2b4e7ffe2bef7972340a28cbe29073d27c48d1f9c64943
Jul 13 16:41:22.034107 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:22.034061    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5759ccdd67-hqwxn"
Jul 13 16:41:22.481979 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:22.481949    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nwqs5" event={"ID":"13951a00-4d7c-43d6-8f05-90bfaaa5e2e1","Type":"ContainerStarted","Data":"fa115696fc052f06ac2b4e7ffe2bef7972340a28cbe29073d27c48d1f9c64943"}
Jul 13 16:41:22.556699 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:22.556665    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:22.623552 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:22.623521    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:23.487113 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:23.487078    2573 generic.go:356] "Generic (PLEG): container finished" podID="13951a00-4d7c-43d6-8f05-90bfaaa5e2e1" containerID="70ffc47ff54d149bf909d127e47c836505c7b15aa5461c5eeab448c80742731f" exitCode=0
Jul 13 16:41:23.487474 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:23.487139    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nwqs5" event={"ID":"13951a00-4d7c-43d6-8f05-90bfaaa5e2e1","Type":"ContainerDied","Data":"70ffc47ff54d149bf909d127e47c836505c7b15aa5461c5eeab448c80742731f"}
Jul 13 16:41:24.150826 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:24.150798    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:24.251988 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:24.251960    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:24.352021 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:24.351991    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:24.404964 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:24.404901    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7d9b796d7f-mbznk"
Jul 13 16:41:24.429477 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:24.429446    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:24.491898 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:24.491796    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nwqs5" event={"ID":"13951a00-4d7c-43d6-8f05-90bfaaa5e2e1","Type":"ContainerStarted","Data":"58dc0ee7127fc4886a7e8defc1eb5347ff4bce20783194fa9bbcf7bb822d8d2f"}
Jul 13 16:41:24.491898 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:24.491847    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nwqs5" event={"ID":"13951a00-4d7c-43d6-8f05-90bfaaa5e2e1","Type":"ContainerStarted","Data":"9860fbea9b4548b03d9fcae722f8cae225e6b9ebf65eadd0ebcfa89b574eacf0"}
Jul 13 16:41:24.511277 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:24.511232    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nwqs5" podStartSLOduration=2.564940006 podStartE2EDuration="3.511218252s" totalImagesPullingTime="879.16175ms" totalInitContainerRuntime="67.116496ms" isStatefulPod=true podCreationTimestamp="2026-07-13 16:41:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:41:24.510023579 +0000 UTC m=+81.868330425" watchObservedRunningTime="2026-07-13 16:41:24.511218252 +0000 UTC m=+81.869525076"
Jul 13 16:41:24.610439 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:24.610412    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:24.710608 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:24.710534    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:25.404393 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:25.404357    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:26.030770 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:26.030738    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:26.181058 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:26.181028    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:26.280821 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:26.280747    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:26.447108 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:26.447076    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:26.504684 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:26.504654    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:26.580275 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:26.580199    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:27.022381 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:27.022353    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:27.051039 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:27.051010    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5759ccdd67-hqwxn" podUID="a72e4071-c03c-44a6-a4b9-fe42565c2ca4" containerName="registry" containerID="cri-o://361de23f8be1c5c393132b74c8517624db976740447a0c81e5e399c7cf545d7f" gracePeriod=30
Jul 13 16:41:27.083871 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:27.083847    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:27.288353 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:27.288328    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5759ccdd67-hqwxn"
Jul 13 16:41:27.347820 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:27.347797    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-registry-certificates\") pod \"a72e4071-c03c-44a6-a4b9-fe42565c2ca4\" (UID: \"a72e4071-c03c-44a6-a4b9-fe42565c2ca4\") "
Jul 13 16:41:27.347909 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:27.347842    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-registry-tls\") pod \"a72e4071-c03c-44a6-a4b9-fe42565c2ca4\" (UID: \"a72e4071-c03c-44a6-a4b9-fe42565c2ca4\") "
Jul 13 16:41:27.347909 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:27.347890    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-trusted-ca\") pod \"a72e4071-c03c-44a6-a4b9-fe42565c2ca4\" (UID: \"a72e4071-c03c-44a6-a4b9-fe42565c2ca4\") "
Jul 13 16:41:27.347996 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:27.347917    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xb5zl\" (UniqueName: \"kubernetes.io/projected/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-kube-api-access-xb5zl\") pod \"a72e4071-c03c-44a6-a4b9-fe42565c2ca4\" (UID: \"a72e4071-c03c-44a6-a4b9-fe42565c2ca4\") "
Jul 13 16:41:27.347996 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:27.347943    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-image-registry-private-configuration\") pod \"a72e4071-c03c-44a6-a4b9-fe42565c2ca4\" (UID: \"a72e4071-c03c-44a6-a4b9-fe42565c2ca4\") "
Jul 13 16:41:27.347996 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:27.347976    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-installation-pull-secrets\") pod \"a72e4071-c03c-44a6-a4b9-fe42565c2ca4\" (UID: \"a72e4071-c03c-44a6-a4b9-fe42565c2ca4\") "
Jul 13 16:41:27.348124 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:27.348032    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-ca-trust-extracted\") pod \"a72e4071-c03c-44a6-a4b9-fe42565c2ca4\" (UID: \"a72e4071-c03c-44a6-a4b9-fe42565c2ca4\") "
Jul 13 16:41:27.348124 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:27.348056    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-bound-sa-token\") pod \"a72e4071-c03c-44a6-a4b9-fe42565c2ca4\" (UID: \"a72e4071-c03c-44a6-a4b9-fe42565c2ca4\") "
Jul 13 16:41:27.348317 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:27.348282    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a72e4071-c03c-44a6-a4b9-fe42565c2ca4" (UID: "a72e4071-c03c-44a6-a4b9-fe42565c2ca4"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 16:41:27.348920 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:27.348880    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a72e4071-c03c-44a6-a4b9-fe42565c2ca4" (UID: "a72e4071-c03c-44a6-a4b9-fe42565c2ca4"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 16:41:27.350869 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:27.350833    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a72e4071-c03c-44a6-a4b9-fe42565c2ca4" (UID: "a72e4071-c03c-44a6-a4b9-fe42565c2ca4"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 16:41:27.350869 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:27.350841    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a72e4071-c03c-44a6-a4b9-fe42565c2ca4" (UID: "a72e4071-c03c-44a6-a4b9-fe42565c2ca4"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 16:41:27.351015 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:27.350928    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a72e4071-c03c-44a6-a4b9-fe42565c2ca4" (UID: "a72e4071-c03c-44a6-a4b9-fe42565c2ca4"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 16:41:27.351015 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:27.350955    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a72e4071-c03c-44a6-a4b9-fe42565c2ca4" (UID: "a72e4071-c03c-44a6-a4b9-fe42565c2ca4"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 16:41:27.351015 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:27.350999    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-kube-api-access-xb5zl" (OuterVolumeSpecName: "kube-api-access-xb5zl") pod "a72e4071-c03c-44a6-a4b9-fe42565c2ca4" (UID: "a72e4071-c03c-44a6-a4b9-fe42565c2ca4"). InnerVolumeSpecName "kube-api-access-xb5zl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 16:41:27.356949 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:27.356924    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a72e4071-c03c-44a6-a4b9-fe42565c2ca4" (UID: "a72e4071-c03c-44a6-a4b9-fe42565c2ca4"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:41:27.449035 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:27.449010    2573 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-registry-tls\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 16:41:27.449035 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:27.449034    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-trusted-ca\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 16:41:27.449170 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:27.449043    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xb5zl\" (UniqueName: \"kubernetes.io/projected/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-kube-api-access-xb5zl\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 16:41:27.449170 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:27.449054    2573 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-image-registry-private-configuration\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 16:41:27.449170 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:27.449064    2573 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-installation-pull-secrets\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 16:41:27.449170 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:27.449072    2573 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-ca-trust-extracted\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 16:41:27.449170 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:27.449081    2573 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-bound-sa-token\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 16:41:27.449170 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:27.449090    2573 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a72e4071-c03c-44a6-a4b9-fe42565c2ca4-registry-certificates\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 16:41:27.497870 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:27.497845    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:27.503026 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:27.503005    2573 generic.go:356] "Generic (PLEG): container finished" podID="a72e4071-c03c-44a6-a4b9-fe42565c2ca4" containerID="361de23f8be1c5c393132b74c8517624db976740447a0c81e5e399c7cf545d7f" exitCode=0
Jul 13 16:41:27.503120 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:27.503047    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5759ccdd67-hqwxn"
Jul 13 16:41:27.503120 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:27.503094    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5759ccdd67-hqwxn" event={"ID":"a72e4071-c03c-44a6-a4b9-fe42565c2ca4","Type":"ContainerDied","Data":"361de23f8be1c5c393132b74c8517624db976740447a0c81e5e399c7cf545d7f"}
Jul 13 16:41:27.503220 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:27.503138    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5759ccdd67-hqwxn" event={"ID":"a72e4071-c03c-44a6-a4b9-fe42565c2ca4","Type":"ContainerDied","Data":"288225c3010df7c5af63f2cd7d1fde3c0b1232ae58e0df2a0b4cf4e32e86d0b5"}
Jul 13 16:41:27.503220 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:27.503162    2573 scope.go:117] "RemoveContainer" containerID="361de23f8be1c5c393132b74c8517624db976740447a0c81e5e399c7cf545d7f"
Jul 13 16:41:27.511513 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:27.511499    2573 scope.go:117] "RemoveContainer" containerID="361de23f8be1c5c393132b74c8517624db976740447a0c81e5e399c7cf545d7f"
Jul 13 16:41:27.511804 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:41:27.511781    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"361de23f8be1c5c393132b74c8517624db976740447a0c81e5e399c7cf545d7f\": container with ID starting with 361de23f8be1c5c393132b74c8517624db976740447a0c81e5e399c7cf545d7f not found: ID does not exist" containerID="361de23f8be1c5c393132b74c8517624db976740447a0c81e5e399c7cf545d7f"
Jul 13 16:41:27.511903 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:27.511810    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"361de23f8be1c5c393132b74c8517624db976740447a0c81e5e399c7cf545d7f"} err="failed to get container status \"361de23f8be1c5c393132b74c8517624db976740447a0c81e5e399c7cf545d7f\": rpc error: code = NotFound desc = could not find container \"361de23f8be1c5c393132b74c8517624db976740447a0c81e5e399c7cf545d7f\": container with ID starting with 361de23f8be1c5c393132b74c8517624db976740447a0c81e5e399c7cf545d7f not found: ID does not exist"
Jul 13 16:41:27.532167 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:27.532120    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5759ccdd67-hqwxn"]
Jul 13 16:41:27.539231 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:27.539210    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5759ccdd67-hqwxn"]
Jul 13 16:41:29.145415 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:29.145379    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a72e4071-c03c-44a6-a4b9-fe42565c2ca4" path="/var/lib/kubelet/pods/a72e4071-c03c-44a6-a4b9-fe42565c2ca4/volumes"
Jul 13 16:41:30.676969 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:30.676934    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:30.777276 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:30.777236    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:32.194736 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:32.194686    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:32.316328 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:32.316296    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:36.628851 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:36.628812    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:36.718204 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:36.718175    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:36.819530 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:36.819499    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:36.918549 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:36.918478    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:39.767990 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:39.767956    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:39.868932 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:39.868904    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:42.007615 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:42.007581    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:42.108814 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:42.108790    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:46.463236 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:46.463204    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5xx8s"
Jul 13 16:41:47.242668 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:47.242644    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5df2r_d7bcf65d-d075-4398-9822-afe9da65a227/serve-healthcheck-canary/0.log"
Jul 13 16:41:53.169818 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:53.169782    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:53.229745 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:53.229706    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:57.487595 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:57.487567    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:41:57.587737 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:41:57.587694    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:42:01.032923 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:42:01.032888    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:42:04.376927 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:42:04.376896    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:42:04.486581 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:42:04.486549    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:42:04.583220 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:42:04.583181    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:42:12.010474 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:42:12.010442    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:42:12.110860 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:42:12.110832    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:42:40.516975 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:42:40.516945    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:42:40.773322 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:42:40.773238    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:42:46.196998 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:42:46.196965    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:42:49.601906 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:42:49.601865    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:42:49.702088 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:42:49.702047    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:42:49.802114 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:42:49.802084    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:42:50.328064 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:42:50.328030    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:42:50.383098 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:42:50.383063    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:42:55.772714 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:42:55.772637    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:42:55.874242 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:42:55.874211    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:43:07.764206 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:43:07.764172    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:43:07.864192 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:43:07.864163    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:43:07.964962 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:43:07.964934    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:43:08.018175 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:43:08.018100    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:43:12.013791 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:43:12.013764    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:43:12.114574 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:43:12.114549    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:43:17.347259 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:43:17.347222    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:43:17.397959 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:43:17.397930    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:43:26.585430 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:43:26.585392    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:43:53.179126 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:43:53.179091    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:44:13.662279 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:44:13.662245    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:44:13.761586 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:44:13.761558    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:44:40.471196 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:44:40.471160    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:44:41.285090 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:44:41.285059    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:44:44.083022 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:44:44.082982    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:44:44.185332 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:44:44.185298    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:44:46.462874 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:44:46.462828    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:44:46.567933 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:44:46.567903    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:44:48.825912 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:44:48.825884    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:44:49.035878 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:44:49.035850    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:44:52.141909 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:44:52.141881    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:44:52.242136 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:44:52.242106    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:44:56.440099 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:44:56.440062    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:44:57.469603 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:44:57.469573    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:44:57.533740 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:44:57.533692    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:44:59.359347 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:44:59.359319    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:44:59.460013 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:44:59.459979    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:45:03.008483 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:03.008455    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnxdg_e1fb6130-2ab7-40f5-831c-ea95ff241f37/ovn-acl-logging/0.log"
Jul 13 16:45:03.011656 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:03.011635    2573 kubelet.go:1648] "Image garbage collection succeeded"
Jul 13 16:45:03.013621 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:03.013605    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnxdg_e1fb6130-2ab7-40f5-831c-ea95ff241f37/ovn-acl-logging/0.log"
Jul 13 16:45:05.901333 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:05.901301    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:45:08.429335 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:08.429301    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:45:16.365543 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:16.365501    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:45:16.459774 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:16.459746    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:45:23.732073 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:23.732042    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:45:23.827115 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:23.827080    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:45:24.530939 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:24.530891    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:45:24.762530 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:24.762494    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:45:24.867933 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:24.867854    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:45:24.897920 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:24.897895    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5857456dfc-lv8xx"]
Jul 13 16:45:24.898172 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:24.898158    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a72e4071-c03c-44a6-a4b9-fe42565c2ca4" containerName="registry"
Jul 13 16:45:24.898215 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:24.898174    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a72e4071-c03c-44a6-a4b9-fe42565c2ca4" containerName="registry"
Jul 13 16:45:24.898247 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:24.898218    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a72e4071-c03c-44a6-a4b9-fe42565c2ca4" containerName="registry"
Jul 13 16:45:24.900828 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:24.900812    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5857456dfc-lv8xx"
Jul 13 16:45:24.904515 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:24.904497    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 13 16:45:24.904818 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:24.904681    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 13 16:45:24.904818 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:24.904765    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 13 16:45:24.905188 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:24.905170    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-h2scv\""
Jul 13 16:45:24.905515 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:24.905493    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 13 16:45:24.918219 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:24.918198    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5857456dfc-lv8xx"]
Jul 13 16:45:25.050780 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:25.050744    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgrs9\" (UniqueName: \"kubernetes.io/projected/e0cc886a-da9e-421c-819b-9dcf35c46c3e-kube-api-access-tgrs9\") pod \"opendatahub-operator-controller-manager-5857456dfc-lv8xx\" (UID: \"e0cc886a-da9e-421c-819b-9dcf35c46c3e\") " pod="opendatahub/opendatahub-operator-controller-manager-5857456dfc-lv8xx"
Jul 13 16:45:25.050929 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:25.050794    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e0cc886a-da9e-421c-819b-9dcf35c46c3e-webhook-cert\") pod \"opendatahub-operator-controller-manager-5857456dfc-lv8xx\" (UID: \"e0cc886a-da9e-421c-819b-9dcf35c46c3e\") " pod="opendatahub/opendatahub-operator-controller-manager-5857456dfc-lv8xx"
Jul 13 16:45:25.050929 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:25.050852    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e0cc886a-da9e-421c-819b-9dcf35c46c3e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5857456dfc-lv8xx\" (UID: \"e0cc886a-da9e-421c-819b-9dcf35c46c3e\") " pod="opendatahub/opendatahub-operator-controller-manager-5857456dfc-lv8xx"
Jul 13 16:45:25.050929 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:25.050881    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e0cc886a-da9e-421c-819b-9dcf35c46c3e-manifests\") pod \"opendatahub-operator-controller-manager-5857456dfc-lv8xx\" (UID: \"e0cc886a-da9e-421c-819b-9dcf35c46c3e\") " pod="opendatahub/opendatahub-operator-controller-manager-5857456dfc-lv8xx"
Jul 13 16:45:25.050929 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:25.050898    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0cc886a-da9e-421c-819b-9dcf35c46c3e-tmp\") pod \"opendatahub-operator-controller-manager-5857456dfc-lv8xx\" (UID: \"e0cc886a-da9e-421c-819b-9dcf35c46c3e\") " pod="opendatahub/opendatahub-operator-controller-manager-5857456dfc-lv8xx"
Jul 13 16:45:25.125751 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:25.125663    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:45:25.152132 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:25.152107    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e0cc886a-da9e-421c-819b-9dcf35c46c3e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5857456dfc-lv8xx\" (UID: \"e0cc886a-da9e-421c-819b-9dcf35c46c3e\") " pod="opendatahub/opendatahub-operator-controller-manager-5857456dfc-lv8xx"
Jul 13 16:45:25.152245 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:25.152135    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e0cc886a-da9e-421c-819b-9dcf35c46c3e-manifests\") pod \"opendatahub-operator-controller-manager-5857456dfc-lv8xx\" (UID: \"e0cc886a-da9e-421c-819b-9dcf35c46c3e\") " pod="opendatahub/opendatahub-operator-controller-manager-5857456dfc-lv8xx"
Jul 13 16:45:25.152245 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:25.152155    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0cc886a-da9e-421c-819b-9dcf35c46c3e-tmp\") pod \"opendatahub-operator-controller-manager-5857456dfc-lv8xx\" (UID: \"e0cc886a-da9e-421c-819b-9dcf35c46c3e\") " pod="opendatahub/opendatahub-operator-controller-manager-5857456dfc-lv8xx"
Jul 13 16:45:25.152314 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:25.152270    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgrs9\" (UniqueName: \"kubernetes.io/projected/e0cc886a-da9e-421c-819b-9dcf35c46c3e-kube-api-access-tgrs9\") pod \"opendatahub-operator-controller-manager-5857456dfc-lv8xx\" (UID: \"e0cc886a-da9e-421c-819b-9dcf35c46c3e\") " pod="opendatahub/opendatahub-operator-controller-manager-5857456dfc-lv8xx"
Jul 13 16:45:25.152364 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:25.152310    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e0cc886a-da9e-421c-819b-9dcf35c46c3e-webhook-cert\") pod \"opendatahub-operator-controller-manager-5857456dfc-lv8xx\" (UID: \"e0cc886a-da9e-421c-819b-9dcf35c46c3e\") " pod="opendatahub/opendatahub-operator-controller-manager-5857456dfc-lv8xx"
Jul 13 16:45:25.152504 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:25.152484    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e0cc886a-da9e-421c-819b-9dcf35c46c3e-manifests\") pod \"opendatahub-operator-controller-manager-5857456dfc-lv8xx\" (UID: \"e0cc886a-da9e-421c-819b-9dcf35c46c3e\") " pod="opendatahub/opendatahub-operator-controller-manager-5857456dfc-lv8xx"
Jul 13 16:45:25.154372 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:25.154353    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0cc886a-da9e-421c-819b-9dcf35c46c3e-tmp\") pod \"opendatahub-operator-controller-manager-5857456dfc-lv8xx\" (UID: \"e0cc886a-da9e-421c-819b-9dcf35c46c3e\") " pod="opendatahub/opendatahub-operator-controller-manager-5857456dfc-lv8xx"
Jul 13 16:45:25.154585 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:25.154567    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e0cc886a-da9e-421c-819b-9dcf35c46c3e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5857456dfc-lv8xx\" (UID: \"e0cc886a-da9e-421c-819b-9dcf35c46c3e\") " pod="opendatahub/opendatahub-operator-controller-manager-5857456dfc-lv8xx"
Jul 13 16:45:25.154750 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:25.154711    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e0cc886a-da9e-421c-819b-9dcf35c46c3e-webhook-cert\") pod \"opendatahub-operator-controller-manager-5857456dfc-lv8xx\" (UID: \"e0cc886a-da9e-421c-819b-9dcf35c46c3e\") " pod="opendatahub/opendatahub-operator-controller-manager-5857456dfc-lv8xx"
Jul 13 16:45:25.161073 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:25.161052    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgrs9\" (UniqueName: \"kubernetes.io/projected/e0cc886a-da9e-421c-819b-9dcf35c46c3e-kube-api-access-tgrs9\") pod \"opendatahub-operator-controller-manager-5857456dfc-lv8xx\" (UID: \"e0cc886a-da9e-421c-819b-9dcf35c46c3e\") " pod="opendatahub/opendatahub-operator-controller-manager-5857456dfc-lv8xx"
Jul 13 16:45:25.210595 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:25.210570    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5857456dfc-lv8xx"
Jul 13 16:45:25.225190 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:25.225168    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:45:25.326536 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:25.326504    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:45:25.342520 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:25.342493    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5857456dfc-lv8xx"]
Jul 13 16:45:25.345525 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:45:25.345500    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0cc886a_da9e_421c_819b_9dcf35c46c3e.slice/crio-8c089f7077bb078863d5562e6f06908bc9f822ec45d5238517cfe4d243512085 WatchSource:0}: Error finding container 8c089f7077bb078863d5562e6f06908bc9f822ec45d5238517cfe4d243512085: Status 404 returned error can't find the container with id 8c089f7077bb078863d5562e6f06908bc9f822ec45d5238517cfe4d243512085
Jul 13 16:45:25.347233 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:25.347216    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 16:45:25.425584 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:25.425524    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:45:25.528846 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:25.528820    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:45:26.269332 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:26.269293    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5857456dfc-lv8xx" event={"ID":"e0cc886a-da9e-421c-819b-9dcf35c46c3e","Type":"ContainerStarted","Data":"8c089f7077bb078863d5562e6f06908bc9f822ec45d5238517cfe4d243512085"}
Jul 13 16:45:29.280811 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:29.280771    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5857456dfc-lv8xx" event={"ID":"e0cc886a-da9e-421c-819b-9dcf35c46c3e","Type":"ContainerStarted","Data":"b9a697bcb7d3756f8699db462141652fb4f78028ab9f5b07ba0b7258bcf34abd"}
Jul 13 16:45:30.285900 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:30.285869    2573 generic.go:356] "Generic (PLEG): container finished" podID="e0cc886a-da9e-421c-819b-9dcf35c46c3e" containerID="b9a697bcb7d3756f8699db462141652fb4f78028ab9f5b07ba0b7258bcf34abd" exitCode=0
Jul 13 16:45:30.286275 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:30.285923    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5857456dfc-lv8xx" event={"ID":"e0cc886a-da9e-421c-819b-9dcf35c46c3e","Type":"ContainerDied","Data":"b9a697bcb7d3756f8699db462141652fb4f78028ab9f5b07ba0b7258bcf34abd"}
Jul 13 16:45:31.292142 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:31.292107    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5857456dfc-lv8xx" event={"ID":"e0cc886a-da9e-421c-819b-9dcf35c46c3e","Type":"ContainerStarted","Data":"66b07dd46f949747defdf336c09ea5b19343b0eb56db803f56cfd2f39a752848"}
Jul 13 16:45:31.292498 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:31.292255    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5857456dfc-lv8xx"
Jul 13 16:45:31.312314 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:31.312267    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5857456dfc-lv8xx" podStartSLOduration=2.561659673 podStartE2EDuration="7.31225149s" totalImagesPullingTime="3.708608183s" totalInitContainerRuntime="1.041983634s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:45:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:45:31.311002992 +0000 UTC m=+328.669309839" watchObservedRunningTime="2026-07-13 16:45:31.31225149 +0000 UTC m=+328.670558314"
Jul 13 16:45:32.719380 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:32.719343    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:45:32.820981 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:32.820950    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:45:36.500518 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:36.500475    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:45:36.660862 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:36.660833    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:45:42.298275 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:42.298248    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5857456dfc-lv8xx"
Jul 13 16:45:44.026129 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:44.026097    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:45:44.148232 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:44.148196    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:45:44.830356 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:44.830322    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-7vb4t"]
Jul 13 16:45:44.844868 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:44.844841    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-7vb4t"
Jul 13 16:45:44.849850 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:44.849829    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-9lnzd\""
Jul 13 16:45:44.849995 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:44.849827    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 13 16:45:44.876866 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:44.876831    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-7vb4t"]
Jul 13 16:45:44.901216 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:44.901181    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:45:44.988604 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:44.988555    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:45:44.998592 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:44.998567    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5b4q\" (UniqueName: \"kubernetes.io/projected/4be7ab36-b9cf-418c-9cd3-e1b69fd2783f-kube-api-access-t5b4q\") pod \"odh-model-controller-7998c67dc4-7vb4t\" (UID: \"4be7ab36-b9cf-418c-9cd3-e1b69fd2783f\") " pod="opendatahub/odh-model-controller-7998c67dc4-7vb4t"
Jul 13 16:45:44.998660 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:44.998614    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4be7ab36-b9cf-418c-9cd3-e1b69fd2783f-cert\") pod \"odh-model-controller-7998c67dc4-7vb4t\" (UID: \"4be7ab36-b9cf-418c-9cd3-e1b69fd2783f\") " pod="opendatahub/odh-model-controller-7998c67dc4-7vb4t"
Jul 13 16:45:45.092166 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:45.092083    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:45:45.099160 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:45.099138    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5b4q\" (UniqueName: \"kubernetes.io/projected/4be7ab36-b9cf-418c-9cd3-e1b69fd2783f-kube-api-access-t5b4q\") pod \"odh-model-controller-7998c67dc4-7vb4t\" (UID: \"4be7ab36-b9cf-418c-9cd3-e1b69fd2783f\") " pod="opendatahub/odh-model-controller-7998c67dc4-7vb4t"
Jul 13 16:45:45.099240 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:45.099184    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4be7ab36-b9cf-418c-9cd3-e1b69fd2783f-cert\") pod \"odh-model-controller-7998c67dc4-7vb4t\" (UID: \"4be7ab36-b9cf-418c-9cd3-e1b69fd2783f\") " pod="opendatahub/odh-model-controller-7998c67dc4-7vb4t"
Jul 13 16:45:45.099307 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:45:45.099294    2573 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 13 16:45:45.099358 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:45:45.099349    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4be7ab36-b9cf-418c-9cd3-e1b69fd2783f-cert podName:4be7ab36-b9cf-418c-9cd3-e1b69fd2783f nodeName:}" failed. No retries permitted until 2026-07-13 16:45:45.599331582 +0000 UTC m=+342.957638400 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4be7ab36-b9cf-418c-9cd3-e1b69fd2783f-cert") pod "odh-model-controller-7998c67dc4-7vb4t" (UID: "4be7ab36-b9cf-418c-9cd3-e1b69fd2783f") : secret "odh-model-controller-webhook-cert" not found
Jul 13 16:45:45.110631 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:45.110610    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5b4q\" (UniqueName: \"kubernetes.io/projected/4be7ab36-b9cf-418c-9cd3-e1b69fd2783f-kube-api-access-t5b4q\") pod \"odh-model-controller-7998c67dc4-7vb4t\" (UID: \"4be7ab36-b9cf-418c-9cd3-e1b69fd2783f\") " pod="opendatahub/odh-model-controller-7998c67dc4-7vb4t"
Jul 13 16:45:45.412430 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:45.412349    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:45:45.534193 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:45.534164    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-fs2pt"]
Jul 13 16:45:45.537616 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:45.537597    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-fs2pt"
Jul 13 16:45:45.540280 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:45.540261    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 13 16:45:45.549118 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:45.549098    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-fs2pt"]
Jul 13 16:45:45.566360 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:45.566308    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:45:45.603252 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:45.603216    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4be7ab36-b9cf-418c-9cd3-e1b69fd2783f-cert\") pod \"odh-model-controller-7998c67dc4-7vb4t\" (UID: \"4be7ab36-b9cf-418c-9cd3-e1b69fd2783f\") " pod="opendatahub/odh-model-controller-7998c67dc4-7vb4t"
Jul 13 16:45:45.605641 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:45.605620    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4be7ab36-b9cf-418c-9cd3-e1b69fd2783f-cert\") pod \"odh-model-controller-7998c67dc4-7vb4t\" (UID: \"4be7ab36-b9cf-418c-9cd3-e1b69fd2783f\") " pod="opendatahub/odh-model-controller-7998c67dc4-7vb4t"
Jul 13 16:45:45.704028 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:45.703947    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp88j\" (UniqueName: \"kubernetes.io/projected/07d6eb79-d7ea-45ce-8961-f57645b1d55e-kube-api-access-wp88j\") pod \"model-serving-api-54d89bd5fc-fs2pt\" (UID: \"07d6eb79-d7ea-45ce-8961-f57645b1d55e\") " pod="opendatahub/model-serving-api-54d89bd5fc-fs2pt"
Jul 13 16:45:45.704028 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:45.703982    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07d6eb79-d7ea-45ce-8961-f57645b1d55e-tls-certs\") pod \"model-serving-api-54d89bd5fc-fs2pt\" (UID: \"07d6eb79-d7ea-45ce-8961-f57645b1d55e\") " pod="opendatahub/model-serving-api-54d89bd5fc-fs2pt"
Jul 13 16:45:45.726522 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:45.726480    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:45:45.756512 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:45.756476    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-7vb4t"
Jul 13 16:45:45.804646 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:45.804615    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp88j\" (UniqueName: \"kubernetes.io/projected/07d6eb79-d7ea-45ce-8961-f57645b1d55e-kube-api-access-wp88j\") pod \"model-serving-api-54d89bd5fc-fs2pt\" (UID: \"07d6eb79-d7ea-45ce-8961-f57645b1d55e\") " pod="opendatahub/model-serving-api-54d89bd5fc-fs2pt"
Jul 13 16:45:45.804646 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:45.804649    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07d6eb79-d7ea-45ce-8961-f57645b1d55e-tls-certs\") pod \"model-serving-api-54d89bd5fc-fs2pt\" (UID: \"07d6eb79-d7ea-45ce-8961-f57645b1d55e\") " pod="opendatahub/model-serving-api-54d89bd5fc-fs2pt"
Jul 13 16:45:45.807038 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:45.807018    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07d6eb79-d7ea-45ce-8961-f57645b1d55e-tls-certs\") pod \"model-serving-api-54d89bd5fc-fs2pt\" (UID: \"07d6eb79-d7ea-45ce-8961-f57645b1d55e\") " pod="opendatahub/model-serving-api-54d89bd5fc-fs2pt"
Jul 13 16:45:45.814955 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:45.814910    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp88j\" (UniqueName: \"kubernetes.io/projected/07d6eb79-d7ea-45ce-8961-f57645b1d55e-kube-api-access-wp88j\") pod \"model-serving-api-54d89bd5fc-fs2pt\" (UID: \"07d6eb79-d7ea-45ce-8961-f57645b1d55e\") " pod="opendatahub/model-serving-api-54d89bd5fc-fs2pt"
Jul 13 16:45:45.848280 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:45.848244    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-fs2pt"
Jul 13 16:45:45.895926 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:45.895874    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-7vb4t"]
Jul 13 16:45:45.901247 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:45:45.901221    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4be7ab36_b9cf_418c_9cd3_e1b69fd2783f.slice/crio-a460fd76bd3a365e4ead09b72a58e624d94320b046d4621803a703303e492ffd WatchSource:0}: Error finding container a460fd76bd3a365e4ead09b72a58e624d94320b046d4621803a703303e492ffd: Status 404 returned error can't find the container with id a460fd76bd3a365e4ead09b72a58e624d94320b046d4621803a703303e492ffd
Jul 13 16:45:45.985050 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:45.985020    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-fs2pt"]
Jul 13 16:45:45.988407 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:45:45.988372    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07d6eb79_d7ea_45ce_8961_f57645b1d55e.slice/crio-9af0a6cefbf4a5bc65480d82b7d0a212afec3c352a961009654e629d678069ce WatchSource:0}: Error finding container 9af0a6cefbf4a5bc65480d82b7d0a212afec3c352a961009654e629d678069ce: Status 404 returned error can't find the container with id 9af0a6cefbf4a5bc65480d82b7d0a212afec3c352a961009654e629d678069ce
Jul 13 16:45:46.343479 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:46.343379    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-7vb4t" event={"ID":"4be7ab36-b9cf-418c-9cd3-e1b69fd2783f","Type":"ContainerStarted","Data":"a460fd76bd3a365e4ead09b72a58e624d94320b046d4621803a703303e492ffd"}
Jul 13 16:45:46.344501 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:46.344470    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-fs2pt" event={"ID":"07d6eb79-d7ea-45ce-8961-f57645b1d55e","Type":"ContainerStarted","Data":"9af0a6cefbf4a5bc65480d82b7d0a212afec3c352a961009654e629d678069ce"}
Jul 13 16:45:48.355598 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:48.355557    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-fs2pt" event={"ID":"07d6eb79-d7ea-45ce-8961-f57645b1d55e","Type":"ContainerStarted","Data":"9b6e21380d60f53f4b894b3b4de1b158dd823d504e7dfa6c9739b648d510f369"}
Jul 13 16:45:48.356076 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:48.355820    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-fs2pt"
Jul 13 16:45:48.374492 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:48.374433    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-fs2pt" podStartSLOduration=1.686805425 podStartE2EDuration="3.374412487s" totalImagesPullingTime="1.687607062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:45:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:45:48.371638291 +0000 UTC m=+345.729945133" watchObservedRunningTime="2026-07-13 16:45:48.374412487 +0000 UTC m=+345.732719314"
Jul 13 16:45:49.994515 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:49.994485    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:45:50.025637 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:50.025604    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-8b9cf5f88-brspz"]
Jul 13 16:45:50.029360 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:50.029298    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8b9cf5f88-brspz"
Jul 13 16:45:50.031946 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:50.031920    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 13 16:45:50.032904 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:50.032880    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 13 16:45:50.033030 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:50.032950    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-gt2bf\""
Jul 13 16:45:50.033096 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:50.033084    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 13 16:45:50.033155 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:50.032882    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 13 16:45:50.039304 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:50.039283    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8b9cf5f88-brspz"]
Jul 13 16:45:50.139232 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:50.139196    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb54ecc6-f715-4c9d-9b07-55999b66b112-tls-certs\") pod \"kube-auth-proxy-8b9cf5f88-brspz\" (UID: \"fb54ecc6-f715-4c9d-9b07-55999b66b112\") " pod="openshift-ingress/kube-auth-proxy-8b9cf5f88-brspz"
Jul 13 16:45:50.139407 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:50.139259    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb54ecc6-f715-4c9d-9b07-55999b66b112-tmp\") pod \"kube-auth-proxy-8b9cf5f88-brspz\" (UID: \"fb54ecc6-f715-4c9d-9b07-55999b66b112\") " pod="openshift-ingress/kube-auth-proxy-8b9cf5f88-brspz"
Jul 13 16:45:50.139407 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:50.139388    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ks5fg\" (UniqueName: \"kubernetes.io/projected/fb54ecc6-f715-4c9d-9b07-55999b66b112-kube-api-access-ks5fg\") pod \"kube-auth-proxy-8b9cf5f88-brspz\" (UID: \"fb54ecc6-f715-4c9d-9b07-55999b66b112\") " pod="openshift-ingress/kube-auth-proxy-8b9cf5f88-brspz"
Jul 13 16:45:50.240307 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:50.240273    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb54ecc6-f715-4c9d-9b07-55999b66b112-tmp\") pod \"kube-auth-proxy-8b9cf5f88-brspz\" (UID: \"fb54ecc6-f715-4c9d-9b07-55999b66b112\") " pod="openshift-ingress/kube-auth-proxy-8b9cf5f88-brspz"
Jul 13 16:45:50.240504 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:50.240338    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ks5fg\" (UniqueName: \"kubernetes.io/projected/fb54ecc6-f715-4c9d-9b07-55999b66b112-kube-api-access-ks5fg\") pod \"kube-auth-proxy-8b9cf5f88-brspz\" (UID: \"fb54ecc6-f715-4c9d-9b07-55999b66b112\") " pod="openshift-ingress/kube-auth-proxy-8b9cf5f88-brspz"
Jul 13 16:45:50.240504 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:50.240370    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb54ecc6-f715-4c9d-9b07-55999b66b112-tls-certs\") pod \"kube-auth-proxy-8b9cf5f88-brspz\" (UID: \"fb54ecc6-f715-4c9d-9b07-55999b66b112\") " pod="openshift-ingress/kube-auth-proxy-8b9cf5f88-brspz"
Jul 13 16:45:50.240504 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:45:50.240482    2573 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 13 16:45:50.240657 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:45:50.240567    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb54ecc6-f715-4c9d-9b07-55999b66b112-tls-certs podName:fb54ecc6-f715-4c9d-9b07-55999b66b112 nodeName:}" failed. No retries permitted until 2026-07-13 16:45:50.740546576 +0000 UTC m=+348.098853382 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/fb54ecc6-f715-4c9d-9b07-55999b66b112-tls-certs") pod "kube-auth-proxy-8b9cf5f88-brspz" (UID: "fb54ecc6-f715-4c9d-9b07-55999b66b112") : secret "kube-auth-proxy-tls" not found
Jul 13 16:45:50.242735 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:50.242683    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb54ecc6-f715-4c9d-9b07-55999b66b112-tmp\") pod \"kube-auth-proxy-8b9cf5f88-brspz\" (UID: \"fb54ecc6-f715-4c9d-9b07-55999b66b112\") " pod="openshift-ingress/kube-auth-proxy-8b9cf5f88-brspz"
Jul 13 16:45:50.253861 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:50.253785    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks5fg\" (UniqueName: \"kubernetes.io/projected/fb54ecc6-f715-4c9d-9b07-55999b66b112-kube-api-access-ks5fg\") pod \"kube-auth-proxy-8b9cf5f88-brspz\" (UID: \"fb54ecc6-f715-4c9d-9b07-55999b66b112\") " pod="openshift-ingress/kube-auth-proxy-8b9cf5f88-brspz"
Jul 13 16:45:50.364975 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:50.364945    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-7vb4t" event={"ID":"4be7ab36-b9cf-418c-9cd3-e1b69fd2783f","Type":"ContainerStarted","Data":"1dfcdf38841a73f142e9bfa1b4c029dc65c01d2e52c5dfa40e485a24908d29c4"}
Jul 13 16:45:50.365113 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:50.365053    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-7vb4t"
Jul 13 16:45:50.383737 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:50.383661    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-7vb4t" podStartSLOduration=1.991999574 podStartE2EDuration="6.383643007s" totalImagesPullingTime="4.391643433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:45:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:45:50.381842234 +0000 UTC m=+347.740149058" watchObservedRunningTime="2026-07-13 16:45:50.383643007 +0000 UTC m=+347.741949851"
Jul 13 16:45:50.566950 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:50.566858    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:45:50.743967 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:50.743932    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb54ecc6-f715-4c9d-9b07-55999b66b112-tls-certs\") pod \"kube-auth-proxy-8b9cf5f88-brspz\" (UID: \"fb54ecc6-f715-4c9d-9b07-55999b66b112\") " pod="openshift-ingress/kube-auth-proxy-8b9cf5f88-brspz"
Jul 13 16:45:50.746586 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:50.746553    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb54ecc6-f715-4c9d-9b07-55999b66b112-tls-certs\") pod \"kube-auth-proxy-8b9cf5f88-brspz\" (UID: \"fb54ecc6-f715-4c9d-9b07-55999b66b112\") " pod="openshift-ingress/kube-auth-proxy-8b9cf5f88-brspz"
Jul 13 16:45:50.942801 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:50.942708    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8b9cf5f88-brspz"
Jul 13 16:45:51.082558 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:51.082520    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8b9cf5f88-brspz"]
Jul 13 16:45:51.085297 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:45:51.085247    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb54ecc6_f715_4c9d_9b07_55999b66b112.slice/crio-125d3d95daed299fdd8aa707628084871e5915a111ce1245f0800345d8ca5899 WatchSource:0}: Error finding container 125d3d95daed299fdd8aa707628084871e5915a111ce1245f0800345d8ca5899: Status 404 returned error can't find the container with id 125d3d95daed299fdd8aa707628084871e5915a111ce1245f0800345d8ca5899
Jul 13 16:45:51.372127 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:51.372085    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8b9cf5f88-brspz" event={"ID":"fb54ecc6-f715-4c9d-9b07-55999b66b112","Type":"ContainerStarted","Data":"125d3d95daed299fdd8aa707628084871e5915a111ce1245f0800345d8ca5899"}
Jul 13 16:45:51.561107 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:51.561080    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:45:51.576639 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:51.576613    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-tdpql"]
Jul 13 16:45:51.580830 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:51.580813    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tdpql"
Jul 13 16:45:51.583837 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:51.583819    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 13 16:45:51.583994 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:51.583972    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 13 16:45:51.584069 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:51.584028    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-6745p\""
Jul 13 16:45:51.584165 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:51.584144    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 13 16:45:51.584265 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:51.584250    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 13 16:45:51.596573 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:51.596547    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-tdpql"]
Jul 13 16:45:51.656025 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:51.655911    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:45:51.750958 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:51.750920    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f7a46e8b-c280-4ab8-a381-fc8335c78d84-cacerts\") pod \"istiod-openshift-gateway-7574459656-tdpql\" (UID: \"f7a46e8b-c280-4ab8-a381-fc8335c78d84\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tdpql"
Jul 13 16:45:51.750958 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:51.750959    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knfgl\" (UniqueName: \"kubernetes.io/projected/f7a46e8b-c280-4ab8-a381-fc8335c78d84-kube-api-access-knfgl\") pod \"istiod-openshift-gateway-7574459656-tdpql\" (UID: \"f7a46e8b-c280-4ab8-a381-fc8335c78d84\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tdpql"
Jul 13 16:45:51.751215 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:51.750995    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7a46e8b-c280-4ab8-a381-fc8335c78d84-istio-token\") pod \"istiod-openshift-gateway-7574459656-tdpql\" (UID: \"f7a46e8b-c280-4ab8-a381-fc8335c78d84\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tdpql"
Jul 13 16:45:51.751215 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:51.751016    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f7a46e8b-c280-4ab8-a381-fc8335c78d84-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-tdpql\" (UID: \"f7a46e8b-c280-4ab8-a381-fc8335c78d84\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tdpql"
Jul 13 16:45:51.751215 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:51.751089    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f7a46e8b-c280-4ab8-a381-fc8335c78d84-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-tdpql\" (UID: \"f7a46e8b-c280-4ab8-a381-fc8335c78d84\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tdpql"
Jul 13 16:45:51.751215 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:51.751174    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f7a46e8b-c280-4ab8-a381-fc8335c78d84-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-tdpql\" (UID: \"f7a46e8b-c280-4ab8-a381-fc8335c78d84\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tdpql"
Jul 13 16:45:51.751481 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:51.751234    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7a46e8b-c280-4ab8-a381-fc8335c78d84-local-certs\") pod \"istiod-openshift-gateway-7574459656-tdpql\" (UID: \"f7a46e8b-c280-4ab8-a381-fc8335c78d84\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tdpql"
Jul 13 16:45:51.852233 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:51.852201    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f7a46e8b-c280-4ab8-a381-fc8335c78d84-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-tdpql\" (UID: \"f7a46e8b-c280-4ab8-a381-fc8335c78d84\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tdpql"
Jul 13 16:45:51.852365 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:51.852251    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7a46e8b-c280-4ab8-a381-fc8335c78d84-local-certs\") pod \"istiod-openshift-gateway-7574459656-tdpql\" (UID: \"f7a46e8b-c280-4ab8-a381-fc8335c78d84\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tdpql"
Jul 13 16:45:51.852365 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:51.852285    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f7a46e8b-c280-4ab8-a381-fc8335c78d84-cacerts\") pod \"istiod-openshift-gateway-7574459656-tdpql\" (UID: \"f7a46e8b-c280-4ab8-a381-fc8335c78d84\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tdpql"
Jul 13 16:45:51.852454 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:51.852398    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knfgl\" (UniqueName: \"kubernetes.io/projected/f7a46e8b-c280-4ab8-a381-fc8335c78d84-kube-api-access-knfgl\") pod \"istiod-openshift-gateway-7574459656-tdpql\" (UID: \"f7a46e8b-c280-4ab8-a381-fc8335c78d84\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tdpql"
Jul 13 16:45:51.852454 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:51.852436    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7a46e8b-c280-4ab8-a381-fc8335c78d84-istio-token\") pod \"istiod-openshift-gateway-7574459656-tdpql\" (UID: \"f7a46e8b-c280-4ab8-a381-fc8335c78d84\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tdpql"
Jul 13 16:45:51.852554 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:51.852461    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f7a46e8b-c280-4ab8-a381-fc8335c78d84-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-tdpql\" (UID: \"f7a46e8b-c280-4ab8-a381-fc8335c78d84\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tdpql"
Jul 13 16:45:51.852554 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:51.852488    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f7a46e8b-c280-4ab8-a381-fc8335c78d84-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-tdpql\" (UID: \"f7a46e8b-c280-4ab8-a381-fc8335c78d84\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tdpql"
Jul 13 16:45:51.853122 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:51.853095    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f7a46e8b-c280-4ab8-a381-fc8335c78d84-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-tdpql\" (UID: \"f7a46e8b-c280-4ab8-a381-fc8335c78d84\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tdpql"
Jul 13 16:45:51.854606 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:51.854583    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7a46e8b-c280-4ab8-a381-fc8335c78d84-local-certs\") pod \"istiod-openshift-gateway-7574459656-tdpql\" (UID: \"f7a46e8b-c280-4ab8-a381-fc8335c78d84\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tdpql"
Jul 13 16:45:51.854701 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:51.854689    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f7a46e8b-c280-4ab8-a381-fc8335c78d84-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-tdpql\" (UID: \"f7a46e8b-c280-4ab8-a381-fc8335c78d84\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tdpql"
Jul 13 16:45:51.854904 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:51.854880    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f7a46e8b-c280-4ab8-a381-fc8335c78d84-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-tdpql\" (UID: \"f7a46e8b-c280-4ab8-a381-fc8335c78d84\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tdpql"
Jul 13 16:45:51.854943 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:51.854880    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f7a46e8b-c280-4ab8-a381-fc8335c78d84-cacerts\") pod \"istiod-openshift-gateway-7574459656-tdpql\" (UID: \"f7a46e8b-c280-4ab8-a381-fc8335c78d84\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tdpql"
Jul 13 16:45:51.860329 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:51.860300    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7a46e8b-c280-4ab8-a381-fc8335c78d84-istio-token\") pod \"istiod-openshift-gateway-7574459656-tdpql\" (UID: \"f7a46e8b-c280-4ab8-a381-fc8335c78d84\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tdpql"
Jul 13 16:45:51.860527 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:51.860511    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knfgl\" (UniqueName: \"kubernetes.io/projected/f7a46e8b-c280-4ab8-a381-fc8335c78d84-kube-api-access-knfgl\") pod \"istiod-openshift-gateway-7574459656-tdpql\" (UID: \"f7a46e8b-c280-4ab8-a381-fc8335c78d84\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-tdpql"
Jul 13 16:45:51.890421 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:51.890389    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tdpql"
Jul 13 16:45:52.048133 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:52.048105    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-tdpql"]
Jul 13 16:45:52.049701 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:45:52.049679    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7a46e8b_c280_4ab8_a381_fc8335c78d84.slice/crio-186ff1f1dc51d2eb55fd4039a2858df2fce0b5112a5f065b7fe58d1ffd78f5c9 WatchSource:0}: Error finding container 186ff1f1dc51d2eb55fd4039a2858df2fce0b5112a5f065b7fe58d1ffd78f5c9: Status 404 returned error can't find the container with id 186ff1f1dc51d2eb55fd4039a2858df2fce0b5112a5f065b7fe58d1ffd78f5c9
Jul 13 16:45:52.376216 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:52.376180    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tdpql" event={"ID":"f7a46e8b-c280-4ab8-a381-fc8335c78d84","Type":"ContainerStarted","Data":"186ff1f1dc51d2eb55fd4039a2858df2fce0b5112a5f065b7fe58d1ffd78f5c9"}
Jul 13 16:45:52.934673 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:52.934639    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:45:55.544337 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:55.544185    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:45:55.622784 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:55.622751    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-sbb74"]
Jul 13 16:45:55.625789 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:55.625768    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-cw5v4"]
Jul 13 16:45:55.625923 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:55.625889    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-sbb74"
Jul 13 16:45:55.629198 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:55.629103    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cw5v4"
Jul 13 16:45:55.631199 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:55.631179    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 13 16:45:55.631311 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:55.631211    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-gdvmg\""
Jul 13 16:45:55.632537 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:55.632349    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-4hrvh\""
Jul 13 16:45:55.632537 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:55.632420    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 13 16:45:55.643085 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:55.642943    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-sbb74"]
Jul 13 16:45:55.675398 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:55.674090    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:45:55.675398 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:55.674869    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-cw5v4"]
Jul 13 16:45:55.787741 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:55.787689    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cede14aa-0f7b-47da-8c71-ceeaa093534b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-cw5v4\" (UID: \"cede14aa-0f7b-47da-8c71-ceeaa093534b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cw5v4"
Jul 13 16:45:55.787913 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:55.787760    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28e7eae8-ab8c-486a-888f-78588b907aef-cert\") pod \"kserve-controller-manager-d6f4b65b8-sbb74\" (UID: \"28e7eae8-ab8c-486a-888f-78588b907aef\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-sbb74"
Jul 13 16:45:55.787913 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:55.787789    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rhjx\" (UniqueName: \"kubernetes.io/projected/28e7eae8-ab8c-486a-888f-78588b907aef-kube-api-access-4rhjx\") pod \"kserve-controller-manager-d6f4b65b8-sbb74\" (UID: \"28e7eae8-ab8c-486a-888f-78588b907aef\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-sbb74"
Jul 13 16:45:55.787913 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:55.787876    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksv86\" (UniqueName: \"kubernetes.io/projected/cede14aa-0f7b-47da-8c71-ceeaa093534b-kube-api-access-ksv86\") pod \"llmisvc-controller-manager-777c6bd7d5-cw5v4\" (UID: \"cede14aa-0f7b-47da-8c71-ceeaa093534b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cw5v4"
Jul 13 16:45:55.893336 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:55.893257    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksv86\" (UniqueName: \"kubernetes.io/projected/cede14aa-0f7b-47da-8c71-ceeaa093534b-kube-api-access-ksv86\") pod \"llmisvc-controller-manager-777c6bd7d5-cw5v4\" (UID: \"cede14aa-0f7b-47da-8c71-ceeaa093534b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cw5v4"
Jul 13 16:45:55.893336 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:55.893315    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cede14aa-0f7b-47da-8c71-ceeaa093534b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-cw5v4\" (UID: \"cede14aa-0f7b-47da-8c71-ceeaa093534b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cw5v4"
Jul 13 16:45:55.893557 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:55.893352    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28e7eae8-ab8c-486a-888f-78588b907aef-cert\") pod \"kserve-controller-manager-d6f4b65b8-sbb74\" (UID: \"28e7eae8-ab8c-486a-888f-78588b907aef\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-sbb74"
Jul 13 16:45:55.893557 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:55.893378    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rhjx\" (UniqueName: \"kubernetes.io/projected/28e7eae8-ab8c-486a-888f-78588b907aef-kube-api-access-4rhjx\") pod \"kserve-controller-manager-d6f4b65b8-sbb74\" (UID: \"28e7eae8-ab8c-486a-888f-78588b907aef\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-sbb74"
Jul 13 16:45:55.893557 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:45:55.893485    2573 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 13 16:45:55.893557 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:45:55.893550    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cede14aa-0f7b-47da-8c71-ceeaa093534b-cert podName:cede14aa-0f7b-47da-8c71-ceeaa093534b nodeName:}" failed. No retries permitted until 2026-07-13 16:45:56.393529711 +0000 UTC m=+353.751836519 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cede14aa-0f7b-47da-8c71-ceeaa093534b-cert") pod "llmisvc-controller-manager-777c6bd7d5-cw5v4" (UID: "cede14aa-0f7b-47da-8c71-ceeaa093534b") : secret "llmisvc-webhook-server-cert" not found
Jul 13 16:45:55.896343 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:55.896295    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28e7eae8-ab8c-486a-888f-78588b907aef-cert\") pod \"kserve-controller-manager-d6f4b65b8-sbb74\" (UID: \"28e7eae8-ab8c-486a-888f-78588b907aef\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-sbb74"
Jul 13 16:45:55.903453 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:55.903430    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rhjx\" (UniqueName: \"kubernetes.io/projected/28e7eae8-ab8c-486a-888f-78588b907aef-kube-api-access-4rhjx\") pod \"kserve-controller-manager-d6f4b65b8-sbb74\" (UID: \"28e7eae8-ab8c-486a-888f-78588b907aef\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-sbb74"
Jul 13 16:45:55.904168 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:55.904140    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksv86\" (UniqueName: \"kubernetes.io/projected/cede14aa-0f7b-47da-8c71-ceeaa093534b-kube-api-access-ksv86\") pod \"llmisvc-controller-manager-777c6bd7d5-cw5v4\" (UID: \"cede14aa-0f7b-47da-8c71-ceeaa093534b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cw5v4"
Jul 13 16:45:55.922832 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:55.922801    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:45:55.940887 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:55.940866    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-sbb74"
Jul 13 16:45:56.100025 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:56.099971    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:45:56.197357 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:56.197325    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-sbb74"]
Jul 13 16:45:56.199328 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:45:56.199305    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28e7eae8_ab8c_486a_888f_78588b907aef.slice/crio-7aae7cfde667b049d834917dc5491f9d70e043c0b4216a3d883d612d4e27eb8a WatchSource:0}: Error finding container 7aae7cfde667b049d834917dc5491f9d70e043c0b4216a3d883d612d4e27eb8a: Status 404 returned error can't find the container with id 7aae7cfde667b049d834917dc5491f9d70e043c0b4216a3d883d612d4e27eb8a
Jul 13 16:45:56.395859 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:56.395819    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8b9cf5f88-brspz" event={"ID":"fb54ecc6-f715-4c9d-9b07-55999b66b112","Type":"ContainerStarted","Data":"95bd05d79fb6e45554a3e1267d338c0b9b4d6ededbc8b5ca83de77d540af56f1"}
Jul 13 16:45:56.397333 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:56.397288    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-sbb74" event={"ID":"28e7eae8-ab8c-486a-888f-78588b907aef","Type":"ContainerStarted","Data":"7aae7cfde667b049d834917dc5491f9d70e043c0b4216a3d883d612d4e27eb8a"}
Jul 13 16:45:56.398666 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:56.398639    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cede14aa-0f7b-47da-8c71-ceeaa093534b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-cw5v4\" (UID: \"cede14aa-0f7b-47da-8c71-ceeaa093534b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cw5v4"
Jul 13 16:45:56.401337 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:56.401274    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cede14aa-0f7b-47da-8c71-ceeaa093534b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-cw5v4\" (UID: \"cede14aa-0f7b-47da-8c71-ceeaa093534b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cw5v4"
Jul 13 16:45:56.419813 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:56.419706    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-8b9cf5f88-brspz" podStartSLOduration=1.4065621209999999 podStartE2EDuration="6.419686968s" totalImagesPullingTime="5.013124847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:45:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:45:56.417904542 +0000 UTC m=+353.776211369" watchObservedRunningTime="2026-07-13 16:45:56.419686968 +0000 UTC m=+353.777993794"
Jul 13 16:45:56.548456 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:56.548422    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cw5v4"
Jul 13 16:45:56.750991 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:56.750957    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-cw5v4"]
Jul 13 16:45:56.754199 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:45:56.754171    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcede14aa_0f7b_47da_8c71_ceeaa093534b.slice/crio-7aa6d88d68a1fc26fc19441dd659e352d7c629ba51d92a14e5f80c666367e7b9 WatchSource:0}: Error finding container 7aa6d88d68a1fc26fc19441dd659e352d7c629ba51d92a14e5f80c666367e7b9: Status 404 returned error can't find the container with id 7aa6d88d68a1fc26fc19441dd659e352d7c629ba51d92a14e5f80c666367e7b9
Jul 13 16:45:56.881520 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:56.881483    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:45:57.404692 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:57.404610    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cw5v4" event={"ID":"cede14aa-0f7b-47da-8c71-ceeaa093534b","Type":"ContainerStarted","Data":"7aa6d88d68a1fc26fc19441dd659e352d7c629ba51d92a14e5f80c666367e7b9"}
Jul 13 16:45:58.014384 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:58.014346    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 16:45:58.014654 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:58.014410    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 16:45:58.051784 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:58.051741    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:45:58.139880 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:58.139831    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:45:58.390300 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:58.390232    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g57xp"]
Jul 13 16:45:58.403752 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:58.403135    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g57xp"
Jul 13 16:45:58.409749 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:58.409143    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-dxzdb\""
Jul 13 16:45:58.418185 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:58.414068    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw5qk\" (UniqueName: \"kubernetes.io/projected/cba63132-bdd7-44f1-a582-63536a10505e-kube-api-access-jw5qk\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g57xp\" (UID: \"cba63132-bdd7-44f1-a582-63536a10505e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g57xp"
Jul 13 16:45:58.418185 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:58.414134    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cba63132-bdd7-44f1-a582-63536a10505e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g57xp\" (UID: \"cba63132-bdd7-44f1-a582-63536a10505e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g57xp"
Jul 13 16:45:58.418185 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:58.414184    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cba63132-bdd7-44f1-a582-63536a10505e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g57xp\" (UID: \"cba63132-bdd7-44f1-a582-63536a10505e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g57xp"
Jul 13 16:45:58.418185 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:58.414206    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cba63132-bdd7-44f1-a582-63536a10505e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g57xp\" (UID: \"cba63132-bdd7-44f1-a582-63536a10505e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g57xp"
Jul 13 16:45:58.418185 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:58.414234    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cba63132-bdd7-44f1-a582-63536a10505e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g57xp\" (UID: \"cba63132-bdd7-44f1-a582-63536a10505e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g57xp"
Jul 13 16:45:58.418185 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:58.414270    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cba63132-bdd7-44f1-a582-63536a10505e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g57xp\" (UID: \"cba63132-bdd7-44f1-a582-63536a10505e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g57xp"
Jul 13 16:45:58.418185 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:58.414296    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cba63132-bdd7-44f1-a582-63536a10505e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g57xp\" (UID: \"cba63132-bdd7-44f1-a582-63536a10505e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g57xp"
Jul 13 16:45:58.418185 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:58.414332    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cba63132-bdd7-44f1-a582-63536a10505e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g57xp\" (UID: \"cba63132-bdd7-44f1-a582-63536a10505e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g57xp"
Jul 13 16:45:58.418185 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:58.414359    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cba63132-bdd7-44f1-a582-63536a10505e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g57xp\" (UID: \"cba63132-bdd7-44f1-a582-63536a10505e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g57xp"
Jul 13 16:45:58.418185 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:58.416006    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g57xp"]
Jul 13 16:45:58.422678 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:58.422108    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tdpql" event={"ID":"f7a46e8b-c280-4ab8-a381-fc8335c78d84","Type":"ContainerStarted","Data":"8c028b4b151471e0e799f2e4adffde693e8ba75a5d6b1fb3b7add3504a298bca"}
Jul 13 16:45:58.422678 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:58.422634    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tdpql"
Jul 13 16:45:58.433432 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:58.433208    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:45:58.454911 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:58.454848    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tdpql" podStartSLOduration=1.492444548 podStartE2EDuration="7.454828696s" totalImagesPullingTime="5.962384148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:45:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:45:58.45450702 +0000 UTC m=+355.812813870" watchObservedRunningTime="2026-07-13 16:45:58.454828696 +0000 UTC m=+355.813135526"
Jul 13 16:45:58.515170 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:58.515143    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cba63132-bdd7-44f1-a582-63536a10505e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g57xp\" (UID: \"cba63132-bdd7-44f1-a582-63536a10505e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g57xp"
Jul 13 16:45:58.515334 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:58.515180    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cba63132-bdd7-44f1-a582-63536a10505e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g57xp\" (UID: \"cba63132-bdd7-44f1-a582-63536a10505e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g57xp"
Jul 13 16:45:58.515334 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:58.515231    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw5qk\" (UniqueName: \"kubernetes.io/projected/cba63132-bdd7-44f1-a582-63536a10505e-kube-api-access-jw5qk\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g57xp\" (UID: \"cba63132-bdd7-44f1-a582-63536a10505e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g57xp"
Jul 13 16:45:58.515521 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:58.515488    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cba63132-bdd7-44f1-a582-63536a10505e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g57xp\" (UID: \"cba63132-bdd7-44f1-a582-63536a10505e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g57xp"
Jul 13 16:45:58.515646 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:58.515537    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cba63132-bdd7-44f1-a582-63536a10505e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g57xp\" (UID: \"cba63132-bdd7-44f1-a582-63536a10505e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g57xp"
Jul 13 16:45:58.515646 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:58.515599    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cba63132-bdd7-44f1-a582-63536a10505e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g57xp\" (UID: \"cba63132-bdd7-44f1-a582-63536a10505e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g57xp"
Jul 13 16:45:58.515646 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:58.515626    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cba63132-bdd7-44f1-a582-63536a10505e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g57xp\" (UID: \"cba63132-bdd7-44f1-a582-63536a10505e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g57xp"
Jul 13 16:45:58.515787 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:58.515656    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cba63132-bdd7-44f1-a582-63536a10505e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g57xp\" (UID: \"cba63132-bdd7-44f1-a582-63536a10505e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g57xp"
Jul 13 16:45:58.515787 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:58.515692    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cba63132-bdd7-44f1-a582-63536a10505e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g57xp\" (UID: \"cba63132-bdd7-44f1-a582-63536a10505e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g57xp"
Jul 13 16:45:58.515787 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:58.515698    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cba63132-bdd7-44f1-a582-63536a10505e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g57xp\" (UID: \"cba63132-bdd7-44f1-a582-63536a10505e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g57xp"
Jul 13 16:45:58.515893 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:58.515783    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cba63132-bdd7-44f1-a582-63536a10505e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g57xp\" (UID: \"cba63132-bdd7-44f1-a582-63536a10505e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g57xp"
Jul 13 16:45:58.515893 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:58.515858    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cba63132-bdd7-44f1-a582-63536a10505e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g57xp\" (UID: \"cba63132-bdd7-44f1-a582-63536a10505e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g57xp"
Jul 13 16:45:58.516326 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:58.516292    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cba63132-bdd7-44f1-a582-63536a10505e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g57xp\" (UID: \"cba63132-bdd7-44f1-a582-63536a10505e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g57xp"
Jul 13 16:45:58.516519 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:58.516490    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cba63132-bdd7-44f1-a582-63536a10505e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g57xp\" (UID: \"cba63132-bdd7-44f1-a582-63536a10505e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g57xp"
Jul 13 16:45:58.517984 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:58.517962    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cba63132-bdd7-44f1-a582-63536a10505e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g57xp\" (UID: \"cba63132-bdd7-44f1-a582-63536a10505e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g57xp"
Jul 13 16:45:58.518608 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:58.518589    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cba63132-bdd7-44f1-a582-63536a10505e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g57xp\" (UID: \"cba63132-bdd7-44f1-a582-63536a10505e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g57xp"
Jul 13 16:45:58.527891 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:58.527868    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cba63132-bdd7-44f1-a582-63536a10505e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g57xp\" (UID: \"cba63132-bdd7-44f1-a582-63536a10505e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g57xp"
Jul 13 16:45:58.528668 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:58.528645    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw5qk\" (UniqueName: \"kubernetes.io/projected/cba63132-bdd7-44f1-a582-63536a10505e-kube-api-access-jw5qk\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4g57xp\" (UID: \"cba63132-bdd7-44f1-a582-63536a10505e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g57xp"
Jul 13 16:45:58.534124 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:58.534099    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:45:58.721751 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:58.721703    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g57xp"
Jul 13 16:45:58.773306 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:58.773225    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:45:59.212963 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:59.212934    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g57xp"]
Jul 13 16:45:59.219204 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:45:59.219179    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcba63132_bdd7_44f1_a582_63536a10505e.slice/crio-57648ff1d079ee12779567f0ca589c35049e99854cae5b0c94cd46c4d6ac8488 WatchSource:0}: Error finding container 57648ff1d079ee12779567f0ca589c35049e99854cae5b0c94cd46c4d6ac8488: Status 404 returned error can't find the container with id 57648ff1d079ee12779567f0ca589c35049e99854cae5b0c94cd46c4d6ac8488
Jul 13 16:45:59.365192 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:59.365162    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-fs2pt"
Jul 13 16:45:59.428461 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:59.428385    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g57xp" event={"ID":"cba63132-bdd7-44f1-a582-63536a10505e","Type":"ContainerStarted","Data":"57648ff1d079ee12779567f0ca589c35049e99854cae5b0c94cd46c4d6ac8488"}
Jul 13 16:45:59.430510 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:45:59.430481    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tdpql"
Jul 13 16:46:00.436329 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:00.435838    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-sbb74" event={"ID":"28e7eae8-ab8c-486a-888f-78588b907aef","Type":"ContainerStarted","Data":"10881de230b92d4472a3591895aa6ddfccf99014968e535905173dbcce6deb3c"}
Jul 13 16:46:00.455993 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:00.455419    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-sbb74" podStartSLOduration=2.310457844 podStartE2EDuration="5.455396808s" totalImagesPullingTime="3.144938964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:45:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:46:00.454600659 +0000 UTC m=+357.812907486" watchObservedRunningTime="2026-07-13 16:46:00.455396808 +0000 UTC m=+357.813703638"
Jul 13 16:46:00.463990 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:00.463959    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-tdpql"]
Jul 13 16:46:01.375532 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:01.374934    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-7vb4t"
Jul 13 16:46:01.442405 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:01.442318    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-sbb74"
Jul 13 16:46:02.327077 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:02.327034    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 16:46:02.327183 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:02.327125    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 16:46:02.327183 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:02.327166    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 16:46:02.449464 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:02.449357    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g57xp" event={"ID":"cba63132-bdd7-44f1-a582-63536a10505e","Type":"ContainerStarted","Data":"47abb19d9a57342d0adb6d82fed8a235f0132b059f9b7059d7a7ab2eadee36da"}
Jul 13 16:46:02.449982 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:02.449488    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tdpql" podUID="f7a46e8b-c280-4ab8-a381-fc8335c78d84" containerName="discovery" containerID="cri-o://8c028b4b151471e0e799f2e4adffde693e8ba75a5d6b1fb3b7add3504a298bca" gracePeriod=30
Jul 13 16:46:02.491904 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:02.491849    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g57xp" podStartSLOduration=1.387061139 podStartE2EDuration="4.491829819s" totalImagesPullingTime="3.10476868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:45:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:46:02.491293348 +0000 UTC m=+359.849600174" watchObservedRunningTime="2026-07-13 16:46:02.491829819 +0000 UTC m=+359.850136645"
Jul 13 16:46:02.700478 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:02.700450    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tdpql"
Jul 13 16:46:02.722431 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:02.722404    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g57xp"
Jul 13 16:46:02.747834 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:02.747800    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f7a46e8b-c280-4ab8-a381-fc8335c78d84-istio-csr-dns-cert\") pod \"f7a46e8b-c280-4ab8-a381-fc8335c78d84\" (UID: \"f7a46e8b-c280-4ab8-a381-fc8335c78d84\") "
Jul 13 16:46:02.747991 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:02.747854    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f7a46e8b-c280-4ab8-a381-fc8335c78d84-istio-kubeconfig\") pod \"f7a46e8b-c280-4ab8-a381-fc8335c78d84\" (UID: \"f7a46e8b-c280-4ab8-a381-fc8335c78d84\") "
Jul 13 16:46:02.747991 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:02.747883    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knfgl\" (UniqueName: \"kubernetes.io/projected/f7a46e8b-c280-4ab8-a381-fc8335c78d84-kube-api-access-knfgl\") pod \"f7a46e8b-c280-4ab8-a381-fc8335c78d84\" (UID: \"f7a46e8b-c280-4ab8-a381-fc8335c78d84\") "
Jul 13 16:46:02.747991 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:02.747912    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7a46e8b-c280-4ab8-a381-fc8335c78d84-istio-token\") pod \"f7a46e8b-c280-4ab8-a381-fc8335c78d84\" (UID: \"f7a46e8b-c280-4ab8-a381-fc8335c78d84\") "
Jul 13 16:46:02.747991 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:02.747939    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7a46e8b-c280-4ab8-a381-fc8335c78d84-local-certs\") pod \"f7a46e8b-c280-4ab8-a381-fc8335c78d84\" (UID: \"f7a46e8b-c280-4ab8-a381-fc8335c78d84\") "
Jul 13 16:46:02.748188 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:02.748069    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f7a46e8b-c280-4ab8-a381-fc8335c78d84-cacerts\") pod \"f7a46e8b-c280-4ab8-a381-fc8335c78d84\" (UID: \"f7a46e8b-c280-4ab8-a381-fc8335c78d84\") "
Jul 13 16:46:02.748188 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:02.748156    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f7a46e8b-c280-4ab8-a381-fc8335c78d84-istio-csr-ca-configmap\") pod \"f7a46e8b-c280-4ab8-a381-fc8335c78d84\" (UID: \"f7a46e8b-c280-4ab8-a381-fc8335c78d84\") "
Jul 13 16:46:02.748813 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:02.748757    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7a46e8b-c280-4ab8-a381-fc8335c78d84-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "f7a46e8b-c280-4ab8-a381-fc8335c78d84" (UID: "f7a46e8b-c280-4ab8-a381-fc8335c78d84"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 16:46:02.750464 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:02.750436    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7a46e8b-c280-4ab8-a381-fc8335c78d84-cacerts" (OuterVolumeSpecName: "cacerts") pod "f7a46e8b-c280-4ab8-a381-fc8335c78d84" (UID: "f7a46e8b-c280-4ab8-a381-fc8335c78d84"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 16:46:02.750595 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:02.750581    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7a46e8b-c280-4ab8-a381-fc8335c78d84-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "f7a46e8b-c280-4ab8-a381-fc8335c78d84" (UID: "f7a46e8b-c280-4ab8-a381-fc8335c78d84"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 16:46:02.750664 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:02.750585    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7a46e8b-c280-4ab8-a381-fc8335c78d84-istio-token" (OuterVolumeSpecName: "istio-token") pod "f7a46e8b-c280-4ab8-a381-fc8335c78d84" (UID: "f7a46e8b-c280-4ab8-a381-fc8335c78d84"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 16:46:02.750715 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:02.750668    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7a46e8b-c280-4ab8-a381-fc8335c78d84-kube-api-access-knfgl" (OuterVolumeSpecName: "kube-api-access-knfgl") pod "f7a46e8b-c280-4ab8-a381-fc8335c78d84" (UID: "f7a46e8b-c280-4ab8-a381-fc8335c78d84"). InnerVolumeSpecName "kube-api-access-knfgl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 16:46:02.750715 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:02.750677    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7a46e8b-c280-4ab8-a381-fc8335c78d84-local-certs" (OuterVolumeSpecName: "local-certs") pod "f7a46e8b-c280-4ab8-a381-fc8335c78d84" (UID: "f7a46e8b-c280-4ab8-a381-fc8335c78d84"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:46:02.750715 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:02.750677    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7a46e8b-c280-4ab8-a381-fc8335c78d84-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "f7a46e8b-c280-4ab8-a381-fc8335c78d84" (UID: "f7a46e8b-c280-4ab8-a381-fc8335c78d84"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 16:46:02.849181 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:02.849147    2573 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f7a46e8b-c280-4ab8-a381-fc8335c78d84-istio-csr-ca-configmap\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 16:46:02.849181 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:02.849175    2573 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f7a46e8b-c280-4ab8-a381-fc8335c78d84-istio-csr-dns-cert\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 16:46:02.849181 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:02.849185    2573 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f7a46e8b-c280-4ab8-a381-fc8335c78d84-istio-kubeconfig\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 16:46:02.849385 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:02.849194    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knfgl\" (UniqueName: \"kubernetes.io/projected/f7a46e8b-c280-4ab8-a381-fc8335c78d84-kube-api-access-knfgl\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 16:46:02.849385 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:02.849213    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7a46e8b-c280-4ab8-a381-fc8335c78d84-istio-token\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 16:46:02.849385 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:02.849220    2573 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7a46e8b-c280-4ab8-a381-fc8335c78d84-local-certs\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 16:46:02.849385 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:02.849227    2573 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f7a46e8b-c280-4ab8-a381-fc8335c78d84-cacerts\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 16:46:03.455481 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:03.455380    2573 generic.go:356] "Generic (PLEG): container finished" podID="f7a46e8b-c280-4ab8-a381-fc8335c78d84" containerID="8c028b4b151471e0e799f2e4adffde693e8ba75a5d6b1fb3b7add3504a298bca" exitCode=0
Jul 13 16:46:03.455481 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:03.455445    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tdpql"
Jul 13 16:46:03.455481 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:03.455463    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tdpql" event={"ID":"f7a46e8b-c280-4ab8-a381-fc8335c78d84","Type":"ContainerDied","Data":"8c028b4b151471e0e799f2e4adffde693e8ba75a5d6b1fb3b7add3504a298bca"}
Jul 13 16:46:03.456058 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:03.455528    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-tdpql" event={"ID":"f7a46e8b-c280-4ab8-a381-fc8335c78d84","Type":"ContainerDied","Data":"186ff1f1dc51d2eb55fd4039a2858df2fce0b5112a5f065b7fe58d1ffd78f5c9"}
Jul 13 16:46:03.456058 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:03.455562    2573 scope.go:117] "RemoveContainer" containerID="8c028b4b151471e0e799f2e4adffde693e8ba75a5d6b1fb3b7add3504a298bca"
Jul 13 16:46:03.457311 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:03.457288    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cw5v4" event={"ID":"cede14aa-0f7b-47da-8c71-ceeaa093534b","Type":"ContainerStarted","Data":"9dcc3835c567a569d94c0c1efa982597de527fdcd59f491135eb846a72cd2139"}
Jul 13 16:46:03.458047 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:03.457474    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cw5v4"
Jul 13 16:46:03.463762 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:03.463739    2573 scope.go:117] "RemoveContainer" containerID="8c028b4b151471e0e799f2e4adffde693e8ba75a5d6b1fb3b7add3504a298bca"
Jul 13 16:46:03.464034 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:46:03.464013    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c028b4b151471e0e799f2e4adffde693e8ba75a5d6b1fb3b7add3504a298bca\": container with ID starting with 8c028b4b151471e0e799f2e4adffde693e8ba75a5d6b1fb3b7add3504a298bca not found: ID does not exist" containerID="8c028b4b151471e0e799f2e4adffde693e8ba75a5d6b1fb3b7add3504a298bca"
Jul 13 16:46:03.464103 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:03.464040    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c028b4b151471e0e799f2e4adffde693e8ba75a5d6b1fb3b7add3504a298bca"} err="failed to get container status \"8c028b4b151471e0e799f2e4adffde693e8ba75a5d6b1fb3b7add3504a298bca\": rpc error: code = NotFound desc = could not find container \"8c028b4b151471e0e799f2e4adffde693e8ba75a5d6b1fb3b7add3504a298bca\": container with ID starting with 8c028b4b151471e0e799f2e4adffde693e8ba75a5d6b1fb3b7add3504a298bca not found: ID does not exist"
Jul 13 16:46:03.478579 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:03.478532    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cw5v4" podStartSLOduration=2.905025276 podStartE2EDuration="8.47851729s" totalImagesPullingTime="5.573492014s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:45:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:46:03.478006599 +0000 UTC m=+360.836313447" watchObservedRunningTime="2026-07-13 16:46:03.47851729 +0000 UTC m=+360.836824120"
Jul 13 16:46:03.492452 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:03.492427    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-tdpql"]
Jul 13 16:46:03.499393 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:03.499374    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-tdpql"]
Jul 13 16:46:03.726359 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:03.726331    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g57xp"
Jul 13 16:46:04.462979 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:04.462937    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g57xp"
Jul 13 16:46:04.463887 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:04.463867    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4g57xp"
Jul 13 16:46:05.146932 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:05.146903    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7a46e8b-c280-4ab8-a381-fc8335c78d84" path="/var/lib/kubelet/pods/f7a46e8b-c280-4ab8-a381-fc8335c78d84/volumes"
Jul 13 16:46:32.454820 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:32.454788    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-sbb74"
Jul 13 16:46:34.465151 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:34.465126    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cw5v4"
Jul 13 16:46:45.534665 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:45.534632    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:46:45.703551 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:45.703520    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gf2pq"]
Jul 13 16:46:45.703885 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:45.703871    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7a46e8b-c280-4ab8-a381-fc8335c78d84" containerName="discovery"
Jul 13 16:46:45.703943 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:45.703888    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7a46e8b-c280-4ab8-a381-fc8335c78d84" containerName="discovery"
Jul 13 16:46:45.703989 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:45.703943    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7a46e8b-c280-4ab8-a381-fc8335c78d84" containerName="discovery"
Jul 13 16:46:45.705729 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:45.705703    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gf2pq"
Jul 13 16:46:45.708465 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:45.708442    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 13 16:46:45.709522 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:45.709501    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-2zq7v\""
Jul 13 16:46:45.709522 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:45.709521    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 13 16:46:45.716168 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:45.716144    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gf2pq"]
Jul 13 16:46:45.780464 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:45.780434    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hwfq\" (UniqueName: \"kubernetes.io/projected/16b140ce-aee0-4f9a-ac31-be7429dcf294-kube-api-access-7hwfq\") pod \"kuadrant-operator-catalog-gf2pq\" (UID: \"16b140ce-aee0-4f9a-ac31-be7429dcf294\") " pod="kuadrant-system/kuadrant-operator-catalog-gf2pq"
Jul 13 16:46:45.881509 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:45.881433    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hwfq\" (UniqueName: \"kubernetes.io/projected/16b140ce-aee0-4f9a-ac31-be7429dcf294-kube-api-access-7hwfq\") pod \"kuadrant-operator-catalog-gf2pq\" (UID: \"16b140ce-aee0-4f9a-ac31-be7429dcf294\") " pod="kuadrant-system/kuadrant-operator-catalog-gf2pq"
Jul 13 16:46:45.890368 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:45.890344    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hwfq\" (UniqueName: \"kubernetes.io/projected/16b140ce-aee0-4f9a-ac31-be7429dcf294-kube-api-access-7hwfq\") pod \"kuadrant-operator-catalog-gf2pq\" (UID: \"16b140ce-aee0-4f9a-ac31-be7429dcf294\") " pod="kuadrant-system/kuadrant-operator-catalog-gf2pq"
Jul 13 16:46:45.962801 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:45.962770    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gf2pq"]
Jul 13 16:46:45.963026 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:45.963012    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gf2pq"
Jul 13 16:46:46.090031 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:46.089996    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gf2pq"]
Jul 13 16:46:46.093115 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:46:46.093089    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16b140ce_aee0_4f9a_ac31_be7429dcf294.slice/crio-234ced0ea601a637139f3984b67b37787ac02a3aab5582dc2c8cf6728b141c1d WatchSource:0}: Error finding container 234ced0ea601a637139f3984b67b37787ac02a3aab5582dc2c8cf6728b141c1d: Status 404 returned error can't find the container with id 234ced0ea601a637139f3984b67b37787ac02a3aab5582dc2c8cf6728b141c1d
Jul 13 16:46:46.173540 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:46.173479    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-k2lpp"]
Jul 13 16:46:46.176147 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:46.176128    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-k2lpp"
Jul 13 16:46:46.185988 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:46.185967    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-k2lpp"]
Jul 13 16:46:46.284897 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:46.284862    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfxcr\" (UniqueName: \"kubernetes.io/projected/69c2a54f-91d0-4120-9bc9-1aa7f8f72049-kube-api-access-cfxcr\") pod \"kuadrant-operator-catalog-k2lpp\" (UID: \"69c2a54f-91d0-4120-9bc9-1aa7f8f72049\") " pod="kuadrant-system/kuadrant-operator-catalog-k2lpp"
Jul 13 16:46:46.385780 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:46.385748    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfxcr\" (UniqueName: \"kubernetes.io/projected/69c2a54f-91d0-4120-9bc9-1aa7f8f72049-kube-api-access-cfxcr\") pod \"kuadrant-operator-catalog-k2lpp\" (UID: \"69c2a54f-91d0-4120-9bc9-1aa7f8f72049\") " pod="kuadrant-system/kuadrant-operator-catalog-k2lpp"
Jul 13 16:46:46.393984 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:46.393960    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfxcr\" (UniqueName: \"kubernetes.io/projected/69c2a54f-91d0-4120-9bc9-1aa7f8f72049-kube-api-access-cfxcr\") pod \"kuadrant-operator-catalog-k2lpp\" (UID: \"69c2a54f-91d0-4120-9bc9-1aa7f8f72049\") " pod="kuadrant-system/kuadrant-operator-catalog-k2lpp"
Jul 13 16:46:46.472852 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:46.472822    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:46:46.484922 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:46.484898    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-k2lpp"
Jul 13 16:46:46.573250 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:46.573225    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:46:46.612033 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:46.612010    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-k2lpp"]
Jul 13 16:46:46.614419 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:46:46.614393    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69c2a54f_91d0_4120_9bc9_1aa7f8f72049.slice/crio-ee7bec50d387ced0b5bd1f6bb6aef5f40c769bd4b32bfb69d0aa832828a75488 WatchSource:0}: Error finding container ee7bec50d387ced0b5bd1f6bb6aef5f40c769bd4b32bfb69d0aa832828a75488: Status 404 returned error can't find the container with id ee7bec50d387ced0b5bd1f6bb6aef5f40c769bd4b32bfb69d0aa832828a75488
Jul 13 16:46:46.628580 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:46.628556    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gf2pq" event={"ID":"16b140ce-aee0-4f9a-ac31-be7429dcf294","Type":"ContainerStarted","Data":"234ced0ea601a637139f3984b67b37787ac02a3aab5582dc2c8cf6728b141c1d"}
Jul 13 16:46:46.629633 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:46.629611    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-k2lpp" event={"ID":"69c2a54f-91d0-4120-9bc9-1aa7f8f72049","Type":"ContainerStarted","Data":"ee7bec50d387ced0b5bd1f6bb6aef5f40c769bd4b32bfb69d0aa832828a75488"}
Jul 13 16:46:46.673658 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:46.673633    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:46:48.640550 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:48.640518    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-k2lpp" event={"ID":"69c2a54f-91d0-4120-9bc9-1aa7f8f72049","Type":"ContainerStarted","Data":"e4ea173f0fe5d05aa45731362b459e2101bab7bdc585baf7cd524d949d844f8e"}
Jul 13 16:46:48.641908 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:48.641880    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gf2pq" event={"ID":"16b140ce-aee0-4f9a-ac31-be7429dcf294","Type":"ContainerStarted","Data":"ed177e7c16ecc6fb4552a6a5941469b77ff0efe2f735b1a1faaaf537d6cbf017"}
Jul 13 16:46:48.642019 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:48.641971    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-gf2pq" podUID="16b140ce-aee0-4f9a-ac31-be7429dcf294" containerName="registry-server" containerID="cri-o://ed177e7c16ecc6fb4552a6a5941469b77ff0efe2f735b1a1faaaf537d6cbf017" gracePeriod=2
Jul 13 16:46:48.657530 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:48.657490    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-k2lpp" podStartSLOduration=1.176473769 podStartE2EDuration="2.657474135s" totalImagesPullingTime="1.481000366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:46:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:46:48.657009195 +0000 UTC m=+406.015316069" watchObservedRunningTime="2026-07-13 16:46:48.657474135 +0000 UTC m=+406.015780959"
Jul 13 16:46:48.677161 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:48.677118    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-gf2pq" podStartSLOduration=1.6776173349999999 podStartE2EDuration="3.677103688s" totalImagesPullingTime="1.999486353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:46:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:46:48.675504111 +0000 UTC m=+406.033810947" watchObservedRunningTime="2026-07-13 16:46:48.677103688 +0000 UTC m=+406.035410513"
Jul 13 16:46:48.874914 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:48.874889    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gf2pq"
Jul 13 16:46:49.008937 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:49.008912    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hwfq\" (UniqueName: \"kubernetes.io/projected/16b140ce-aee0-4f9a-ac31-be7429dcf294-kube-api-access-7hwfq\") pod \"16b140ce-aee0-4f9a-ac31-be7429dcf294\" (UID: \"16b140ce-aee0-4f9a-ac31-be7429dcf294\") "
Jul 13 16:46:49.010980 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:49.010955    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16b140ce-aee0-4f9a-ac31-be7429dcf294-kube-api-access-7hwfq" (OuterVolumeSpecName: "kube-api-access-7hwfq") pod "16b140ce-aee0-4f9a-ac31-be7429dcf294" (UID: "16b140ce-aee0-4f9a-ac31-be7429dcf294"). InnerVolumeSpecName "kube-api-access-7hwfq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 16:46:49.109503 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:49.109476    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hwfq\" (UniqueName: \"kubernetes.io/projected/16b140ce-aee0-4f9a-ac31-be7429dcf294-kube-api-access-7hwfq\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 16:46:49.646918 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:49.646883    2573 generic.go:356] "Generic (PLEG): container finished" podID="16b140ce-aee0-4f9a-ac31-be7429dcf294" containerID="ed177e7c16ecc6fb4552a6a5941469b77ff0efe2f735b1a1faaaf537d6cbf017" exitCode=0
Jul 13 16:46:49.647314 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:49.646939    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gf2pq"
Jul 13 16:46:49.647314 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:49.646970    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gf2pq" event={"ID":"16b140ce-aee0-4f9a-ac31-be7429dcf294","Type":"ContainerDied","Data":"ed177e7c16ecc6fb4552a6a5941469b77ff0efe2f735b1a1faaaf537d6cbf017"}
Jul 13 16:46:49.647314 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:49.647048    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gf2pq" event={"ID":"16b140ce-aee0-4f9a-ac31-be7429dcf294","Type":"ContainerDied","Data":"234ced0ea601a637139f3984b67b37787ac02a3aab5582dc2c8cf6728b141c1d"}
Jul 13 16:46:49.647314 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:49.647073    2573 scope.go:117] "RemoveContainer" containerID="ed177e7c16ecc6fb4552a6a5941469b77ff0efe2f735b1a1faaaf537d6cbf017"
Jul 13 16:46:49.657307 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:49.657290    2573 scope.go:117] "RemoveContainer" containerID="ed177e7c16ecc6fb4552a6a5941469b77ff0efe2f735b1a1faaaf537d6cbf017"
Jul 13 16:46:49.657545 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:46:49.657525    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed177e7c16ecc6fb4552a6a5941469b77ff0efe2f735b1a1faaaf537d6cbf017\": container with ID starting with ed177e7c16ecc6fb4552a6a5941469b77ff0efe2f735b1a1faaaf537d6cbf017 not found: ID does not exist" containerID="ed177e7c16ecc6fb4552a6a5941469b77ff0efe2f735b1a1faaaf537d6cbf017"
Jul 13 16:46:49.657604 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:49.657557    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed177e7c16ecc6fb4552a6a5941469b77ff0efe2f735b1a1faaaf537d6cbf017"} err="failed to get container status \"ed177e7c16ecc6fb4552a6a5941469b77ff0efe2f735b1a1faaaf537d6cbf017\": rpc error: code = NotFound desc = could not find container \"ed177e7c16ecc6fb4552a6a5941469b77ff0efe2f735b1a1faaaf537d6cbf017\": container with ID starting with ed177e7c16ecc6fb4552a6a5941469b77ff0efe2f735b1a1faaaf537d6cbf017 not found: ID does not exist"
Jul 13 16:46:49.665389 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:49.665368    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gf2pq"]
Jul 13 16:46:49.669715 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:49.669696    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gf2pq"]
Jul 13 16:46:51.145969 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:51.145941    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16b140ce-aee0-4f9a-ac31-be7429dcf294" path="/var/lib/kubelet/pods/16b140ce-aee0-4f9a-ac31-be7429dcf294/volumes"
Jul 13 16:46:52.399557 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:52.399530    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:46:56.485600 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:56.485554    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-k2lpp"
Jul 13 16:46:56.486037 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:56.485632    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-k2lpp"
Jul 13 16:46:56.507701 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:56.507678    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-k2lpp"
Jul 13 16:46:56.698377 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:46:56.698351    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-k2lpp"
Jul 13 16:47:02.395143 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:02.395109    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:47:02.496480 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:02.496453    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:47:15.023009 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:15.022974    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:47:16.718754 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:16.718704    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:47:16.828224 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:16.828196    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:47:19.129997 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:19.129953    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-5c4n5"]
Jul 13 16:47:19.130355 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:19.130249    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16b140ce-aee0-4f9a-ac31-be7429dcf294" containerName="registry-server"
Jul 13 16:47:19.130355 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:19.130260    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="16b140ce-aee0-4f9a-ac31-be7429dcf294" containerName="registry-server"
Jul 13 16:47:19.130355 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:19.130313    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="16b140ce-aee0-4f9a-ac31-be7429dcf294" containerName="registry-server"
Jul 13 16:47:19.137859 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:19.137839    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5c4n5"
Jul 13 16:47:19.141514 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:19.141491    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-gcxrk\""
Jul 13 16:47:19.147629 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:19.147607    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-5c4n5"]
Jul 13 16:47:19.233826 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:19.233797    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmpbh\" (UniqueName: \"kubernetes.io/projected/d52179ea-be4b-4d06-b3a6-850ed89b5e5d-kube-api-access-fmpbh\") pod \"authorino-operator-75cc8d5cb7-5c4n5\" (UID: \"d52179ea-be4b-4d06-b3a6-850ed89b5e5d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-5c4n5"
Jul 13 16:47:19.334991 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:19.334963    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmpbh\" (UniqueName: \"kubernetes.io/projected/d52179ea-be4b-4d06-b3a6-850ed89b5e5d-kube-api-access-fmpbh\") pod \"authorino-operator-75cc8d5cb7-5c4n5\" (UID: \"d52179ea-be4b-4d06-b3a6-850ed89b5e5d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-5c4n5"
Jul 13 16:47:19.350217 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:19.350183    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmpbh\" (UniqueName: \"kubernetes.io/projected/d52179ea-be4b-4d06-b3a6-850ed89b5e5d-kube-api-access-fmpbh\") pod \"authorino-operator-75cc8d5cb7-5c4n5\" (UID: \"d52179ea-be4b-4d06-b3a6-850ed89b5e5d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-5c4n5"
Jul 13 16:47:19.448349 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:19.448274    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5c4n5"
Jul 13 16:47:19.591442 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:19.591418    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-5c4n5"]
Jul 13 16:47:19.593848 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:47:19.593821    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd52179ea_be4b_4d06_b3a6_850ed89b5e5d.slice/crio-2410718330d3aec8f26d95159009935094ddeb0880cbdba3d5ebb17a9765217b WatchSource:0}: Error finding container 2410718330d3aec8f26d95159009935094ddeb0880cbdba3d5ebb17a9765217b: Status 404 returned error can't find the container with id 2410718330d3aec8f26d95159009935094ddeb0880cbdba3d5ebb17a9765217b
Jul 13 16:47:19.765380 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:19.765343    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5c4n5" event={"ID":"d52179ea-be4b-4d06-b3a6-850ed89b5e5d","Type":"ContainerStarted","Data":"2410718330d3aec8f26d95159009935094ddeb0880cbdba3d5ebb17a9765217b"}
Jul 13 16:47:19.766132 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:19.766111    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:47:22.780274 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:22.780238    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5c4n5" event={"ID":"d52179ea-be4b-4d06-b3a6-850ed89b5e5d","Type":"ContainerStarted","Data":"e2a3674f1460f00cf8152586db9b5502c642ba341569204449acfb9e709ff648"}
Jul 13 16:47:22.780761 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:22.780354    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5c4n5"
Jul 13 16:47:22.799700 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:22.799657    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5c4n5" podStartSLOduration=1.5400232740000002 podStartE2EDuration="3.799643315s" totalImagesPullingTime="2.259620041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:47:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:47:22.79886444 +0000 UTC m=+440.157171289" watchObservedRunningTime="2026-07-13 16:47:22.799643315 +0000 UTC m=+440.157950208"
Jul 13 16:47:23.574233 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:23.574199    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k5f22"]
Jul 13 16:47:23.577433 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:23.577417    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k5f22"
Jul 13 16:47:23.579121 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:23.579097    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:47:23.579919 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:23.579903    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-k29jm\""
Jul 13 16:47:23.607257 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:23.607232    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k5f22"]
Jul 13 16:47:23.668338 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:23.668311    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzzzp\" (UniqueName: \"kubernetes.io/projected/c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51-kube-api-access-nzzzp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k5f22\" (UID: \"c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k5f22"
Jul 13 16:47:23.668457 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:23.668355    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k5f22\" (UID: \"c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k5f22"
Jul 13 16:47:23.769554 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:23.769523    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k5f22\" (UID: \"c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k5f22"
Jul 13 16:47:23.769687 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:23.769585    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzzzp\" (UniqueName: \"kubernetes.io/projected/c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51-kube-api-access-nzzzp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k5f22\" (UID: \"c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k5f22"
Jul 13 16:47:23.769908 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:23.769890    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k5f22\" (UID: \"c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k5f22"
Jul 13 16:47:23.784083 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:23.784050    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzzzp\" (UniqueName: \"kubernetes.io/projected/c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51-kube-api-access-nzzzp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k5f22\" (UID: \"c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k5f22"
Jul 13 16:47:23.887052 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:23.886985    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k5f22"
Jul 13 16:47:24.029968 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:24.029844    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k5f22"]
Jul 13 16:47:24.032649 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:47:24.032618    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4e3458f_8d41_47f9_bdec_ba8fdd7f6e51.slice/crio-19b459c8eeedd1ff3fc659a75875185a607e36574d93f1493e2519b231caaf4e WatchSource:0}: Error finding container 19b459c8eeedd1ff3fc659a75875185a607e36574d93f1493e2519b231caaf4e: Status 404 returned error can't find the container with id 19b459c8eeedd1ff3fc659a75875185a607e36574d93f1493e2519b231caaf4e
Jul 13 16:47:24.196052 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:24.195977    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:47:24.788610 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:24.788535    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k5f22" event={"ID":"c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51","Type":"ContainerStarted","Data":"19b459c8eeedd1ff3fc659a75875185a607e36574d93f1493e2519b231caaf4e"}
Jul 13 16:47:25.526639 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:25.526605    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-95c4p"]
Jul 13 16:47:25.529587 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:25.529571    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-95c4p"
Jul 13 16:47:25.532419 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:25.532396    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-k8shp\""
Jul 13 16:47:25.532621 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:25.532606    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 13 16:47:25.545583 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:25.545562    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-95c4p"]
Jul 13 16:47:25.585830 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:25.585800    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84zhz\" (UniqueName: \"kubernetes.io/projected/b10416b9-e190-4d6c-9889-24663835d28d-kube-api-access-84zhz\") pod \"dns-operator-controller-manager-864dd78c4c-95c4p\" (UID: \"b10416b9-e190-4d6c-9889-24663835d28d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-95c4p"
Jul 13 16:47:25.687038 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:25.687010    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84zhz\" (UniqueName: \"kubernetes.io/projected/b10416b9-e190-4d6c-9889-24663835d28d-kube-api-access-84zhz\") pod \"dns-operator-controller-manager-864dd78c4c-95c4p\" (UID: \"b10416b9-e190-4d6c-9889-24663835d28d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-95c4p"
Jul 13 16:47:25.701342 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:25.701311    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84zhz\" (UniqueName: \"kubernetes.io/projected/b10416b9-e190-4d6c-9889-24663835d28d-kube-api-access-84zhz\") pod \"dns-operator-controller-manager-864dd78c4c-95c4p\" (UID: \"b10416b9-e190-4d6c-9889-24663835d28d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-95c4p"
Jul 13 16:47:25.839654 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:25.839576    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-95c4p"
Jul 13 16:47:25.995948 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:25.995918    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-95c4p"]
Jul 13 16:47:25.999006 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:47:25.998980    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb10416b9_e190_4d6c_9889_24663835d28d.slice/crio-5bbd7524cd3b69cf97df6de628cceb568ba0a579a0848cbfbc79750afbe44cfa WatchSource:0}: Error finding container 5bbd7524cd3b69cf97df6de628cceb568ba0a579a0848cbfbc79750afbe44cfa: Status 404 returned error can't find the container with id 5bbd7524cd3b69cf97df6de628cceb568ba0a579a0848cbfbc79750afbe44cfa
Jul 13 16:47:26.173850 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:26.173765    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:47:26.435013 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:26.434934    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:47:26.800041 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:26.800006    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-95c4p" event={"ID":"b10416b9-e190-4d6c-9889-24663835d28d","Type":"ContainerStarted","Data":"5bbd7524cd3b69cf97df6de628cceb568ba0a579a0848cbfbc79750afbe44cfa"}
Jul 13 16:47:28.490265 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:28.490225    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5wtbr"]
Jul 13 16:47:28.494107 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:28.494078    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5wtbr"
Jul 13 16:47:28.498028 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:28.498005    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-wk59d\""
Jul 13 16:47:28.503678 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:28.503519    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5wtbr"]
Jul 13 16:47:28.610995 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:28.610961    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf7v7\" (UniqueName: \"kubernetes.io/projected/3303207a-6861-410d-8e14-a5ccd1201708-kube-api-access-bf7v7\") pod \"limitador-operator-controller-manager-859d7b78bd-5wtbr\" (UID: \"3303207a-6861-410d-8e14-a5ccd1201708\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5wtbr"
Jul 13 16:47:28.712221 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:28.712183    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf7v7\" (UniqueName: \"kubernetes.io/projected/3303207a-6861-410d-8e14-a5ccd1201708-kube-api-access-bf7v7\") pod \"limitador-operator-controller-manager-859d7b78bd-5wtbr\" (UID: \"3303207a-6861-410d-8e14-a5ccd1201708\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5wtbr"
Jul 13 16:47:28.722855 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:28.722830    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf7v7\" (UniqueName: \"kubernetes.io/projected/3303207a-6861-410d-8e14-a5ccd1201708-kube-api-access-bf7v7\") pod \"limitador-operator-controller-manager-859d7b78bd-5wtbr\" (UID: \"3303207a-6861-410d-8e14-a5ccd1201708\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5wtbr"
Jul 13 16:47:28.809635 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:28.809522    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5wtbr"
Jul 13 16:47:28.826031 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:28.825981    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:47:28.971871 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:28.971847    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5wtbr"]
Jul 13 16:47:28.973928 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:47:28.973905    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3303207a_6861_410d_8e14_a5ccd1201708.slice/crio-210cf00746bebd38ad74f92bac3d94f537309cce03df1be65ea019358de95aa0 WatchSource:0}: Error finding container 210cf00746bebd38ad74f92bac3d94f537309cce03df1be65ea019358de95aa0: Status 404 returned error can't find the container with id 210cf00746bebd38ad74f92bac3d94f537309cce03df1be65ea019358de95aa0
Jul 13 16:47:29.817117 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:29.817034    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5wtbr" event={"ID":"3303207a-6861-410d-8e14-a5ccd1201708","Type":"ContainerStarted","Data":"210cf00746bebd38ad74f92bac3d94f537309cce03df1be65ea019358de95aa0"}
Jul 13 16:47:29.957401 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:29.957359    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:47:30.022397 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:30.022362    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:47:30.366640 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:30.366608    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:47:30.427823 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:30.427794    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:47:30.822232 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:30.822196    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-95c4p" event={"ID":"b10416b9-e190-4d6c-9889-24663835d28d","Type":"ContainerStarted","Data":"d9ea3164f20cd8515dbbb8d79ccb7266f1024c554b9991af9be41f92835698e7"}
Jul 13 16:47:30.822647 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:30.822371    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-95c4p"
Jul 13 16:47:30.823853 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:30.823832    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k5f22" event={"ID":"c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51","Type":"ContainerStarted","Data":"1ae65617dffa68ed28d897427fe0dfa2118b863b6fee78b2187e0f2b3ba31d9f"}
Jul 13 16:47:30.823983 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:30.823970    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k5f22"
Jul 13 16:47:30.876874 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:30.876821    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-95c4p" podStartSLOduration=1.244866265 podStartE2EDuration="5.876805996s" totalImagesPullingTime="4.631939731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:47:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:47:30.876100481 +0000 UTC m=+448.234407306" watchObservedRunningTime="2026-07-13 16:47:30.876805996 +0000 UTC m=+448.235112821"
Jul 13 16:47:30.909234 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:30.909150    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k5f22" podStartSLOduration=1.253845296 podStartE2EDuration="7.909134316s" totalImagesPullingTime="6.65528902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:47:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:47:30.906601372 +0000 UTC m=+448.264908196" watchObservedRunningTime="2026-07-13 16:47:30.909134316 +0000 UTC m=+448.267441140"
Jul 13 16:47:32.834372 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:32.834335    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5wtbr" event={"ID":"3303207a-6861-410d-8e14-a5ccd1201708","Type":"ContainerStarted","Data":"b239f7d6ae74e98f0c5cf5ec5da1ebc63bbdb0e1fa58841d7263aa1b5c5410cd"}
Jul 13 16:47:32.834773 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:32.834453    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5wtbr"
Jul 13 16:47:32.858052 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:32.858003    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5wtbr" podStartSLOduration=1.493563653 podStartE2EDuration="4.857978615s" totalImagesPullingTime="3.364414962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:47:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:47:32.856411763 +0000 UTC m=+450.214718607" watchObservedRunningTime="2026-07-13 16:47:32.857978615 +0000 UTC m=+450.216285439"
Jul 13 16:47:33.408847 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:33.408800    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:47:33.514157 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:33.514123    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:47:33.785968 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:33.785934    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5c4n5"
Jul 13 16:47:33.817919 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:33.817883    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:47:33.913228 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:33.913198    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:47:40.972354 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:40.972322    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:47:41.076546 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:41.076513    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:47:41.831033 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:41.831003    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-95c4p"
Jul 13 16:47:41.831190 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:41.831079    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k5f22"
Jul 13 16:47:43.556666 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.556632    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k5f22"]
Jul 13 16:47:43.557154 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.556816    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k5f22" podUID="c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51" containerName="manager" containerID="cri-o://1ae65617dffa68ed28d897427fe0dfa2118b863b6fee78b2187e0f2b3ba31d9f" gracePeriod=2
Jul 13 16:47:43.566046 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.565832    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k5f22"]
Jul 13 16:47:43.566492 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:47:43.566460    2573 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-k5f22\": pods \"kuadrant-operator-controller-manager-8684c9ff49-k5f22\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k5f22"
Jul 13 16:47:43.574861 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.574837    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5wtbr"]
Jul 13 16:47:43.575104 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.575062    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5wtbr" podUID="3303207a-6861-410d-8e14-a5ccd1201708" containerName="manager" containerID="cri-o://b239f7d6ae74e98f0c5cf5ec5da1ebc63bbdb0e1fa58841d7263aa1b5c5410cd" gracePeriod=2
Jul 13 16:47:43.577169 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.577150    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5wtbr"
Jul 13 16:47:43.581191 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.581159    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5wtbr"]
Jul 13 16:47:43.584244 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:47:43.584208    2573 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"3303207a-6861-410d-8e14-a5ccd1201708\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-5wtbr\": pods \"limitador-operator-controller-manager-859d7b78bd-5wtbr\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5wtbr"
Jul 13 16:47:43.586422 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:47:43.586396    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k5f22\" is forbidden: User \"system:node:ip-10-0-143-51.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-51.ec2.internal' and this object" podUID="c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k5f22"
Jul 13 16:47:43.588697 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:47:43.588670    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5wtbr\" is forbidden: User \"system:node:ip-10-0-143-51.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-51.ec2.internal' and this object" podUID="3303207a-6861-410d-8e14-a5ccd1201708" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5wtbr"
Jul 13 16:47:43.589636 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.589617    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mhwdn"]
Jul 13 16:47:43.590020 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.590004    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51" containerName="manager"
Jul 13 16:47:43.590020 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.590021    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51" containerName="manager"
Jul 13 16:47:43.590141 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.590030    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3303207a-6861-410d-8e14-a5ccd1201708" containerName="manager"
Jul 13 16:47:43.590141 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.590036    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3303207a-6861-410d-8e14-a5ccd1201708" containerName="manager"
Jul 13 16:47:43.590141 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.590092    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51" containerName="manager"
Jul 13 16:47:43.590141 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.590101    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3303207a-6861-410d-8e14-a5ccd1201708" containerName="manager"
Jul 13 16:47:43.590691 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:47:43.590664    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k5f22\" is forbidden: User \"system:node:ip-10-0-143-51.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-51.ec2.internal' and this object" podUID="c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k5f22"
Jul 13 16:47:43.592992 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.592976    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mhwdn"
Jul 13 16:47:43.608157 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.608135    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vxgch"]
Jul 13 16:47:43.611299 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.611279    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vxgch"
Jul 13 16:47:43.611908 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.611889    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mhwdn"]
Jul 13 16:47:43.625820 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.625794    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vxgch"]
Jul 13 16:47:43.628051 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:47:43.628019    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5wtbr\" is forbidden: User \"system:node:ip-10-0-143-51.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-51.ec2.internal' and this object" podUID="3303207a-6861-410d-8e14-a5ccd1201708" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5wtbr"
Jul 13 16:47:43.630338 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:47:43.630305    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k5f22\" is forbidden: User \"system:node:ip-10-0-143-51.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-51.ec2.internal' and this object" podUID="c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k5f22"
Jul 13 16:47:43.632674 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:47:43.632651    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5wtbr\" is forbidden: User \"system:node:ip-10-0-143-51.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-51.ec2.internal' and this object" podUID="3303207a-6861-410d-8e14-a5ccd1201708" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5wtbr"
Jul 13 16:47:43.635078 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:47:43.635051    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k5f22\" is forbidden: User \"system:node:ip-10-0-143-51.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-51.ec2.internal' and this object" podUID="c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k5f22"
Jul 13 16:47:43.731767 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.731714    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v8b7\" (UniqueName: \"kubernetes.io/projected/cc7045d9-39e1-471d-b61d-b9e8c84f7aa3-kube-api-access-2v8b7\") pod \"limitador-operator-controller-manager-859d7b78bd-vxgch\" (UID: \"cc7045d9-39e1-471d-b61d-b9e8c84f7aa3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vxgch"
Jul 13 16:47:43.731900 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.731816    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0666554-a679-4a4d-83f6-bd3729942c21-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mhwdn\" (UID: \"d0666554-a679-4a4d-83f6-bd3729942c21\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mhwdn"
Jul 13 16:47:43.731900 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.731836    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq7fx\" (UniqueName: \"kubernetes.io/projected/d0666554-a679-4a4d-83f6-bd3729942c21-kube-api-access-pq7fx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mhwdn\" (UID: \"d0666554-a679-4a4d-83f6-bd3729942c21\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mhwdn"
Jul 13 16:47:43.818830 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.818808    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k5f22"
Jul 13 16:47:43.821388 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.821366    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5wtbr"
Jul 13 16:47:43.824509 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:47:43.824483    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5wtbr\" is forbidden: User \"system:node:ip-10-0-143-51.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-51.ec2.internal' and this object" podUID="3303207a-6861-410d-8e14-a5ccd1201708" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5wtbr"
Jul 13 16:47:43.826511 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:47:43.826485    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k5f22\" is forbidden: User \"system:node:ip-10-0-143-51.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-51.ec2.internal' and this object" podUID="c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k5f22"
Jul 13 16:47:43.830033 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:47:43.830013    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5wtbr\" is forbidden: User \"system:node:ip-10-0-143-51.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-51.ec2.internal' and this object" podUID="3303207a-6861-410d-8e14-a5ccd1201708" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5wtbr"
Jul 13 16:47:43.832055 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:47:43.832034    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k5f22\" is forbidden: User \"system:node:ip-10-0-143-51.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-51.ec2.internal' and this object" podUID="c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k5f22"
Jul 13 16:47:43.832264 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.832248    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v8b7\" (UniqueName: \"kubernetes.io/projected/cc7045d9-39e1-471d-b61d-b9e8c84f7aa3-kube-api-access-2v8b7\") pod \"limitador-operator-controller-manager-859d7b78bd-vxgch\" (UID: \"cc7045d9-39e1-471d-b61d-b9e8c84f7aa3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vxgch"
Jul 13 16:47:43.832329 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.832317    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0666554-a679-4a4d-83f6-bd3729942c21-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mhwdn\" (UID: \"d0666554-a679-4a4d-83f6-bd3729942c21\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mhwdn"
Jul 13 16:47:43.832428 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.832340    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq7fx\" (UniqueName: \"kubernetes.io/projected/d0666554-a679-4a4d-83f6-bd3729942c21-kube-api-access-pq7fx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mhwdn\" (UID: \"d0666554-a679-4a4d-83f6-bd3729942c21\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mhwdn"
Jul 13 16:47:43.832676 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.832655    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0666554-a679-4a4d-83f6-bd3729942c21-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mhwdn\" (UID: \"d0666554-a679-4a4d-83f6-bd3729942c21\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mhwdn"
Jul 13 16:47:43.853498 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.853475    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v8b7\" (UniqueName: \"kubernetes.io/projected/cc7045d9-39e1-471d-b61d-b9e8c84f7aa3-kube-api-access-2v8b7\") pod \"limitador-operator-controller-manager-859d7b78bd-vxgch\" (UID: \"cc7045d9-39e1-471d-b61d-b9e8c84f7aa3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vxgch"
Jul 13 16:47:43.854556 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.854539    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq7fx\" (UniqueName: \"kubernetes.io/projected/d0666554-a679-4a4d-83f6-bd3729942c21-kube-api-access-pq7fx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mhwdn\" (UID: \"d0666554-a679-4a4d-83f6-bd3729942c21\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mhwdn"
Jul 13 16:47:43.868960 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.868934    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7j7sn"]
Jul 13 16:47:43.872149 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.872134    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7j7sn"
Jul 13 16:47:43.883300 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.883276    2573 generic.go:356] "Generic (PLEG): container finished" podID="c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51" containerID="1ae65617dffa68ed28d897427fe0dfa2118b863b6fee78b2187e0f2b3ba31d9f" exitCode=0
Jul 13 16:47:43.883383 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.883311    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k5f22"
Jul 13 16:47:43.883383 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.883364    2573 scope.go:117] "RemoveContainer" containerID="1ae65617dffa68ed28d897427fe0dfa2118b863b6fee78b2187e0f2b3ba31d9f"
Jul 13 16:47:43.885533 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.885508    2573 generic.go:356] "Generic (PLEG): container finished" podID="3303207a-6861-410d-8e14-a5ccd1201708" containerID="b239f7d6ae74e98f0c5cf5ec5da1ebc63bbdb0e1fa58841d7263aa1b5c5410cd" exitCode=0
Jul 13 16:47:43.885620 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.885564    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5wtbr"
Jul 13 16:47:43.887290 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.887269    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7j7sn"]
Jul 13 16:47:43.892660 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.892645    2573 scope.go:117] "RemoveContainer" containerID="1ae65617dffa68ed28d897427fe0dfa2118b863b6fee78b2187e0f2b3ba31d9f"
Jul 13 16:47:43.892932 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:47:43.892914    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ae65617dffa68ed28d897427fe0dfa2118b863b6fee78b2187e0f2b3ba31d9f\": container with ID starting with 1ae65617dffa68ed28d897427fe0dfa2118b863b6fee78b2187e0f2b3ba31d9f not found: ID does not exist" containerID="1ae65617dffa68ed28d897427fe0dfa2118b863b6fee78b2187e0f2b3ba31d9f"
Jul 13 16:47:43.892986 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.892939    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ae65617dffa68ed28d897427fe0dfa2118b863b6fee78b2187e0f2b3ba31d9f"} err="failed to get container status \"1ae65617dffa68ed28d897427fe0dfa2118b863b6fee78b2187e0f2b3ba31d9f\": rpc error: code = NotFound desc = could not find container \"1ae65617dffa68ed28d897427fe0dfa2118b863b6fee78b2187e0f2b3ba31d9f\": container with ID starting with 1ae65617dffa68ed28d897427fe0dfa2118b863b6fee78b2187e0f2b3ba31d9f not found: ID does not exist"
Jul 13 16:47:43.892986 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.892964    2573 scope.go:117] "RemoveContainer" containerID="b239f7d6ae74e98f0c5cf5ec5da1ebc63bbdb0e1fa58841d7263aa1b5c5410cd"
Jul 13 16:47:43.899922 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.899896    2573 scope.go:117] "RemoveContainer" containerID="b239f7d6ae74e98f0c5cf5ec5da1ebc63bbdb0e1fa58841d7263aa1b5c5410cd"
Jul 13 16:47:43.900223 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:47:43.900192    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b239f7d6ae74e98f0c5cf5ec5da1ebc63bbdb0e1fa58841d7263aa1b5c5410cd\": container with ID starting with b239f7d6ae74e98f0c5cf5ec5da1ebc63bbdb0e1fa58841d7263aa1b5c5410cd not found: ID does not exist" containerID="b239f7d6ae74e98f0c5cf5ec5da1ebc63bbdb0e1fa58841d7263aa1b5c5410cd"
Jul 13 16:47:43.900315 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.900222    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b239f7d6ae74e98f0c5cf5ec5da1ebc63bbdb0e1fa58841d7263aa1b5c5410cd"} err="failed to get container status \"b239f7d6ae74e98f0c5cf5ec5da1ebc63bbdb0e1fa58841d7263aa1b5c5410cd\": rpc error: code = NotFound desc = could not find container \"b239f7d6ae74e98f0c5cf5ec5da1ebc63bbdb0e1fa58841d7263aa1b5c5410cd\": container with ID starting with b239f7d6ae74e98f0c5cf5ec5da1ebc63bbdb0e1fa58841d7263aa1b5c5410cd not found: ID does not exist"
Jul 13 16:47:43.907328 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:47:43.907289    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5wtbr\" is forbidden: User \"system:node:ip-10-0-143-51.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-51.ec2.internal' and this object" podUID="3303207a-6861-410d-8e14-a5ccd1201708" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5wtbr"
Jul 13 16:47:43.910415 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:47:43.910392    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k5f22\" is forbidden: User \"system:node:ip-10-0-143-51.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-51.ec2.internal' and this object" podUID="c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k5f22"
Jul 13 16:47:43.914028 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:47:43.914002    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5wtbr\" is forbidden: User \"system:node:ip-10-0-143-51.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-51.ec2.internal' and this object" podUID="3303207a-6861-410d-8e14-a5ccd1201708" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5wtbr"
Jul 13 16:47:43.916297 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:47:43.916274    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k5f22\" is forbidden: User \"system:node:ip-10-0-143-51.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-51.ec2.internal' and this object" podUID="c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k5f22"
Jul 13 16:47:43.932616 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.932589    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51-extensions-socket-volume\") pod \"c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51\" (UID: \"c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51\") "
Jul 13 16:47:43.932710 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.932638    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzzzp\" (UniqueName: \"kubernetes.io/projected/c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51-kube-api-access-nzzzp\") pod \"c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51\" (UID: \"c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51\") "
Jul 13 16:47:43.932710 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.932655    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bf7v7\" (UniqueName: \"kubernetes.io/projected/3303207a-6861-410d-8e14-a5ccd1201708-kube-api-access-bf7v7\") pod \"3303207a-6861-410d-8e14-a5ccd1201708\" (UID: \"3303207a-6861-410d-8e14-a5ccd1201708\") "
Jul 13 16:47:43.932826 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.932775    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssksb\" (UniqueName: \"kubernetes.io/projected/4bbe843a-2566-40ff-a03e-509d7d9328b4-kube-api-access-ssksb\") pod \"kuadrant-operator-controller-manager-86878c769f-7j7sn\" (UID: \"4bbe843a-2566-40ff-a03e-509d7d9328b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7j7sn"
Jul 13 16:47:43.932916 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.932878    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4bbe843a-2566-40ff-a03e-509d7d9328b4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7j7sn\" (UID: \"4bbe843a-2566-40ff-a03e-509d7d9328b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7j7sn"
Jul 13 16:47:43.933082 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.933057    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51" (UID: "c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:47:43.934665 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.934641    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3303207a-6861-410d-8e14-a5ccd1201708-kube-api-access-bf7v7" (OuterVolumeSpecName: "kube-api-access-bf7v7") pod "3303207a-6861-410d-8e14-a5ccd1201708" (UID: "3303207a-6861-410d-8e14-a5ccd1201708"). InnerVolumeSpecName "kube-api-access-bf7v7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 16:47:43.934765 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:43.934670    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51-kube-api-access-nzzzp" (OuterVolumeSpecName: "kube-api-access-nzzzp") pod "c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51" (UID: "c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51"). InnerVolumeSpecName "kube-api-access-nzzzp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 16:47:44.015127 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:44.015095    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mhwdn"
Jul 13 16:47:44.022213 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:44.022195    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vxgch"
Jul 13 16:47:44.034086 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:44.034057    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4bbe843a-2566-40ff-a03e-509d7d9328b4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7j7sn\" (UID: \"4bbe843a-2566-40ff-a03e-509d7d9328b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7j7sn"
Jul 13 16:47:44.034186 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:44.034096    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssksb\" (UniqueName: \"kubernetes.io/projected/4bbe843a-2566-40ff-a03e-509d7d9328b4-kube-api-access-ssksb\") pod \"kuadrant-operator-controller-manager-86878c769f-7j7sn\" (UID: \"4bbe843a-2566-40ff-a03e-509d7d9328b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7j7sn"
Jul 13 16:47:44.034186 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:44.034153    2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51-extensions-socket-volume\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 16:47:44.034186 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:44.034162    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzzzp\" (UniqueName: \"kubernetes.io/projected/c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51-kube-api-access-nzzzp\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 16:47:44.034186 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:44.034171    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bf7v7\" (UniqueName: \"kubernetes.io/projected/3303207a-6861-410d-8e14-a5ccd1201708-kube-api-access-bf7v7\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 16:47:44.034403 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:44.034360    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4bbe843a-2566-40ff-a03e-509d7d9328b4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7j7sn\" (UID: \"4bbe843a-2566-40ff-a03e-509d7d9328b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7j7sn"
Jul 13 16:47:44.046593 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:44.046564    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssksb\" (UniqueName: \"kubernetes.io/projected/4bbe843a-2566-40ff-a03e-509d7d9328b4-kube-api-access-ssksb\") pod \"kuadrant-operator-controller-manager-86878c769f-7j7sn\" (UID: \"4bbe843a-2566-40ff-a03e-509d7d9328b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7j7sn"
Jul 13 16:47:44.151163 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:44.151014    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mhwdn"]
Jul 13 16:47:44.154032 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:47:44.154002    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0666554_a679_4a4d_83f6_bd3729942c21.slice/crio-88064be1ac54821645891d79680e1ac42c7df2a0fa2688565213b1d27e396a26 WatchSource:0}: Error finding container 88064be1ac54821645891d79680e1ac42c7df2a0fa2688565213b1d27e396a26: Status 404 returned error can't find the container with id 88064be1ac54821645891d79680e1ac42c7df2a0fa2688565213b1d27e396a26
Jul 13 16:47:44.177742 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:44.177703    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vxgch"]
Jul 13 16:47:44.182121 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:44.182100    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7j7sn"
Jul 13 16:47:44.185918 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:47:44.185880    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc7045d9_39e1_471d_b61d_b9e8c84f7aa3.slice/crio-fa846d54a4ca68bd2fd0004c51be802e85b211feed56abfebb0c4ccdf03270e7 WatchSource:0}: Error finding container fa846d54a4ca68bd2fd0004c51be802e85b211feed56abfebb0c4ccdf03270e7: Status 404 returned error can't find the container with id fa846d54a4ca68bd2fd0004c51be802e85b211feed56abfebb0c4ccdf03270e7
Jul 13 16:47:44.207323 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:47:44.207283    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5wtbr\" is forbidden: User \"system:node:ip-10-0-143-51.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-51.ec2.internal' and this object" podUID="3303207a-6861-410d-8e14-a5ccd1201708" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5wtbr"
Jul 13 16:47:44.210052 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:47:44.209940    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k5f22\" is forbidden: User \"system:node:ip-10-0-143-51.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-51.ec2.internal' and this object" podUID="c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k5f22"
Jul 13 16:47:44.212483 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:47:44.212460    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5wtbr\" is forbidden: User \"system:node:ip-10-0-143-51.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-51.ec2.internal' and this object" podUID="3303207a-6861-410d-8e14-a5ccd1201708" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5wtbr"
Jul 13 16:47:44.214521 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:47:44.214487    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k5f22\" is forbidden: User \"system:node:ip-10-0-143-51.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-51.ec2.internal' and this object" podUID="c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k5f22"
Jul 13 16:47:44.322670 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:44.322628    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7j7sn"]
Jul 13 16:47:44.324991 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:47:44.324963    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bbe843a_2566_40ff_a03e_509d7d9328b4.slice/crio-7e06461b99f69e414a9833cae669283c4ae07b797fe65a85eea44ec7a7f3886d WatchSource:0}: Error finding container 7e06461b99f69e414a9833cae669283c4ae07b797fe65a85eea44ec7a7f3886d: Status 404 returned error can't find the container with id 7e06461b99f69e414a9833cae669283c4ae07b797fe65a85eea44ec7a7f3886d
Jul 13 16:47:44.891756 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:44.891647    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7j7sn" event={"ID":"4bbe843a-2566-40ff-a03e-509d7d9328b4","Type":"ContainerStarted","Data":"1368d9e6edef5af4daf4fca6a1b2f4e7f5380bfe88a6c3f16f8c26ed663f976c"}
Jul 13 16:47:44.891756 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:44.891704    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7j7sn" event={"ID":"4bbe843a-2566-40ff-a03e-509d7d9328b4","Type":"ContainerStarted","Data":"7e06461b99f69e414a9833cae669283c4ae07b797fe65a85eea44ec7a7f3886d"}
Jul 13 16:47:44.892240 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:44.891831    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7j7sn"
Jul 13 16:47:44.894779 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:44.894749    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vxgch" event={"ID":"cc7045d9-39e1-471d-b61d-b9e8c84f7aa3","Type":"ContainerStarted","Data":"91ac6ca6fb5616c053102547673c5e10e8d57081ac346f16f223f92caff06830"}
Jul 13 16:47:44.894898 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:44.894794    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vxgch" event={"ID":"cc7045d9-39e1-471d-b61d-b9e8c84f7aa3","Type":"ContainerStarted","Data":"fa846d54a4ca68bd2fd0004c51be802e85b211feed56abfebb0c4ccdf03270e7"}
Jul 13 16:47:44.894898 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:44.894818    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vxgch"
Jul 13 16:47:44.896250 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:44.896230    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mhwdn" event={"ID":"d0666554-a679-4a4d-83f6-bd3729942c21","Type":"ContainerStarted","Data":"5d6a3ef66bc85ad6c7b9bbf68905c8ee143b7f07cdc5b8a192620a157937c0c5"}
Jul 13 16:47:44.896330 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:44.896281    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mhwdn"
Jul 13 16:47:44.896330 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:44.896300    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mhwdn" event={"ID":"d0666554-a679-4a4d-83f6-bd3729942c21","Type":"ContainerStarted","Data":"88064be1ac54821645891d79680e1ac42c7df2a0fa2688565213b1d27e396a26"}
Jul 13 16:47:44.917788 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:44.917748    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7j7sn" podStartSLOduration=1.9177349129999999 podStartE2EDuration="1.917734913s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:47:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:47:44.916499856 +0000 UTC m=+462.274806680" watchObservedRunningTime="2026-07-13 16:47:44.917734913 +0000 UTC m=+462.276041733"
Jul 13 16:47:44.918858 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:47:44.918837    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5wtbr\" is forbidden: User \"system:node:ip-10-0-143-51.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-51.ec2.internal' and this object" podUID="3303207a-6861-410d-8e14-a5ccd1201708" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5wtbr"
Jul 13 16:47:44.921174 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:47:44.921152    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k5f22\" is forbidden: User \"system:node:ip-10-0-143-51.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-51.ec2.internal' and this object" podUID="c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k5f22"
Jul 13 16:47:44.948845 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:44.948796    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vxgch" podStartSLOduration=1.948781884 podStartE2EDuration="1.948781884s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:47:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:47:44.947318082 +0000 UTC m=+462.305624906" watchObservedRunningTime="2026-07-13 16:47:44.948781884 +0000 UTC m=+462.307088709"
Jul 13 16:47:44.949950 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:47:44.949926    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5wtbr\" is forbidden: User \"system:node:ip-10-0-143-51.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-51.ec2.internal' and this object" podUID="3303207a-6861-410d-8e14-a5ccd1201708" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5wtbr"
Jul 13 16:47:44.952092 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:47:44.952071    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k5f22\" is forbidden: User \"system:node:ip-10-0-143-51.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-51.ec2.internal' and this object" podUID="c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k5f22"
Jul 13 16:47:44.973260 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:44.973218    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mhwdn" podStartSLOduration=1.973204239 podStartE2EDuration="1.973204239s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:47:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:47:44.972175599 +0000 UTC m=+462.330482423" watchObservedRunningTime="2026-07-13 16:47:44.973204239 +0000 UTC m=+462.331511063"
Jul 13 16:47:45.148074 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:45.148000    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3303207a-6861-410d-8e14-a5ccd1201708" path="/var/lib/kubelet/pods/3303207a-6861-410d-8e14-a5ccd1201708/volumes"
Jul 13 16:47:45.148391 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:45.148376    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51" path="/var/lib/kubelet/pods/c4e3458f-8d41-47f9-bdec-ba8fdd7f6e51/volumes"
Jul 13 16:47:45.231873 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:45.231842    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:47:45.416256 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:45.416185    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:47:48.991478 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:48.991447    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:47:49.087406 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:49.087372    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:47:49.228484 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:49.228456    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:47:49.346826 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:49.346749    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:47:51.815844 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:51.815814    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:47:51.916705 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:51.916678    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:47:53.307435 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:53.307397    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:47:53.406977 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:53.406946    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:47:53.506452 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:53.506426    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:47:54.012399 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:54.012356    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:47:54.079082 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:54.079058    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:47:55.902421 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:55.902390    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vxgch"
Jul 13 16:47:55.902847 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:55.902467    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mhwdn"
Jul 13 16:47:55.903017 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:55.902994    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7j7sn"
Jul 13 16:47:56.016975 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:56.016945    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mhwdn"]
Jul 13 16:47:56.017133 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:56.017114    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mhwdn" podUID="d0666554-a679-4a4d-83f6-bd3729942c21" containerName="manager" containerID="cri-o://5d6a3ef66bc85ad6c7b9bbf68905c8ee143b7f07cdc5b8a192620a157937c0c5" gracePeriod=10
Jul 13 16:47:56.293297 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:56.293270    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mhwdn"
Jul 13 16:47:56.444228 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:56.444192    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0666554-a679-4a4d-83f6-bd3729942c21-extensions-socket-volume\") pod \"d0666554-a679-4a4d-83f6-bd3729942c21\" (UID: \"d0666554-a679-4a4d-83f6-bd3729942c21\") "
Jul 13 16:47:56.444384 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:56.444293    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pq7fx\" (UniqueName: \"kubernetes.io/projected/d0666554-a679-4a4d-83f6-bd3729942c21-kube-api-access-pq7fx\") pod \"d0666554-a679-4a4d-83f6-bd3729942c21\" (UID: \"d0666554-a679-4a4d-83f6-bd3729942c21\") "
Jul 13 16:47:56.444661 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:56.444630    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0666554-a679-4a4d-83f6-bd3729942c21-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d0666554-a679-4a4d-83f6-bd3729942c21" (UID: "d0666554-a679-4a4d-83f6-bd3729942c21"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:47:56.446288 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:56.446242    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0666554-a679-4a4d-83f6-bd3729942c21-kube-api-access-pq7fx" (OuterVolumeSpecName: "kube-api-access-pq7fx") pod "d0666554-a679-4a4d-83f6-bd3729942c21" (UID: "d0666554-a679-4a4d-83f6-bd3729942c21"). InnerVolumeSpecName "kube-api-access-pq7fx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 16:47:56.545163 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:56.545133    2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0666554-a679-4a4d-83f6-bd3729942c21-extensions-socket-volume\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 16:47:56.545163 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:56.545156    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pq7fx\" (UniqueName: \"kubernetes.io/projected/d0666554-a679-4a4d-83f6-bd3729942c21-kube-api-access-pq7fx\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 16:47:56.947559 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:56.947526    2573 generic.go:356] "Generic (PLEG): container finished" podID="d0666554-a679-4a4d-83f6-bd3729942c21" containerID="5d6a3ef66bc85ad6c7b9bbf68905c8ee143b7f07cdc5b8a192620a157937c0c5" exitCode=0
Jul 13 16:47:56.948030 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:56.947565    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mhwdn"
Jul 13 16:47:56.948030 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:56.947575    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mhwdn" event={"ID":"d0666554-a679-4a4d-83f6-bd3729942c21","Type":"ContainerDied","Data":"5d6a3ef66bc85ad6c7b9bbf68905c8ee143b7f07cdc5b8a192620a157937c0c5"}
Jul 13 16:47:56.948030 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:56.947631    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mhwdn" event={"ID":"d0666554-a679-4a4d-83f6-bd3729942c21","Type":"ContainerDied","Data":"88064be1ac54821645891d79680e1ac42c7df2a0fa2688565213b1d27e396a26"}
Jul 13 16:47:56.948030 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:56.947663    2573 scope.go:117] "RemoveContainer" containerID="5d6a3ef66bc85ad6c7b9bbf68905c8ee143b7f07cdc5b8a192620a157937c0c5"
Jul 13 16:47:56.956141 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:56.956125    2573 scope.go:117] "RemoveContainer" containerID="5d6a3ef66bc85ad6c7b9bbf68905c8ee143b7f07cdc5b8a192620a157937c0c5"
Jul 13 16:47:56.956383 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:47:56.956366    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d6a3ef66bc85ad6c7b9bbf68905c8ee143b7f07cdc5b8a192620a157937c0c5\": container with ID starting with 5d6a3ef66bc85ad6c7b9bbf68905c8ee143b7f07cdc5b8a192620a157937c0c5 not found: ID does not exist" containerID="5d6a3ef66bc85ad6c7b9bbf68905c8ee143b7f07cdc5b8a192620a157937c0c5"
Jul 13 16:47:56.956428 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:56.956392    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d6a3ef66bc85ad6c7b9bbf68905c8ee143b7f07cdc5b8a192620a157937c0c5"} err="failed to get container status \"5d6a3ef66bc85ad6c7b9bbf68905c8ee143b7f07cdc5b8a192620a157937c0c5\": rpc error: code = NotFound desc = could not find container \"5d6a3ef66bc85ad6c7b9bbf68905c8ee143b7f07cdc5b8a192620a157937c0c5\": container with ID starting with 5d6a3ef66bc85ad6c7b9bbf68905c8ee143b7f07cdc5b8a192620a157937c0c5 not found: ID does not exist"
Jul 13 16:47:56.977700 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:56.977678    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mhwdn"]
Jul 13 16:47:56.988364 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:56.988346    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mhwdn"]
Jul 13 16:47:57.146978 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:57.146941    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0666554-a679-4a4d-83f6-bd3729942c21" path="/var/lib/kubelet/pods/d0666554-a679-4a4d-83f6-bd3729942c21/volumes"
Jul 13 16:47:58.294475 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:58.294442    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:47:58.395068 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:58.395032    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:47:59.312708 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:47:59.312677    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:48:03.047232 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:03.047200    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:48:03.155296 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:03.155244    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:48:04.347451 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:04.347416    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:48:04.449205 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:04.449161    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:48:04.552729 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:04.552703    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:48:06.842278 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:06.842251    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:48:06.942047 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:06.942015    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:48:07.257501 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:07.257470    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:48:07.359669 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:07.359636    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:48:11.466404 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:11.466370    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:48:11.566949 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:11.566917    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:48:12.524872 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:12.524838    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg"]
Jul 13 16:48:12.525367 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:12.525341    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0666554-a679-4a4d-83f6-bd3729942c21" containerName="manager"
Jul 13 16:48:12.525367 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:12.525367    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0666554-a679-4a4d-83f6-bd3729942c21" containerName="manager"
Jul 13 16:48:12.525558 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:12.525441    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0666554-a679-4a4d-83f6-bd3729942c21" containerName="manager"
Jul 13 16:48:12.528902 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:12.528883    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg"
Jul 13 16:48:12.532376 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:12.532358    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-frssf\""
Jul 13 16:48:12.545245 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:12.545218    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg"]
Jul 13 16:48:12.573451 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:12.573419    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc1c3cfe-4f36-4c88-907d-5a24887c1f64-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-2fcjg\" (UID: \"fc1c3cfe-4f36-4c88-907d-5a24887c1f64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg"
Jul 13 16:48:12.573582 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:12.573453    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frx99\" (UniqueName: \"kubernetes.io/projected/fc1c3cfe-4f36-4c88-907d-5a24887c1f64-kube-api-access-frx99\") pod \"maas-default-gateway-openshift-default-56654dcf7-2fcjg\" (UID: \"fc1c3cfe-4f36-4c88-907d-5a24887c1f64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg"
Jul 13 16:48:12.573582 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:12.573472    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc1c3cfe-4f36-4c88-907d-5a24887c1f64-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-2fcjg\" (UID: \"fc1c3cfe-4f36-4c88-907d-5a24887c1f64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg"
Jul 13 16:48:12.573582 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:12.573552    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc1c3cfe-4f36-4c88-907d-5a24887c1f64-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-2fcjg\" (UID: \"fc1c3cfe-4f36-4c88-907d-5a24887c1f64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg"
Jul 13 16:48:12.573797 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:12.573599    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc1c3cfe-4f36-4c88-907d-5a24887c1f64-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-2fcjg\" (UID: \"fc1c3cfe-4f36-4c88-907d-5a24887c1f64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg"
Jul 13 16:48:12.573797 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:12.573623    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc1c3cfe-4f36-4c88-907d-5a24887c1f64-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-2fcjg\" (UID: \"fc1c3cfe-4f36-4c88-907d-5a24887c1f64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg"
Jul 13 16:48:12.573797 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:12.573674    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc1c3cfe-4f36-4c88-907d-5a24887c1f64-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-2fcjg\" (UID: \"fc1c3cfe-4f36-4c88-907d-5a24887c1f64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg"
Jul 13 16:48:12.573797 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:12.573702    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc1c3cfe-4f36-4c88-907d-5a24887c1f64-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-2fcjg\" (UID: \"fc1c3cfe-4f36-4c88-907d-5a24887c1f64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg"
Jul 13 16:48:12.573797 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:12.573717    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc1c3cfe-4f36-4c88-907d-5a24887c1f64-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-2fcjg\" (UID: \"fc1c3cfe-4f36-4c88-907d-5a24887c1f64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg"
Jul 13 16:48:12.583913 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:12.583886    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:48:12.674706 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:12.674672    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc1c3cfe-4f36-4c88-907d-5a24887c1f64-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-2fcjg\" (UID: \"fc1c3cfe-4f36-4c88-907d-5a24887c1f64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg"
Jul 13 16:48:12.674706 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:12.674711    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc1c3cfe-4f36-4c88-907d-5a24887c1f64-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-2fcjg\" (UID: \"fc1c3cfe-4f36-4c88-907d-5a24887c1f64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg"
Jul 13 16:48:12.674947 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:12.674764    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc1c3cfe-4f36-4c88-907d-5a24887c1f64-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-2fcjg\" (UID: \"fc1c3cfe-4f36-4c88-907d-5a24887c1f64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg"
Jul 13 16:48:12.674947 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:12.674797    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc1c3cfe-4f36-4c88-907d-5a24887c1f64-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-2fcjg\" (UID: \"fc1c3cfe-4f36-4c88-907d-5a24887c1f64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg"
Jul 13 16:48:12.674947 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:12.674835    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc1c3cfe-4f36-4c88-907d-5a24887c1f64-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-2fcjg\" (UID: \"fc1c3cfe-4f36-4c88-907d-5a24887c1f64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg"
Jul 13 16:48:12.674947 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:12.674859    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc1c3cfe-4f36-4c88-907d-5a24887c1f64-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-2fcjg\" (UID: \"fc1c3cfe-4f36-4c88-907d-5a24887c1f64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg"
Jul 13 16:48:12.674947 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:12.674897    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc1c3cfe-4f36-4c88-907d-5a24887c1f64-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-2fcjg\" (UID: \"fc1c3cfe-4f36-4c88-907d-5a24887c1f64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg"
Jul 13 16:48:12.674947 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:12.674947    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frx99\" (UniqueName: \"kubernetes.io/projected/fc1c3cfe-4f36-4c88-907d-5a24887c1f64-kube-api-access-frx99\") pod \"maas-default-gateway-openshift-default-56654dcf7-2fcjg\" (UID: \"fc1c3cfe-4f36-4c88-907d-5a24887c1f64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg"
Jul 13 16:48:12.675249 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:12.674978    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc1c3cfe-4f36-4c88-907d-5a24887c1f64-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-2fcjg\" (UID: \"fc1c3cfe-4f36-4c88-907d-5a24887c1f64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg"
Jul 13 16:48:12.675249 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:12.675128    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc1c3cfe-4f36-4c88-907d-5a24887c1f64-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-2fcjg\" (UID: \"fc1c3cfe-4f36-4c88-907d-5a24887c1f64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg"
Jul 13 16:48:12.675249 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:12.675153    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc1c3cfe-4f36-4c88-907d-5a24887c1f64-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-2fcjg\" (UID: \"fc1c3cfe-4f36-4c88-907d-5a24887c1f64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg"
Jul 13 16:48:12.675249 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:12.675214    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc1c3cfe-4f36-4c88-907d-5a24887c1f64-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-2fcjg\" (UID: \"fc1c3cfe-4f36-4c88-907d-5a24887c1f64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg"
Jul 13 16:48:12.675527 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:12.675502    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc1c3cfe-4f36-4c88-907d-5a24887c1f64-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-2fcjg\" (UID: \"fc1c3cfe-4f36-4c88-907d-5a24887c1f64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg"
Jul 13 16:48:12.675684 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:12.675665    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc1c3cfe-4f36-4c88-907d-5a24887c1f64-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-2fcjg\" (UID: \"fc1c3cfe-4f36-4c88-907d-5a24887c1f64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg"
Jul 13 16:48:12.677146 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:12.677117    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc1c3cfe-4f36-4c88-907d-5a24887c1f64-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-2fcjg\" (UID: \"fc1c3cfe-4f36-4c88-907d-5a24887c1f64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg"
Jul 13 16:48:12.677348 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:12.677329    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc1c3cfe-4f36-4c88-907d-5a24887c1f64-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-2fcjg\" (UID: \"fc1c3cfe-4f36-4c88-907d-5a24887c1f64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg"
Jul 13 16:48:12.685286 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:12.685264    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frx99\" (UniqueName: \"kubernetes.io/projected/fc1c3cfe-4f36-4c88-907d-5a24887c1f64-kube-api-access-frx99\") pod \"maas-default-gateway-openshift-default-56654dcf7-2fcjg\" (UID: \"fc1c3cfe-4f36-4c88-907d-5a24887c1f64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg"
Jul 13 16:48:12.686267 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:12.686245    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc1c3cfe-4f36-4c88-907d-5a24887c1f64-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-2fcjg\" (UID: \"fc1c3cfe-4f36-4c88-907d-5a24887c1f64\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg"
Jul 13 16:48:12.697838 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:12.697817    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:48:12.838840 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:12.838761    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg"
Jul 13 16:48:12.973209 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:12.973181    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg"]
Jul 13 16:48:12.980180 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:12.980150    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 16:48:12.980291 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:12.980227    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 16:48:12.980291 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:12.980272    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 16:48:13.019256 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:13.019233    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg" event={"ID":"fc1c3cfe-4f36-4c88-907d-5a24887c1f64","Type":"ContainerStarted","Data":"a29607281609afacd2a2fb38732a7854edcdf38f21db8e4831aeb7d476664828"}
Jul 13 16:48:14.029429 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:14.029381    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg" event={"ID":"fc1c3cfe-4f36-4c88-907d-5a24887c1f64","Type":"ContainerStarted","Data":"020213dbd953c74df28ad05daef296c23fc6a0b5b3a2afb88ac0c3a8eecd095e"}
Jul 13 16:48:14.051399 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:14.051352    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg" podStartSLOduration=2.051336697 podStartE2EDuration="2.051336697s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:48:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:48:14.049788477 +0000 UTC m=+491.408095303" watchObservedRunningTime="2026-07-13 16:48:14.051336697 +0000 UTC m=+491.409643522"
Jul 13 16:48:14.839364 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:14.839332    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg"
Jul 13 16:48:14.844179 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:14.844155    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg"
Jul 13 16:48:15.033422 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:15.033396    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg"
Jul 13 16:48:15.034492 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:15.034474    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg"
Jul 13 16:48:15.138123 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:15.138052    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:48:15.275735 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:15.275689    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:48:15.546709 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:15.546680    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:48:16.048017 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:16.047983    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-v7z2p"]
Jul 13 16:48:16.050294 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:16.050276    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-v7z2p"
Jul 13 16:48:16.053642 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:16.053624    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-qsrf5\""
Jul 13 16:48:16.066050 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:16.066029    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-v7z2p"]
Jul 13 16:48:16.089345 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:16.089317    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:48:16.105624 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:16.105595    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv5wg\" (UniqueName: \"kubernetes.io/projected/2f564229-ba03-4022-907a-d9cc44e1dcef-kube-api-access-nv5wg\") pod \"authorino-58cd955675-v7z2p\" (UID: \"2f564229-ba03-4022-907a-d9cc44e1dcef\") " pod="kuadrant-system/authorino-58cd955675-v7z2p"
Jul 13 16:48:16.175289 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:16.175261    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:48:16.206239 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:16.206209    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nv5wg\" (UniqueName: \"kubernetes.io/projected/2f564229-ba03-4022-907a-d9cc44e1dcef-kube-api-access-nv5wg\") pod \"authorino-58cd955675-v7z2p\" (UID: \"2f564229-ba03-4022-907a-d9cc44e1dcef\") " pod="kuadrant-system/authorino-58cd955675-v7z2p"
Jul 13 16:48:16.216354 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:16.216327    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv5wg\" (UniqueName: \"kubernetes.io/projected/2f564229-ba03-4022-907a-d9cc44e1dcef-kube-api-access-nv5wg\") pod \"authorino-58cd955675-v7z2p\" (UID: \"2f564229-ba03-4022-907a-d9cc44e1dcef\") " pod="kuadrant-system/authorino-58cd955675-v7z2p"
Jul 13 16:48:16.258897 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:16.258865    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-wm7gq"]
Jul 13 16:48:16.261102 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:16.261071    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wm7gq"
Jul 13 16:48:16.270026 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:16.270007    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wm7gq"]
Jul 13 16:48:16.307189 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:16.307113    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lzlm\" (UniqueName: \"kubernetes.io/projected/8234b03f-0b6c-44e9-acde-0fce58e56e75-kube-api-access-5lzlm\") pod \"authorino-75d556bd77-wm7gq\" (UID: \"8234b03f-0b6c-44e9-acde-0fce58e56e75\") " pod="kuadrant-system/authorino-75d556bd77-wm7gq"
Jul 13 16:48:16.359817 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:16.359790    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-v7z2p"
Jul 13 16:48:16.408357 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:16.408181    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lzlm\" (UniqueName: \"kubernetes.io/projected/8234b03f-0b6c-44e9-acde-0fce58e56e75-kube-api-access-5lzlm\") pod \"authorino-75d556bd77-wm7gq\" (UID: \"8234b03f-0b6c-44e9-acde-0fce58e56e75\") " pod="kuadrant-system/authorino-75d556bd77-wm7gq"
Jul 13 16:48:16.424932 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:16.424882    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lzlm\" (UniqueName: \"kubernetes.io/projected/8234b03f-0b6c-44e9-acde-0fce58e56e75-kube-api-access-5lzlm\") pod \"authorino-75d556bd77-wm7gq\" (UID: \"8234b03f-0b6c-44e9-acde-0fce58e56e75\") " pod="kuadrant-system/authorino-75d556bd77-wm7gq"
Jul 13 16:48:16.502922 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:16.502887    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-v7z2p"]
Jul 13 16:48:16.504402 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:48:16.504374    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f564229_ba03_4022_907a_d9cc44e1dcef.slice/crio-3244f040e2a6e5bb3546fcbc76bd121648e4836364ae82b743a30d11f0bed027 WatchSource:0}: Error finding container 3244f040e2a6e5bb3546fcbc76bd121648e4836364ae82b743a30d11f0bed027: Status 404 returned error can't find the container with id 3244f040e2a6e5bb3546fcbc76bd121648e4836364ae82b743a30d11f0bed027
Jul 13 16:48:16.570814 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:16.570715    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wm7gq"
Jul 13 16:48:16.716822 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:16.716798    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wm7gq"]
Jul 13 16:48:16.719264 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:48:16.719233    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8234b03f_0b6c_44e9_acde_0fce58e56e75.slice/crio-f361d8779d0aa043a50a0c4bf5c15b20bdac585589a0eb9683feb4f25c27c29d WatchSource:0}: Error finding container f361d8779d0aa043a50a0c4bf5c15b20bdac585589a0eb9683feb4f25c27c29d: Status 404 returned error can't find the container with id f361d8779d0aa043a50a0c4bf5c15b20bdac585589a0eb9683feb4f25c27c29d
Jul 13 16:48:17.042605 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:17.042568    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wm7gq" event={"ID":"8234b03f-0b6c-44e9-acde-0fce58e56e75","Type":"ContainerStarted","Data":"f361d8779d0aa043a50a0c4bf5c15b20bdac585589a0eb9683feb4f25c27c29d"}
Jul 13 16:48:17.043642 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:17.043616    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-v7z2p" event={"ID":"2f564229-ba03-4022-907a-d9cc44e1dcef","Type":"ContainerStarted","Data":"3244f040e2a6e5bb3546fcbc76bd121648e4836364ae82b743a30d11f0bed027"}
Jul 13 16:48:19.046072 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:19.046035    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:48:19.110469 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:19.110437    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:48:20.062128 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:20.062098    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-v7z2p" event={"ID":"2f564229-ba03-4022-907a-d9cc44e1dcef","Type":"ContainerStarted","Data":"84af0326002f196869d0e47213fab4a14d54d3ccd97587dfa4b820b6a0e21321"}
Jul 13 16:48:20.063492 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:20.063467    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wm7gq" event={"ID":"8234b03f-0b6c-44e9-acde-0fce58e56e75","Type":"ContainerStarted","Data":"6abfa41f52516f5ccf907e6436f4d8bf5fee2a2c8977e5279b88152cb3d78298"}
Jul 13 16:48:20.079554 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:20.079509    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-v7z2p" podStartSLOduration=0.728183293 podStartE2EDuration="4.079496673s" totalImagesPullingTime="3.35131338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:48:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:48:20.079065457 +0000 UTC m=+497.437372283" watchObservedRunningTime="2026-07-13 16:48:20.079496673 +0000 UTC m=+497.437803498"
Jul 13 16:48:20.097314 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:20.097263    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-wm7gq" podStartSLOduration=0.954571987 podStartE2EDuration="4.097243201s" totalImagesPullingTime="3.142671214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:48:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:48:20.09477224 +0000 UTC m=+497.453079089" watchObservedRunningTime="2026-07-13 16:48:20.097243201 +0000 UTC m=+497.455550026"
Jul 13 16:48:20.128587 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:20.126486    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-v7z2p"]
Jul 13 16:48:22.071852 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:22.071805    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-v7z2p" podUID="2f564229-ba03-4022-907a-d9cc44e1dcef" containerName="authorino" containerID="cri-o://84af0326002f196869d0e47213fab4a14d54d3ccd97587dfa4b820b6a0e21321" gracePeriod=30
Jul 13 16:48:22.318427 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:22.318407    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-v7z2p"
Jul 13 16:48:22.364319 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:22.364267    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nv5wg\" (UniqueName: \"kubernetes.io/projected/2f564229-ba03-4022-907a-d9cc44e1dcef-kube-api-access-nv5wg\") pod \"2f564229-ba03-4022-907a-d9cc44e1dcef\" (UID: \"2f564229-ba03-4022-907a-d9cc44e1dcef\") "
Jul 13 16:48:22.366199 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:22.366166    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f564229-ba03-4022-907a-d9cc44e1dcef-kube-api-access-nv5wg" (OuterVolumeSpecName: "kube-api-access-nv5wg") pod "2f564229-ba03-4022-907a-d9cc44e1dcef" (UID: "2f564229-ba03-4022-907a-d9cc44e1dcef"). InnerVolumeSpecName "kube-api-access-nv5wg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 16:48:22.464965 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:22.464936    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nv5wg\" (UniqueName: \"kubernetes.io/projected/2f564229-ba03-4022-907a-d9cc44e1dcef-kube-api-access-nv5wg\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 16:48:22.465131 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:22.465085    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:48:22.567433 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:22.567401    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:48:22.664180 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:22.664103    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:48:23.077206 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:23.077172    2573 generic.go:356] "Generic (PLEG): container finished" podID="2f564229-ba03-4022-907a-d9cc44e1dcef" containerID="84af0326002f196869d0e47213fab4a14d54d3ccd97587dfa4b820b6a0e21321" exitCode=0
Jul 13 16:48:23.077206 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:23.077210    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-v7z2p" event={"ID":"2f564229-ba03-4022-907a-d9cc44e1dcef","Type":"ContainerDied","Data":"84af0326002f196869d0e47213fab4a14d54d3ccd97587dfa4b820b6a0e21321"}
Jul 13 16:48:23.077674 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:23.077217    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-v7z2p"
Jul 13 16:48:23.077674 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:23.077237    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-v7z2p" event={"ID":"2f564229-ba03-4022-907a-d9cc44e1dcef","Type":"ContainerDied","Data":"3244f040e2a6e5bb3546fcbc76bd121648e4836364ae82b743a30d11f0bed027"}
Jul 13 16:48:23.077674 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:23.077260    2573 scope.go:117] "RemoveContainer" containerID="84af0326002f196869d0e47213fab4a14d54d3ccd97587dfa4b820b6a0e21321"
Jul 13 16:48:23.085290 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:23.085273    2573 scope.go:117] "RemoveContainer" containerID="84af0326002f196869d0e47213fab4a14d54d3ccd97587dfa4b820b6a0e21321"
Jul 13 16:48:23.085562 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:48:23.085543    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84af0326002f196869d0e47213fab4a14d54d3ccd97587dfa4b820b6a0e21321\": container with ID starting with 84af0326002f196869d0e47213fab4a14d54d3ccd97587dfa4b820b6a0e21321 not found: ID does not exist" containerID="84af0326002f196869d0e47213fab4a14d54d3ccd97587dfa4b820b6a0e21321"
Jul 13 16:48:23.085630 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:23.085572    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84af0326002f196869d0e47213fab4a14d54d3ccd97587dfa4b820b6a0e21321"} err="failed to get container status \"84af0326002f196869d0e47213fab4a14d54d3ccd97587dfa4b820b6a0e21321\": rpc error: code = NotFound desc = could not find container \"84af0326002f196869d0e47213fab4a14d54d3ccd97587dfa4b820b6a0e21321\": container with ID starting with 84af0326002f196869d0e47213fab4a14d54d3ccd97587dfa4b820b6a0e21321 not found: ID does not exist"
Jul 13 16:48:23.098706 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:23.098675    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-v7z2p"]
Jul 13 16:48:23.102513 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:23.102493    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-v7z2p"]
Jul 13 16:48:23.147503 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:23.147478    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f564229-ba03-4022-907a-d9cc44e1dcef" path="/var/lib/kubelet/pods/2f564229-ba03-4022-907a-d9cc44e1dcef/volumes"
Jul 13 16:48:36.574278 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:36.574245    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:48:36.669102 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:36.669070    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:48:37.238934 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:37.238902    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:48:39.500695 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:39.500665    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:48:39.624626 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:39.624593    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:48:49.722425 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:49.722392    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:48:49.908611 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:49.908574    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5dmk6"]
Jul 13 16:48:49.909005 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:49.908988    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f564229-ba03-4022-907a-d9cc44e1dcef" containerName="authorino"
Jul 13 16:48:49.909108 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:49.909009    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f564229-ba03-4022-907a-d9cc44e1dcef" containerName="authorino"
Jul 13 16:48:49.909108 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:49.909093    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f564229-ba03-4022-907a-d9cc44e1dcef" containerName="authorino"
Jul 13 16:48:49.913456 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:49.913432    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5dmk6"
Jul 13 16:48:49.920541 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:49.920515    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5dmk6"]
Jul 13 16:48:49.995399 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:49.995323    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mc4c\" (UniqueName: \"kubernetes.io/projected/053d5178-d19f-45ef-9f11-a391e921c9ae-kube-api-access-4mc4c\") pod \"authorino-5d4b67c446-5dmk6\" (UID: \"053d5178-d19f-45ef-9f11-a391e921c9ae\") " pod="kuadrant-system/authorino-5d4b67c446-5dmk6"
Jul 13 16:48:50.096455 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:50.096425    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mc4c\" (UniqueName: \"kubernetes.io/projected/053d5178-d19f-45ef-9f11-a391e921c9ae-kube-api-access-4mc4c\") pod \"authorino-5d4b67c446-5dmk6\" (UID: \"053d5178-d19f-45ef-9f11-a391e921c9ae\") " pod="kuadrant-system/authorino-5d4b67c446-5dmk6"
Jul 13 16:48:50.101167 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:50.101141    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:48:50.104641 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:50.104616    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mc4c\" (UniqueName: \"kubernetes.io/projected/053d5178-d19f-45ef-9f11-a391e921c9ae-kube-api-access-4mc4c\") pod \"authorino-5d4b67c446-5dmk6\" (UID: \"053d5178-d19f-45ef-9f11-a391e921c9ae\") " pod="kuadrant-system/authorino-5d4b67c446-5dmk6"
Jul 13 16:48:50.220658 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:50.220630    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5dmk6"]
Jul 13 16:48:50.220868 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:50.220856    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5dmk6"
Jul 13 16:48:50.242175 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:50.242148    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-d4ccbd7d6-d4fkv"]
Jul 13 16:48:50.244971 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:50.244948    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d4ccbd7d6-d4fkv"
Jul 13 16:48:50.261942 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:50.261823    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d4ccbd7d6-d4fkv"]
Jul 13 16:48:50.316974 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:50.316929    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-d4ccbd7d6-d4fkv"]
Jul 13 16:48:50.317277 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:48:50.317237    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-wtptc], unattached volumes=[], failed to process volumes=[kube-api-access-wtptc]: context canceled" pod="kuadrant-system/authorino-d4ccbd7d6-d4fkv" podUID="f2f9a8e0-0275-408d-af42-0c58ab2720a5"
Jul 13 16:48:50.348039 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:50.347999    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-d6dbfc7c4-cf7xw"]
Jul 13 16:48:50.350465 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:50.350448    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d6dbfc7c4-cf7xw"
Jul 13 16:48:50.353139 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:50.353119    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 13 16:48:50.364050 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:50.364030    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d6dbfc7c4-cf7xw"]
Jul 13 16:48:50.369852 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:50.369830    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5dmk6"]
Jul 13 16:48:50.371636 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:48:50.371607    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod053d5178_d19f_45ef_9f11_a391e921c9ae.slice/crio-4f5330656e1085fff907685079855fd0c8928ee9c08af95b3901e59c22641bf4 WatchSource:0}: Error finding container 4f5330656e1085fff907685079855fd0c8928ee9c08af95b3901e59c22641bf4: Status 404 returned error can't find the container with id 4f5330656e1085fff907685079855fd0c8928ee9c08af95b3901e59c22641bf4
Jul 13 16:48:50.399511 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:50.399479    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtptc\" (UniqueName: \"kubernetes.io/projected/f2f9a8e0-0275-408d-af42-0c58ab2720a5-kube-api-access-wtptc\") pod \"authorino-d4ccbd7d6-d4fkv\" (UID: \"f2f9a8e0-0275-408d-af42-0c58ab2720a5\") " pod="kuadrant-system/authorino-d4ccbd7d6-d4fkv"
Jul 13 16:48:50.500269 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:50.500232    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtptc\" (UniqueName: \"kubernetes.io/projected/f2f9a8e0-0275-408d-af42-0c58ab2720a5-kube-api-access-wtptc\") pod \"authorino-d4ccbd7d6-d4fkv\" (UID: \"f2f9a8e0-0275-408d-af42-0c58ab2720a5\") " pod="kuadrant-system/authorino-d4ccbd7d6-d4fkv"
Jul 13 16:48:50.500428 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:50.500291    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/da4aed23-39e5-4c7e-93bd-309716353a0e-tls-cert\") pod \"authorino-d6dbfc7c4-cf7xw\" (UID: \"da4aed23-39e5-4c7e-93bd-309716353a0e\") " pod="kuadrant-system/authorino-d6dbfc7c4-cf7xw"
Jul 13 16:48:50.500428 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:50.500311    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f92vj\" (UniqueName: \"kubernetes.io/projected/da4aed23-39e5-4c7e-93bd-309716353a0e-kube-api-access-f92vj\") pod \"authorino-d6dbfc7c4-cf7xw\" (UID: \"da4aed23-39e5-4c7e-93bd-309716353a0e\") " pod="kuadrant-system/authorino-d6dbfc7c4-cf7xw"
Jul 13 16:48:50.508393 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:50.508323    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtptc\" (UniqueName: \"kubernetes.io/projected/f2f9a8e0-0275-408d-af42-0c58ab2720a5-kube-api-access-wtptc\") pod \"authorino-d4ccbd7d6-d4fkv\" (UID: \"f2f9a8e0-0275-408d-af42-0c58ab2720a5\") " pod="kuadrant-system/authorino-d4ccbd7d6-d4fkv"
Jul 13 16:48:50.601123 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:50.601088    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/da4aed23-39e5-4c7e-93bd-309716353a0e-tls-cert\") pod \"authorino-d6dbfc7c4-cf7xw\" (UID: \"da4aed23-39e5-4c7e-93bd-309716353a0e\") " pod="kuadrant-system/authorino-d6dbfc7c4-cf7xw"
Jul 13 16:48:50.601298 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:50.601130    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f92vj\" (UniqueName: \"kubernetes.io/projected/da4aed23-39e5-4c7e-93bd-309716353a0e-kube-api-access-f92vj\") pod \"authorino-d6dbfc7c4-cf7xw\" (UID: \"da4aed23-39e5-4c7e-93bd-309716353a0e\") " pod="kuadrant-system/authorino-d6dbfc7c4-cf7xw"
Jul 13 16:48:50.603600 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:50.603574    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/da4aed23-39e5-4c7e-93bd-309716353a0e-tls-cert\") pod \"authorino-d6dbfc7c4-cf7xw\" (UID: \"da4aed23-39e5-4c7e-93bd-309716353a0e\") " pod="kuadrant-system/authorino-d6dbfc7c4-cf7xw"
Jul 13 16:48:50.610228 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:50.610207    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f92vj\" (UniqueName: \"kubernetes.io/projected/da4aed23-39e5-4c7e-93bd-309716353a0e-kube-api-access-f92vj\") pod \"authorino-d6dbfc7c4-cf7xw\" (UID: \"da4aed23-39e5-4c7e-93bd-309716353a0e\") " pod="kuadrant-system/authorino-d6dbfc7c4-cf7xw"
Jul 13 16:48:50.659205 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:50.659184    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d6dbfc7c4-cf7xw"
Jul 13 16:48:50.785678 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:50.785599    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d6dbfc7c4-cf7xw"]
Jul 13 16:48:50.788237 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:48:50.788214    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podda4aed23_39e5_4c7e_93bd_309716353a0e.slice/crio-7cf517e94bb3d7252df412df62958315cb230e00bbf26efca00b09e8e5708254 WatchSource:0}: Error finding container 7cf517e94bb3d7252df412df62958315cb230e00bbf26efca00b09e8e5708254: Status 404 returned error can't find the container with id 7cf517e94bb3d7252df412df62958315cb230e00bbf26efca00b09e8e5708254
Jul 13 16:48:51.214690 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:51.214607    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d6dbfc7c4-cf7xw" event={"ID":"da4aed23-39e5-4c7e-93bd-309716353a0e","Type":"ContainerStarted","Data":"7cf517e94bb3d7252df412df62958315cb230e00bbf26efca00b09e8e5708254"}
Jul 13 16:48:51.215948 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:51.215924    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-5dmk6" event={"ID":"053d5178-d19f-45ef-9f11-a391e921c9ae","Type":"ContainerStarted","Data":"af765956092dc8cec68904c2f16d11c527a5ebb8d1fb95f26993a0622d7ca138"}
Jul 13 16:48:51.216076 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:51.215965    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-5dmk6" event={"ID":"053d5178-d19f-45ef-9f11-a391e921c9ae","Type":"ContainerStarted","Data":"4f5330656e1085fff907685079855fd0c8928ee9c08af95b3901e59c22641bf4"}
Jul 13 16:48:51.216076 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:51.215936    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d4ccbd7d6-d4fkv"
Jul 13 16:48:51.216076 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:51.215993    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-5dmk6" podUID="053d5178-d19f-45ef-9f11-a391e921c9ae" containerName="authorino" containerID="cri-o://af765956092dc8cec68904c2f16d11c527a5ebb8d1fb95f26993a0622d7ca138" gracePeriod=30
Jul 13 16:48:51.223377 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:51.223358    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d4ccbd7d6-d4fkv"
Jul 13 16:48:51.249955 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:51.249914    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-5dmk6" podStartSLOduration=1.735751911 podStartE2EDuration="2.249899964s" totalImagesPullingTime="514.148053ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:48:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:48:51.249444487 +0000 UTC m=+528.607751312" watchObservedRunningTime="2026-07-13 16:48:51.249899964 +0000 UTC m=+528.608206788"
Jul 13 16:48:51.306624 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:51.306599    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtptc\" (UniqueName: \"kubernetes.io/projected/f2f9a8e0-0275-408d-af42-0c58ab2720a5-kube-api-access-wtptc\") pod \"f2f9a8e0-0275-408d-af42-0c58ab2720a5\" (UID: \"f2f9a8e0-0275-408d-af42-0c58ab2720a5\") "
Jul 13 16:48:51.308401 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:51.308382    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2f9a8e0-0275-408d-af42-0c58ab2720a5-kube-api-access-wtptc" (OuterVolumeSpecName: "kube-api-access-wtptc") pod "f2f9a8e0-0275-408d-af42-0c58ab2720a5" (UID: "f2f9a8e0-0275-408d-af42-0c58ab2720a5"). InnerVolumeSpecName "kube-api-access-wtptc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 16:48:51.407288 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:51.407259    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtptc\" (UniqueName: \"kubernetes.io/projected/f2f9a8e0-0275-408d-af42-0c58ab2720a5-kube-api-access-wtptc\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 16:48:51.457290 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:51.457265    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5dmk6"
Jul 13 16:48:51.608737 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:51.608688    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mc4c\" (UniqueName: \"kubernetes.io/projected/053d5178-d19f-45ef-9f11-a391e921c9ae-kube-api-access-4mc4c\") pod \"053d5178-d19f-45ef-9f11-a391e921c9ae\" (UID: \"053d5178-d19f-45ef-9f11-a391e921c9ae\") "
Jul 13 16:48:51.610682 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:51.610657    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/053d5178-d19f-45ef-9f11-a391e921c9ae-kube-api-access-4mc4c" (OuterVolumeSpecName: "kube-api-access-4mc4c") pod "053d5178-d19f-45ef-9f11-a391e921c9ae" (UID: "053d5178-d19f-45ef-9f11-a391e921c9ae"). InnerVolumeSpecName "kube-api-access-4mc4c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 16:48:51.709824 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:51.709795    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mc4c\" (UniqueName: \"kubernetes.io/projected/053d5178-d19f-45ef-9f11-a391e921c9ae-kube-api-access-4mc4c\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 16:48:52.221740 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:52.221679    2573 generic.go:356] "Generic (PLEG): container finished" podID="053d5178-d19f-45ef-9f11-a391e921c9ae" containerID="af765956092dc8cec68904c2f16d11c527a5ebb8d1fb95f26993a0622d7ca138" exitCode=0
Jul 13 16:48:52.221740 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:52.221738    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5dmk6"
Jul 13 16:48:52.222240 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:52.221773    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-5dmk6" event={"ID":"053d5178-d19f-45ef-9f11-a391e921c9ae","Type":"ContainerDied","Data":"af765956092dc8cec68904c2f16d11c527a5ebb8d1fb95f26993a0622d7ca138"}
Jul 13 16:48:52.222240 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:52.221817    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-5dmk6" event={"ID":"053d5178-d19f-45ef-9f11-a391e921c9ae","Type":"ContainerDied","Data":"4f5330656e1085fff907685079855fd0c8928ee9c08af95b3901e59c22641bf4"}
Jul 13 16:48:52.222240 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:52.221842    2573 scope.go:117] "RemoveContainer" containerID="af765956092dc8cec68904c2f16d11c527a5ebb8d1fb95f26993a0622d7ca138"
Jul 13 16:48:52.223437 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:52.223403    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d6dbfc7c4-cf7xw" event={"ID":"da4aed23-39e5-4c7e-93bd-309716353a0e","Type":"ContainerStarted","Data":"4ed0b8a93ed015424ea62df4647bf2e1619e2492db7bfc4d0cf4701aa5654d5d"}
Jul 13 16:48:52.223563 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:52.223445    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d4ccbd7d6-d4fkv"
Jul 13 16:48:52.232696 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:52.232678    2573 scope.go:117] "RemoveContainer" containerID="af765956092dc8cec68904c2f16d11c527a5ebb8d1fb95f26993a0622d7ca138"
Jul 13 16:48:52.233174 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:48:52.233118    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af765956092dc8cec68904c2f16d11c527a5ebb8d1fb95f26993a0622d7ca138\": container with ID starting with af765956092dc8cec68904c2f16d11c527a5ebb8d1fb95f26993a0622d7ca138 not found: ID does not exist" containerID="af765956092dc8cec68904c2f16d11c527a5ebb8d1fb95f26993a0622d7ca138"
Jul 13 16:48:52.233174 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:52.233151    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af765956092dc8cec68904c2f16d11c527a5ebb8d1fb95f26993a0622d7ca138"} err="failed to get container status \"af765956092dc8cec68904c2f16d11c527a5ebb8d1fb95f26993a0622d7ca138\": rpc error: code = NotFound desc = could not find container \"af765956092dc8cec68904c2f16d11c527a5ebb8d1fb95f26993a0622d7ca138\": container with ID starting with af765956092dc8cec68904c2f16d11c527a5ebb8d1fb95f26993a0622d7ca138 not found: ID does not exist"
Jul 13 16:48:52.245778 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:52.245711    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-d6dbfc7c4-cf7xw" podStartSLOduration=1.5149806940000001 podStartE2EDuration="2.245698065s" totalImagesPullingTime="730.717371ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:48:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:48:52.24479445 +0000 UTC m=+529.603101300" watchObservedRunningTime="2026-07-13 16:48:52.245698065 +0000 UTC m=+529.604004889"
Jul 13 16:48:52.270483 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:52.270460    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-d4ccbd7d6-d4fkv"]
Jul 13 16:48:52.277334 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:52.277312    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wm7gq"]
Jul 13 16:48:52.277499 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:52.277470    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-wm7gq" podUID="8234b03f-0b6c-44e9-acde-0fce58e56e75" containerName="authorino" containerID="cri-o://6abfa41f52516f5ccf907e6436f4d8bf5fee2a2c8977e5279b88152cb3d78298" gracePeriod=30
Jul 13 16:48:52.280108 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:52.280084    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-d4ccbd7d6-d4fkv"]
Jul 13 16:48:52.293754 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:52.293733    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5dmk6"]
Jul 13 16:48:52.300447 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:52.300427    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5dmk6"]
Jul 13 16:48:52.525118 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:52.525092    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wm7gq"
Jul 13 16:48:52.616248 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:52.616220    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5lzlm\" (UniqueName: \"kubernetes.io/projected/8234b03f-0b6c-44e9-acde-0fce58e56e75-kube-api-access-5lzlm\") pod \"8234b03f-0b6c-44e9-acde-0fce58e56e75\" (UID: \"8234b03f-0b6c-44e9-acde-0fce58e56e75\") "
Jul 13 16:48:52.618268 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:52.618245    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8234b03f-0b6c-44e9-acde-0fce58e56e75-kube-api-access-5lzlm" (OuterVolumeSpecName: "kube-api-access-5lzlm") pod "8234b03f-0b6c-44e9-acde-0fce58e56e75" (UID: "8234b03f-0b6c-44e9-acde-0fce58e56e75"). InnerVolumeSpecName "kube-api-access-5lzlm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 16:48:52.717796 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:52.717708    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5lzlm\" (UniqueName: \"kubernetes.io/projected/8234b03f-0b6c-44e9-acde-0fce58e56e75-kube-api-access-5lzlm\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 16:48:53.147344 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:53.147306    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="053d5178-d19f-45ef-9f11-a391e921c9ae" path="/var/lib/kubelet/pods/053d5178-d19f-45ef-9f11-a391e921c9ae/volumes"
Jul 13 16:48:53.147639 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:53.147626    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2f9a8e0-0275-408d-af42-0c58ab2720a5" path="/var/lib/kubelet/pods/f2f9a8e0-0275-408d-af42-0c58ab2720a5/volumes"
Jul 13 16:48:53.229651 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:53.229613    2573 generic.go:356] "Generic (PLEG): container finished" podID="8234b03f-0b6c-44e9-acde-0fce58e56e75" containerID="6abfa41f52516f5ccf907e6436f4d8bf5fee2a2c8977e5279b88152cb3d78298" exitCode=0
Jul 13 16:48:53.230093 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:53.229649    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wm7gq" event={"ID":"8234b03f-0b6c-44e9-acde-0fce58e56e75","Type":"ContainerDied","Data":"6abfa41f52516f5ccf907e6436f4d8bf5fee2a2c8977e5279b88152cb3d78298"}
Jul 13 16:48:53.230093 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:53.229671    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wm7gq"
Jul 13 16:48:53.230093 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:53.229697    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wm7gq" event={"ID":"8234b03f-0b6c-44e9-acde-0fce58e56e75","Type":"ContainerDied","Data":"f361d8779d0aa043a50a0c4bf5c15b20bdac585589a0eb9683feb4f25c27c29d"}
Jul 13 16:48:53.230093 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:53.229716    2573 scope.go:117] "RemoveContainer" containerID="6abfa41f52516f5ccf907e6436f4d8bf5fee2a2c8977e5279b88152cb3d78298"
Jul 13 16:48:53.237831 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:53.237816    2573 scope.go:117] "RemoveContainer" containerID="6abfa41f52516f5ccf907e6436f4d8bf5fee2a2c8977e5279b88152cb3d78298"
Jul 13 16:48:53.238066 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:48:53.238050    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6abfa41f52516f5ccf907e6436f4d8bf5fee2a2c8977e5279b88152cb3d78298\": container with ID starting with 6abfa41f52516f5ccf907e6436f4d8bf5fee2a2c8977e5279b88152cb3d78298 not found: ID does not exist" containerID="6abfa41f52516f5ccf907e6436f4d8bf5fee2a2c8977e5279b88152cb3d78298"
Jul 13 16:48:53.238111 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:53.238073    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6abfa41f52516f5ccf907e6436f4d8bf5fee2a2c8977e5279b88152cb3d78298"} err="failed to get container status \"6abfa41f52516f5ccf907e6436f4d8bf5fee2a2c8977e5279b88152cb3d78298\": rpc error: code = NotFound desc = could not find container \"6abfa41f52516f5ccf907e6436f4d8bf5fee2a2c8977e5279b88152cb3d78298\": container with ID starting with 6abfa41f52516f5ccf907e6436f4d8bf5fee2a2c8977e5279b88152cb3d78298 not found: ID does not exist"
Jul 13 16:48:53.247781 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:53.247760    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wm7gq"]
Jul 13 16:48:53.251856 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:53.251837    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wm7gq"]
Jul 13 16:48:55.147098 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:55.147025    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8234b03f-0b6c-44e9-acde-0fce58e56e75" path="/var/lib/kubelet/pods/8234b03f-0b6c-44e9-acde-0fce58e56e75/volumes"
Jul 13 16:48:57.630083 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:57.630053    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:48:57.727957 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:57.727928    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:48:57.876997 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:57.876967    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:48:58.170360 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:48:58.170328    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:49:00.620557 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:00.620522    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:49:01.229404 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:01.229345    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:49:10.127576 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:10.127546    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:49:34.229406 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:34.229360    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:49:34.386267 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:34.386213    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:49:34.642873 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:34.642768    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:49:34.839595 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:34.839567    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:49:35.277564 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:35.277533    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:49:35.381121 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:35.381093    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:49:43.448265 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:43.448235    2573 generic.go:356] "Generic (PLEG): container finished" podID="fc1c3cfe-4f36-4c88-907d-5a24887c1f64" containerID="020213dbd953c74df28ad05daef296c23fc6a0b5b3a2afb88ac0c3a8eecd095e" exitCode=0
Jul 13 16:49:43.448677 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:43.448292    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg" event={"ID":"fc1c3cfe-4f36-4c88-907d-5a24887c1f64","Type":"ContainerDied","Data":"020213dbd953c74df28ad05daef296c23fc6a0b5b3a2afb88ac0c3a8eecd095e"}
Jul 13 16:49:43.448677 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:43.448612    2573 scope.go:117] "RemoveContainer" containerID="020213dbd953c74df28ad05daef296c23fc6a0b5b3a2afb88ac0c3a8eecd095e"
Jul 13 16:49:43.449559 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:43.449530    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 16:49:43.449615 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:43.449597    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 16:49:43.449650 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:43.449628    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 16:49:44.458747 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:44.458489    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg" event={"ID":"fc1c3cfe-4f36-4c88-907d-5a24887c1f64","Type":"ContainerStarted","Data":"2b28c0b65f5ab601b81606ad43b1b9a815b0b2c8e995280e2f4026767c679409"}
Jul 13 16:49:44.659300 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:44.659263    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:49:44.752918 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:44.752870    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:49:44.840513 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:44.839486    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg"
Jul 13 16:49:44.840830 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:44.840807    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-2fcjg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 13 16:49:44.841014 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:44.840989    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg" podUID="fc1c3cfe-4f36-4c88-907d-5a24887c1f64" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 13 16:49:45.033681 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:45.033599    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg"
Jul 13 16:49:45.839484 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:45.839439    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-2fcjg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 13 16:49:45.839991 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:45.839505    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg" podUID="fc1c3cfe-4f36-4c88-907d-5a24887c1f64" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 13 16:49:46.840090 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:46.840046    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-2fcjg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 13 16:49:46.840558 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:46.840120    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg" podUID="fc1c3cfe-4f36-4c88-907d-5a24887c1f64" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 13 16:49:47.840216 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:47.839790    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-2fcjg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 13 16:49:47.840216 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:47.839850    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg" podUID="fc1c3cfe-4f36-4c88-907d-5a24887c1f64" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 13 16:49:48.843786 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:48.843748    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg"
Jul 13 16:49:48.844658 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:48.844635    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2fcjg"
Jul 13 16:49:53.399845 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:53.399807    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:49:53.463940 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:53.463906    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:49:59.900990 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:59.900963    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw"]
Jul 13 16:49:59.901342 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:59.901259    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8234b03f-0b6c-44e9-acde-0fce58e56e75" containerName="authorino"
Jul 13 16:49:59.901342 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:59.901269    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8234b03f-0b6c-44e9-acde-0fce58e56e75" containerName="authorino"
Jul 13 16:49:59.901342 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:59.901289    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="053d5178-d19f-45ef-9f11-a391e921c9ae" containerName="authorino"
Jul 13 16:49:59.901342 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:59.901295    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="053d5178-d19f-45ef-9f11-a391e921c9ae" containerName="authorino"
Jul 13 16:49:59.901470 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:59.901347    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="8234b03f-0b6c-44e9-acde-0fce58e56e75" containerName="authorino"
Jul 13 16:49:59.901470 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:59.901356    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="053d5178-d19f-45ef-9f11-a391e921c9ae" containerName="authorino"
Jul 13 16:49:59.904234 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:59.904212    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw"
Jul 13 16:49:59.908430 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:59.908407    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 13 16:49:59.908958 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:59.908939    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-xms2v\""
Jul 13 16:49:59.909024 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:59.908995    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 13 16:49:59.909401 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:59.909387    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 13 16:49:59.915448 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:59.915427    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw"]
Jul 13 16:49:59.936209 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:59.936188    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:49:59.982572 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:59.982545    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f2a90f3-2855-4964-93ce-486f1a244e5e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw\" (UID: \"7f2a90f3-2855-4964-93ce-486f1a244e5e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw"
Jul 13 16:49:59.982675 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:59.982577    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f2a90f3-2855-4964-93ce-486f1a244e5e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw\" (UID: \"7f2a90f3-2855-4964-93ce-486f1a244e5e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw"
Jul 13 16:49:59.982675 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:59.982606    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f2a90f3-2855-4964-93ce-486f1a244e5e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw\" (UID: \"7f2a90f3-2855-4964-93ce-486f1a244e5e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw"
Jul 13 16:49:59.982675 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:59.982630    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f2a90f3-2855-4964-93ce-486f1a244e5e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw\" (UID: \"7f2a90f3-2855-4964-93ce-486f1a244e5e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw"
Jul 13 16:49:59.982675 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:59.982648    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktllj\" (UniqueName: \"kubernetes.io/projected/7f2a90f3-2855-4964-93ce-486f1a244e5e-kube-api-access-ktllj\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw\" (UID: \"7f2a90f3-2855-4964-93ce-486f1a244e5e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw"
Jul 13 16:49:59.982838 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:49:59.982744    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f2a90f3-2855-4964-93ce-486f1a244e5e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw\" (UID: \"7f2a90f3-2855-4964-93ce-486f1a244e5e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw"
Jul 13 16:50:00.083985 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:50:00.083944    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f2a90f3-2855-4964-93ce-486f1a244e5e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw\" (UID: \"7f2a90f3-2855-4964-93ce-486f1a244e5e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw"
Jul 13 16:50:00.084181 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:50:00.083995    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktllj\" (UniqueName: \"kubernetes.io/projected/7f2a90f3-2855-4964-93ce-486f1a244e5e-kube-api-access-ktllj\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw\" (UID: \"7f2a90f3-2855-4964-93ce-486f1a244e5e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw"
Jul 13 16:50:00.084181 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:50:00.084054    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f2a90f3-2855-4964-93ce-486f1a244e5e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw\" (UID: \"7f2a90f3-2855-4964-93ce-486f1a244e5e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw"
Jul 13 16:50:00.084181 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:50:00.084116    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f2a90f3-2855-4964-93ce-486f1a244e5e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw\" (UID: \"7f2a90f3-2855-4964-93ce-486f1a244e5e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw"
Jul 13 16:50:00.084181 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:50:00.084152    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f2a90f3-2855-4964-93ce-486f1a244e5e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw\" (UID: \"7f2a90f3-2855-4964-93ce-486f1a244e5e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw"
Jul 13 16:50:00.084401 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:50:00.084198    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f2a90f3-2855-4964-93ce-486f1a244e5e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw\" (UID: \"7f2a90f3-2855-4964-93ce-486f1a244e5e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw"
Jul 13 16:50:00.084577 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:50:00.084551    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f2a90f3-2855-4964-93ce-486f1a244e5e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw\" (UID: \"7f2a90f3-2855-4964-93ce-486f1a244e5e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw"
Jul 13 16:50:00.084656 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:50:00.084570    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f2a90f3-2855-4964-93ce-486f1a244e5e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw\" (UID: \"7f2a90f3-2855-4964-93ce-486f1a244e5e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw"
Jul 13 16:50:00.084656 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:50:00.084621    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f2a90f3-2855-4964-93ce-486f1a244e5e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw\" (UID: \"7f2a90f3-2855-4964-93ce-486f1a244e5e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw"
Jul 13 16:50:00.086531 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:50:00.086503    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f2a90f3-2855-4964-93ce-486f1a244e5e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw\" (UID: \"7f2a90f3-2855-4964-93ce-486f1a244e5e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw"
Jul 13 16:50:00.086757 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:50:00.086741    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f2a90f3-2855-4964-93ce-486f1a244e5e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw\" (UID: \"7f2a90f3-2855-4964-93ce-486f1a244e5e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw"
Jul 13 16:50:00.093267 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:50:00.093241    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktllj\" (UniqueName: \"kubernetes.io/projected/7f2a90f3-2855-4964-93ce-486f1a244e5e-kube-api-access-ktllj\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw\" (UID: \"7f2a90f3-2855-4964-93ce-486f1a244e5e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw"
Jul 13 16:50:00.218094 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:50:00.218024    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw"
Jul 13 16:50:00.359340 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:50:00.359318    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw"]
Jul 13 16:50:00.362588 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:50:00.362556    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f2a90f3_2855_4964_93ce_486f1a244e5e.slice/crio-509fbfc1f9eeaada6688007a84362f20edae648850c8ac195cae7fbf9514b6e9 WatchSource:0}: Error finding container 509fbfc1f9eeaada6688007a84362f20edae648850c8ac195cae7fbf9514b6e9: Status 404 returned error can't find the container with id 509fbfc1f9eeaada6688007a84362f20edae648850c8ac195cae7fbf9514b6e9
Jul 13 16:50:00.530752 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:50:00.530701    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw" event={"ID":"7f2a90f3-2855-4964-93ce-486f1a244e5e","Type":"ContainerStarted","Data":"509fbfc1f9eeaada6688007a84362f20edae648850c8ac195cae7fbf9514b6e9"}
Jul 13 16:50:02.543326 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:50:02.543286    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw" event={"ID":"7f2a90f3-2855-4964-93ce-486f1a244e5e","Type":"ContainerStarted","Data":"842eee35d61b36390d1e7972617e4ef1f1ed428f6880b01502c649c77a033d39"}
Jul 13 16:50:02.580000 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:50:02.579949    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw" podStartSLOduration=2.288599944 podStartE2EDuration="3.579934376s" totalImagesPullingTime="1.291334432s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:49:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:50:02.579521674 +0000 UTC m=+599.937828499" watchObservedRunningTime="2026-07-13 16:50:02.579934376 +0000 UTC m=+599.938241201"
Jul 13 16:50:03.040448 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:50:03.040419    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnxdg_e1fb6130-2ab7-40f5-831c-ea95ff241f37/ovn-acl-logging/0.log"
Jul 13 16:50:03.041740 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:50:03.041698    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnxdg_e1fb6130-2ab7-40f5-831c-ea95ff241f37/ovn-acl-logging/0.log"
Jul 13 16:50:10.218984 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:50:10.218950    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw"
Jul 13 16:50:10.219429 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:50:10.219010    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw"
Jul 13 16:50:10.230918 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:50:10.230890    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw"
Jul 13 16:50:10.590082 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:50:10.590055    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw"
Jul 13 16:50:12.912924 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:50:12.912881    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:50:20.355106 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:50:20.355072    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:50:31.172114 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:50:31.172084    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:51:01.644815 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:51:01.644769    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:51:16.590310 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:51:16.590279    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv"]
Jul 13 16:51:16.593853 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:51:16.593829    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv"
Jul 13 16:51:16.596923 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:51:16.596902    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 13 16:51:16.605295 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:51:16.605272    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv"]
Jul 13 16:51:16.622360 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:51:16.622328    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:51:16.726644 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:51:16.726608    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6b7a8a4-c852-4267-bcaf-aeaa861fcfa6-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv\" (UID: \"c6b7a8a4-c852-4267-bcaf-aeaa861fcfa6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv"
Jul 13 16:51:16.726824 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:51:16.726659    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6b7a8a4-c852-4267-bcaf-aeaa861fcfa6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv\" (UID: \"c6b7a8a4-c852-4267-bcaf-aeaa861fcfa6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv"
Jul 13 16:51:16.726824 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:51:16.726764    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6b7a8a4-c852-4267-bcaf-aeaa861fcfa6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv\" (UID: \"c6b7a8a4-c852-4267-bcaf-aeaa861fcfa6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv"
Jul 13 16:51:16.726824 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:51:16.726813    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6b7a8a4-c852-4267-bcaf-aeaa861fcfa6-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv\" (UID: \"c6b7a8a4-c852-4267-bcaf-aeaa861fcfa6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv"
Jul 13 16:51:16.726961 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:51:16.726881    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6b7a8a4-c852-4267-bcaf-aeaa861fcfa6-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv\" (UID: \"c6b7a8a4-c852-4267-bcaf-aeaa861fcfa6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv"
Jul 13 16:51:16.727012 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:51:16.726978    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcqtm\" (UniqueName: \"kubernetes.io/projected/c6b7a8a4-c852-4267-bcaf-aeaa861fcfa6-kube-api-access-tcqtm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv\" (UID: \"c6b7a8a4-c852-4267-bcaf-aeaa861fcfa6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv"
Jul 13 16:51:16.827838 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:51:16.827798    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6b7a8a4-c852-4267-bcaf-aeaa861fcfa6-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv\" (UID: \"c6b7a8a4-c852-4267-bcaf-aeaa861fcfa6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv"
Jul 13 16:51:16.828025 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:51:16.827864    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6b7a8a4-c852-4267-bcaf-aeaa861fcfa6-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv\" (UID: \"c6b7a8a4-c852-4267-bcaf-aeaa861fcfa6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv"
Jul 13 16:51:16.828025 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:51:16.827908    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcqtm\" (UniqueName: \"kubernetes.io/projected/c6b7a8a4-c852-4267-bcaf-aeaa861fcfa6-kube-api-access-tcqtm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv\" (UID: \"c6b7a8a4-c852-4267-bcaf-aeaa861fcfa6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv"
Jul 13 16:51:16.828025 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:51:16.827946    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6b7a8a4-c852-4267-bcaf-aeaa861fcfa6-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv\" (UID: \"c6b7a8a4-c852-4267-bcaf-aeaa861fcfa6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv"
Jul 13 16:51:16.828025 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:51:16.827974    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6b7a8a4-c852-4267-bcaf-aeaa861fcfa6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv\" (UID: \"c6b7a8a4-c852-4267-bcaf-aeaa861fcfa6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv"
Jul 13 16:51:16.828025 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:51:16.828005    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6b7a8a4-c852-4267-bcaf-aeaa861fcfa6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv\" (UID: \"c6b7a8a4-c852-4267-bcaf-aeaa861fcfa6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv"
Jul 13 16:51:16.828638 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:51:16.828249    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6b7a8a4-c852-4267-bcaf-aeaa861fcfa6-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv\" (UID: \"c6b7a8a4-c852-4267-bcaf-aeaa861fcfa6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv"
Jul 13 16:51:16.828638 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:51:16.828272    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6b7a8a4-c852-4267-bcaf-aeaa861fcfa6-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv\" (UID: \"c6b7a8a4-c852-4267-bcaf-aeaa861fcfa6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv"
Jul 13 16:51:16.828638 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:51:16.828341    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6b7a8a4-c852-4267-bcaf-aeaa861fcfa6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv\" (UID: \"c6b7a8a4-c852-4267-bcaf-aeaa861fcfa6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv"
Jul 13 16:51:16.830246 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:51:16.830226    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6b7a8a4-c852-4267-bcaf-aeaa861fcfa6-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv\" (UID: \"c6b7a8a4-c852-4267-bcaf-aeaa861fcfa6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv"
Jul 13 16:51:16.830404 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:51:16.830387    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6b7a8a4-c852-4267-bcaf-aeaa861fcfa6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv\" (UID: \"c6b7a8a4-c852-4267-bcaf-aeaa861fcfa6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv"
Jul 13 16:51:16.835616 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:51:16.835594    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcqtm\" (UniqueName: \"kubernetes.io/projected/c6b7a8a4-c852-4267-bcaf-aeaa861fcfa6-kube-api-access-tcqtm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv\" (UID: \"c6b7a8a4-c852-4267-bcaf-aeaa861fcfa6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv"
Jul 13 16:51:16.903502 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:51:16.903420    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv"
Jul 13 16:51:17.042601 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:51:17.042568    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv"]
Jul 13 16:51:17.046064 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:51:17.046037    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc6b7a8a4_c852_4267_bcaf_aeaa861fcfa6.slice/crio-d5545e977023578305d3438bc82fc2e9269ecc1599df78a1eef7c46c3a424b7a WatchSource:0}: Error finding container d5545e977023578305d3438bc82fc2e9269ecc1599df78a1eef7c46c3a424b7a: Status 404 returned error can't find the container with id d5545e977023578305d3438bc82fc2e9269ecc1599df78a1eef7c46c3a424b7a
Jul 13 16:51:17.047951 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:51:17.047929    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 16:51:17.887637 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:51:17.887599    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv" event={"ID":"c6b7a8a4-c852-4267-bcaf-aeaa861fcfa6","Type":"ContainerStarted","Data":"cdcf448e1c958adf0639636295a974f949c4bd0ff72cdf2dfb73ca5b5fc973d0"}
Jul 13 16:51:17.888020 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:51:17.887645    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv" event={"ID":"c6b7a8a4-c852-4267-bcaf-aeaa861fcfa6","Type":"ContainerStarted","Data":"d5545e977023578305d3438bc82fc2e9269ecc1599df78a1eef7c46c3a424b7a"}
Jul 13 16:51:17.907129 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:51:17.907081    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv" podStartSLOduration=1.6784270559999999 podStartE2EDuration="1.907066739s" totalImagesPullingTime="228.639683ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:51:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:51:17.904687302 +0000 UTC m=+675.262994131" watchObservedRunningTime="2026-07-13 16:51:17.907066739 +0000 UTC m=+675.265373565"
Jul 13 16:51:23.713493 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:51:23.713456    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:51:26.904407 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:51:26.904368    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv"
Jul 13 16:51:26.904407 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:51:26.904417    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv"
Jul 13 16:51:26.916992 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:51:26.916967    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv"
Jul 13 16:51:26.947582 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:51:26.947553    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv"
Jul 13 16:52:30.114678 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:52:30.114640    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-d54dfccc5-w6v9t"]
Jul 13 16:52:30.117908 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:52:30.117878    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d54dfccc5-w6v9t"
Jul 13 16:52:30.128454 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:52:30.128427    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d54dfccc5-w6v9t"]
Jul 13 16:52:30.230507 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:52:30.230476    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/950a2e8e-738d-4d4d-8b85-66087f31a61d-tls-cert\") pod \"authorino-d54dfccc5-w6v9t\" (UID: \"950a2e8e-738d-4d4d-8b85-66087f31a61d\") " pod="kuadrant-system/authorino-d54dfccc5-w6v9t"
Jul 13 16:52:30.230713 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:52:30.230540    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq4hx\" (UniqueName: \"kubernetes.io/projected/950a2e8e-738d-4d4d-8b85-66087f31a61d-kube-api-access-lq4hx\") pod \"authorino-d54dfccc5-w6v9t\" (UID: \"950a2e8e-738d-4d4d-8b85-66087f31a61d\") " pod="kuadrant-system/authorino-d54dfccc5-w6v9t"
Jul 13 16:52:30.331378 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:52:30.331337    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/950a2e8e-738d-4d4d-8b85-66087f31a61d-tls-cert\") pod \"authorino-d54dfccc5-w6v9t\" (UID: \"950a2e8e-738d-4d4d-8b85-66087f31a61d\") " pod="kuadrant-system/authorino-d54dfccc5-w6v9t"
Jul 13 16:52:30.331540 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:52:30.331402    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq4hx\" (UniqueName: \"kubernetes.io/projected/950a2e8e-738d-4d4d-8b85-66087f31a61d-kube-api-access-lq4hx\") pod \"authorino-d54dfccc5-w6v9t\" (UID: \"950a2e8e-738d-4d4d-8b85-66087f31a61d\") " pod="kuadrant-system/authorino-d54dfccc5-w6v9t"
Jul 13 16:52:30.333904 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:52:30.333882    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/950a2e8e-738d-4d4d-8b85-66087f31a61d-tls-cert\") pod \"authorino-d54dfccc5-w6v9t\" (UID: \"950a2e8e-738d-4d4d-8b85-66087f31a61d\") " pod="kuadrant-system/authorino-d54dfccc5-w6v9t"
Jul 13 16:52:30.354417 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:52:30.354389    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq4hx\" (UniqueName: \"kubernetes.io/projected/950a2e8e-738d-4d4d-8b85-66087f31a61d-kube-api-access-lq4hx\") pod \"authorino-d54dfccc5-w6v9t\" (UID: \"950a2e8e-738d-4d4d-8b85-66087f31a61d\") " pod="kuadrant-system/authorino-d54dfccc5-w6v9t"
Jul 13 16:52:30.358759 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:52:30.358730    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:52:30.426600 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:52:30.426508    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d54dfccc5-w6v9t"
Jul 13 16:52:30.455669 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:52:30.455645    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:52:30.565945 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:52:30.565920    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d54dfccc5-w6v9t"]
Jul 13 16:52:30.568218 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:52:30.568188    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod950a2e8e_738d_4d4d_8b85_66087f31a61d.slice/crio-7ccf8af2e7f7d343039bc218d071b0c0374c1e391c46745c7bbe0ef97ec6a6be WatchSource:0}: Error finding container 7ccf8af2e7f7d343039bc218d071b0c0374c1e391c46745c7bbe0ef97ec6a6be: Status 404 returned error can't find the container with id 7ccf8af2e7f7d343039bc218d071b0c0374c1e391c46745c7bbe0ef97ec6a6be
Jul 13 16:52:31.205311 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:52:31.205217    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d54dfccc5-w6v9t" event={"ID":"950a2e8e-738d-4d4d-8b85-66087f31a61d","Type":"ContainerStarted","Data":"7ba3735fb260c888d5b857e4bfaf6c1baf3aab3f26c6d72131cb06077e4ed8ac"}
Jul 13 16:52:31.205311 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:52:31.205262    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d54dfccc5-w6v9t" event={"ID":"950a2e8e-738d-4d4d-8b85-66087f31a61d","Type":"ContainerStarted","Data":"7ccf8af2e7f7d343039bc218d071b0c0374c1e391c46745c7bbe0ef97ec6a6be"}
Jul 13 16:52:31.229373 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:52:31.229314    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-d54dfccc5-w6v9t" podStartSLOduration=0.847341481 podStartE2EDuration="1.229288807s" totalImagesPullingTime="381.947326ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:52:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:52:31.226864079 +0000 UTC m=+748.585170904" watchObservedRunningTime="2026-07-13 16:52:31.229288807 +0000 UTC m=+748.587595634"
Jul 13 16:52:31.261090 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:52:31.261052    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-d6dbfc7c4-cf7xw"]
Jul 13 16:52:31.261295 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:52:31.261271    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-d6dbfc7c4-cf7xw" podUID="da4aed23-39e5-4c7e-93bd-309716353a0e" containerName="authorino" containerID="cri-o://4ed0b8a93ed015424ea62df4647bf2e1619e2492db7bfc4d0cf4701aa5654d5d" gracePeriod=30
Jul 13 16:52:31.515608 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:52:31.515574    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:52:31.537597 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:52:31.537570    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d6dbfc7c4-cf7xw"
Jul 13 16:52:31.625142 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:52:31.625106    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:52:31.649552 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:52:31.649520    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f92vj\" (UniqueName: \"kubernetes.io/projected/da4aed23-39e5-4c7e-93bd-309716353a0e-kube-api-access-f92vj\") pod \"da4aed23-39e5-4c7e-93bd-309716353a0e\" (UID: \"da4aed23-39e5-4c7e-93bd-309716353a0e\") "
Jul 13 16:52:31.649739 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:52:31.649567    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/da4aed23-39e5-4c7e-93bd-309716353a0e-tls-cert\") pod \"da4aed23-39e5-4c7e-93bd-309716353a0e\" (UID: \"da4aed23-39e5-4c7e-93bd-309716353a0e\") "
Jul 13 16:52:31.651673 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:52:31.651634    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da4aed23-39e5-4c7e-93bd-309716353a0e-kube-api-access-f92vj" (OuterVolumeSpecName: "kube-api-access-f92vj") pod "da4aed23-39e5-4c7e-93bd-309716353a0e" (UID: "da4aed23-39e5-4c7e-93bd-309716353a0e"). InnerVolumeSpecName "kube-api-access-f92vj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 16:52:31.659753 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:52:31.659699    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da4aed23-39e5-4c7e-93bd-309716353a0e-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "da4aed23-39e5-4c7e-93bd-309716353a0e" (UID: "da4aed23-39e5-4c7e-93bd-309716353a0e"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 16:52:31.751030 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:52:31.750988    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f92vj\" (UniqueName: \"kubernetes.io/projected/da4aed23-39e5-4c7e-93bd-309716353a0e-kube-api-access-f92vj\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 16:52:31.751030 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:52:31.751026    2573 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/da4aed23-39e5-4c7e-93bd-309716353a0e-tls-cert\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 16:52:32.211294 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:52:32.211261    2573 generic.go:356] "Generic (PLEG): container finished" podID="da4aed23-39e5-4c7e-93bd-309716353a0e" containerID="4ed0b8a93ed015424ea62df4647bf2e1619e2492db7bfc4d0cf4701aa5654d5d" exitCode=0
Jul 13 16:52:32.211696 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:52:32.211311    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d6dbfc7c4-cf7xw"
Jul 13 16:52:32.211696 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:52:32.211350    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d6dbfc7c4-cf7xw" event={"ID":"da4aed23-39e5-4c7e-93bd-309716353a0e","Type":"ContainerDied","Data":"4ed0b8a93ed015424ea62df4647bf2e1619e2492db7bfc4d0cf4701aa5654d5d"}
Jul 13 16:52:32.211696 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:52:32.211392    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d6dbfc7c4-cf7xw" event={"ID":"da4aed23-39e5-4c7e-93bd-309716353a0e","Type":"ContainerDied","Data":"7cf517e94bb3d7252df412df62958315cb230e00bbf26efca00b09e8e5708254"}
Jul 13 16:52:32.211696 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:52:32.211415    2573 scope.go:117] "RemoveContainer" containerID="4ed0b8a93ed015424ea62df4647bf2e1619e2492db7bfc4d0cf4701aa5654d5d"
Jul 13 16:52:32.220824 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:52:32.220788    2573 scope.go:117] "RemoveContainer" containerID="4ed0b8a93ed015424ea62df4647bf2e1619e2492db7bfc4d0cf4701aa5654d5d"
Jul 13 16:52:32.221127 ip-10-0-143-51 kubenswrapper[2573]: E0713 16:52:32.221099    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ed0b8a93ed015424ea62df4647bf2e1619e2492db7bfc4d0cf4701aa5654d5d\": container with ID starting with 4ed0b8a93ed015424ea62df4647bf2e1619e2492db7bfc4d0cf4701aa5654d5d not found: ID does not exist" containerID="4ed0b8a93ed015424ea62df4647bf2e1619e2492db7bfc4d0cf4701aa5654d5d"
Jul 13 16:52:32.221231 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:52:32.221142    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ed0b8a93ed015424ea62df4647bf2e1619e2492db7bfc4d0cf4701aa5654d5d"} err="failed to get container status \"4ed0b8a93ed015424ea62df4647bf2e1619e2492db7bfc4d0cf4701aa5654d5d\": rpc error: code = NotFound desc = could not find container \"4ed0b8a93ed015424ea62df4647bf2e1619e2492db7bfc4d0cf4701aa5654d5d\": container with ID starting with 4ed0b8a93ed015424ea62df4647bf2e1619e2492db7bfc4d0cf4701aa5654d5d not found: ID does not exist"
Jul 13 16:52:32.233702 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:52:32.233678    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-d6dbfc7c4-cf7xw"]
Jul 13 16:52:32.237904 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:52:32.237882    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-d6dbfc7c4-cf7xw"]
Jul 13 16:52:33.148664 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:52:33.148630    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da4aed23-39e5-4c7e-93bd-309716353a0e" path="/var/lib/kubelet/pods/da4aed23-39e5-4c7e-93bd-309716353a0e/volumes"
Jul 13 16:53:42.888393 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:53:42.888357    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:53:44.490334 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:53:44.490305    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:54:27.432479 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:54:27.432446    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:54:27.533010 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:54:27.532973    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:54:27.669452 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:54:27.669420    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:54:32.327775 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:54:32.327743    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:54:33.422770 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:54:33.422731    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:54:33.501876 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:54:33.501847    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:54:33.588331 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:54:33.588298    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:54:33.861759 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:54:33.861713    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:54:39.437319 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:54:39.437282    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:54:39.509410 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:54:39.509377    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:55:03.066835 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:55:03.066764    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnxdg_e1fb6130-2ab7-40f5-831c-ea95ff241f37/ovn-acl-logging/0.log"
Jul 13 16:55:03.068027 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:55:03.068008    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnxdg_e1fb6130-2ab7-40f5-831c-ea95ff241f37/ovn-acl-logging/0.log"
Jul 13 16:55:59.917386 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:55:59.917344    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:56:01.664150 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:56:01.664110    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:57:08.442568 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:57:08.442524    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:58:32.633155 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:58:32.633122    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7j7sn"]
Jul 13 16:58:32.633801 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:58:32.633377    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7j7sn" podUID="4bbe843a-2566-40ff-a03e-509d7d9328b4" containerName="manager" containerID="cri-o://1368d9e6edef5af4daf4fca6a1b2f4e7f5380bfe88a6c3f16f8c26ed663f976c" gracePeriod=10
Jul 13 16:58:35.854631 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:58:35.854599    2573 generic.go:356] "Generic (PLEG): container finished" podID="4bbe843a-2566-40ff-a03e-509d7d9328b4" containerID="1368d9e6edef5af4daf4fca6a1b2f4e7f5380bfe88a6c3f16f8c26ed663f976c" exitCode=0
Jul 13 16:58:35.855002 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:58:35.854648    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7j7sn" event={"ID":"4bbe843a-2566-40ff-a03e-509d7d9328b4","Type":"ContainerDied","Data":"1368d9e6edef5af4daf4fca6a1b2f4e7f5380bfe88a6c3f16f8c26ed663f976c"}
Jul 13 16:58:35.901016 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:58:35.900931    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7j7sn" podUID="4bbe843a-2566-40ff-a03e-509d7d9328b4" containerName="manager" probeResult="failure" output="Get \"http://10.133.0.31:8081/readyz\": dial tcp 10.133.0.31:8081: connect: connection refused"
Jul 13 16:58:36.290357 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:58:36.290332    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7j7sn"
Jul 13 16:58:36.339460 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:58:36.339431    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ssksb\" (UniqueName: \"kubernetes.io/projected/4bbe843a-2566-40ff-a03e-509d7d9328b4-kube-api-access-ssksb\") pod \"4bbe843a-2566-40ff-a03e-509d7d9328b4\" (UID: \"4bbe843a-2566-40ff-a03e-509d7d9328b4\") "
Jul 13 16:58:36.339623 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:58:36.339498    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4bbe843a-2566-40ff-a03e-509d7d9328b4-extensions-socket-volume\") pod \"4bbe843a-2566-40ff-a03e-509d7d9328b4\" (UID: \"4bbe843a-2566-40ff-a03e-509d7d9328b4\") "
Jul 13 16:58:36.339937 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:58:36.339911    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bbe843a-2566-40ff-a03e-509d7d9328b4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4bbe843a-2566-40ff-a03e-509d7d9328b4" (UID: "4bbe843a-2566-40ff-a03e-509d7d9328b4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:58:36.341745 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:58:36.341694    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bbe843a-2566-40ff-a03e-509d7d9328b4-kube-api-access-ssksb" (OuterVolumeSpecName: "kube-api-access-ssksb") pod "4bbe843a-2566-40ff-a03e-509d7d9328b4" (UID: "4bbe843a-2566-40ff-a03e-509d7d9328b4"). InnerVolumeSpecName "kube-api-access-ssksb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 16:58:36.440745 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:58:36.440694    2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4bbe843a-2566-40ff-a03e-509d7d9328b4-extensions-socket-volume\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 16:58:36.440745 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:58:36.440741    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ssksb\" (UniqueName: \"kubernetes.io/projected/4bbe843a-2566-40ff-a03e-509d7d9328b4-kube-api-access-ssksb\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 16:58:36.861147 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:58:36.861104    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7j7sn" event={"ID":"4bbe843a-2566-40ff-a03e-509d7d9328b4","Type":"ContainerDied","Data":"7e06461b99f69e414a9833cae669283c4ae07b797fe65a85eea44ec7a7f3886d"}
Jul 13 16:58:36.861567 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:58:36.861166    2573 scope.go:117] "RemoveContainer" containerID="1368d9e6edef5af4daf4fca6a1b2f4e7f5380bfe88a6c3f16f8c26ed663f976c"
Jul 13 16:58:36.861567 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:58:36.861121    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7j7sn"
Jul 13 16:58:36.888001 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:58:36.887977    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7j7sn"]
Jul 13 16:58:36.899285 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:58:36.899263    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7j7sn"]
Jul 13 16:58:37.147404 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:58:37.147326    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bbe843a-2566-40ff-a03e-509d7d9328b4" path="/var/lib/kubelet/pods/4bbe843a-2566-40ff-a03e-509d7d9328b4/volumes"
Jul 13 16:58:44.049480 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:58:44.049440    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:58:44.146291 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:58:44.146263    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:58:53.756137 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:58:53.756099    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 16:59:33.930282 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:59:33.930247    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m54nf"]
Jul 13 16:59:33.931271 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:59:33.930569    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da4aed23-39e5-4c7e-93bd-309716353a0e" containerName="authorino"
Jul 13 16:59:33.931271 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:59:33.930581    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="da4aed23-39e5-4c7e-93bd-309716353a0e" containerName="authorino"
Jul 13 16:59:33.931271 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:59:33.930610    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bbe843a-2566-40ff-a03e-509d7d9328b4" containerName="manager"
Jul 13 16:59:33.931271 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:59:33.930617    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bbe843a-2566-40ff-a03e-509d7d9328b4" containerName="manager"
Jul 13 16:59:33.931271 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:59:33.930673    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bbe843a-2566-40ff-a03e-509d7d9328b4" containerName="manager"
Jul 13 16:59:33.931271 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:59:33.930682    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="da4aed23-39e5-4c7e-93bd-309716353a0e" containerName="authorino"
Jul 13 16:59:33.933635 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:59:33.933620    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m54nf"
Jul 13 16:59:33.936709 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:59:33.936688    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-k29jm\""
Jul 13 16:59:33.955890 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:59:33.955866    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m54nf"]
Jul 13 16:59:34.011252 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:59:34.011225    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f847864-7026-4f6c-a85d-888d55d40ea9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-m54nf\" (UID: \"6f847864-7026-4f6c-a85d-888d55d40ea9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m54nf"
Jul 13 16:59:34.011363 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:59:34.011284    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4sh7\" (UniqueName: \"kubernetes.io/projected/6f847864-7026-4f6c-a85d-888d55d40ea9-kube-api-access-l4sh7\") pod \"kuadrant-operator-controller-manager-86878c769f-m54nf\" (UID: \"6f847864-7026-4f6c-a85d-888d55d40ea9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m54nf"
Jul 13 16:59:34.112219 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:59:34.112190    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f847864-7026-4f6c-a85d-888d55d40ea9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-m54nf\" (UID: \"6f847864-7026-4f6c-a85d-888d55d40ea9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m54nf"
Jul 13 16:59:34.112436 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:59:34.112249    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4sh7\" (UniqueName: \"kubernetes.io/projected/6f847864-7026-4f6c-a85d-888d55d40ea9-kube-api-access-l4sh7\") pod \"kuadrant-operator-controller-manager-86878c769f-m54nf\" (UID: \"6f847864-7026-4f6c-a85d-888d55d40ea9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m54nf"
Jul 13 16:59:34.112574 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:59:34.112556    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f847864-7026-4f6c-a85d-888d55d40ea9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-m54nf\" (UID: \"6f847864-7026-4f6c-a85d-888d55d40ea9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m54nf"
Jul 13 16:59:34.121180 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:59:34.121159    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4sh7\" (UniqueName: \"kubernetes.io/projected/6f847864-7026-4f6c-a85d-888d55d40ea9-kube-api-access-l4sh7\") pod \"kuadrant-operator-controller-manager-86878c769f-m54nf\" (UID: \"6f847864-7026-4f6c-a85d-888d55d40ea9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m54nf"
Jul 13 16:59:34.243698 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:59:34.243670    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m54nf"
Jul 13 16:59:34.407411 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:59:34.407381    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m54nf"]
Jul 13 16:59:34.413307 ip-10-0-143-51 kubenswrapper[2573]: W0713 16:59:34.412373    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f847864_7026_4f6c_a85d_888d55d40ea9.slice/crio-8a90984f27ce05f8d8490be28c37fe07e73a9fcab49898e100ce309456ddae94 WatchSource:0}: Error finding container 8a90984f27ce05f8d8490be28c37fe07e73a9fcab49898e100ce309456ddae94: Status 404 returned error can't find the container with id 8a90984f27ce05f8d8490be28c37fe07e73a9fcab49898e100ce309456ddae94
Jul 13 16:59:35.115044 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:59:35.115010    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m54nf" event={"ID":"6f847864-7026-4f6c-a85d-888d55d40ea9","Type":"ContainerStarted","Data":"213d8fec9262361d86f8a50725daf5919a61d997eeafefa909fd6b507f2cde8c"}
Jul 13 16:59:35.115514 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:59:35.115065    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m54nf" event={"ID":"6f847864-7026-4f6c-a85d-888d55d40ea9","Type":"ContainerStarted","Data":"8a90984f27ce05f8d8490be28c37fe07e73a9fcab49898e100ce309456ddae94"}
Jul 13 16:59:35.115514 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:59:35.115097    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m54nf"
Jul 13 16:59:35.144322 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:59:35.144278    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m54nf" podStartSLOduration=2.144263506 podStartE2EDuration="2.144263506s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:59:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:59:35.142670239 +0000 UTC m=+1172.500977076" watchObservedRunningTime="2026-07-13 16:59:35.144263506 +0000 UTC m=+1172.502570417"
Jul 13 16:59:46.122656 ip-10-0-143-51 kubenswrapper[2573]: I0713 16:59:46.122623    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m54nf"
Jul 13 17:00:00.146679 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:00:00.146636    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29732700-6svjq"]
Jul 13 17:00:00.149910 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:00:00.149890    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732700-6svjq"
Jul 13 17:00:00.153004 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:00:00.152954    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fkks4\""
Jul 13 17:00:00.159255 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:00:00.159232    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29732700-6svjq"]
Jul 13 17:00:00.161140 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:00:00.161121    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732700-6svjq"
Jul 13 17:00:00.300049 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:00:00.300020    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29732700-6svjq"]
Jul 13 17:00:00.302012 ip-10-0-143-51 kubenswrapper[2573]: W0713 17:00:00.301975    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod850e5ed8_9ea1_49b2_bb45_a4a381cf4339.slice/crio-862b6ad8d2262d50dd62f18b10e3e881973851ecad126b080b674f127da59fd2 WatchSource:0}: Error finding container 862b6ad8d2262d50dd62f18b10e3e881973851ecad126b080b674f127da59fd2: Status 404 returned error can't find the container with id 862b6ad8d2262d50dd62f18b10e3e881973851ecad126b080b674f127da59fd2
Jul 13 17:00:00.304021 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:00:00.304005    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 17:00:01.233907 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:00:01.233873    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732700-6svjq" event={"ID":"850e5ed8-9ea1-49b2-bb45-a4a381cf4339","Type":"ContainerStarted","Data":"862b6ad8d2262d50dd62f18b10e3e881973851ecad126b080b674f127da59fd2"}
Jul 13 17:00:03.093105 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:00:03.093074    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnxdg_e1fb6130-2ab7-40f5-831c-ea95ff241f37/ovn-acl-logging/0.log"
Jul 13 17:00:03.093511 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:00:03.093270    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnxdg_e1fb6130-2ab7-40f5-831c-ea95ff241f37/ovn-acl-logging/0.log"
Jul 13 17:00:06.259491 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:00:06.259440    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732700-6svjq" event={"ID":"850e5ed8-9ea1-49b2-bb45-a4a381cf4339","Type":"ContainerStarted","Data":"403ac9aff749cfb63a6bce77f22e26e679d85fa65800aac8a2509d366e7910bd"}
Jul 13 17:00:06.283864 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:00:06.283812    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732700-6svjq" podStartSLOduration=0.902543333 podStartE2EDuration="6.283797857s" totalImagesPullingTime="5.381254524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:00:06.282661103 +0000 UTC m=+1203.640967927" watchObservedRunningTime="2026-07-13 17:00:06.283797857 +0000 UTC m=+1203.642104681"
Jul 13 17:00:07.265419 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:00:07.265386    2573 generic.go:356] "Generic (PLEG): container finished" podID="850e5ed8-9ea1-49b2-bb45-a4a381cf4339" containerID="403ac9aff749cfb63a6bce77f22e26e679d85fa65800aac8a2509d366e7910bd" exitCode=0
Jul 13 17:00:07.265846 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:00:07.265474    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732700-6svjq" event={"ID":"850e5ed8-9ea1-49b2-bb45-a4a381cf4339","Type":"ContainerDied","Data":"403ac9aff749cfb63a6bce77f22e26e679d85fa65800aac8a2509d366e7910bd"}
Jul 13 17:00:08.402458 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:00:08.402431    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732700-6svjq"
Jul 13 17:00:09.275756 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:00:09.275708    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732700-6svjq"
Jul 13 17:00:09.275951 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:00:09.275700    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732700-6svjq" event={"ID":"850e5ed8-9ea1-49b2-bb45-a4a381cf4339","Type":"ContainerDied","Data":"862b6ad8d2262d50dd62f18b10e3e881973851ecad126b080b674f127da59fd2"}
Jul 13 17:00:09.275951 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:00:09.275856    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="862b6ad8d2262d50dd62f18b10e3e881973851ecad126b080b674f127da59fd2"
Jul 13 17:00:44.884056 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:00:44.884021    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:03:09.035017 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:03:09.034978    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:04:58.413017 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:04:58.412979    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:05:03.119792 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:03.119762    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnxdg_e1fb6130-2ab7-40f5-831c-ea95ff241f37/ovn-acl-logging/0.log"
Jul 13 17:05:03.122267 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:03.121311    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnxdg_e1fb6130-2ab7-40f5-831c-ea95ff241f37/ovn-acl-logging/0.log"
Jul 13 17:05:09.082815 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:09.082779    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:05:25.204146 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:25.204068    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:05:32.657937 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:32.657899    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:05:41.094740 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:41.094693    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:05:46.545489 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:46.545452    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:05:49.693004 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:49.692957    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:05:49.792307 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:49.792275    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:05:50.178609 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:50.178572    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:05:52.912587 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:52.912554    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:05:53.013903 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:53.013873    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:05:56.711433 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:56.711406    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf"]
Jul 13 17:05:56.711774 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:56.711761    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="850e5ed8-9ea1-49b2-bb45-a4a381cf4339" containerName="cleanup"
Jul 13 17:05:56.711826 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:56.711775    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="850e5ed8-9ea1-49b2-bb45-a4a381cf4339" containerName="cleanup"
Jul 13 17:05:56.711869 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:56.711830    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="850e5ed8-9ea1-49b2-bb45-a4a381cf4339" containerName="cleanup"
Jul 13 17:05:56.714808 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:56.714792    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf"
Jul 13 17:05:56.718149 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:56.718125    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-a5ed8a38-openshift-default-dockercfg-gjtj7\""
Jul 13 17:05:56.741809 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:56.741786    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf"]
Jul 13 17:05:56.792008 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:56.791973    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d459d99-6faf-4282-9b9b-8c4be3068570-credential-socket\") pod \"e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf\" (UID: \"5d459d99-6faf-4282-9b9b-8c4be3068570\") " pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf"
Jul 13 17:05:56.792171 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:56.792059    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d459d99-6faf-4282-9b9b-8c4be3068570-workload-socket\") pod \"e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf\" (UID: \"5d459d99-6faf-4282-9b9b-8c4be3068570\") " pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf"
Jul 13 17:05:56.792171 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:56.792123    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mzvs\" (UniqueName: \"kubernetes.io/projected/5d459d99-6faf-4282-9b9b-8c4be3068570-kube-api-access-4mzvs\") pod \"e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf\" (UID: \"5d459d99-6faf-4282-9b9b-8c4be3068570\") " pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf"
Jul 13 17:05:56.792171 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:56.792156    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d459d99-6faf-4282-9b9b-8c4be3068570-istio-token\") pod \"e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf\" (UID: \"5d459d99-6faf-4282-9b9b-8c4be3068570\") " pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf"
Jul 13 17:05:56.792292 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:56.792180    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d459d99-6faf-4282-9b9b-8c4be3068570-istiod-ca-cert\") pod \"e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf\" (UID: \"5d459d99-6faf-4282-9b9b-8c4be3068570\") " pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf"
Jul 13 17:05:56.792292 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:56.792238    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d459d99-6faf-4282-9b9b-8c4be3068570-istio-data\") pod \"e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf\" (UID: \"5d459d99-6faf-4282-9b9b-8c4be3068570\") " pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf"
Jul 13 17:05:56.792292 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:56.792264    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d459d99-6faf-4282-9b9b-8c4be3068570-istio-envoy\") pod \"e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf\" (UID: \"5d459d99-6faf-4282-9b9b-8c4be3068570\") " pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf"
Jul 13 17:05:56.792453 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:56.792292    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d459d99-6faf-4282-9b9b-8c4be3068570-workload-certs\") pod \"e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf\" (UID: \"5d459d99-6faf-4282-9b9b-8c4be3068570\") " pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf"
Jul 13 17:05:56.792453 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:56.792315    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d459d99-6faf-4282-9b9b-8c4be3068570-istio-podinfo\") pod \"e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf\" (UID: \"5d459d99-6faf-4282-9b9b-8c4be3068570\") " pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf"
Jul 13 17:05:56.882335 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:56.882302    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:05:56.893424 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:56.893397    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d459d99-6faf-4282-9b9b-8c4be3068570-credential-socket\") pod \"e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf\" (UID: \"5d459d99-6faf-4282-9b9b-8c4be3068570\") " pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf"
Jul 13 17:05:56.893573 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:56.893443    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d459d99-6faf-4282-9b9b-8c4be3068570-workload-socket\") pod \"e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf\" (UID: \"5d459d99-6faf-4282-9b9b-8c4be3068570\") " pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf"
Jul 13 17:05:56.893573 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:56.893481    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mzvs\" (UniqueName: \"kubernetes.io/projected/5d459d99-6faf-4282-9b9b-8c4be3068570-kube-api-access-4mzvs\") pod \"e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf\" (UID: \"5d459d99-6faf-4282-9b9b-8c4be3068570\") " pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf"
Jul 13 17:05:56.893573 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:56.893501    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d459d99-6faf-4282-9b9b-8c4be3068570-istio-token\") pod \"e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf\" (UID: \"5d459d99-6faf-4282-9b9b-8c4be3068570\") " pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf"
Jul 13 17:05:56.893573 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:56.893514    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d459d99-6faf-4282-9b9b-8c4be3068570-istiod-ca-cert\") pod \"e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf\" (UID: \"5d459d99-6faf-4282-9b9b-8c4be3068570\") " pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf"
Jul 13 17:05:56.893573 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:56.893539    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d459d99-6faf-4282-9b9b-8c4be3068570-istio-data\") pod \"e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf\" (UID: \"5d459d99-6faf-4282-9b9b-8c4be3068570\") " pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf"
Jul 13 17:05:56.893573 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:56.893557    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d459d99-6faf-4282-9b9b-8c4be3068570-istio-envoy\") pod \"e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf\" (UID: \"5d459d99-6faf-4282-9b9b-8c4be3068570\") " pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf"
Jul 13 17:05:56.893926 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:56.893580    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d459d99-6faf-4282-9b9b-8c4be3068570-workload-certs\") pod \"e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf\" (UID: \"5d459d99-6faf-4282-9b9b-8c4be3068570\") " pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf"
Jul 13 17:05:56.893926 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:56.893605    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d459d99-6faf-4282-9b9b-8c4be3068570-istio-podinfo\") pod \"e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf\" (UID: \"5d459d99-6faf-4282-9b9b-8c4be3068570\") " pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf"
Jul 13 17:05:56.893926 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:56.893856    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d459d99-6faf-4282-9b9b-8c4be3068570-credential-socket\") pod \"e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf\" (UID: \"5d459d99-6faf-4282-9b9b-8c4be3068570\") " pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf"
Jul 13 17:05:56.894079 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:56.894060    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d459d99-6faf-4282-9b9b-8c4be3068570-istio-data\") pod \"e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf\" (UID: \"5d459d99-6faf-4282-9b9b-8c4be3068570\") " pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf"
Jul 13 17:05:56.894142 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:56.894104    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d459d99-6faf-4282-9b9b-8c4be3068570-workload-socket\") pod \"e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf\" (UID: \"5d459d99-6faf-4282-9b9b-8c4be3068570\") " pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf"
Jul 13 17:05:56.894234 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:56.894215    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d459d99-6faf-4282-9b9b-8c4be3068570-workload-certs\") pod \"e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf\" (UID: \"5d459d99-6faf-4282-9b9b-8c4be3068570\") " pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf"
Jul 13 17:05:56.894289 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:56.894254    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d459d99-6faf-4282-9b9b-8c4be3068570-istiod-ca-cert\") pod \"e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf\" (UID: \"5d459d99-6faf-4282-9b9b-8c4be3068570\") " pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf"
Jul 13 17:05:56.895910 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:56.895887    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d459d99-6faf-4282-9b9b-8c4be3068570-istio-envoy\") pod \"e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf\" (UID: \"5d459d99-6faf-4282-9b9b-8c4be3068570\") " pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf"
Jul 13 17:05:56.896000 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:56.895988    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d459d99-6faf-4282-9b9b-8c4be3068570-istio-podinfo\") pod \"e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf\" (UID: \"5d459d99-6faf-4282-9b9b-8c4be3068570\") " pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf"
Jul 13 17:05:56.902893 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:56.902868    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mzvs\" (UniqueName: \"kubernetes.io/projected/5d459d99-6faf-4282-9b9b-8c4be3068570-kube-api-access-4mzvs\") pod \"e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf\" (UID: \"5d459d99-6faf-4282-9b9b-8c4be3068570\") " pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf"
Jul 13 17:05:56.902992 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:56.902904    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d459d99-6faf-4282-9b9b-8c4be3068570-istio-token\") pod \"e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf\" (UID: \"5d459d99-6faf-4282-9b9b-8c4be3068570\") " pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf"
Jul 13 17:05:56.989673 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:56.989642    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:05:57.024887 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:57.024863    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf"
Jul 13 17:05:57.166606 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:57.166584    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf"]
Jul 13 17:05:57.168325 ip-10-0-143-51 kubenswrapper[2573]: W0713 17:05:57.168298    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d459d99_6faf_4282_9b9b_8c4be3068570.slice/crio-fd534ffd3f4e5424dcc0ac385c4c0556bf8c8513ebf3af36cf2e3ac11da5266f WatchSource:0}: Error finding container fd534ffd3f4e5424dcc0ac385c4c0556bf8c8513ebf3af36cf2e3ac11da5266f: Status 404 returned error can't find the container with id fd534ffd3f4e5424dcc0ac385c4c0556bf8c8513ebf3af36cf2e3ac11da5266f
Jul 13 17:05:57.170568 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:57.170536    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:05:57.170670 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:57.170611    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:05:57.170772 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:57.170676    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:05:57.878737 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:57.878695    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf" event={"ID":"5d459d99-6faf-4282-9b9b-8c4be3068570","Type":"ContainerStarted","Data":"56000dc08024907cee43a62bac47e7403ebf139e6c424b9755a5e3543e7207e5"}
Jul 13 17:05:57.879118 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:57.878769    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf" event={"ID":"5d459d99-6faf-4282-9b9b-8c4be3068570","Type":"ContainerStarted","Data":"fd534ffd3f4e5424dcc0ac385c4c0556bf8c8513ebf3af36cf2e3ac11da5266f"}
Jul 13 17:05:57.917602 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:57.917556    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf" podStartSLOduration=1.917539406 podStartE2EDuration="1.917539406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:05:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:05:57.917488195 +0000 UTC m=+1555.275795047" watchObservedRunningTime="2026-07-13 17:05:57.917539406 +0000 UTC m=+1555.275846232"
Jul 13 17:05:58.020106 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:58.020069    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:05:58.025220 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:58.025201    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf"
Jul 13 17:05:58.029824 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:58.029804    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf"
Jul 13 17:05:58.173513 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:58.173424    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:05:58.314279 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:58.314242    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:05:58.883260 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:58.883223    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf"
Jul 13 17:05:58.884174 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:58.884151    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf"
Jul 13 17:05:58.884782 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:58.884761    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:05:59.184168 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:59.184087    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:05:59.283499 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:05:59.283471    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:06:00.893922 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:00.893898    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:06:08.931545 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:08.931461    2573 generic.go:356] "Generic (PLEG): container finished" podID="5d459d99-6faf-4282-9b9b-8c4be3068570" containerID="56000dc08024907cee43a62bac47e7403ebf139e6c424b9755a5e3543e7207e5" exitCode=0
Jul 13 17:06:08.931545 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:08.931536    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf" event={"ID":"5d459d99-6faf-4282-9b9b-8c4be3068570","Type":"ContainerDied","Data":"56000dc08024907cee43a62bac47e7403ebf139e6c424b9755a5e3543e7207e5"}
Jul 13 17:06:08.932038 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:08.931940    2573 scope.go:117] "RemoveContainer" containerID="56000dc08024907cee43a62bac47e7403ebf139e6c424b9755a5e3543e7207e5"
Jul 13 17:06:08.932914 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:08.932880    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:06:08.933026 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:08.932948    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:06:08.933026 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:08.932980    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:06:09.938250 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:09.938216    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf" event={"ID":"5d459d99-6faf-4282-9b9b-8c4be3068570","Type":"ContainerStarted","Data":"b9fd4e7e1fc4174ae97e774aca8beb3b13e1c32eefa2a95380569c31e9b5a20e"}
Jul 13 17:06:10.025914 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:10.025881    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf"
Jul 13 17:06:10.026912 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:10.026884    2573 patch_prober.go:28] interesting pod/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 13 17:06:10.027055 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:10.026940    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf" podUID="5d459d99-6faf-4282-9b9b-8c4be3068570" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 13 17:06:11.025766 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:11.025714    2573 patch_prober.go:28] interesting pod/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 13 17:06:11.026152 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:11.025789    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf" podUID="5d459d99-6faf-4282-9b9b-8c4be3068570" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 13 17:06:12.025690 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:12.025653    2573 patch_prober.go:28] interesting pod/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 13 17:06:12.025999 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:12.025706    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf" podUID="5d459d99-6faf-4282-9b9b-8c4be3068570" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 13 17:06:13.025674 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:13.025638    2573 patch_prober.go:28] interesting pod/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 13 17:06:13.025868 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:13.025693    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf" podUID="5d459d99-6faf-4282-9b9b-8c4be3068570" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 13 17:06:13.428940 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:13.428868    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:06:13.883448 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:13.883412    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf"
Jul 13 17:06:14.025228 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:14.025197    2573 patch_prober.go:28] interesting pod/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 13 17:06:14.025395 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:14.025245    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf" podUID="5d459d99-6faf-4282-9b9b-8c4be3068570" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 13 17:06:15.029467 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:15.029441    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf"
Jul 13 17:06:15.030470 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:15.030449    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf"
Jul 13 17:06:18.133375 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:18.133335    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:06:24.383696 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:24.383663    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:06:24.444241 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:24.444211    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:06:28.278936 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:28.278903    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf"]
Jul 13 17:06:28.279374 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:28.279102    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf" podUID="5d459d99-6faf-4282-9b9b-8c4be3068570" containerName="istio-proxy" containerID="cri-o://b9fd4e7e1fc4174ae97e774aca8beb3b13e1c32eefa2a95380569c31e9b5a20e" gracePeriod=30
Jul 13 17:06:28.305711 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:28.305684    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:06:28.678491 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:28.678314    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:06:28.791019 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:28.790988    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:06:29.070053 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:29.070017    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh"]
Jul 13 17:06:29.073442 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:29.073423    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh"
Jul 13 17:06:29.077511 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:29.077488    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-51bf4736-gw-openshift-default-dockercfg-szzvd\""
Jul 13 17:06:29.088633 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:29.088610    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh"]
Jul 13 17:06:29.102876 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:29.102837    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:06:29.107844 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:29.107821    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsfg7\" (UniqueName: \"kubernetes.io/projected/8f41d537-f736-4072-bf37-6324a1dad3ad-kube-api-access-tsfg7\") pod \"e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh\" (UID: \"8f41d537-f736-4072-bf37-6324a1dad3ad\") " pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh"
Jul 13 17:06:29.107954 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:29.107859    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f41d537-f736-4072-bf37-6324a1dad3ad-workload-certs\") pod \"e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh\" (UID: \"8f41d537-f736-4072-bf37-6324a1dad3ad\") " pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh"
Jul 13 17:06:29.107954 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:29.107912    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f41d537-f736-4072-bf37-6324a1dad3ad-istio-envoy\") pod \"e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh\" (UID: \"8f41d537-f736-4072-bf37-6324a1dad3ad\") " pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh"
Jul 13 17:06:29.107954 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:29.107937    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f41d537-f736-4072-bf37-6324a1dad3ad-istiod-ca-cert\") pod \"e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh\" (UID: \"8f41d537-f736-4072-bf37-6324a1dad3ad\") " pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh"
Jul 13 17:06:29.108114 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:29.108003    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f41d537-f736-4072-bf37-6324a1dad3ad-istio-data\") pod \"e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh\" (UID: \"8f41d537-f736-4072-bf37-6324a1dad3ad\") " pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh"
Jul 13 17:06:29.108114 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:29.108042    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f41d537-f736-4072-bf37-6324a1dad3ad-credential-socket\") pod \"e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh\" (UID: \"8f41d537-f736-4072-bf37-6324a1dad3ad\") " pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh"
Jul 13 17:06:29.108114 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:29.108065    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f41d537-f736-4072-bf37-6324a1dad3ad-istio-podinfo\") pod \"e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh\" (UID: \"8f41d537-f736-4072-bf37-6324a1dad3ad\") " pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh"
Jul 13 17:06:29.108216 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:29.108149    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f41d537-f736-4072-bf37-6324a1dad3ad-workload-socket\") pod \"e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh\" (UID: \"8f41d537-f736-4072-bf37-6324a1dad3ad\") " pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh"
Jul 13 17:06:29.108255 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:29.108208    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f41d537-f736-4072-bf37-6324a1dad3ad-istio-token\") pod \"e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh\" (UID: \"8f41d537-f736-4072-bf37-6324a1dad3ad\") " pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh"
Jul 13 17:06:29.208956 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:29.208929    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f41d537-f736-4072-bf37-6324a1dad3ad-istio-envoy\") pod \"e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh\" (UID: \"8f41d537-f736-4072-bf37-6324a1dad3ad\") " pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh"
Jul 13 17:06:29.208956 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:29.208960    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f41d537-f736-4072-bf37-6324a1dad3ad-istiod-ca-cert\") pod \"e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh\" (UID: \"8f41d537-f736-4072-bf37-6324a1dad3ad\") " pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh"
Jul 13 17:06:29.209210 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:29.208993    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f41d537-f736-4072-bf37-6324a1dad3ad-istio-data\") pod \"e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh\" (UID: \"8f41d537-f736-4072-bf37-6324a1dad3ad\") " pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh"
Jul 13 17:06:29.209210 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:29.209018    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f41d537-f736-4072-bf37-6324a1dad3ad-credential-socket\") pod \"e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh\" (UID: \"8f41d537-f736-4072-bf37-6324a1dad3ad\") " pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh"
Jul 13 17:06:29.209210 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:29.209058    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f41d537-f736-4072-bf37-6324a1dad3ad-istio-podinfo\") pod \"e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh\" (UID: \"8f41d537-f736-4072-bf37-6324a1dad3ad\") " pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh"
Jul 13 17:06:29.209210 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:29.209124    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f41d537-f736-4072-bf37-6324a1dad3ad-workload-socket\") pod \"e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh\" (UID: \"8f41d537-f736-4072-bf37-6324a1dad3ad\") " pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh"
Jul 13 17:06:29.209210 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:29.209167    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f41d537-f736-4072-bf37-6324a1dad3ad-istio-token\") pod \"e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh\" (UID: \"8f41d537-f736-4072-bf37-6324a1dad3ad\") " pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh"
Jul 13 17:06:29.209461 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:29.209236    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsfg7\" (UniqueName: \"kubernetes.io/projected/8f41d537-f736-4072-bf37-6324a1dad3ad-kube-api-access-tsfg7\") pod \"e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh\" (UID: \"8f41d537-f736-4072-bf37-6324a1dad3ad\") " pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh"
Jul 13 17:06:29.209461 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:29.209270    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f41d537-f736-4072-bf37-6324a1dad3ad-workload-certs\") pod \"e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh\" (UID: \"8f41d537-f736-4072-bf37-6324a1dad3ad\") " pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh"
Jul 13 17:06:29.209461 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:29.209447    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f41d537-f736-4072-bf37-6324a1dad3ad-credential-socket\") pod \"e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh\" (UID: \"8f41d537-f736-4072-bf37-6324a1dad3ad\") " pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh"
Jul 13 17:06:29.209621 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:29.209550    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f41d537-f736-4072-bf37-6324a1dad3ad-workload-socket\") pod \"e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh\" (UID: \"8f41d537-f736-4072-bf37-6324a1dad3ad\") " pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh"
Jul 13 17:06:29.209621 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:29.209578    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f41d537-f736-4072-bf37-6324a1dad3ad-istio-data\") pod \"e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh\" (UID: \"8f41d537-f736-4072-bf37-6324a1dad3ad\") " pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh"
Jul 13 17:06:29.209754 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:29.209659    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f41d537-f736-4072-bf37-6324a1dad3ad-workload-certs\") pod \"e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh\" (UID: \"8f41d537-f736-4072-bf37-6324a1dad3ad\") " pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh"
Jul 13 17:06:29.209870 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:29.209851    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f41d537-f736-4072-bf37-6324a1dad3ad-istiod-ca-cert\") pod \"e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh\" (UID: \"8f41d537-f736-4072-bf37-6324a1dad3ad\") " pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh"
Jul 13 17:06:29.211748 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:29.211710    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f41d537-f736-4072-bf37-6324a1dad3ad-istio-envoy\") pod \"e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh\" (UID: \"8f41d537-f736-4072-bf37-6324a1dad3ad\") " pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh"
Jul 13 17:06:29.211944 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:29.211930    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f41d537-f736-4072-bf37-6324a1dad3ad-istio-podinfo\") pod \"e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh\" (UID: \"8f41d537-f736-4072-bf37-6324a1dad3ad\") " pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh"
Jul 13 17:06:29.221301 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:29.221275    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f41d537-f736-4072-bf37-6324a1dad3ad-istio-token\") pod \"e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh\" (UID: \"8f41d537-f736-4072-bf37-6324a1dad3ad\") " pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh"
Jul 13 17:06:29.221511 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:29.221495    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsfg7\" (UniqueName: \"kubernetes.io/projected/8f41d537-f736-4072-bf37-6324a1dad3ad-kube-api-access-tsfg7\") pod \"e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh\" (UID: \"8f41d537-f736-4072-bf37-6324a1dad3ad\") " pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh"
Jul 13 17:06:29.384236 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:29.384157    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh"
Jul 13 17:06:29.524742 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:29.524693    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh"]
Jul 13 17:06:29.527453 ip-10-0-143-51 kubenswrapper[2573]: W0713 17:06:29.527426    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f41d537_f736_4072_bf37_6324a1dad3ad.slice/crio-b6cfc73a4e4ecf8648a61bf46fa4dba748c80777b750d006cdd1570c389ed574 WatchSource:0}: Error finding container b6cfc73a4e4ecf8648a61bf46fa4dba748c80777b750d006cdd1570c389ed574: Status 404 returned error can't find the container with id b6cfc73a4e4ecf8648a61bf46fa4dba748c80777b750d006cdd1570c389ed574
Jul 13 17:06:29.529687 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:29.529657    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:06:29.529769 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:29.529742    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:06:29.529815 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:29.529772    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:06:30.032469 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:30.032432    2573 patch_prober.go:28] interesting pod/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 13 17:06:30.032641 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:30.032485    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf" podUID="5d459d99-6faf-4282-9b9b-8c4be3068570" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 17:06:30.039421 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:30.039384    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh" event={"ID":"8f41d537-f736-4072-bf37-6324a1dad3ad","Type":"ContainerStarted","Data":"3f4a63eb16e3aa7e06916038f414fe385ecf5964c26a994519f943842da8efcd"}
Jul 13 17:06:30.039545 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:30.039446    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh" event={"ID":"8f41d537-f736-4072-bf37-6324a1dad3ad","Type":"ContainerStarted","Data":"b6cfc73a4e4ecf8648a61bf46fa4dba748c80777b750d006cdd1570c389ed574"}
Jul 13 17:06:30.059504 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:30.059451    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh" podStartSLOduration=1.059436565 podStartE2EDuration="1.059436565s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:06:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:06:30.059089702 +0000 UTC m=+1587.417396560" watchObservedRunningTime="2026-07-13 17:06:30.059436565 +0000 UTC m=+1587.417743389"
Jul 13 17:06:30.385385 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:30.385305    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh"
Jul 13 17:06:30.390159 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:30.390134    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh"
Jul 13 17:06:30.398599 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:30.398573    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:06:30.511857 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:30.511823    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:06:30.737444 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:30.737408    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:06:31.045110 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:31.045037    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh"
Jul 13 17:06:31.046110 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:31.046086    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh"
Jul 13 17:06:31.190655 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:31.190624    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:06:31.291454 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:31.291424    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:06:33.570900 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:33.570823    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf"
Jul 13 17:06:33.655746 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:33.653015    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d459d99-6faf-4282-9b9b-8c4be3068570-credential-socket\") pod \"5d459d99-6faf-4282-9b9b-8c4be3068570\" (UID: \"5d459d99-6faf-4282-9b9b-8c4be3068570\") "
Jul 13 17:06:33.655746 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:33.653073    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mzvs\" (UniqueName: \"kubernetes.io/projected/5d459d99-6faf-4282-9b9b-8c4be3068570-kube-api-access-4mzvs\") pod \"5d459d99-6faf-4282-9b9b-8c4be3068570\" (UID: \"5d459d99-6faf-4282-9b9b-8c4be3068570\") "
Jul 13 17:06:33.655746 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:33.653113    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d459d99-6faf-4282-9b9b-8c4be3068570-workload-socket\") pod \"5d459d99-6faf-4282-9b9b-8c4be3068570\" (UID: \"5d459d99-6faf-4282-9b9b-8c4be3068570\") "
Jul 13 17:06:33.655746 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:33.653142    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d459d99-6faf-4282-9b9b-8c4be3068570-istio-data\") pod \"5d459d99-6faf-4282-9b9b-8c4be3068570\" (UID: \"5d459d99-6faf-4282-9b9b-8c4be3068570\") "
Jul 13 17:06:33.655746 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:33.653202    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d459d99-6faf-4282-9b9b-8c4be3068570-istiod-ca-cert\") pod \"5d459d99-6faf-4282-9b9b-8c4be3068570\" (UID: \"5d459d99-6faf-4282-9b9b-8c4be3068570\") "
Jul 13 17:06:33.655746 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:33.653224    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d459d99-6faf-4282-9b9b-8c4be3068570-istio-envoy\") pod \"5d459d99-6faf-4282-9b9b-8c4be3068570\" (UID: \"5d459d99-6faf-4282-9b9b-8c4be3068570\") "
Jul 13 17:06:33.655746 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:33.653251    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d459d99-6faf-4282-9b9b-8c4be3068570-workload-certs\") pod \"5d459d99-6faf-4282-9b9b-8c4be3068570\" (UID: \"5d459d99-6faf-4282-9b9b-8c4be3068570\") "
Jul 13 17:06:33.655746 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:33.653291    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d459d99-6faf-4282-9b9b-8c4be3068570-istio-podinfo\") pod \"5d459d99-6faf-4282-9b9b-8c4be3068570\" (UID: \"5d459d99-6faf-4282-9b9b-8c4be3068570\") "
Jul 13 17:06:33.655746 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:33.653351    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d459d99-6faf-4282-9b9b-8c4be3068570-istio-token\") pod \"5d459d99-6faf-4282-9b9b-8c4be3068570\" (UID: \"5d459d99-6faf-4282-9b9b-8c4be3068570\") "
Jul 13 17:06:33.655746 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:33.655092    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d459d99-6faf-4282-9b9b-8c4be3068570-istio-data" (OuterVolumeSpecName: "istio-data") pod "5d459d99-6faf-4282-9b9b-8c4be3068570" (UID: "5d459d99-6faf-4282-9b9b-8c4be3068570"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:06:33.655746 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:33.655263    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d459d99-6faf-4282-9b9b-8c4be3068570-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5d459d99-6faf-4282-9b9b-8c4be3068570" (UID: "5d459d99-6faf-4282-9b9b-8c4be3068570"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:06:33.659742 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:33.657489    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d459d99-6faf-4282-9b9b-8c4be3068570-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5d459d99-6faf-4282-9b9b-8c4be3068570" (UID: "5d459d99-6faf-4282-9b9b-8c4be3068570"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:06:33.659742 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:33.657654    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d459d99-6faf-4282-9b9b-8c4be3068570-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5d459d99-6faf-4282-9b9b-8c4be3068570" (UID: "5d459d99-6faf-4282-9b9b-8c4be3068570"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:06:33.672065 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:33.667891    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d459d99-6faf-4282-9b9b-8c4be3068570-istio-token" (OuterVolumeSpecName: "istio-token") pod "5d459d99-6faf-4282-9b9b-8c4be3068570" (UID: "5d459d99-6faf-4282-9b9b-8c4be3068570"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:06:33.672065 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:33.667966    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d459d99-6faf-4282-9b9b-8c4be3068570-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5d459d99-6faf-4282-9b9b-8c4be3068570" (UID: "5d459d99-6faf-4282-9b9b-8c4be3068570"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:06:33.672065 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:33.668350    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5d459d99-6faf-4282-9b9b-8c4be3068570-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5d459d99-6faf-4282-9b9b-8c4be3068570" (UID: "5d459d99-6faf-4282-9b9b-8c4be3068570"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 17:06:33.674350 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:33.674313    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d459d99-6faf-4282-9b9b-8c4be3068570-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5d459d99-6faf-4282-9b9b-8c4be3068570" (UID: "5d459d99-6faf-4282-9b9b-8c4be3068570"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:06:33.676074 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:33.676043    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d459d99-6faf-4282-9b9b-8c4be3068570-kube-api-access-4mzvs" (OuterVolumeSpecName: "kube-api-access-4mzvs") pod "5d459d99-6faf-4282-9b9b-8c4be3068570" (UID: "5d459d99-6faf-4282-9b9b-8c4be3068570"). InnerVolumeSpecName "kube-api-access-4mzvs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:06:33.754329 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:33.754253    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d459d99-6faf-4282-9b9b-8c4be3068570-istiod-ca-cert\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:06:33.754329 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:33.754301    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d459d99-6faf-4282-9b9b-8c4be3068570-istio-envoy\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:06:33.754329 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:33.754316    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d459d99-6faf-4282-9b9b-8c4be3068570-workload-certs\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:06:33.754329 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:33.754330    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d459d99-6faf-4282-9b9b-8c4be3068570-istio-podinfo\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:06:33.754692 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:33.754344    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d459d99-6faf-4282-9b9b-8c4be3068570-istio-token\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:06:33.754692 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:33.754357    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d459d99-6faf-4282-9b9b-8c4be3068570-credential-socket\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:06:33.754692 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:33.754370    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mzvs\" (UniqueName: \"kubernetes.io/projected/5d459d99-6faf-4282-9b9b-8c4be3068570-kube-api-access-4mzvs\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:06:33.754692 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:33.754384    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d459d99-6faf-4282-9b9b-8c4be3068570-workload-socket\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:06:33.754692 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:33.754396    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d459d99-6faf-4282-9b9b-8c4be3068570-istio-data\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:06:34.064772 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:34.064698    2573 generic.go:356] "Generic (PLEG): container finished" podID="5d459d99-6faf-4282-9b9b-8c4be3068570" containerID="b9fd4e7e1fc4174ae97e774aca8beb3b13e1c32eefa2a95380569c31e9b5a20e" exitCode=0
Jul 13 17:06:34.064772 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:34.064771    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf"
Jul 13 17:06:34.065046 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:34.064783    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf" event={"ID":"5d459d99-6faf-4282-9b9b-8c4be3068570","Type":"ContainerDied","Data":"b9fd4e7e1fc4174ae97e774aca8beb3b13e1c32eefa2a95380569c31e9b5a20e"}
Jul 13 17:06:34.065046 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:34.064837    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf" event={"ID":"5d459d99-6faf-4282-9b9b-8c4be3068570","Type":"ContainerDied","Data":"fd534ffd3f4e5424dcc0ac385c4c0556bf8c8513ebf3af36cf2e3ac11da5266f"}
Jul 13 17:06:34.065046 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:34.064869    2573 scope.go:117] "RemoveContainer" containerID="b9fd4e7e1fc4174ae97e774aca8beb3b13e1c32eefa2a95380569c31e9b5a20e"
Jul 13 17:06:34.074073 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:34.074053    2573 scope.go:117] "RemoveContainer" containerID="56000dc08024907cee43a62bac47e7403ebf139e6c424b9755a5e3543e7207e5"
Jul 13 17:06:34.081559 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:34.081544    2573 scope.go:117] "RemoveContainer" containerID="b9fd4e7e1fc4174ae97e774aca8beb3b13e1c32eefa2a95380569c31e9b5a20e"
Jul 13 17:06:34.081827 ip-10-0-143-51 kubenswrapper[2573]: E0713 17:06:34.081803    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9fd4e7e1fc4174ae97e774aca8beb3b13e1c32eefa2a95380569c31e9b5a20e\": container with ID starting with b9fd4e7e1fc4174ae97e774aca8beb3b13e1c32eefa2a95380569c31e9b5a20e not found: ID does not exist" containerID="b9fd4e7e1fc4174ae97e774aca8beb3b13e1c32eefa2a95380569c31e9b5a20e"
Jul 13 17:06:34.081913 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:34.081835    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9fd4e7e1fc4174ae97e774aca8beb3b13e1c32eefa2a95380569c31e9b5a20e"} err="failed to get container status \"b9fd4e7e1fc4174ae97e774aca8beb3b13e1c32eefa2a95380569c31e9b5a20e\": rpc error: code = NotFound desc = could not find container \"b9fd4e7e1fc4174ae97e774aca8beb3b13e1c32eefa2a95380569c31e9b5a20e\": container with ID starting with b9fd4e7e1fc4174ae97e774aca8beb3b13e1c32eefa2a95380569c31e9b5a20e not found: ID does not exist"
Jul 13 17:06:34.081913 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:34.081857    2573 scope.go:117] "RemoveContainer" containerID="56000dc08024907cee43a62bac47e7403ebf139e6c424b9755a5e3543e7207e5"
Jul 13 17:06:34.082082 ip-10-0-143-51 kubenswrapper[2573]: E0713 17:06:34.082066    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56000dc08024907cee43a62bac47e7403ebf139e6c424b9755a5e3543e7207e5\": container with ID starting with 56000dc08024907cee43a62bac47e7403ebf139e6c424b9755a5e3543e7207e5 not found: ID does not exist" containerID="56000dc08024907cee43a62bac47e7403ebf139e6c424b9755a5e3543e7207e5"
Jul 13 17:06:34.082130 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:34.082086    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56000dc08024907cee43a62bac47e7403ebf139e6c424b9755a5e3543e7207e5"} err="failed to get container status \"56000dc08024907cee43a62bac47e7403ebf139e6c424b9755a5e3543e7207e5\": rpc error: code = NotFound desc = could not find container \"56000dc08024907cee43a62bac47e7403ebf139e6c424b9755a5e3543e7207e5\": container with ID starting with 56000dc08024907cee43a62bac47e7403ebf139e6c424b9755a5e3543e7207e5 not found: ID does not exist"
Jul 13 17:06:34.088089 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:34.088068    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf"]
Jul 13 17:06:34.092153 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:34.092134    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-a5ed8a38-openshift-default-fd5567fb5-cknrf"]
Jul 13 17:06:34.767747 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:34.767034    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:06:34.867660 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:34.867567    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:06:35.151960 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:35.151868    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d459d99-6faf-4282-9b9b-8c4be3068570" path="/var/lib/kubelet/pods/5d459d99-6faf-4282-9b9b-8c4be3068570/volumes"
Jul 13 17:06:37.910292 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:37.910248    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:06:38.429191 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:38.429156    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:06:40.095879 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:40.095801    2573 generic.go:356] "Generic (PLEG): container finished" podID="8f41d537-f736-4072-bf37-6324a1dad3ad" containerID="3f4a63eb16e3aa7e06916038f414fe385ecf5964c26a994519f943842da8efcd" exitCode=0
Jul 13 17:06:40.095879 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:40.095861    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh" event={"ID":"8f41d537-f736-4072-bf37-6324a1dad3ad","Type":"ContainerDied","Data":"3f4a63eb16e3aa7e06916038f414fe385ecf5964c26a994519f943842da8efcd"}
Jul 13 17:06:40.096294 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:40.096245    2573 scope.go:117] "RemoveContainer" containerID="3f4a63eb16e3aa7e06916038f414fe385ecf5964c26a994519f943842da8efcd"
Jul 13 17:06:40.097368 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:40.097334    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:06:40.097444 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:40.097426    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:06:40.097492 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:40.097478    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:06:41.102957 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:41.102923    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh" event={"ID":"8f41d537-f736-4072-bf37-6324a1dad3ad","Type":"ContainerStarted","Data":"ee5510923b17378ddd727eafc7fbef15df0d5082ca459e100afd85a5bf9a8a49"}
Jul 13 17:06:41.385291 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:41.385202    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh"
Jul 13 17:06:41.386263 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:41.386237    2573 patch_prober.go:28] interesting pod/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 13 17:06:41.386391 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:41.386296    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh" podUID="8f41d537-f736-4072-bf37-6324a1dad3ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 13 17:06:42.384704 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:42.384672    2573 patch_prober.go:28] interesting pod/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 13 17:06:42.385185 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:42.384765    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh" podUID="8f41d537-f736-4072-bf37-6324a1dad3ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 13 17:06:43.384667 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:43.384636    2573 patch_prober.go:28] interesting pod/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 13 17:06:43.384944 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:43.384686    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh" podUID="8f41d537-f736-4072-bf37-6324a1dad3ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 13 17:06:44.384890 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:44.384855    2573 patch_prober.go:28] interesting pod/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 13 17:06:44.385062 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:44.384912    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh" podUID="8f41d537-f736-4072-bf37-6324a1dad3ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 13 17:06:45.389048 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:45.389018    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh"
Jul 13 17:06:45.389431 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:45.389292    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh"
Jul 13 17:06:45.390042 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:06:45.390023    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh"
Jul 13 17:07:35.490604 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:35.490572    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh"]
Jul 13 17:07:35.491133 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:35.490789    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh" podUID="8f41d537-f736-4072-bf37-6324a1dad3ad" containerName="istio-proxy" containerID="cri-o://ee5510923b17378ddd727eafc7fbef15df0d5082ca459e100afd85a5bf9a8a49" gracePeriod=30
Jul 13 17:07:35.514983 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:35.514943    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:07:35.628535 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:35.628502    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:07:40.710351 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:40.710313    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:07:40.760222 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:40.760153    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh"
Jul 13 17:07:40.849542 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:40.849519    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f41d537-f736-4072-bf37-6324a1dad3ad-credential-socket\") pod \"8f41d537-f736-4072-bf37-6324a1dad3ad\" (UID: \"8f41d537-f736-4072-bf37-6324a1dad3ad\") "
Jul 13 17:07:40.849701 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:40.849549    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f41d537-f736-4072-bf37-6324a1dad3ad-istio-data\") pod \"8f41d537-f736-4072-bf37-6324a1dad3ad\" (UID: \"8f41d537-f736-4072-bf37-6324a1dad3ad\") "
Jul 13 17:07:40.849701 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:40.849585    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tsfg7\" (UniqueName: \"kubernetes.io/projected/8f41d537-f736-4072-bf37-6324a1dad3ad-kube-api-access-tsfg7\") pod \"8f41d537-f736-4072-bf37-6324a1dad3ad\" (UID: \"8f41d537-f736-4072-bf37-6324a1dad3ad\") "
Jul 13 17:07:40.849701 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:40.849667    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f41d537-f736-4072-bf37-6324a1dad3ad-istiod-ca-cert\") pod \"8f41d537-f736-4072-bf37-6324a1dad3ad\" (UID: \"8f41d537-f736-4072-bf37-6324a1dad3ad\") "
Jul 13 17:07:40.849701 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:40.849698    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f41d537-f736-4072-bf37-6324a1dad3ad-workload-socket\") pod \"8f41d537-f736-4072-bf37-6324a1dad3ad\" (UID: \"8f41d537-f736-4072-bf37-6324a1dad3ad\") "
Jul 13 17:07:40.849948 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:40.849741    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f41d537-f736-4072-bf37-6324a1dad3ad-istio-token\") pod \"8f41d537-f736-4072-bf37-6324a1dad3ad\" (UID: \"8f41d537-f736-4072-bf37-6324a1dad3ad\") "
Jul 13 17:07:40.849948 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:40.849768    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f41d537-f736-4072-bf37-6324a1dad3ad-workload-certs\") pod \"8f41d537-f736-4072-bf37-6324a1dad3ad\" (UID: \"8f41d537-f736-4072-bf37-6324a1dad3ad\") "
Jul 13 17:07:40.849948 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:40.849851    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f41d537-f736-4072-bf37-6324a1dad3ad-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8f41d537-f736-4072-bf37-6324a1dad3ad" (UID: "8f41d537-f736-4072-bf37-6324a1dad3ad"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:07:40.849948 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:40.849918    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f41d537-f736-4072-bf37-6324a1dad3ad-istio-envoy\") pod \"8f41d537-f736-4072-bf37-6324a1dad3ad\" (UID: \"8f41d537-f736-4072-bf37-6324a1dad3ad\") "
Jul 13 17:07:40.850153 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:40.849959    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f41d537-f736-4072-bf37-6324a1dad3ad-istio-podinfo\") pod \"8f41d537-f736-4072-bf37-6324a1dad3ad\" (UID: \"8f41d537-f736-4072-bf37-6324a1dad3ad\") "
Jul 13 17:07:40.850203 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:40.850170    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f41d537-f736-4072-bf37-6324a1dad3ad-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8f41d537-f736-4072-bf37-6324a1dad3ad" (UID: "8f41d537-f736-4072-bf37-6324a1dad3ad"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:07:40.850526 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:40.850300    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f41d537-f736-4072-bf37-6324a1dad3ad-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8f41d537-f736-4072-bf37-6324a1dad3ad" (UID: "8f41d537-f736-4072-bf37-6324a1dad3ad"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:07:40.850526 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:40.850321    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f41d537-f736-4072-bf37-6324a1dad3ad-credential-socket\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:07:40.850526 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:40.850344    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f41d537-f736-4072-bf37-6324a1dad3ad-istiod-ca-cert\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:07:40.850526 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:40.850486    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f41d537-f736-4072-bf37-6324a1dad3ad-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8f41d537-f736-4072-bf37-6324a1dad3ad" (UID: "8f41d537-f736-4072-bf37-6324a1dad3ad"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:07:40.850837 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:40.850539    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f41d537-f736-4072-bf37-6324a1dad3ad-istio-data" (OuterVolumeSpecName: "istio-data") pod "8f41d537-f736-4072-bf37-6324a1dad3ad" (UID: "8f41d537-f736-4072-bf37-6324a1dad3ad"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:07:40.851999 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:40.851974    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f41d537-f736-4072-bf37-6324a1dad3ad-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8f41d537-f736-4072-bf37-6324a1dad3ad" (UID: "8f41d537-f736-4072-bf37-6324a1dad3ad"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:07:40.852163 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:40.852143    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8f41d537-f736-4072-bf37-6324a1dad3ad-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8f41d537-f736-4072-bf37-6324a1dad3ad" (UID: "8f41d537-f736-4072-bf37-6324a1dad3ad"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 17:07:40.854849 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:40.852148    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f41d537-f736-4072-bf37-6324a1dad3ad-istio-token" (OuterVolumeSpecName: "istio-token") pod "8f41d537-f736-4072-bf37-6324a1dad3ad" (UID: "8f41d537-f736-4072-bf37-6324a1dad3ad"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:07:40.854849 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:40.852565    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f41d537-f736-4072-bf37-6324a1dad3ad-kube-api-access-tsfg7" (OuterVolumeSpecName: "kube-api-access-tsfg7") pod "8f41d537-f736-4072-bf37-6324a1dad3ad" (UID: "8f41d537-f736-4072-bf37-6324a1dad3ad"). InnerVolumeSpecName "kube-api-access-tsfg7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:07:40.951128 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:40.951093    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f41d537-f736-4072-bf37-6324a1dad3ad-workload-socket\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:07:40.951128 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:40.951124    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f41d537-f736-4072-bf37-6324a1dad3ad-istio-token\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:07:40.951128 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:40.951133    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f41d537-f736-4072-bf37-6324a1dad3ad-workload-certs\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:07:40.951351 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:40.951141    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f41d537-f736-4072-bf37-6324a1dad3ad-istio-envoy\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:07:40.951351 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:40.951150    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f41d537-f736-4072-bf37-6324a1dad3ad-istio-podinfo\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:07:40.951351 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:40.951157    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f41d537-f736-4072-bf37-6324a1dad3ad-istio-data\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:07:40.951351 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:40.951166    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tsfg7\" (UniqueName: \"kubernetes.io/projected/8f41d537-f736-4072-bf37-6324a1dad3ad-kube-api-access-tsfg7\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:07:41.373740 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:41.373687    2573 generic.go:356] "Generic (PLEG): container finished" podID="8f41d537-f736-4072-bf37-6324a1dad3ad" containerID="ee5510923b17378ddd727eafc7fbef15df0d5082ca459e100afd85a5bf9a8a49" exitCode=0
Jul 13 17:07:41.373885 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:41.373747    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh" event={"ID":"8f41d537-f736-4072-bf37-6324a1dad3ad","Type":"ContainerDied","Data":"ee5510923b17378ddd727eafc7fbef15df0d5082ca459e100afd85a5bf9a8a49"}
Jul 13 17:07:41.373885 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:41.373763    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh"
Jul 13 17:07:41.373885 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:41.373790    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh" event={"ID":"8f41d537-f736-4072-bf37-6324a1dad3ad","Type":"ContainerDied","Data":"b6cfc73a4e4ecf8648a61bf46fa4dba748c80777b750d006cdd1570c389ed574"}
Jul 13 17:07:41.373885 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:41.373812    2573 scope.go:117] "RemoveContainer" containerID="ee5510923b17378ddd727eafc7fbef15df0d5082ca459e100afd85a5bf9a8a49"
Jul 13 17:07:41.383217 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:41.383200    2573 scope.go:117] "RemoveContainer" containerID="3f4a63eb16e3aa7e06916038f414fe385ecf5964c26a994519f943842da8efcd"
Jul 13 17:07:41.390951 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:41.390934    2573 scope.go:117] "RemoveContainer" containerID="ee5510923b17378ddd727eafc7fbef15df0d5082ca459e100afd85a5bf9a8a49"
Jul 13 17:07:41.391222 ip-10-0-143-51 kubenswrapper[2573]: E0713 17:07:41.391194    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee5510923b17378ddd727eafc7fbef15df0d5082ca459e100afd85a5bf9a8a49\": container with ID starting with ee5510923b17378ddd727eafc7fbef15df0d5082ca459e100afd85a5bf9a8a49 not found: ID does not exist" containerID="ee5510923b17378ddd727eafc7fbef15df0d5082ca459e100afd85a5bf9a8a49"
Jul 13 17:07:41.391323 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:41.391233    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee5510923b17378ddd727eafc7fbef15df0d5082ca459e100afd85a5bf9a8a49"} err="failed to get container status \"ee5510923b17378ddd727eafc7fbef15df0d5082ca459e100afd85a5bf9a8a49\": rpc error: code = NotFound desc = could not find container \"ee5510923b17378ddd727eafc7fbef15df0d5082ca459e100afd85a5bf9a8a49\": container with ID starting with ee5510923b17378ddd727eafc7fbef15df0d5082ca459e100afd85a5bf9a8a49 not found: ID does not exist"
Jul 13 17:07:41.391323 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:41.391257    2573 scope.go:117] "RemoveContainer" containerID="3f4a63eb16e3aa7e06916038f414fe385ecf5964c26a994519f943842da8efcd"
Jul 13 17:07:41.391565 ip-10-0-143-51 kubenswrapper[2573]: E0713 17:07:41.391547    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f4a63eb16e3aa7e06916038f414fe385ecf5964c26a994519f943842da8efcd\": container with ID starting with 3f4a63eb16e3aa7e06916038f414fe385ecf5964c26a994519f943842da8efcd not found: ID does not exist" containerID="3f4a63eb16e3aa7e06916038f414fe385ecf5964c26a994519f943842da8efcd"
Jul 13 17:07:41.391633 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:41.391571    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f4a63eb16e3aa7e06916038f414fe385ecf5964c26a994519f943842da8efcd"} err="failed to get container status \"3f4a63eb16e3aa7e06916038f414fe385ecf5964c26a994519f943842da8efcd\": rpc error: code = NotFound desc = could not find container \"3f4a63eb16e3aa7e06916038f414fe385ecf5964c26a994519f943842da8efcd\": container with ID starting with 3f4a63eb16e3aa7e06916038f414fe385ecf5964c26a994519f943842da8efcd not found: ID does not exist"
Jul 13 17:07:41.393849 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:41.393829    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh"]
Jul 13 17:07:41.400350 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:41.400330    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-51bf4736-gw-openshift-default-7f79984bdc-zt4zh"]
Jul 13 17:07:41.712891 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:41.712860    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:07:42.188131 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:42.188104    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:07:43.148390 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:43.148358    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f41d537-f736-4072-bf37-6324a1dad3ad" path="/var/lib/kubelet/pods/8f41d537-f736-4072-bf37-6324a1dad3ad/volumes"
Jul 13 17:07:47.670484 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:47.670449    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:07:47.769982 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:47.769937    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:07:47.847808 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:47.847778    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm"]
Jul 13 17:07:47.848269 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:47.848253    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d459d99-6faf-4282-9b9b-8c4be3068570" containerName="istio-proxy"
Jul 13 17:07:47.848314 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:47.848273    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d459d99-6faf-4282-9b9b-8c4be3068570" containerName="istio-proxy"
Jul 13 17:07:47.848314 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:47.848286    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f41d537-f736-4072-bf37-6324a1dad3ad" containerName="istio-proxy"
Jul 13 17:07:47.848314 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:47.848295    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f41d537-f736-4072-bf37-6324a1dad3ad" containerName="istio-proxy"
Jul 13 17:07:47.848314 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:47.848306    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f41d537-f736-4072-bf37-6324a1dad3ad" containerName="istio-proxy"
Jul 13 17:07:47.848440 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:47.848315    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f41d537-f736-4072-bf37-6324a1dad3ad" containerName="istio-proxy"
Jul 13 17:07:47.848440 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:47.848414    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d459d99-6faf-4282-9b9b-8c4be3068570" containerName="istio-proxy"
Jul 13 17:07:47.848440 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:47.848425    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f41d537-f736-4072-bf37-6324a1dad3ad" containerName="istio-proxy"
Jul 13 17:07:47.848440 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:47.848435    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d459d99-6faf-4282-9b9b-8c4be3068570" containerName="istio-proxy"
Jul 13 17:07:47.848555 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:47.848446    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f41d537-f736-4072-bf37-6324a1dad3ad" containerName="istio-proxy"
Jul 13 17:07:47.853072 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:47.853055    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm"
Jul 13 17:07:47.855928 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:47.855908    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-97e65980-openshift-default-dockercfg-t4qs9\""
Jul 13 17:07:47.861483 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:47.861458    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm"]
Jul 13 17:07:47.877760 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:47.877710    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:07:47.976540 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:47.976510    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:07:48.010456 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:48.010430    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-workload-socket\") pod \"e2e-ait-97e65980-openshift-default-578c47485-9j4gm\" (UID: \"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e\") " pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm"
Jul 13 17:07:48.010605 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:48.010460    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6swg\" (UniqueName: \"kubernetes.io/projected/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-kube-api-access-z6swg\") pod \"e2e-ait-97e65980-openshift-default-578c47485-9j4gm\" (UID: \"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e\") " pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm"
Jul 13 17:07:48.010605 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:48.010493    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-istiod-ca-cert\") pod \"e2e-ait-97e65980-openshift-default-578c47485-9j4gm\" (UID: \"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e\") " pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm"
Jul 13 17:07:48.010605 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:48.010551    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-istio-envoy\") pod \"e2e-ait-97e65980-openshift-default-578c47485-9j4gm\" (UID: \"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e\") " pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm"
Jul 13 17:07:48.010605 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:48.010569    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-istio-data\") pod \"e2e-ait-97e65980-openshift-default-578c47485-9j4gm\" (UID: \"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e\") " pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm"
Jul 13 17:07:48.010852 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:48.010642    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-workload-certs\") pod \"e2e-ait-97e65980-openshift-default-578c47485-9j4gm\" (UID: \"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e\") " pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm"
Jul 13 17:07:48.010852 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:48.010704    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-istio-podinfo\") pod \"e2e-ait-97e65980-openshift-default-578c47485-9j4gm\" (UID: \"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e\") " pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm"
Jul 13 17:07:48.010852 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:48.010775    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-istio-token\") pod \"e2e-ait-97e65980-openshift-default-578c47485-9j4gm\" (UID: \"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e\") " pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm"
Jul 13 17:07:48.010852 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:48.010809    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-credential-socket\") pod \"e2e-ait-97e65980-openshift-default-578c47485-9j4gm\" (UID: \"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e\") " pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm"
Jul 13 17:07:48.111962 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:48.111934    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-istiod-ca-cert\") pod \"e2e-ait-97e65980-openshift-default-578c47485-9j4gm\" (UID: \"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e\") " pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm"
Jul 13 17:07:48.112119 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:48.111975    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-istio-envoy\") pod \"e2e-ait-97e65980-openshift-default-578c47485-9j4gm\" (UID: \"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e\") " pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm"
Jul 13 17:07:48.112119 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:48.111994    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-istio-data\") pod \"e2e-ait-97e65980-openshift-default-578c47485-9j4gm\" (UID: \"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e\") " pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm"
Jul 13 17:07:48.112119 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:48.112020    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-workload-certs\") pod \"e2e-ait-97e65980-openshift-default-578c47485-9j4gm\" (UID: \"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e\") " pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm"
Jul 13 17:07:48.112119 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:48.112048    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-istio-podinfo\") pod \"e2e-ait-97e65980-openshift-default-578c47485-9j4gm\" (UID: \"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e\") " pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm"
Jul 13 17:07:48.112119 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:48.112069    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-istio-token\") pod \"e2e-ait-97e65980-openshift-default-578c47485-9j4gm\" (UID: \"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e\") " pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm"
Jul 13 17:07:48.112119 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:48.112086    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-credential-socket\") pod \"e2e-ait-97e65980-openshift-default-578c47485-9j4gm\" (UID: \"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e\") " pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm"
Jul 13 17:07:48.112504 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:48.112129    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-workload-socket\") pod \"e2e-ait-97e65980-openshift-default-578c47485-9j4gm\" (UID: \"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e\") " pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm"
Jul 13 17:07:48.112504 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:48.112154    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6swg\" (UniqueName: \"kubernetes.io/projected/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-kube-api-access-z6swg\") pod \"e2e-ait-97e65980-openshift-default-578c47485-9j4gm\" (UID: \"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e\") " pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm"
Jul 13 17:07:48.112504 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:48.112467    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-istio-data\") pod \"e2e-ait-97e65980-openshift-default-578c47485-9j4gm\" (UID: \"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e\") " pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm"
Jul 13 17:07:48.112669 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:48.112625    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-workload-socket\") pod \"e2e-ait-97e65980-openshift-default-578c47485-9j4gm\" (UID: \"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e\") " pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm"
Jul 13 17:07:48.112669 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:48.112645    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-credential-socket\") pod \"e2e-ait-97e65980-openshift-default-578c47485-9j4gm\" (UID: \"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e\") " pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm"
Jul 13 17:07:48.112803 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:48.112680    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-workload-certs\") pod \"e2e-ait-97e65980-openshift-default-578c47485-9j4gm\" (UID: \"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e\") " pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm"
Jul 13 17:07:48.112803 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:48.112759    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-istiod-ca-cert\") pod \"e2e-ait-97e65980-openshift-default-578c47485-9j4gm\" (UID: \"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e\") " pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm"
Jul 13 17:07:48.114765 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:48.114739    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-istio-envoy\") pod \"e2e-ait-97e65980-openshift-default-578c47485-9j4gm\" (UID: \"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e\") " pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm"
Jul 13 17:07:48.114961 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:48.114946    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-istio-podinfo\") pod \"e2e-ait-97e65980-openshift-default-578c47485-9j4gm\" (UID: \"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e\") " pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm"
Jul 13 17:07:48.121177 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:48.121152    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-istio-token\") pod \"e2e-ait-97e65980-openshift-default-578c47485-9j4gm\" (UID: \"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e\") " pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm"
Jul 13 17:07:48.121384 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:48.121369    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6swg\" (UniqueName: \"kubernetes.io/projected/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-kube-api-access-z6swg\") pod \"e2e-ait-97e65980-openshift-default-578c47485-9j4gm\" (UID: \"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e\") " pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm"
Jul 13 17:07:48.164592 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:48.164569    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm"
Jul 13 17:07:48.310406 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:48.310381    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm"]
Jul 13 17:07:48.311953 ip-10-0-143-51 kubenswrapper[2573]: W0713 17:07:48.311929    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e5cc3c1_dbfa_4beb_8ff3_56e9c9a4bc8e.slice/crio-03d6e54d4bdffd4f3c7f7d0083e6d591702aa646077a6ac035b1bf9a4e32531f WatchSource:0}: Error finding container 03d6e54d4bdffd4f3c7f7d0083e6d591702aa646077a6ac035b1bf9a4e32531f: Status 404 returned error can't find the container with id 03d6e54d4bdffd4f3c7f7d0083e6d591702aa646077a6ac035b1bf9a4e32531f
Jul 13 17:07:48.314084 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:48.314051    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:07:48.314151 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:48.314117    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:07:48.314191 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:48.314148    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:07:48.409963 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:48.409918    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm" event={"ID":"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e","Type":"ContainerStarted","Data":"519e94a4da7399e253aa5f2e4dc3ad017cc682be6594f65ddcb294127ec19390"}
Jul 13 17:07:48.410121 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:48.409993    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm" event={"ID":"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e","Type":"ContainerStarted","Data":"03d6e54d4bdffd4f3c7f7d0083e6d591702aa646077a6ac035b1bf9a4e32531f"}
Jul 13 17:07:49.005229 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:49.005195    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:07:49.105383 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:49.105353    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:07:49.165465 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:49.165437    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm"
Jul 13 17:07:49.170453 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:49.170429    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm"
Jul 13 17:07:49.208567 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:49.208521    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm" podStartSLOduration=2.208505864 podStartE2EDuration="2.208505864s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:07:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:07:48.441444361 +0000 UTC m=+1665.799751187" watchObservedRunningTime="2026-07-13 17:07:49.208505864 +0000 UTC m=+1666.566812689"
Jul 13 17:07:49.245898 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:49.245871    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:07:49.349829 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:49.349747    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:07:49.414659 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:49.414628    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm"
Jul 13 17:07:49.415425 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:49.415409    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm"
Jul 13 17:07:49.725789 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:49.725758    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:07:49.886113 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:49.886079    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:07:51.446372 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:51.446308    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:07:59.473612 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:59.473584    2573 generic.go:356] "Generic (PLEG): container finished" podID="2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e" containerID="519e94a4da7399e253aa5f2e4dc3ad017cc682be6594f65ddcb294127ec19390" exitCode=0
Jul 13 17:07:59.474073 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:59.473660    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm" event={"ID":"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e","Type":"ContainerDied","Data":"519e94a4da7399e253aa5f2e4dc3ad017cc682be6594f65ddcb294127ec19390"}
Jul 13 17:07:59.474204 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:59.474188    2573 scope.go:117] "RemoveContainer" containerID="519e94a4da7399e253aa5f2e4dc3ad017cc682be6594f65ddcb294127ec19390"
Jul 13 17:07:59.475285 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:59.475259    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:07:59.475347 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:59.475325    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:07:59.475394 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:07:59.475357    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:08:00.480904 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:00.480871    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm" event={"ID":"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e","Type":"ContainerStarted","Data":"e4ce7ee29365589fb040c011e994061af4b8f0d2f2ff3785763aae5f9116f03b"}
Jul 13 17:08:01.167812 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:01.167773    2573 patch_prober.go:28] interesting pod/e2e-ait-97e65980-openshift-default-578c47485-9j4gm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 13 17:08:01.168018 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:01.167842    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm" podUID="2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 13 17:08:01.171087 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:01.171062    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm"
Jul 13 17:08:02.165879 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:02.165838    2573 patch_prober.go:28] interesting pod/e2e-ait-97e65980-openshift-default-578c47485-9j4gm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 13 17:08:02.166301 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:02.165911    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm" podUID="2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 13 17:08:03.165304 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:03.165266    2573 patch_prober.go:28] interesting pod/e2e-ait-97e65980-openshift-default-578c47485-9j4gm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 13 17:08:03.165484 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:03.165330    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm" podUID="2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 13 17:08:04.165099 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:04.165059    2573 patch_prober.go:28] interesting pod/e2e-ait-97e65980-openshift-default-578c47485-9j4gm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 13 17:08:04.165477 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:04.165114    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm" podUID="2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 13 17:08:04.414837 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:04.414808    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm"
Jul 13 17:08:04.650761 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:04.650732    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:08:04.839612 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:04.839577    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:08:05.168896 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:05.168869    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm"
Jul 13 17:08:05.169865 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:05.169848    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm"
Jul 13 17:08:09.298154 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:09.298117    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:08:15.324252 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:15.324218    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:08:17.037875 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:17.037840    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:08:20.400786 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:20.400752    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm"]
Jul 13 17:08:20.401203 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:20.401015    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm" podUID="2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e" containerName="istio-proxy" containerID="cri-o://e4ce7ee29365589fb040c011e994061af4b8f0d2f2ff3785763aae5f9116f03b" gracePeriod=30
Jul 13 17:08:20.427254 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:20.427230    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:08:20.738164 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:20.738134    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8"]
Jul 13 17:08:20.738550 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:20.738534    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d459d99-6faf-4282-9b9b-8c4be3068570" containerName="istio-proxy"
Jul 13 17:08:20.738550 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:20.738550    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d459d99-6faf-4282-9b9b-8c4be3068570" containerName="istio-proxy"
Jul 13 17:08:20.741866 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:20.741844    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8"
Jul 13 17:08:20.745154 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:20.745131    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-1890c174-openshift-default-dockercfg-98c68\""
Jul 13 17:08:20.754924 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:20.754901    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8"]
Jul 13 17:08:20.780674 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:20.780640    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:08:20.788936 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:20.788913    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c21e46c-1f07-499e-8071-df00fe79095f-workload-socket\") pod \"e2e-derive-1890c174-openshift-default-5b55649bff-np2n8\" (UID: \"6c21e46c-1f07-499e-8071-df00fe79095f\") " pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8"
Jul 13 17:08:20.789053 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:20.788945    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c21e46c-1f07-499e-8071-df00fe79095f-credential-socket\") pod \"e2e-derive-1890c174-openshift-default-5b55649bff-np2n8\" (UID: \"6c21e46c-1f07-499e-8071-df00fe79095f\") " pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8"
Jul 13 17:08:20.789053 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:20.788985    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8glq\" (UniqueName: \"kubernetes.io/projected/6c21e46c-1f07-499e-8071-df00fe79095f-kube-api-access-b8glq\") pod \"e2e-derive-1890c174-openshift-default-5b55649bff-np2n8\" (UID: \"6c21e46c-1f07-499e-8071-df00fe79095f\") " pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8"
Jul 13 17:08:20.789136 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:20.789069    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c21e46c-1f07-499e-8071-df00fe79095f-istiod-ca-cert\") pod \"e2e-derive-1890c174-openshift-default-5b55649bff-np2n8\" (UID: \"6c21e46c-1f07-499e-8071-df00fe79095f\") " pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8"
Jul 13 17:08:20.789136 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:20.789118    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c21e46c-1f07-499e-8071-df00fe79095f-workload-certs\") pod \"e2e-derive-1890c174-openshift-default-5b55649bff-np2n8\" (UID: \"6c21e46c-1f07-499e-8071-df00fe79095f\") " pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8"
Jul 13 17:08:20.789211 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:20.789177    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c21e46c-1f07-499e-8071-df00fe79095f-istio-envoy\") pod \"e2e-derive-1890c174-openshift-default-5b55649bff-np2n8\" (UID: \"6c21e46c-1f07-499e-8071-df00fe79095f\") " pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8"
Jul 13 17:08:20.789256 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:20.789211    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c21e46c-1f07-499e-8071-df00fe79095f-istio-podinfo\") pod \"e2e-derive-1890c174-openshift-default-5b55649bff-np2n8\" (UID: \"6c21e46c-1f07-499e-8071-df00fe79095f\") " pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8"
Jul 13 17:08:20.789292 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:20.789255    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c21e46c-1f07-499e-8071-df00fe79095f-istio-token\") pod \"e2e-derive-1890c174-openshift-default-5b55649bff-np2n8\" (UID: \"6c21e46c-1f07-499e-8071-df00fe79095f\") " pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8"
Jul 13 17:08:20.789348 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:20.789290    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c21e46c-1f07-499e-8071-df00fe79095f-istio-data\") pod \"e2e-derive-1890c174-openshift-default-5b55649bff-np2n8\" (UID: \"6c21e46c-1f07-499e-8071-df00fe79095f\") " pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8"
Jul 13 17:08:20.890852 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:20.890807    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c21e46c-1f07-499e-8071-df00fe79095f-workload-certs\") pod \"e2e-derive-1890c174-openshift-default-5b55649bff-np2n8\" (UID: \"6c21e46c-1f07-499e-8071-df00fe79095f\") " pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8"
Jul 13 17:08:20.890852 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:20.890869    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c21e46c-1f07-499e-8071-df00fe79095f-istio-envoy\") pod \"e2e-derive-1890c174-openshift-default-5b55649bff-np2n8\" (UID: \"6c21e46c-1f07-499e-8071-df00fe79095f\") " pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8"
Jul 13 17:08:20.891110 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:20.890892    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c21e46c-1f07-499e-8071-df00fe79095f-istio-podinfo\") pod \"e2e-derive-1890c174-openshift-default-5b55649bff-np2n8\" (UID: \"6c21e46c-1f07-499e-8071-df00fe79095f\") " pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8"
Jul 13 17:08:20.891110 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:20.890914    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c21e46c-1f07-499e-8071-df00fe79095f-istio-token\") pod \"e2e-derive-1890c174-openshift-default-5b55649bff-np2n8\" (UID: \"6c21e46c-1f07-499e-8071-df00fe79095f\") " pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8"
Jul 13 17:08:20.891110 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:20.890935    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c21e46c-1f07-499e-8071-df00fe79095f-istio-data\") pod \"e2e-derive-1890c174-openshift-default-5b55649bff-np2n8\" (UID: \"6c21e46c-1f07-499e-8071-df00fe79095f\") " pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8"
Jul 13 17:08:20.891110 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:20.890965    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c21e46c-1f07-499e-8071-df00fe79095f-workload-socket\") pod \"e2e-derive-1890c174-openshift-default-5b55649bff-np2n8\" (UID: \"6c21e46c-1f07-499e-8071-df00fe79095f\") " pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8"
Jul 13 17:08:20.891312 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:20.891204    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c21e46c-1f07-499e-8071-df00fe79095f-credential-socket\") pod \"e2e-derive-1890c174-openshift-default-5b55649bff-np2n8\" (UID: \"6c21e46c-1f07-499e-8071-df00fe79095f\") " pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8"
Jul 13 17:08:20.891312 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:20.891272    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8glq\" (UniqueName: \"kubernetes.io/projected/6c21e46c-1f07-499e-8071-df00fe79095f-kube-api-access-b8glq\") pod \"e2e-derive-1890c174-openshift-default-5b55649bff-np2n8\" (UID: \"6c21e46c-1f07-499e-8071-df00fe79095f\") " pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8"
Jul 13 17:08:20.891312 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:20.891287    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c21e46c-1f07-499e-8071-df00fe79095f-workload-certs\") pod \"e2e-derive-1890c174-openshift-default-5b55649bff-np2n8\" (UID: \"6c21e46c-1f07-499e-8071-df00fe79095f\") " pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8"
Jul 13 17:08:20.891479 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:20.891353    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c21e46c-1f07-499e-8071-df00fe79095f-istiod-ca-cert\") pod \"e2e-derive-1890c174-openshift-default-5b55649bff-np2n8\" (UID: \"6c21e46c-1f07-499e-8071-df00fe79095f\") " pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8"
Jul 13 17:08:20.891479 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:20.891369    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c21e46c-1f07-499e-8071-df00fe79095f-istio-data\") pod \"e2e-derive-1890c174-openshift-default-5b55649bff-np2n8\" (UID: \"6c21e46c-1f07-499e-8071-df00fe79095f\") " pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8"
Jul 13 17:08:20.891479 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:20.891385    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c21e46c-1f07-499e-8071-df00fe79095f-workload-socket\") pod \"e2e-derive-1890c174-openshift-default-5b55649bff-np2n8\" (UID: \"6c21e46c-1f07-499e-8071-df00fe79095f\") " pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8"
Jul 13 17:08:20.891677 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:20.891654    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c21e46c-1f07-499e-8071-df00fe79095f-credential-socket\") pod \"e2e-derive-1890c174-openshift-default-5b55649bff-np2n8\" (UID: \"6c21e46c-1f07-499e-8071-df00fe79095f\") " pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8"
Jul 13 17:08:20.892130 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:20.892105    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c21e46c-1f07-499e-8071-df00fe79095f-istiod-ca-cert\") pod \"e2e-derive-1890c174-openshift-default-5b55649bff-np2n8\" (UID: \"6c21e46c-1f07-499e-8071-df00fe79095f\") " pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8"
Jul 13 17:08:20.893259 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:20.893239    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c21e46c-1f07-499e-8071-df00fe79095f-istio-envoy\") pod \"e2e-derive-1890c174-openshift-default-5b55649bff-np2n8\" (UID: \"6c21e46c-1f07-499e-8071-df00fe79095f\") " pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8"
Jul 13 17:08:20.893505 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:20.893486    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c21e46c-1f07-499e-8071-df00fe79095f-istio-podinfo\") pod \"e2e-derive-1890c174-openshift-default-5b55649bff-np2n8\" (UID: \"6c21e46c-1f07-499e-8071-df00fe79095f\") " pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8"
Jul 13 17:08:20.899859 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:20.899839    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c21e46c-1f07-499e-8071-df00fe79095f-istio-token\") pod \"e2e-derive-1890c174-openshift-default-5b55649bff-np2n8\" (UID: \"6c21e46c-1f07-499e-8071-df00fe79095f\") " pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8"
Jul 13 17:08:20.900013 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:20.899997    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8glq\" (UniqueName: \"kubernetes.io/projected/6c21e46c-1f07-499e-8071-df00fe79095f-kube-api-access-b8glq\") pod \"e2e-derive-1890c174-openshift-default-5b55649bff-np2n8\" (UID: \"6c21e46c-1f07-499e-8071-df00fe79095f\") " pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8"
Jul 13 17:08:21.054324 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:21.054238    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8"
Jul 13 17:08:21.197800 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:21.197779    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8"]
Jul 13 17:08:21.199482 ip-10-0-143-51 kubenswrapper[2573]: W0713 17:08:21.199438    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c21e46c_1f07_499e_8071_df00fe79095f.slice/crio-09be03353eda4f89a9fca15fd789e8c33df01a80f97897b5315f5e506f83b4fb WatchSource:0}: Error finding container 09be03353eda4f89a9fca15fd789e8c33df01a80f97897b5315f5e506f83b4fb: Status 404 returned error can't find the container with id 09be03353eda4f89a9fca15fd789e8c33df01a80f97897b5315f5e506f83b4fb
Jul 13 17:08:21.201682 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:21.201644    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:08:21.201795 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:21.201775    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:08:21.201840 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:21.201830    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:08:21.577132 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:21.577092    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8" event={"ID":"6c21e46c-1f07-499e-8071-df00fe79095f","Type":"ContainerStarted","Data":"bb412d94ee773e23dac1bcb5124b75f419de37411e2a701197262528fe481a73"}
Jul 13 17:08:21.577611 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:21.577188    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8" event={"ID":"6c21e46c-1f07-499e-8071-df00fe79095f","Type":"ContainerStarted","Data":"09be03353eda4f89a9fca15fd789e8c33df01a80f97897b5315f5e506f83b4fb"}
Jul 13 17:08:21.598760 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:21.598696    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8" podStartSLOduration=1.598682257 podStartE2EDuration="1.598682257s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:08:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:08:21.597193296 +0000 UTC m=+1698.955500123" watchObservedRunningTime="2026-07-13 17:08:21.598682257 +0000 UTC m=+1698.956989131"
Jul 13 17:08:21.890919 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:21.890836    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:08:21.969343 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:21.969311    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:08:22.034107 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:22.034071    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:08:22.055148 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:22.055116    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8"
Jul 13 17:08:22.060274 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:22.060251    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8"
Jul 13 17:08:22.349571 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:22.349541    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:08:22.541297 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:22.541266    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:08:22.581366 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:22.581339    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8"
Jul 13 17:08:22.582400 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:22.582381    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8"
Jul 13 17:08:22.690181 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:22.690157    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:08:25.598962 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:25.598924    2573 generic.go:356] "Generic (PLEG): container finished" podID="2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e" containerID="e4ce7ee29365589fb040c011e994061af4b8f0d2f2ff3785763aae5f9116f03b" exitCode=0
Jul 13 17:08:25.599414 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:25.598992    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm" event={"ID":"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e","Type":"ContainerDied","Data":"e4ce7ee29365589fb040c011e994061af4b8f0d2f2ff3785763aae5f9116f03b"}
Jul 13 17:08:25.599414 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:25.599056    2573 scope.go:117] "RemoveContainer" containerID="519e94a4da7399e253aa5f2e4dc3ad017cc682be6594f65ddcb294127ec19390"
Jul 13 17:08:25.655295 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:25.655274    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm"
Jul 13 17:08:25.739754 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:25.739088    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-workload-certs\") pod \"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e\" (UID: \"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e\") "
Jul 13 17:08:25.739754 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:25.739137    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-istio-envoy\") pod \"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e\" (UID: \"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e\") "
Jul 13 17:08:25.739754 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:25.739171    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-istiod-ca-cert\") pod \"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e\" (UID: \"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e\") "
Jul 13 17:08:25.739754 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:25.739210    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-istio-token\") pod \"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e\" (UID: \"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e\") "
Jul 13 17:08:25.739754 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:25.739238    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6swg\" (UniqueName: \"kubernetes.io/projected/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-kube-api-access-z6swg\") pod \"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e\" (UID: \"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e\") "
Jul 13 17:08:25.739754 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:25.739278    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-istio-data\") pod \"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e\" (UID: \"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e\") "
Jul 13 17:08:25.739754 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:25.739319    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-workload-socket\") pod \"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e\" (UID: \"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e\") "
Jul 13 17:08:25.739754 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:25.739393    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-istio-podinfo\") pod \"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e\" (UID: \"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e\") "
Jul 13 17:08:25.739754 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:25.739424    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-credential-socket\") pod \"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e\" (UID: \"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e\") "
Jul 13 17:08:25.740344 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:25.739920    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e" (UID: "2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:08:25.740344 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:25.740138    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e" (UID: "2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:08:25.742781 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:25.741022    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e" (UID: "2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:08:25.742781 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:25.741871    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-istio-data" (OuterVolumeSpecName: "istio-data") pod "2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e" (UID: "2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:08:25.742781 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:25.742747    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e" (UID: "2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:08:25.748178 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:25.748139    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-kube-api-access-z6swg" (OuterVolumeSpecName: "kube-api-access-z6swg") pod "2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e" (UID: "2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e"). InnerVolumeSpecName "kube-api-access-z6swg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:08:25.750263 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:25.750226    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-istio-token" (OuterVolumeSpecName: "istio-token") pod "2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e" (UID: "2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:08:25.771973 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:25.771898    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e" (UID: "2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 17:08:25.772205 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:25.772169    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e" (UID: "2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:08:25.848260 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:25.848220    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-istio-podinfo\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:08:25.848260 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:25.848258    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-credential-socket\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:08:25.848514 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:25.848274    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-workload-certs\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:08:25.848514 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:25.848287    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-istio-envoy\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:08:25.848514 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:25.848302    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-istiod-ca-cert\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:08:25.848514 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:25.848314    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-istio-token\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:08:25.848514 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:25.848327    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6swg\" (UniqueName: \"kubernetes.io/projected/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-kube-api-access-z6swg\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:08:25.848514 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:25.848341    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-istio-data\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:08:25.848514 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:25.848354    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e-workload-socket\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:08:26.609694 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:26.609657    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm" event={"ID":"2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e","Type":"ContainerDied","Data":"03d6e54d4bdffd4f3c7f7d0083e6d591702aa646077a6ac035b1bf9a4e32531f"}
Jul 13 17:08:26.610164 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:26.609755    2573 scope.go:117] "RemoveContainer" containerID="e4ce7ee29365589fb040c011e994061af4b8f0d2f2ff3785763aae5f9116f03b"
Jul 13 17:08:26.610164 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:26.609674    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm"
Jul 13 17:08:26.631275 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:26.631249    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm"]
Jul 13 17:08:26.635666 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:26.635646    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-97e65980-openshift-default-578c47485-9j4gm"]
Jul 13 17:08:27.150778 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:27.150734    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e" path="/var/lib/kubelet/pods/2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e/volumes"
Jul 13 17:08:32.195487 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:32.195459    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:08:32.252150 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:32.252120    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:08:32.640047 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:32.640015    2573 generic.go:356] "Generic (PLEG): container finished" podID="6c21e46c-1f07-499e-8071-df00fe79095f" containerID="bb412d94ee773e23dac1bcb5124b75f419de37411e2a701197262528fe481a73" exitCode=0
Jul 13 17:08:32.640236 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:32.640089    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8" event={"ID":"6c21e46c-1f07-499e-8071-df00fe79095f","Type":"ContainerDied","Data":"bb412d94ee773e23dac1bcb5124b75f419de37411e2a701197262528fe481a73"}
Jul 13 17:08:32.640493 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:32.640479    2573 scope.go:117] "RemoveContainer" containerID="bb412d94ee773e23dac1bcb5124b75f419de37411e2a701197262528fe481a73"
Jul 13 17:08:32.641598 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:32.641568    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:08:32.641669 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:32.641653    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:08:32.641753 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:32.641714    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:08:33.651576 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:33.650593    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8" event={"ID":"6c21e46c-1f07-499e-8071-df00fe79095f","Type":"ContainerStarted","Data":"388d3fd7b15c47ae5477666a1f60606b21ff1827b12af51ae3fa22f2e14fbfc1"}
Jul 13 17:08:34.056637 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:34.056603    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8"
Jul 13 17:08:34.057013 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:34.056991    2573 patch_prober.go:28] interesting pod/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 13 17:08:34.057197 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:34.057170    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8" podUID="6c21e46c-1f07-499e-8071-df00fe79095f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 13 17:08:35.055429 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:35.055391    2573 patch_prober.go:28] interesting pod/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 13 17:08:35.056055 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:35.056021    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8" podUID="6c21e46c-1f07-499e-8071-df00fe79095f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 13 17:08:35.898145 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:35.898112    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:08:36.055091 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:36.055056    2573 patch_prober.go:28] interesting pod/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 13 17:08:36.055363 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:36.055333    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8" podUID="6c21e46c-1f07-499e-8071-df00fe79095f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 13 17:08:37.054846 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:37.054808    2573 patch_prober.go:28] interesting pod/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 13 17:08:37.055319 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:37.054871    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8" podUID="6c21e46c-1f07-499e-8071-df00fe79095f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 13 17:08:37.582153 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:37.582116    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8"
Jul 13 17:08:38.059305 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:38.059269    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8"
Jul 13 17:08:38.060191 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:38.060170    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8"
Jul 13 17:08:55.861282 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:08:55.861236    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:09:08.377591 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:08.377541    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:09:08.478860 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:08.478817    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:09:16.889515 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:16.889480    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:09:16.989391 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:16.989358    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:09:26.885842 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:26.885807    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:09:31.466664 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:31.466625    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:09:37.382117 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:37.382080    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:09:37.484420 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:37.484386    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:09:41.640059 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:41.640029    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8"]
Jul 13 17:09:41.640517 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:41.640205    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8" podUID="6c21e46c-1f07-499e-8071-df00fe79095f" containerName="istio-proxy" containerID="cri-o://388d3fd7b15c47ae5477666a1f60606b21ff1827b12af51ae3fa22f2e14fbfc1" gracePeriod=30
Jul 13 17:09:41.664205 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:41.664153    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:09:42.304492 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:42.304393    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:09:42.396200 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:42.396170    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:09:42.496004 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:42.495967    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:09:44.028002 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:44.027972    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:09:46.931618 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:46.931591    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8"
Jul 13 17:09:46.971224 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:46.971191    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c21e46c-1f07-499e-8071-df00fe79095f-istiod-ca-cert\") pod \"6c21e46c-1f07-499e-8071-df00fe79095f\" (UID: \"6c21e46c-1f07-499e-8071-df00fe79095f\") "
Jul 13 17:09:46.971398 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:46.971292    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c21e46c-1f07-499e-8071-df00fe79095f-workload-certs\") pod \"6c21e46c-1f07-499e-8071-df00fe79095f\" (UID: \"6c21e46c-1f07-499e-8071-df00fe79095f\") "
Jul 13 17:09:46.971398 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:46.971322    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c21e46c-1f07-499e-8071-df00fe79095f-istio-envoy\") pod \"6c21e46c-1f07-499e-8071-df00fe79095f\" (UID: \"6c21e46c-1f07-499e-8071-df00fe79095f\") "
Jul 13 17:09:46.971398 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:46.971355    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c21e46c-1f07-499e-8071-df00fe79095f-istio-data\") pod \"6c21e46c-1f07-499e-8071-df00fe79095f\" (UID: \"6c21e46c-1f07-499e-8071-df00fe79095f\") "
Jul 13 17:09:46.971572 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:46.971411    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c21e46c-1f07-499e-8071-df00fe79095f-workload-socket\") pod \"6c21e46c-1f07-499e-8071-df00fe79095f\" (UID: \"6c21e46c-1f07-499e-8071-df00fe79095f\") "
Jul 13 17:09:46.971572 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:46.971438    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8glq\" (UniqueName: \"kubernetes.io/projected/6c21e46c-1f07-499e-8071-df00fe79095f-kube-api-access-b8glq\") pod \"6c21e46c-1f07-499e-8071-df00fe79095f\" (UID: \"6c21e46c-1f07-499e-8071-df00fe79095f\") "
Jul 13 17:09:46.971572 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:46.971466    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c21e46c-1f07-499e-8071-df00fe79095f-istio-token\") pod \"6c21e46c-1f07-499e-8071-df00fe79095f\" (UID: \"6c21e46c-1f07-499e-8071-df00fe79095f\") "
Jul 13 17:09:46.971572 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:46.971507    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c21e46c-1f07-499e-8071-df00fe79095f-istio-podinfo\") pod \"6c21e46c-1f07-499e-8071-df00fe79095f\" (UID: \"6c21e46c-1f07-499e-8071-df00fe79095f\") "
Jul 13 17:09:46.971572 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:46.971536    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c21e46c-1f07-499e-8071-df00fe79095f-credential-socket\") pod \"6c21e46c-1f07-499e-8071-df00fe79095f\" (UID: \"6c21e46c-1f07-499e-8071-df00fe79095f\") "
Jul 13 17:09:46.971865 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:46.971609    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c21e46c-1f07-499e-8071-df00fe79095f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6c21e46c-1f07-499e-8071-df00fe79095f" (UID: "6c21e46c-1f07-499e-8071-df00fe79095f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:09:46.971976 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:46.971954    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c21e46c-1f07-499e-8071-df00fe79095f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6c21e46c-1f07-499e-8071-df00fe79095f" (UID: "6c21e46c-1f07-499e-8071-df00fe79095f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:09:46.972135 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:46.971912    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c21e46c-1f07-499e-8071-df00fe79095f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6c21e46c-1f07-499e-8071-df00fe79095f" (UID: "6c21e46c-1f07-499e-8071-df00fe79095f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:09:46.972232 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:46.972163    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c21e46c-1f07-499e-8071-df00fe79095f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6c21e46c-1f07-499e-8071-df00fe79095f" (UID: "6c21e46c-1f07-499e-8071-df00fe79095f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:09:46.972352 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:46.971958    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c21e46c-1f07-499e-8071-df00fe79095f-istiod-ca-cert\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:09:46.972872 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:46.972840    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c21e46c-1f07-499e-8071-df00fe79095f-istio-data" (OuterVolumeSpecName: "istio-data") pod "6c21e46c-1f07-499e-8071-df00fe79095f" (UID: "6c21e46c-1f07-499e-8071-df00fe79095f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:09:46.974614 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:46.974520    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c21e46c-1f07-499e-8071-df00fe79095f-kube-api-access-b8glq" (OuterVolumeSpecName: "kube-api-access-b8glq") pod "6c21e46c-1f07-499e-8071-df00fe79095f" (UID: "6c21e46c-1f07-499e-8071-df00fe79095f"). InnerVolumeSpecName "kube-api-access-b8glq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:09:46.974614 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:46.974578    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c21e46c-1f07-499e-8071-df00fe79095f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6c21e46c-1f07-499e-8071-df00fe79095f" (UID: "6c21e46c-1f07-499e-8071-df00fe79095f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:09:46.974897 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:46.974640    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6c21e46c-1f07-499e-8071-df00fe79095f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6c21e46c-1f07-499e-8071-df00fe79095f" (UID: "6c21e46c-1f07-499e-8071-df00fe79095f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 17:09:46.974980 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:46.974957    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c21e46c-1f07-499e-8071-df00fe79095f-istio-token" (OuterVolumeSpecName: "istio-token") pod "6c21e46c-1f07-499e-8071-df00fe79095f" (UID: "6c21e46c-1f07-499e-8071-df00fe79095f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:09:47.009110 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:47.009072    2573 generic.go:356] "Generic (PLEG): container finished" podID="6c21e46c-1f07-499e-8071-df00fe79095f" containerID="388d3fd7b15c47ae5477666a1f60606b21ff1827b12af51ae3fa22f2e14fbfc1" exitCode=0
Jul 13 17:09:47.009262 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:47.009118    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8" event={"ID":"6c21e46c-1f07-499e-8071-df00fe79095f","Type":"ContainerDied","Data":"388d3fd7b15c47ae5477666a1f60606b21ff1827b12af51ae3fa22f2e14fbfc1"}
Jul 13 17:09:47.009262 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:47.009167    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8" event={"ID":"6c21e46c-1f07-499e-8071-df00fe79095f","Type":"ContainerDied","Data":"09be03353eda4f89a9fca15fd789e8c33df01a80f97897b5315f5e506f83b4fb"}
Jul 13 17:09:47.009262 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:47.009122    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8"
Jul 13 17:09:47.009262 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:47.009200    2573 scope.go:117] "RemoveContainer" containerID="388d3fd7b15c47ae5477666a1f60606b21ff1827b12af51ae3fa22f2e14fbfc1"
Jul 13 17:09:47.018855 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:47.018823    2573 scope.go:117] "RemoveContainer" containerID="bb412d94ee773e23dac1bcb5124b75f419de37411e2a701197262528fe481a73"
Jul 13 17:09:47.028315 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:47.028291    2573 scope.go:117] "RemoveContainer" containerID="388d3fd7b15c47ae5477666a1f60606b21ff1827b12af51ae3fa22f2e14fbfc1"
Jul 13 17:09:47.028630 ip-10-0-143-51 kubenswrapper[2573]: E0713 17:09:47.028604    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"388d3fd7b15c47ae5477666a1f60606b21ff1827b12af51ae3fa22f2e14fbfc1\": container with ID starting with 388d3fd7b15c47ae5477666a1f60606b21ff1827b12af51ae3fa22f2e14fbfc1 not found: ID does not exist" containerID="388d3fd7b15c47ae5477666a1f60606b21ff1827b12af51ae3fa22f2e14fbfc1"
Jul 13 17:09:47.028690 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:47.028644    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"388d3fd7b15c47ae5477666a1f60606b21ff1827b12af51ae3fa22f2e14fbfc1"} err="failed to get container status \"388d3fd7b15c47ae5477666a1f60606b21ff1827b12af51ae3fa22f2e14fbfc1\": rpc error: code = NotFound desc = could not find container \"388d3fd7b15c47ae5477666a1f60606b21ff1827b12af51ae3fa22f2e14fbfc1\": container with ID starting with 388d3fd7b15c47ae5477666a1f60606b21ff1827b12af51ae3fa22f2e14fbfc1 not found: ID does not exist"
Jul 13 17:09:47.028690 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:47.028671    2573 scope.go:117] "RemoveContainer" containerID="bb412d94ee773e23dac1bcb5124b75f419de37411e2a701197262528fe481a73"
Jul 13 17:09:47.028981 ip-10-0-143-51 kubenswrapper[2573]: E0713 17:09:47.028963    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb412d94ee773e23dac1bcb5124b75f419de37411e2a701197262528fe481a73\": container with ID starting with bb412d94ee773e23dac1bcb5124b75f419de37411e2a701197262528fe481a73 not found: ID does not exist" containerID="bb412d94ee773e23dac1bcb5124b75f419de37411e2a701197262528fe481a73"
Jul 13 17:09:47.029045 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:47.028990    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb412d94ee773e23dac1bcb5124b75f419de37411e2a701197262528fe481a73"} err="failed to get container status \"bb412d94ee773e23dac1bcb5124b75f419de37411e2a701197262528fe481a73\": rpc error: code = NotFound desc = could not find container \"bb412d94ee773e23dac1bcb5124b75f419de37411e2a701197262528fe481a73\": container with ID starting with bb412d94ee773e23dac1bcb5124b75f419de37411e2a701197262528fe481a73 not found: ID does not exist"
Jul 13 17:09:47.036794 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:47.036769    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8"]
Jul 13 17:09:47.042475 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:47.042451    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-1890c174-openshift-default-5b55649bff-np2n8"]
Jul 13 17:09:47.073560 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:47.073521    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c21e46c-1f07-499e-8071-df00fe79095f-workload-certs\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:09:47.073560 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:47.073550    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c21e46c-1f07-499e-8071-df00fe79095f-istio-envoy\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:09:47.073560 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:47.073560    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c21e46c-1f07-499e-8071-df00fe79095f-istio-data\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:09:47.073790 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:47.073572    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c21e46c-1f07-499e-8071-df00fe79095f-workload-socket\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:09:47.073790 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:47.073582    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8glq\" (UniqueName: \"kubernetes.io/projected/6c21e46c-1f07-499e-8071-df00fe79095f-kube-api-access-b8glq\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:09:47.073790 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:47.073591    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c21e46c-1f07-499e-8071-df00fe79095f-istio-token\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:09:47.073790 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:47.073600    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c21e46c-1f07-499e-8071-df00fe79095f-istio-podinfo\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:09:47.073790 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:47.073607    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c21e46c-1f07-499e-8071-df00fe79095f-credential-socket\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:09:47.147864 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:47.147831    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c21e46c-1f07-499e-8071-df00fe79095f" path="/var/lib/kubelet/pods/6c21e46c-1f07-499e-8071-df00fe79095f/volumes"
Jul 13 17:09:48.108091 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:48.108066    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:09:49.993364 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:49.993330    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:09:50.101390 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:50.101345    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:09:50.196440 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:50.196410    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:09:50.296834 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:50.296733    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:09:50.817399 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:09:50.817364    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:10:03.146963 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:10:03.146931    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnxdg_e1fb6130-2ab7-40f5-831c-ea95ff241f37/ovn-acl-logging/0.log"
Jul 13 17:10:03.148781 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:10:03.148761    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnxdg_e1fb6130-2ab7-40f5-831c-ea95ff241f37/ovn-acl-logging/0.log"
Jul 13 17:10:16.851555 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:10:16.851521    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:10:22.610853 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:10:22.610815    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:10:22.675340 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:10:22.675306    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:10:22.757539 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:10:22.757507    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:10:22.858544 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:10:22.858511    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:10:38.761052 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:10:38.761017    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:10:44.835715 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:10:44.835685    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:10:44.909555 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:10:44.909521    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:10:45.070932 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:10:45.070883    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:10:45.175127 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:10:45.175048    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:10:55.675263 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:10:55.675208    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:10:56.495441 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:10:56.495410    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:11:02.539442 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:02.539410    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:11:02.659284 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:02.659246    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:11:02.741430 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:02.741395    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:11:02.794681 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:02.794594    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:11:03.693772 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:03.693692    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:11:03.789012 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:03.788971    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:11:03.884639 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:03.884606    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:11:05.607444 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:05.607408    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:11:11.693651 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:11.693612    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:11:11.795127 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:11.795090    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:11:12.384813 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:12.384780    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:11:18.488061 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:18.488021    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:11:18.588847 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:18.588814    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:11:18.739789 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:18.739685    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:11:19.035774 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.035669    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c"]
Jul 13 17:11:19.036765 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.036712    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c21e46c-1f07-499e-8071-df00fe79095f" containerName="istio-proxy"
Jul 13 17:11:19.036765 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.036764    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c21e46c-1f07-499e-8071-df00fe79095f" containerName="istio-proxy"
Jul 13 17:11:19.036950 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.036790    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e" containerName="istio-proxy"
Jul 13 17:11:19.036950 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.036800    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e" containerName="istio-proxy"
Jul 13 17:11:19.036950 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.036834    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c21e46c-1f07-499e-8071-df00fe79095f" containerName="istio-proxy"
Jul 13 17:11:19.036950 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.036845    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c21e46c-1f07-499e-8071-df00fe79095f" containerName="istio-proxy"
Jul 13 17:11:19.036950 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.036863    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e" containerName="istio-proxy"
Jul 13 17:11:19.036950 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.036871    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e" containerName="istio-proxy"
Jul 13 17:11:19.037182 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.036984    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c21e46c-1f07-499e-8071-df00fe79095f" containerName="istio-proxy"
Jul 13 17:11:19.037182 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.036997    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c21e46c-1f07-499e-8071-df00fe79095f" containerName="istio-proxy"
Jul 13 17:11:19.037182 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.037009    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e" containerName="istio-proxy"
Jul 13 17:11:19.037182 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.037019    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e5cc3c1-dbfa-4beb-8ff3-56e9c9a4bc8e" containerName="istio-proxy"
Jul 13 17:11:19.040254 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.040233    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c"
Jul 13 17:11:19.042954 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.042935    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-45a43c1d-openshift-default-dockercfg-2zbc2\""
Jul 13 17:11:19.059548 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.059520    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c"]
Jul 13 17:11:19.083966 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.083944    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:11:19.143794 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.143761    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc361054-f272-4618-adb9-69702f8833a0-workload-socket\") pod \"e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c\" (UID: \"cc361054-f272-4618-adb9-69702f8833a0\") " pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c"
Jul 13 17:11:19.144022 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.144003    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc361054-f272-4618-adb9-69702f8833a0-credential-socket\") pod \"e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c\" (UID: \"cc361054-f272-4618-adb9-69702f8833a0\") " pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c"
Jul 13 17:11:19.144161 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.144144    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc361054-f272-4618-adb9-69702f8833a0-istio-envoy\") pod \"e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c\" (UID: \"cc361054-f272-4618-adb9-69702f8833a0\") " pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c"
Jul 13 17:11:19.144339 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.144305    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc361054-f272-4618-adb9-69702f8833a0-istio-data\") pod \"e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c\" (UID: \"cc361054-f272-4618-adb9-69702f8833a0\") " pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c"
Jul 13 17:11:19.144553 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.144522    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc361054-f272-4618-adb9-69702f8833a0-istio-podinfo\") pod \"e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c\" (UID: \"cc361054-f272-4618-adb9-69702f8833a0\") " pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c"
Jul 13 17:11:19.144713 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.144693    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc361054-f272-4618-adb9-69702f8833a0-workload-certs\") pod \"e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c\" (UID: \"cc361054-f272-4618-adb9-69702f8833a0\") " pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c"
Jul 13 17:11:19.144867 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.144836    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc361054-f272-4618-adb9-69702f8833a0-istiod-ca-cert\") pod \"e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c\" (UID: \"cc361054-f272-4618-adb9-69702f8833a0\") " pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c"
Jul 13 17:11:19.144991 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.144884    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc361054-f272-4618-adb9-69702f8833a0-istio-token\") pod \"e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c\" (UID: \"cc361054-f272-4618-adb9-69702f8833a0\") " pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c"
Jul 13 17:11:19.144991 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.144909    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnkpm\" (UniqueName: \"kubernetes.io/projected/cc361054-f272-4618-adb9-69702f8833a0-kube-api-access-fnkpm\") pod \"e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c\" (UID: \"cc361054-f272-4618-adb9-69702f8833a0\") " pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c"
Jul 13 17:11:19.246255 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.246218    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc361054-f272-4618-adb9-69702f8833a0-istio-podinfo\") pod \"e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c\" (UID: \"cc361054-f272-4618-adb9-69702f8833a0\") " pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c"
Jul 13 17:11:19.246443 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.246271    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc361054-f272-4618-adb9-69702f8833a0-workload-certs\") pod \"e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c\" (UID: \"cc361054-f272-4618-adb9-69702f8833a0\") " pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c"
Jul 13 17:11:19.246443 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.246296    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc361054-f272-4618-adb9-69702f8833a0-istiod-ca-cert\") pod \"e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c\" (UID: \"cc361054-f272-4618-adb9-69702f8833a0\") " pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c"
Jul 13 17:11:19.246443 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.246330    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc361054-f272-4618-adb9-69702f8833a0-istio-token\") pod \"e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c\" (UID: \"cc361054-f272-4618-adb9-69702f8833a0\") " pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c"
Jul 13 17:11:19.246443 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.246349    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnkpm\" (UniqueName: \"kubernetes.io/projected/cc361054-f272-4618-adb9-69702f8833a0-kube-api-access-fnkpm\") pod \"e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c\" (UID: \"cc361054-f272-4618-adb9-69702f8833a0\") " pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c"
Jul 13 17:11:19.246443 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.246383    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc361054-f272-4618-adb9-69702f8833a0-workload-socket\") pod \"e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c\" (UID: \"cc361054-f272-4618-adb9-69702f8833a0\") " pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c"
Jul 13 17:11:19.246443 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.246407    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc361054-f272-4618-adb9-69702f8833a0-credential-socket\") pod \"e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c\" (UID: \"cc361054-f272-4618-adb9-69702f8833a0\") " pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c"
Jul 13 17:11:19.246443 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.246424    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc361054-f272-4618-adb9-69702f8833a0-istio-envoy\") pod \"e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c\" (UID: \"cc361054-f272-4618-adb9-69702f8833a0\") " pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c"
Jul 13 17:11:19.246830 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.246503    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc361054-f272-4618-adb9-69702f8833a0-istio-data\") pod \"e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c\" (UID: \"cc361054-f272-4618-adb9-69702f8833a0\") " pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c"
Jul 13 17:11:19.246830 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.246704    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc361054-f272-4618-adb9-69702f8833a0-workload-certs\") pod \"e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c\" (UID: \"cc361054-f272-4618-adb9-69702f8833a0\") " pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c"
Jul 13 17:11:19.246830 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.246811    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc361054-f272-4618-adb9-69702f8833a0-istio-data\") pod \"e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c\" (UID: \"cc361054-f272-4618-adb9-69702f8833a0\") " pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c"
Jul 13 17:11:19.246978 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.246858    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc361054-f272-4618-adb9-69702f8833a0-workload-socket\") pod \"e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c\" (UID: \"cc361054-f272-4618-adb9-69702f8833a0\") " pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c"
Jul 13 17:11:19.247380 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.247358    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc361054-f272-4618-adb9-69702f8833a0-credential-socket\") pod \"e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c\" (UID: \"cc361054-f272-4618-adb9-69702f8833a0\") " pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c"
Jul 13 17:11:19.247555 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.247376    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc361054-f272-4618-adb9-69702f8833a0-istiod-ca-cert\") pod \"e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c\" (UID: \"cc361054-f272-4618-adb9-69702f8833a0\") " pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c"
Jul 13 17:11:19.249114 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.249083    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc361054-f272-4618-adb9-69702f8833a0-istio-podinfo\") pod \"e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c\" (UID: \"cc361054-f272-4618-adb9-69702f8833a0\") " pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c"
Jul 13 17:11:19.249404 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.249384    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc361054-f272-4618-adb9-69702f8833a0-istio-envoy\") pod \"e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c\" (UID: \"cc361054-f272-4618-adb9-69702f8833a0\") " pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c"
Jul 13 17:11:19.256348 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.256328    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc361054-f272-4618-adb9-69702f8833a0-istio-token\") pod \"e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c\" (UID: \"cc361054-f272-4618-adb9-69702f8833a0\") " pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c"
Jul 13 17:11:19.256483 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.256462    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnkpm\" (UniqueName: \"kubernetes.io/projected/cc361054-f272-4618-adb9-69702f8833a0-kube-api-access-fnkpm\") pod \"e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c\" (UID: \"cc361054-f272-4618-adb9-69702f8833a0\") " pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c"
Jul 13 17:11:19.315744 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.315647    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:11:19.350809 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.350774    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c"
Jul 13 17:11:19.498054 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.498023    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c"]
Jul 13 17:11:19.498531 ip-10-0-143-51 kubenswrapper[2573]: W0713 17:11:19.498511    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc361054_f272_4618_adb9_69702f8833a0.slice/crio-fd768b880ff16a4c550587eba8aac8175297e64d6f78ca27c4f7a748360d8f46 WatchSource:0}: Error finding container fd768b880ff16a4c550587eba8aac8175297e64d6f78ca27c4f7a748360d8f46: Status 404 returned error can't find the container with id fd768b880ff16a4c550587eba8aac8175297e64d6f78ca27c4f7a748360d8f46
Jul 13 17:11:19.500640 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.500610    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:11:19.500779 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.500671    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:11:19.500779 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:19.500699    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:11:20.439074 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:20.439037    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c" event={"ID":"cc361054-f272-4618-adb9-69702f8833a0","Type":"ContainerStarted","Data":"cdc3afb581753b8c5d4bb1c20f5a3cfbbde5f5c0f6d01934e80558a5a87f1ab6"}
Jul 13 17:11:20.439286 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:20.439097    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c" event={"ID":"cc361054-f272-4618-adb9-69702f8833a0","Type":"ContainerStarted","Data":"fd768b880ff16a4c550587eba8aac8175297e64d6f78ca27c4f7a748360d8f46"}
Jul 13 17:11:20.462348 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:20.462290    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c" podStartSLOduration=1.462272134 podStartE2EDuration="1.462272134s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:11:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:11:20.460467814 +0000 UTC m=+1877.818774651" watchObservedRunningTime="2026-07-13 17:11:20.462272134 +0000 UTC m=+1877.820578960"
Jul 13 17:11:21.351053 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:21.351019    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c"
Jul 13 17:11:21.356021 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:21.355995    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c"
Jul 13 17:11:21.445855 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:21.445827    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c"
Jul 13 17:11:21.446676 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:21.446657    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c"
Jul 13 17:11:22.418292 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:22.418257    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:11:22.503236 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:22.503202    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:11:22.573429 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:22.573397    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:11:22.872289 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:22.872254    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:11:23.080616 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:23.080574    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:11:23.180642 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:23.180548    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:11:26.928085 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:26.928002    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:11:27.662546 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:27.662509    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:11:27.755251 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:27.755220    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:11:28.113267 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:28.113237    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:11:34.063529 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:34.063493    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:11:34.206413 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:34.206386    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:11:35.518969 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:35.518938    2573 generic.go:356] "Generic (PLEG): container finished" podID="cc361054-f272-4618-adb9-69702f8833a0" containerID="cdc3afb581753b8c5d4bb1c20f5a3cfbbde5f5c0f6d01934e80558a5a87f1ab6" exitCode=0
Jul 13 17:11:35.519347 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:35.519010    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c" event={"ID":"cc361054-f272-4618-adb9-69702f8833a0","Type":"ContainerDied","Data":"cdc3afb581753b8c5d4bb1c20f5a3cfbbde5f5c0f6d01934e80558a5a87f1ab6"}
Jul 13 17:11:35.519389 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:35.519372    2573 scope.go:117] "RemoveContainer" containerID="cdc3afb581753b8c5d4bb1c20f5a3cfbbde5f5c0f6d01934e80558a5a87f1ab6"
Jul 13 17:11:35.520436 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:35.520383    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:11:35.520510 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:35.520453    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:11:35.520510 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:35.520483    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:11:36.446325 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:36.446283    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c"
Jul 13 17:11:36.525684 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:36.525655    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c" event={"ID":"cc361054-f272-4618-adb9-69702f8833a0","Type":"ContainerStarted","Data":"6a25cba7d0087aa875518cae53a15aaf42b9eae2242013ece9bbabb1fce8d877"}
Jul 13 17:11:37.351751 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:37.351702    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c"
Jul 13 17:11:37.362380 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:37.362332    2573 patch_prober.go:28] interesting pod/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 13 17:11:37.362560 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:37.362403    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c" podUID="cc361054-f272-4618-adb9-69702f8833a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 13 17:11:38.352129 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:38.352091    2573 patch_prober.go:28] interesting pod/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 13 17:11:38.352769 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:38.352711    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c" podUID="cc361054-f272-4618-adb9-69702f8833a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 13 17:11:39.351561 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:39.351523    2573 patch_prober.go:28] interesting pod/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 13 17:11:39.351878 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:39.351849    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c" podUID="cc361054-f272-4618-adb9-69702f8833a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 13 17:11:40.355714 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:40.355687    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c"
Jul 13 17:11:40.356196 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:40.356178    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c"
Jul 13 17:11:40.356735 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:40.356698    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c"
Jul 13 17:11:44.961128 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:44.961098    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:11:49.584806 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:49.584769    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:11:55.578692 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:55.578658    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:11:55.662528 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:11:55.662493    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:12:00.329382 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:00.329353    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c"]
Jul 13 17:12:00.329930 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:00.329546    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c" podUID="cc361054-f272-4618-adb9-69702f8833a0" containerName="istio-proxy" containerID="cri-o://6a25cba7d0087aa875518cae53a15aaf42b9eae2242013ece9bbabb1fce8d877" gracePeriod=30
Jul 13 17:12:00.355923 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:00.355884    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:12:00.613698 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:00.613617    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:12:00.751227 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:00.751200    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:12:00.912065 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:00.911973    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:12:01.077741 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:01.077692    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:12:05.580080 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:05.580056    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c"
Jul 13 17:12:05.648566 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:05.648471    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc361054-f272-4618-adb9-69702f8833a0-istio-envoy\") pod \"cc361054-f272-4618-adb9-69702f8833a0\" (UID: \"cc361054-f272-4618-adb9-69702f8833a0\") "
Jul 13 17:12:05.648566 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:05.648513    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc361054-f272-4618-adb9-69702f8833a0-workload-certs\") pod \"cc361054-f272-4618-adb9-69702f8833a0\" (UID: \"cc361054-f272-4618-adb9-69702f8833a0\") "
Jul 13 17:12:05.648566 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:05.648539    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnkpm\" (UniqueName: \"kubernetes.io/projected/cc361054-f272-4618-adb9-69702f8833a0-kube-api-access-fnkpm\") pod \"cc361054-f272-4618-adb9-69702f8833a0\" (UID: \"cc361054-f272-4618-adb9-69702f8833a0\") "
Jul 13 17:12:05.648566 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:05.648556    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc361054-f272-4618-adb9-69702f8833a0-istio-token\") pod \"cc361054-f272-4618-adb9-69702f8833a0\" (UID: \"cc361054-f272-4618-adb9-69702f8833a0\") "
Jul 13 17:12:05.648943 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:05.648591    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc361054-f272-4618-adb9-69702f8833a0-istio-data\") pod \"cc361054-f272-4618-adb9-69702f8833a0\" (UID: \"cc361054-f272-4618-adb9-69702f8833a0\") "
Jul 13 17:12:05.648943 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:05.648625    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc361054-f272-4618-adb9-69702f8833a0-istio-podinfo\") pod \"cc361054-f272-4618-adb9-69702f8833a0\" (UID: \"cc361054-f272-4618-adb9-69702f8833a0\") "
Jul 13 17:12:05.648943 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:05.648652    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc361054-f272-4618-adb9-69702f8833a0-istiod-ca-cert\") pod \"cc361054-f272-4618-adb9-69702f8833a0\" (UID: \"cc361054-f272-4618-adb9-69702f8833a0\") "
Jul 13 17:12:05.648943 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:05.648671    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc361054-f272-4618-adb9-69702f8833a0-credential-socket\") pod \"cc361054-f272-4618-adb9-69702f8833a0\" (UID: \"cc361054-f272-4618-adb9-69702f8833a0\") "
Jul 13 17:12:05.648943 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:05.648693    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc361054-f272-4618-adb9-69702f8833a0-workload-socket\") pod \"cc361054-f272-4618-adb9-69702f8833a0\" (UID: \"cc361054-f272-4618-adb9-69702f8833a0\") "
Jul 13 17:12:05.648943 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:05.648788    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc361054-f272-4618-adb9-69702f8833a0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cc361054-f272-4618-adb9-69702f8833a0" (UID: "cc361054-f272-4618-adb9-69702f8833a0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:12:05.649263 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:05.648996    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc361054-f272-4618-adb9-69702f8833a0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cc361054-f272-4618-adb9-69702f8833a0" (UID: "cc361054-f272-4618-adb9-69702f8833a0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:12:05.649263 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:05.649156    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc361054-f272-4618-adb9-69702f8833a0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cc361054-f272-4618-adb9-69702f8833a0" (UID: "cc361054-f272-4618-adb9-69702f8833a0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:12:05.649263 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:05.649221    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc361054-f272-4618-adb9-69702f8833a0-workload-certs\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:12:05.649428 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:05.649260    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc361054-f272-4618-adb9-69702f8833a0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cc361054-f272-4618-adb9-69702f8833a0" (UID: "cc361054-f272-4618-adb9-69702f8833a0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:12:05.649968 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:05.649931    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc361054-f272-4618-adb9-69702f8833a0-istio-data" (OuterVolumeSpecName: "istio-data") pod "cc361054-f272-4618-adb9-69702f8833a0" (UID: "cc361054-f272-4618-adb9-69702f8833a0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:12:05.650965 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:05.650938    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cc361054-f272-4618-adb9-69702f8833a0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cc361054-f272-4618-adb9-69702f8833a0" (UID: "cc361054-f272-4618-adb9-69702f8833a0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 17:12:05.651105 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:05.650938    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc361054-f272-4618-adb9-69702f8833a0-kube-api-access-fnkpm" (OuterVolumeSpecName: "kube-api-access-fnkpm") pod "cc361054-f272-4618-adb9-69702f8833a0" (UID: "cc361054-f272-4618-adb9-69702f8833a0"). InnerVolumeSpecName "kube-api-access-fnkpm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:12:05.651176 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:05.651095    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc361054-f272-4618-adb9-69702f8833a0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cc361054-f272-4618-adb9-69702f8833a0" (UID: "cc361054-f272-4618-adb9-69702f8833a0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:12:05.651176 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:05.651103    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc361054-f272-4618-adb9-69702f8833a0-istio-token" (OuterVolumeSpecName: "istio-token") pod "cc361054-f272-4618-adb9-69702f8833a0" (UID: "cc361054-f272-4618-adb9-69702f8833a0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:12:05.658100 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:05.658076    2573 generic.go:356] "Generic (PLEG): container finished" podID="cc361054-f272-4618-adb9-69702f8833a0" containerID="6a25cba7d0087aa875518cae53a15aaf42b9eae2242013ece9bbabb1fce8d877" exitCode=0
Jul 13 17:12:05.658205 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:05.658134    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c"
Jul 13 17:12:05.658205 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:05.658152    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c" event={"ID":"cc361054-f272-4618-adb9-69702f8833a0","Type":"ContainerDied","Data":"6a25cba7d0087aa875518cae53a15aaf42b9eae2242013ece9bbabb1fce8d877"}
Jul 13 17:12:05.658331 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:05.658233    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c" event={"ID":"cc361054-f272-4618-adb9-69702f8833a0","Type":"ContainerDied","Data":"fd768b880ff16a4c550587eba8aac8175297e64d6f78ca27c4f7a748360d8f46"}
Jul 13 17:12:05.658331 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:05.658267    2573 scope.go:117] "RemoveContainer" containerID="6a25cba7d0087aa875518cae53a15aaf42b9eae2242013ece9bbabb1fce8d877"
Jul 13 17:12:05.668626 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:05.668610    2573 scope.go:117] "RemoveContainer" containerID="cdc3afb581753b8c5d4bb1c20f5a3cfbbde5f5c0f6d01934e80558a5a87f1ab6"
Jul 13 17:12:05.676278 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:05.676263    2573 scope.go:117] "RemoveContainer" containerID="6a25cba7d0087aa875518cae53a15aaf42b9eae2242013ece9bbabb1fce8d877"
Jul 13 17:12:05.676504 ip-10-0-143-51 kubenswrapper[2573]: E0713 17:12:05.676486    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a25cba7d0087aa875518cae53a15aaf42b9eae2242013ece9bbabb1fce8d877\": container with ID starting with 6a25cba7d0087aa875518cae53a15aaf42b9eae2242013ece9bbabb1fce8d877 not found: ID does not exist" containerID="6a25cba7d0087aa875518cae53a15aaf42b9eae2242013ece9bbabb1fce8d877"
Jul 13 17:12:05.676550 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:05.676509    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a25cba7d0087aa875518cae53a15aaf42b9eae2242013ece9bbabb1fce8d877"} err="failed to get container status \"6a25cba7d0087aa875518cae53a15aaf42b9eae2242013ece9bbabb1fce8d877\": rpc error: code = NotFound desc = could not find container \"6a25cba7d0087aa875518cae53a15aaf42b9eae2242013ece9bbabb1fce8d877\": container with ID starting with 6a25cba7d0087aa875518cae53a15aaf42b9eae2242013ece9bbabb1fce8d877 not found: ID does not exist"
Jul 13 17:12:05.676550 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:05.676524    2573 scope.go:117] "RemoveContainer" containerID="cdc3afb581753b8c5d4bb1c20f5a3cfbbde5f5c0f6d01934e80558a5a87f1ab6"
Jul 13 17:12:05.676714 ip-10-0-143-51 kubenswrapper[2573]: E0713 17:12:05.676700    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdc3afb581753b8c5d4bb1c20f5a3cfbbde5f5c0f6d01934e80558a5a87f1ab6\": container with ID starting with cdc3afb581753b8c5d4bb1c20f5a3cfbbde5f5c0f6d01934e80558a5a87f1ab6 not found: ID does not exist" containerID="cdc3afb581753b8c5d4bb1c20f5a3cfbbde5f5c0f6d01934e80558a5a87f1ab6"
Jul 13 17:12:05.676789 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:05.676732    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdc3afb581753b8c5d4bb1c20f5a3cfbbde5f5c0f6d01934e80558a5a87f1ab6"} err="failed to get container status \"cdc3afb581753b8c5d4bb1c20f5a3cfbbde5f5c0f6d01934e80558a5a87f1ab6\": rpc error: code = NotFound desc = could not find container \"cdc3afb581753b8c5d4bb1c20f5a3cfbbde5f5c0f6d01934e80558a5a87f1ab6\": container with ID starting with cdc3afb581753b8c5d4bb1c20f5a3cfbbde5f5c0f6d01934e80558a5a87f1ab6 not found: ID does not exist"
Jul 13 17:12:05.692907 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:05.692763    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c"]
Jul 13 17:12:05.707505 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:05.707486    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-45a43c1d-openshift-default-78c75744c9-cmb5c"]
Jul 13 17:12:05.749833 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:05.749814    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc361054-f272-4618-adb9-69702f8833a0-istio-podinfo\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:12:05.749833 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:05.749832    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc361054-f272-4618-adb9-69702f8833a0-istiod-ca-cert\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:12:05.749944 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:05.749840    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc361054-f272-4618-adb9-69702f8833a0-credential-socket\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:12:05.749944 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:05.749849    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc361054-f272-4618-adb9-69702f8833a0-workload-socket\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:12:05.749944 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:05.749857    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc361054-f272-4618-adb9-69702f8833a0-istio-envoy\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:12:05.749944 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:05.749865    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnkpm\" (UniqueName: \"kubernetes.io/projected/cc361054-f272-4618-adb9-69702f8833a0-kube-api-access-fnkpm\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:12:05.749944 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:05.749872    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc361054-f272-4618-adb9-69702f8833a0-istio-token\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:12:05.749944 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:05.749880    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc361054-f272-4618-adb9-69702f8833a0-istio-data\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:12:07.147527 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:07.147493    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc361054-f272-4618-adb9-69702f8833a0" path="/var/lib/kubelet/pods/cc361054-f272-4618-adb9-69702f8833a0/volumes"
Jul 13 17:12:07.282158 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:07.282123    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:12:07.392326 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:07.392262    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:12:07.545811 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:07.545768    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:12:08.389467 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:08.389435    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:12:13.573081 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:13.573028    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:12:13.640402 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:13.640364    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:12:22.799174 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:22.799139    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:12:23.106639 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:23.106545    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954"]
Jul 13 17:12:23.106971 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:23.106952    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc361054-f272-4618-adb9-69702f8833a0" containerName="istio-proxy"
Jul 13 17:12:23.107047 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:23.106975    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc361054-f272-4618-adb9-69702f8833a0" containerName="istio-proxy"
Jul 13 17:12:23.107047 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:23.106993    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc361054-f272-4618-adb9-69702f8833a0" containerName="istio-proxy"
Jul 13 17:12:23.107047 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:23.107001    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc361054-f272-4618-adb9-69702f8833a0" containerName="istio-proxy"
Jul 13 17:12:23.107158 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:23.107099    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc361054-f272-4618-adb9-69702f8833a0" containerName="istio-proxy"
Jul 13 17:12:23.111313 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:23.111294    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954"
Jul 13 17:12:23.114032 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:23.114012    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-54358301-openshift-default-dockercfg-pvtv6\""
Jul 13 17:12:23.123516 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:23.123491    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954"]
Jul 13 17:12:23.125160 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:23.125136    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:12:23.290419 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:23.290384    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-istio-token\") pod \"e2e-mt-54358301-openshift-default-658977f69f-gr954\" (UID: \"ca343d0b-3bb2-4999-b47a-2a21ffa9008b\") " pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954"
Jul 13 17:12:23.290419 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:23.290419    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-istio-envoy\") pod \"e2e-mt-54358301-openshift-default-658977f69f-gr954\" (UID: \"ca343d0b-3bb2-4999-b47a-2a21ffa9008b\") " pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954"
Jul 13 17:12:23.290643 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:23.290453    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-credential-socket\") pod \"e2e-mt-54358301-openshift-default-658977f69f-gr954\" (UID: \"ca343d0b-3bb2-4999-b47a-2a21ffa9008b\") " pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954"
Jul 13 17:12:23.290643 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:23.290511    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-workload-socket\") pod \"e2e-mt-54358301-openshift-default-658977f69f-gr954\" (UID: \"ca343d0b-3bb2-4999-b47a-2a21ffa9008b\") " pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954"
Jul 13 17:12:23.290643 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:23.290554    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xcsd\" (UniqueName: \"kubernetes.io/projected/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-kube-api-access-9xcsd\") pod \"e2e-mt-54358301-openshift-default-658977f69f-gr954\" (UID: \"ca343d0b-3bb2-4999-b47a-2a21ffa9008b\") " pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954"
Jul 13 17:12:23.290643 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:23.290608    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-istiod-ca-cert\") pod \"e2e-mt-54358301-openshift-default-658977f69f-gr954\" (UID: \"ca343d0b-3bb2-4999-b47a-2a21ffa9008b\") " pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954"
Jul 13 17:12:23.290809 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:23.290653    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-istio-data\") pod \"e2e-mt-54358301-openshift-default-658977f69f-gr954\" (UID: \"ca343d0b-3bb2-4999-b47a-2a21ffa9008b\") " pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954"
Jul 13 17:12:23.290809 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:23.290714    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-istio-podinfo\") pod \"e2e-mt-54358301-openshift-default-658977f69f-gr954\" (UID: \"ca343d0b-3bb2-4999-b47a-2a21ffa9008b\") " pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954"
Jul 13 17:12:23.290809 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:23.290775    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-workload-certs\") pod \"e2e-mt-54358301-openshift-default-658977f69f-gr954\" (UID: \"ca343d0b-3bb2-4999-b47a-2a21ffa9008b\") " pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954"
Jul 13 17:12:23.391594 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:23.391503    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-credential-socket\") pod \"e2e-mt-54358301-openshift-default-658977f69f-gr954\" (UID: \"ca343d0b-3bb2-4999-b47a-2a21ffa9008b\") " pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954"
Jul 13 17:12:23.391594 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:23.391563    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-workload-socket\") pod \"e2e-mt-54358301-openshift-default-658977f69f-gr954\" (UID: \"ca343d0b-3bb2-4999-b47a-2a21ffa9008b\") " pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954"
Jul 13 17:12:23.391594 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:23.391588    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xcsd\" (UniqueName: \"kubernetes.io/projected/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-kube-api-access-9xcsd\") pod \"e2e-mt-54358301-openshift-default-658977f69f-gr954\" (UID: \"ca343d0b-3bb2-4999-b47a-2a21ffa9008b\") " pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954"
Jul 13 17:12:23.391908 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:23.391620    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-istiod-ca-cert\") pod \"e2e-mt-54358301-openshift-default-658977f69f-gr954\" (UID: \"ca343d0b-3bb2-4999-b47a-2a21ffa9008b\") " pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954"
Jul 13 17:12:23.391908 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:23.391767    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-istio-data\") pod \"e2e-mt-54358301-openshift-default-658977f69f-gr954\" (UID: \"ca343d0b-3bb2-4999-b47a-2a21ffa9008b\") " pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954"
Jul 13 17:12:23.391908 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:23.391836    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-istio-podinfo\") pod \"e2e-mt-54358301-openshift-default-658977f69f-gr954\" (UID: \"ca343d0b-3bb2-4999-b47a-2a21ffa9008b\") " pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954"
Jul 13 17:12:23.391908 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:23.391868    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-workload-certs\") pod \"e2e-mt-54358301-openshift-default-658977f69f-gr954\" (UID: \"ca343d0b-3bb2-4999-b47a-2a21ffa9008b\") " pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954"
Jul 13 17:12:23.392115 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:23.391947    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-istio-token\") pod \"e2e-mt-54358301-openshift-default-658977f69f-gr954\" (UID: \"ca343d0b-3bb2-4999-b47a-2a21ffa9008b\") " pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954"
Jul 13 17:12:23.392115 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:23.391950    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-credential-socket\") pod \"e2e-mt-54358301-openshift-default-658977f69f-gr954\" (UID: \"ca343d0b-3bb2-4999-b47a-2a21ffa9008b\") " pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954"
Jul 13 17:12:23.392115 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:23.391999    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-istio-envoy\") pod \"e2e-mt-54358301-openshift-default-658977f69f-gr954\" (UID: \"ca343d0b-3bb2-4999-b47a-2a21ffa9008b\") " pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954"
Jul 13 17:12:23.392269 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:23.392177    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-workload-socket\") pod \"e2e-mt-54358301-openshift-default-658977f69f-gr954\" (UID: \"ca343d0b-3bb2-4999-b47a-2a21ffa9008b\") " pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954"
Jul 13 17:12:23.392269 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:23.392221    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-workload-certs\") pod \"e2e-mt-54358301-openshift-default-658977f69f-gr954\" (UID: \"ca343d0b-3bb2-4999-b47a-2a21ffa9008b\") " pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954"
Jul 13 17:12:23.392381 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:23.392345    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-istiod-ca-cert\") pod \"e2e-mt-54358301-openshift-default-658977f69f-gr954\" (UID: \"ca343d0b-3bb2-4999-b47a-2a21ffa9008b\") " pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954"
Jul 13 17:12:23.392438 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:23.392387    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-istio-data\") pod \"e2e-mt-54358301-openshift-default-658977f69f-gr954\" (UID: \"ca343d0b-3bb2-4999-b47a-2a21ffa9008b\") " pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954"
Jul 13 17:12:23.394118 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:23.394094    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-istio-envoy\") pod \"e2e-mt-54358301-openshift-default-658977f69f-gr954\" (UID: \"ca343d0b-3bb2-4999-b47a-2a21ffa9008b\") " pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954"
Jul 13 17:12:23.394297 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:23.394282    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-istio-podinfo\") pod \"e2e-mt-54358301-openshift-default-658977f69f-gr954\" (UID: \"ca343d0b-3bb2-4999-b47a-2a21ffa9008b\") " pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954"
Jul 13 17:12:23.400107 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:23.400076    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-istio-token\") pod \"e2e-mt-54358301-openshift-default-658977f69f-gr954\" (UID: \"ca343d0b-3bb2-4999-b47a-2a21ffa9008b\") " pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954"
Jul 13 17:12:23.400294 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:23.400275    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xcsd\" (UniqueName: \"kubernetes.io/projected/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-kube-api-access-9xcsd\") pod \"e2e-mt-54358301-openshift-default-658977f69f-gr954\" (UID: \"ca343d0b-3bb2-4999-b47a-2a21ffa9008b\") " pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954"
Jul 13 17:12:23.421794 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:23.421769    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954"
Jul 13 17:12:23.567957 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:23.567917    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954"]
Jul 13 17:12:23.571582 ip-10-0-143-51 kubenswrapper[2573]: W0713 17:12:23.571552    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca343d0b_3bb2_4999_b47a_2a21ffa9008b.slice/crio-3f8d475b59a6d7c9678196b0dadc78c5f5b675dfaba1ed5e6e65e73c0d9f4e6f WatchSource:0}: Error finding container 3f8d475b59a6d7c9678196b0dadc78c5f5b675dfaba1ed5e6e65e73c0d9f4e6f: Status 404 returned error can't find the container with id 3f8d475b59a6d7c9678196b0dadc78c5f5b675dfaba1ed5e6e65e73c0d9f4e6f
Jul 13 17:12:23.574027 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:23.573980    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:12:23.574150 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:23.574098    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:12:23.574202 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:23.574146    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:12:23.632510 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:23.632485    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:12:23.748685 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:23.748654    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954" event={"ID":"ca343d0b-3bb2-4999-b47a-2a21ffa9008b","Type":"ContainerStarted","Data":"100d647eb9d3628b8fc69343c2932eda4b7a03f510d273a5332e3f016d68ce67"}
Jul 13 17:12:23.748882 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:23.748757    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954" event={"ID":"ca343d0b-3bb2-4999-b47a-2a21ffa9008b","Type":"ContainerStarted","Data":"3f8d475b59a6d7c9678196b0dadc78c5f5b675dfaba1ed5e6e65e73c0d9f4e6f"}
Jul 13 17:12:23.773128 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:23.773079    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954" podStartSLOduration=0.773063324 podStartE2EDuration="773.063324ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:12:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:12:23.772304618 +0000 UTC m=+1941.130611443" watchObservedRunningTime="2026-07-13 17:12:23.773063324 +0000 UTC m=+1941.131370150"
Jul 13 17:12:24.422883 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:24.422854    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954"
Jul 13 17:12:24.427642 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:24.427620    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954"
Jul 13 17:12:24.754218 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:24.754188    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954"
Jul 13 17:12:24.755148 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:24.755128    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954"
Jul 13 17:12:25.732602 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:25.732570    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:12:25.823607 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:25.823581    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:12:25.924175 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:25.924129    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:12:26.021039 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:26.020956    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:12:26.473855 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:26.473824    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:12:26.574283 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:26.574247    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:12:30.258869 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:30.258835    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:12:34.646611 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:34.646537    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:12:34.739827 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:34.739786    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:12:39.755916 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:39.755886    2573 patch_prober.go:28] interesting pod/e2e-mt-54358301-openshift-default-658977f69f-gr954 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 13 17:12:39.756327 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:39.755947    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954" podUID="ca343d0b-3bb2-4999-b47a-2a21ffa9008b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 13 17:12:39.823835 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:39.823802    2573 generic.go:356] "Generic (PLEG): container finished" podID="ca343d0b-3bb2-4999-b47a-2a21ffa9008b" containerID="100d647eb9d3628b8fc69343c2932eda4b7a03f510d273a5332e3f016d68ce67" exitCode=0
Jul 13 17:12:39.823978 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:39.823878    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954" event={"ID":"ca343d0b-3bb2-4999-b47a-2a21ffa9008b","Type":"ContainerDied","Data":"100d647eb9d3628b8fc69343c2932eda4b7a03f510d273a5332e3f016d68ce67"}
Jul 13 17:12:39.824240 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:39.824225    2573 scope.go:117] "RemoveContainer" containerID="100d647eb9d3628b8fc69343c2932eda4b7a03f510d273a5332e3f016d68ce67"
Jul 13 17:12:39.825164 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:39.825135    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:12:39.825257 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:39.825203    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:12:39.825257 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:39.825246    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:12:40.832423 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:40.832390    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954" event={"ID":"ca343d0b-3bb2-4999-b47a-2a21ffa9008b","Type":"ContainerStarted","Data":"f88c44415c85682e08be71d112c7f99d1ef7112ae742086e2967218f9c10b076"}
Jul 13 17:12:41.422446 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:41.422410    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954"
Jul 13 17:12:41.422648 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:41.422622    2573 patch_prober.go:28] interesting pod/e2e-mt-54358301-openshift-default-658977f69f-gr954 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 13 17:12:41.422764 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:41.422695    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954" podUID="ca343d0b-3bb2-4999-b47a-2a21ffa9008b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 13 17:12:42.422616 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:42.422583    2573 patch_prober.go:28] interesting pod/e2e-mt-54358301-openshift-default-658977f69f-gr954 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 13 17:12:42.423001 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:42.422642    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954" podUID="ca343d0b-3bb2-4999-b47a-2a21ffa9008b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 13 17:12:43.422852 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:43.422818    2573 patch_prober.go:28] interesting pod/e2e-mt-54358301-openshift-default-658977f69f-gr954 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 13 17:12:43.423237 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:43.422885    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954" podUID="ca343d0b-3bb2-4999-b47a-2a21ffa9008b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 13 17:12:44.422925 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:44.422891    2573 patch_prober.go:28] interesting pod/e2e-mt-54358301-openshift-default-658977f69f-gr954 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 13 17:12:44.423291 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:44.422940    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954" podUID="ca343d0b-3bb2-4999-b47a-2a21ffa9008b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 13 17:12:45.426220 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:45.426189    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954"
Jul 13 17:12:45.426692 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:45.426571    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954"
Jul 13 17:12:45.427118 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:45.427101    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954"
Jul 13 17:12:51.801782 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:51.801748    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-54358301/e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52"]
Jul 13 17:12:51.802367 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:51.802350    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc361054-f272-4618-adb9-69702f8833a0" containerName="istio-proxy"
Jul 13 17:12:51.804841 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:51.804821    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-54358301/e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52"
Jul 13 17:12:51.808874 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:51.808850    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-54358301\"/\"openshift-service-ca.crt\""
Jul 13 17:12:51.809015 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:51.808885    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-54358301\"/\"e2e-lifecycle-model-54358301-kserve-self-signed-certs\""
Jul 13 17:12:51.809015 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:51.808934    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-54358301\"/\"default-dockercfg-s7zwj\""
Jul 13 17:12:51.809148 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:51.809039    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-54358301\"/\"kube-root-ca.crt\""
Jul 13 17:12:51.813957 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:51.813931    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-54358301/e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52"]
Jul 13 17:12:51.829110 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:51.829082    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b62kt\" (UniqueName: \"kubernetes.io/projected/a0605d6d-afe4-4cb4-8857-507e7142c73a-kube-api-access-b62kt\") pod \"e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52\" (UID: \"a0605d6d-afe4-4cb4-8857-507e7142c73a\") " pod="ai-tenant-e2e-mt-54358301/e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52"
Jul 13 17:12:51.829238 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:51.829117    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0605d6d-afe4-4cb4-8857-507e7142c73a-home\") pod \"e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52\" (UID: \"a0605d6d-afe4-4cb4-8857-507e7142c73a\") " pod="ai-tenant-e2e-mt-54358301/e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52"
Jul 13 17:12:51.829238 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:51.829144    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0605d6d-afe4-4cb4-8857-507e7142c73a-model-cache\") pod \"e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52\" (UID: \"a0605d6d-afe4-4cb4-8857-507e7142c73a\") " pod="ai-tenant-e2e-mt-54358301/e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52"
Jul 13 17:12:51.829238 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:51.829194    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0605d6d-afe4-4cb4-8857-507e7142c73a-tmp-dir\") pod \"e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52\" (UID: \"a0605d6d-afe4-4cb4-8857-507e7142c73a\") " pod="ai-tenant-e2e-mt-54358301/e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52"
Jul 13 17:12:51.829238 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:51.829225    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0605d6d-afe4-4cb4-8857-507e7142c73a-tls-certs\") pod \"e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52\" (UID: \"a0605d6d-afe4-4cb4-8857-507e7142c73a\") " pod="ai-tenant-e2e-mt-54358301/e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52"
Jul 13 17:12:51.829471 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:51.829242    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0605d6d-afe4-4cb4-8857-507e7142c73a-dshm\") pod \"e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52\" (UID: \"a0605d6d-afe4-4cb4-8857-507e7142c73a\") " pod="ai-tenant-e2e-mt-54358301/e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52"
Jul 13 17:12:51.843508 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:51.843479    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:12:51.930590 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:51.930566    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0605d6d-afe4-4cb4-8857-507e7142c73a-tmp-dir\") pod \"e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52\" (UID: \"a0605d6d-afe4-4cb4-8857-507e7142c73a\") " pod="ai-tenant-e2e-mt-54358301/e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52"
Jul 13 17:12:51.930760 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:51.930607    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0605d6d-afe4-4cb4-8857-507e7142c73a-tls-certs\") pod \"e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52\" (UID: \"a0605d6d-afe4-4cb4-8857-507e7142c73a\") " pod="ai-tenant-e2e-mt-54358301/e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52"
Jul 13 17:12:51.930760 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:51.930637    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0605d6d-afe4-4cb4-8857-507e7142c73a-dshm\") pod \"e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52\" (UID: \"a0605d6d-afe4-4cb4-8857-507e7142c73a\") " pod="ai-tenant-e2e-mt-54358301/e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52"
Jul 13 17:12:51.930760 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:51.930689    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b62kt\" (UniqueName: \"kubernetes.io/projected/a0605d6d-afe4-4cb4-8857-507e7142c73a-kube-api-access-b62kt\") pod \"e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52\" (UID: \"a0605d6d-afe4-4cb4-8857-507e7142c73a\") " pod="ai-tenant-e2e-mt-54358301/e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52"
Jul 13 17:12:51.930760 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:51.930747    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0605d6d-afe4-4cb4-8857-507e7142c73a-home\") pod \"e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52\" (UID: \"a0605d6d-afe4-4cb4-8857-507e7142c73a\") " pod="ai-tenant-e2e-mt-54358301/e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52"
Jul 13 17:12:51.930989 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:51.930788    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0605d6d-afe4-4cb4-8857-507e7142c73a-model-cache\") pod \"e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52\" (UID: \"a0605d6d-afe4-4cb4-8857-507e7142c73a\") " pod="ai-tenant-e2e-mt-54358301/e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52"
Jul 13 17:12:51.930989 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:51.930980    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0605d6d-afe4-4cb4-8857-507e7142c73a-tmp-dir\") pod \"e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52\" (UID: \"a0605d6d-afe4-4cb4-8857-507e7142c73a\") " pod="ai-tenant-e2e-mt-54358301/e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52"
Jul 13 17:12:51.931114 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:51.931091    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0605d6d-afe4-4cb4-8857-507e7142c73a-home\") pod \"e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52\" (UID: \"a0605d6d-afe4-4cb4-8857-507e7142c73a\") " pod="ai-tenant-e2e-mt-54358301/e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52"
Jul 13 17:12:51.931169 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:51.931153    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0605d6d-afe4-4cb4-8857-507e7142c73a-model-cache\") pod \"e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52\" (UID: \"a0605d6d-afe4-4cb4-8857-507e7142c73a\") " pod="ai-tenant-e2e-mt-54358301/e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52"
Jul 13 17:12:51.932933 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:51.932913    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0605d6d-afe4-4cb4-8857-507e7142c73a-dshm\") pod \"e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52\" (UID: \"a0605d6d-afe4-4cb4-8857-507e7142c73a\") " pod="ai-tenant-e2e-mt-54358301/e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52"
Jul 13 17:12:51.933104 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:51.933087    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0605d6d-afe4-4cb4-8857-507e7142c73a-tls-certs\") pod \"e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52\" (UID: \"a0605d6d-afe4-4cb4-8857-507e7142c73a\") " pod="ai-tenant-e2e-mt-54358301/e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52"
Jul 13 17:12:51.940737 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:51.940704    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b62kt\" (UniqueName: \"kubernetes.io/projected/a0605d6d-afe4-4cb4-8857-507e7142c73a-kube-api-access-b62kt\") pod \"e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52\" (UID: \"a0605d6d-afe4-4cb4-8857-507e7142c73a\") " pod="ai-tenant-e2e-mt-54358301/e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52"
Jul 13 17:12:52.114770 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:52.114672    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-54358301/e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52"
Jul 13 17:12:52.246228 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:52.246195    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-54358301/e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52"]
Jul 13 17:12:52.248964 ip-10-0-143-51 kubenswrapper[2573]: W0713 17:12:52.248930    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda0605d6d_afe4_4cb4_8857_507e7142c73a.slice/crio-00ecbfad3879d4e72a4793b8cf2f886b0cbc247802970ee0304267d45060c610 WatchSource:0}: Error finding container 00ecbfad3879d4e72a4793b8cf2f886b0cbc247802970ee0304267d45060c610: Status 404 returned error can't find the container with id 00ecbfad3879d4e72a4793b8cf2f886b0cbc247802970ee0304267d45060c610
Jul 13 17:12:52.893383 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:52.893355    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-54358301/e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52" event={"ID":"a0605d6d-afe4-4cb4-8857-507e7142c73a","Type":"ContainerStarted","Data":"a94b3ced59c5788904b878949b6fd439eaece71a3591a76adf86d21d72b7c2b8"}
Jul 13 17:12:52.893383 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:52.893394    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-54358301/e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52" event={"ID":"a0605d6d-afe4-4cb4-8857-507e7142c73a","Type":"ContainerStarted","Data":"00ecbfad3879d4e72a4793b8cf2f886b0cbc247802970ee0304267d45060c610"}
Jul 13 17:12:52.911313 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:12:52.911270    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-54358301/e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52" podStartSLOduration=1.9112560790000002 podStartE2EDuration="1.911256079s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:12:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:12:52.910265601 +0000 UTC m=+1970.268572419" watchObservedRunningTime="2026-07-13 17:12:52.911256079 +0000 UTC m=+1970.269562903"
Jul 13 17:13:02.114965 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:13:02.114882    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-54358301/e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52"
Jul 13 17:13:02.114965 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:13:02.114923    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-54358301/e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52"
Jul 13 17:13:02.126875 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:13:02.126848    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-54358301/e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52"
Jul 13 17:13:02.954476 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:13:02.954444    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-54358301/e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52"
Jul 13 17:13:29.604784 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:13:29.604751    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:13:34.194245 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:13:34.194213    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:13:39.167199 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:13:39.167167    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-54358301/e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52"]
Jul 13 17:13:39.262123 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:13:39.262095    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:13:54.187074 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:13:54.187033    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-54358301/e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52" podUID="a0605d6d-afe4-4cb4-8857-507e7142c73a" containerName="main" containerID="cri-o://a94b3ced59c5788904b878949b6fd439eaece71a3591a76adf86d21d72b7c2b8" gracePeriod=45
Jul 13 17:13:54.448417 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:13:54.448363    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-54358301/e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52"
Jul 13 17:13:54.564002 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:13:54.563970    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0605d6d-afe4-4cb4-8857-507e7142c73a-model-cache\") pod \"a0605d6d-afe4-4cb4-8857-507e7142c73a\" (UID: \"a0605d6d-afe4-4cb4-8857-507e7142c73a\") "
Jul 13 17:13:54.564184 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:13:54.564010    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b62kt\" (UniqueName: \"kubernetes.io/projected/a0605d6d-afe4-4cb4-8857-507e7142c73a-kube-api-access-b62kt\") pod \"a0605d6d-afe4-4cb4-8857-507e7142c73a\" (UID: \"a0605d6d-afe4-4cb4-8857-507e7142c73a\") "
Jul 13 17:13:54.564184 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:13:54.564040    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0605d6d-afe4-4cb4-8857-507e7142c73a-tls-certs\") pod \"a0605d6d-afe4-4cb4-8857-507e7142c73a\" (UID: \"a0605d6d-afe4-4cb4-8857-507e7142c73a\") "
Jul 13 17:13:54.564184 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:13:54.564062    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0605d6d-afe4-4cb4-8857-507e7142c73a-tmp-dir\") pod \"a0605d6d-afe4-4cb4-8857-507e7142c73a\" (UID: \"a0605d6d-afe4-4cb4-8857-507e7142c73a\") "
Jul 13 17:13:54.564184 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:13:54.564082    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0605d6d-afe4-4cb4-8857-507e7142c73a-dshm\") pod \"a0605d6d-afe4-4cb4-8857-507e7142c73a\" (UID: \"a0605d6d-afe4-4cb4-8857-507e7142c73a\") "
Jul 13 17:13:54.564184 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:13:54.564121    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0605d6d-afe4-4cb4-8857-507e7142c73a-home\") pod \"a0605d6d-afe4-4cb4-8857-507e7142c73a\" (UID: \"a0605d6d-afe4-4cb4-8857-507e7142c73a\") "
Jul 13 17:13:54.564443 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:13:54.564252    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0605d6d-afe4-4cb4-8857-507e7142c73a-model-cache" (OuterVolumeSpecName: "model-cache") pod "a0605d6d-afe4-4cb4-8857-507e7142c73a" (UID: "a0605d6d-afe4-4cb4-8857-507e7142c73a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:13:54.564443 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:13:54.564415    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0605d6d-afe4-4cb4-8857-507e7142c73a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a0605d6d-afe4-4cb4-8857-507e7142c73a" (UID: "a0605d6d-afe4-4cb4-8857-507e7142c73a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:13:54.564443 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:13:54.564437    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0605d6d-afe4-4cb4-8857-507e7142c73a-home" (OuterVolumeSpecName: "home") pod "a0605d6d-afe4-4cb4-8857-507e7142c73a" (UID: "a0605d6d-afe4-4cb4-8857-507e7142c73a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:13:54.564567 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:13:54.564474    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0605d6d-afe4-4cb4-8857-507e7142c73a-model-cache\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:13:54.566253 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:13:54.566230    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0605d6d-afe4-4cb4-8857-507e7142c73a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a0605d6d-afe4-4cb4-8857-507e7142c73a" (UID: "a0605d6d-afe4-4cb4-8857-507e7142c73a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:13:54.566362 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:13:54.566265    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0605d6d-afe4-4cb4-8857-507e7142c73a-dshm" (OuterVolumeSpecName: "dshm") pod "a0605d6d-afe4-4cb4-8857-507e7142c73a" (UID: "a0605d6d-afe4-4cb4-8857-507e7142c73a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:13:54.566362 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:13:54.566270    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0605d6d-afe4-4cb4-8857-507e7142c73a-kube-api-access-b62kt" (OuterVolumeSpecName: "kube-api-access-b62kt") pod "a0605d6d-afe4-4cb4-8857-507e7142c73a" (UID: "a0605d6d-afe4-4cb4-8857-507e7142c73a"). InnerVolumeSpecName "kube-api-access-b62kt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:13:54.664906 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:13:54.664871    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b62kt\" (UniqueName: \"kubernetes.io/projected/a0605d6d-afe4-4cb4-8857-507e7142c73a-kube-api-access-b62kt\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:13:54.664906 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:13:54.664904    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0605d6d-afe4-4cb4-8857-507e7142c73a-tls-certs\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:13:54.664906 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:13:54.664914    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0605d6d-afe4-4cb4-8857-507e7142c73a-tmp-dir\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:13:54.665097 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:13:54.664922    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0605d6d-afe4-4cb4-8857-507e7142c73a-dshm\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:13:54.665097 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:13:54.664930    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0605d6d-afe4-4cb4-8857-507e7142c73a-home\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:13:55.184918 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:13:55.184887    2573 generic.go:356] "Generic (PLEG): container finished" podID="a0605d6d-afe4-4cb4-8857-507e7142c73a" containerID="a94b3ced59c5788904b878949b6fd439eaece71a3591a76adf86d21d72b7c2b8" exitCode=0
Jul 13 17:13:55.185064 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:13:55.184929    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-54358301/e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52"
Jul 13 17:13:55.185064 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:13:55.184927    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-54358301/e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52" event={"ID":"a0605d6d-afe4-4cb4-8857-507e7142c73a","Type":"ContainerDied","Data":"a94b3ced59c5788904b878949b6fd439eaece71a3591a76adf86d21d72b7c2b8"}
Jul 13 17:13:55.185064 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:13:55.185054    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-54358301/e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52" event={"ID":"a0605d6d-afe4-4cb4-8857-507e7142c73a","Type":"ContainerDied","Data":"00ecbfad3879d4e72a4793b8cf2f886b0cbc247802970ee0304267d45060c610"}
Jul 13 17:13:55.185206 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:13:55.185076    2573 scope.go:117] "RemoveContainer" containerID="a94b3ced59c5788904b878949b6fd439eaece71a3591a76adf86d21d72b7c2b8"
Jul 13 17:13:55.193402 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:13:55.193172    2573 scope.go:117] "RemoveContainer" containerID="a94b3ced59c5788904b878949b6fd439eaece71a3591a76adf86d21d72b7c2b8"
Jul 13 17:13:55.193611 ip-10-0-143-51 kubenswrapper[2573]: E0713 17:13:55.193406    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a94b3ced59c5788904b878949b6fd439eaece71a3591a76adf86d21d72b7c2b8\": container with ID starting with a94b3ced59c5788904b878949b6fd439eaece71a3591a76adf86d21d72b7c2b8 not found: ID does not exist" containerID="a94b3ced59c5788904b878949b6fd439eaece71a3591a76adf86d21d72b7c2b8"
Jul 13 17:13:55.193611 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:13:55.193429    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a94b3ced59c5788904b878949b6fd439eaece71a3591a76adf86d21d72b7c2b8"} err="failed to get container status \"a94b3ced59c5788904b878949b6fd439eaece71a3591a76adf86d21d72b7c2b8\": rpc error: code = NotFound desc = could not find container \"a94b3ced59c5788904b878949b6fd439eaece71a3591a76adf86d21d72b7c2b8\": container with ID starting with a94b3ced59c5788904b878949b6fd439eaece71a3591a76adf86d21d72b7c2b8 not found: ID does not exist"
Jul 13 17:13:55.202994 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:13:55.202975    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-54358301/e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52"]
Jul 13 17:13:55.209746 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:13:55.209708    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-54358301/e2e-lifecycle-model-54358301-kserve-6c65cfff95-t9d52"]
Jul 13 17:13:57.147233 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:13:57.147196    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0605d6d-afe4-4cb4-8857-507e7142c73a" path="/var/lib/kubelet/pods/a0605d6d-afe4-4cb4-8857-507e7142c73a/volumes"
Jul 13 17:14:09.183931 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:09.183888    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:14:09.285023 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:09.284994    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:14:16.465375 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:16.465343    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:14:17.257309 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:17.257279    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:14:22.849666 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:22.849636    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:14:37.153354 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:37.153306    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:14:37.238902 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:37.238872    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:14:46.514424 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:46.514387    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954"]
Jul 13 17:14:46.514854 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:46.514668    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954" podUID="ca343d0b-3bb2-4999-b47a-2a21ffa9008b" containerName="istio-proxy" containerID="cri-o://f88c44415c85682e08be71d112c7f99d1ef7112ae742086e2967218f9c10b076" gracePeriod=30
Jul 13 17:14:46.539905 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:46.539863    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:14:46.790578 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:46.790490    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:14:47.860867 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:47.860832    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:14:47.952379 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:47.952348    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:14:48.053985 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:48.053951    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:14:48.758300 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:48.758256    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:14:48.859356 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:48.859324    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:14:48.955276 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:48.955245    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:14:50.345214 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:50.345185    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:14:51.777120 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:51.777064    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954"
Jul 13 17:14:51.841304 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:51.841277    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-istio-token\") pod \"ca343d0b-3bb2-4999-b47a-2a21ffa9008b\" (UID: \"ca343d0b-3bb2-4999-b47a-2a21ffa9008b\") "
Jul 13 17:14:51.841464 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:51.841319    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-credential-socket\") pod \"ca343d0b-3bb2-4999-b47a-2a21ffa9008b\" (UID: \"ca343d0b-3bb2-4999-b47a-2a21ffa9008b\") "
Jul 13 17:14:51.841464 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:51.841347    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-istio-envoy\") pod \"ca343d0b-3bb2-4999-b47a-2a21ffa9008b\" (UID: \"ca343d0b-3bb2-4999-b47a-2a21ffa9008b\") "
Jul 13 17:14:51.841464 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:51.841393    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-istio-data\") pod \"ca343d0b-3bb2-4999-b47a-2a21ffa9008b\" (UID: \"ca343d0b-3bb2-4999-b47a-2a21ffa9008b\") "
Jul 13 17:14:51.841464 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:51.841423    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-istiod-ca-cert\") pod \"ca343d0b-3bb2-4999-b47a-2a21ffa9008b\" (UID: \"ca343d0b-3bb2-4999-b47a-2a21ffa9008b\") "
Jul 13 17:14:51.841464 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:51.841459    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-workload-certs\") pod \"ca343d0b-3bb2-4999-b47a-2a21ffa9008b\" (UID: \"ca343d0b-3bb2-4999-b47a-2a21ffa9008b\") "
Jul 13 17:14:51.841783 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:51.841509    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-istio-podinfo\") pod \"ca343d0b-3bb2-4999-b47a-2a21ffa9008b\" (UID: \"ca343d0b-3bb2-4999-b47a-2a21ffa9008b\") "
Jul 13 17:14:51.841783 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:51.841538    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xcsd\" (UniqueName: \"kubernetes.io/projected/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-kube-api-access-9xcsd\") pod \"ca343d0b-3bb2-4999-b47a-2a21ffa9008b\" (UID: \"ca343d0b-3bb2-4999-b47a-2a21ffa9008b\") "
Jul 13 17:14:51.841783 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:51.841563    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-workload-socket\") pod \"ca343d0b-3bb2-4999-b47a-2a21ffa9008b\" (UID: \"ca343d0b-3bb2-4999-b47a-2a21ffa9008b\") "
Jul 13 17:14:51.842562 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:51.842110    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ca343d0b-3bb2-4999-b47a-2a21ffa9008b" (UID: "ca343d0b-3bb2-4999-b47a-2a21ffa9008b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:14:51.842562 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:51.842497    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ca343d0b-3bb2-4999-b47a-2a21ffa9008b" (UID: "ca343d0b-3bb2-4999-b47a-2a21ffa9008b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:14:51.842765 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:51.842653    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ca343d0b-3bb2-4999-b47a-2a21ffa9008b" (UID: "ca343d0b-3bb2-4999-b47a-2a21ffa9008b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:14:51.844785 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:51.843277    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-credential-socket\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:14:51.844785 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:51.843300    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-workload-certs\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:14:51.844785 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:51.843425    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-workload-socket\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:14:51.854090 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:51.845280    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ca343d0b-3bb2-4999-b47a-2a21ffa9008b" (UID: "ca343d0b-3bb2-4999-b47a-2a21ffa9008b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:14:51.854090 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:51.845575    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-istio-data" (OuterVolumeSpecName: "istio-data") pod "ca343d0b-3bb2-4999-b47a-2a21ffa9008b" (UID: "ca343d0b-3bb2-4999-b47a-2a21ffa9008b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:14:51.854376 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:51.854233    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ca343d0b-3bb2-4999-b47a-2a21ffa9008b" (UID: "ca343d0b-3bb2-4999-b47a-2a21ffa9008b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 17:14:51.854515 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:51.854387    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-istio-token" (OuterVolumeSpecName: "istio-token") pod "ca343d0b-3bb2-4999-b47a-2a21ffa9008b" (UID: "ca343d0b-3bb2-4999-b47a-2a21ffa9008b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:14:51.854515 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:51.854406    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-kube-api-access-9xcsd" (OuterVolumeSpecName: "kube-api-access-9xcsd") pod "ca343d0b-3bb2-4999-b47a-2a21ffa9008b" (UID: "ca343d0b-3bb2-4999-b47a-2a21ffa9008b"). InnerVolumeSpecName "kube-api-access-9xcsd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:14:51.856098 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:51.856076    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ca343d0b-3bb2-4999-b47a-2a21ffa9008b" (UID: "ca343d0b-3bb2-4999-b47a-2a21ffa9008b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:14:51.944983 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:51.944938    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-istio-token\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:14:51.944983 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:51.944982    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-istio-envoy\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:14:51.944983 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:51.944996    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-istio-data\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:14:51.945180 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:51.945009    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-istiod-ca-cert\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:14:51.945180 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:51.945023    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-istio-podinfo\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:14:51.945180 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:51.945037    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xcsd\" (UniqueName: \"kubernetes.io/projected/ca343d0b-3bb2-4999-b47a-2a21ffa9008b-kube-api-access-9xcsd\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:14:52.459165 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:52.459129    2573 generic.go:356] "Generic (PLEG): container finished" podID="ca343d0b-3bb2-4999-b47a-2a21ffa9008b" containerID="f88c44415c85682e08be71d112c7f99d1ef7112ae742086e2967218f9c10b076" exitCode=0
Jul 13 17:14:52.459358 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:52.459270    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954"
Jul 13 17:14:52.459358 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:52.459266    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954" event={"ID":"ca343d0b-3bb2-4999-b47a-2a21ffa9008b","Type":"ContainerDied","Data":"f88c44415c85682e08be71d112c7f99d1ef7112ae742086e2967218f9c10b076"}
Jul 13 17:14:52.459470 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:52.459397    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954" event={"ID":"ca343d0b-3bb2-4999-b47a-2a21ffa9008b","Type":"ContainerDied","Data":"3f8d475b59a6d7c9678196b0dadc78c5f5b675dfaba1ed5e6e65e73c0d9f4e6f"}
Jul 13 17:14:52.459470 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:52.459419    2573 scope.go:117] "RemoveContainer" containerID="f88c44415c85682e08be71d112c7f99d1ef7112ae742086e2967218f9c10b076"
Jul 13 17:14:52.469341 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:52.469307    2573 scope.go:117] "RemoveContainer" containerID="100d647eb9d3628b8fc69343c2932eda4b7a03f510d273a5332e3f016d68ce67"
Jul 13 17:14:52.478020 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:52.477987    2573 scope.go:117] "RemoveContainer" containerID="f88c44415c85682e08be71d112c7f99d1ef7112ae742086e2967218f9c10b076"
Jul 13 17:14:52.478282 ip-10-0-143-51 kubenswrapper[2573]: E0713 17:14:52.478262    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f88c44415c85682e08be71d112c7f99d1ef7112ae742086e2967218f9c10b076\": container with ID starting with f88c44415c85682e08be71d112c7f99d1ef7112ae742086e2967218f9c10b076 not found: ID does not exist" containerID="f88c44415c85682e08be71d112c7f99d1ef7112ae742086e2967218f9c10b076"
Jul 13 17:14:52.478364 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:52.478291    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f88c44415c85682e08be71d112c7f99d1ef7112ae742086e2967218f9c10b076"} err="failed to get container status \"f88c44415c85682e08be71d112c7f99d1ef7112ae742086e2967218f9c10b076\": rpc error: code = NotFound desc = could not find container \"f88c44415c85682e08be71d112c7f99d1ef7112ae742086e2967218f9c10b076\": container with ID starting with f88c44415c85682e08be71d112c7f99d1ef7112ae742086e2967218f9c10b076 not found: ID does not exist"
Jul 13 17:14:52.478364 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:52.478308    2573 scope.go:117] "RemoveContainer" containerID="100d647eb9d3628b8fc69343c2932eda4b7a03f510d273a5332e3f016d68ce67"
Jul 13 17:14:52.478516 ip-10-0-143-51 kubenswrapper[2573]: E0713 17:14:52.478501    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"100d647eb9d3628b8fc69343c2932eda4b7a03f510d273a5332e3f016d68ce67\": container with ID starting with 100d647eb9d3628b8fc69343c2932eda4b7a03f510d273a5332e3f016d68ce67 not found: ID does not exist" containerID="100d647eb9d3628b8fc69343c2932eda4b7a03f510d273a5332e3f016d68ce67"
Jul 13 17:14:52.478578 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:52.478519    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"100d647eb9d3628b8fc69343c2932eda4b7a03f510d273a5332e3f016d68ce67"} err="failed to get container status \"100d647eb9d3628b8fc69343c2932eda4b7a03f510d273a5332e3f016d68ce67\": rpc error: code = NotFound desc = could not find container \"100d647eb9d3628b8fc69343c2932eda4b7a03f510d273a5332e3f016d68ce67\": container with ID starting with 100d647eb9d3628b8fc69343c2932eda4b7a03f510d273a5332e3f016d68ce67 not found: ID does not exist"
Jul 13 17:14:52.482054 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:52.482031    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954"]
Jul 13 17:14:52.487746 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:52.487706    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-54358301-openshift-default-658977f69f-gr954"]
Jul 13 17:14:53.147508 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:53.147473    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca343d0b-3bb2-4999-b47a-2a21ffa9008b" path="/var/lib/kubelet/pods/ca343d0b-3bb2-4999-b47a-2a21ffa9008b/volumes"
Jul 13 17:14:56.190919 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:56.190890    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:14:56.290845 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:56.290818    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:14:56.891601 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:14:56.891571    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:15:00.146400 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:00.146367    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29732715-5jkwd"]
Jul 13 17:15:00.146788 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:00.146734    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca343d0b-3bb2-4999-b47a-2a21ffa9008b" containerName="istio-proxy"
Jul 13 17:15:00.146788 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:00.146747    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca343d0b-3bb2-4999-b47a-2a21ffa9008b" containerName="istio-proxy"
Jul 13 17:15:00.146788 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:00.146762    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0605d6d-afe4-4cb4-8857-507e7142c73a" containerName="main"
Jul 13 17:15:00.146788 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:00.146767    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0605d6d-afe4-4cb4-8857-507e7142c73a" containerName="main"
Jul 13 17:15:00.146920 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:00.146825    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca343d0b-3bb2-4999-b47a-2a21ffa9008b" containerName="istio-proxy"
Jul 13 17:15:00.146920 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:00.146832    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0605d6d-afe4-4cb4-8857-507e7142c73a" containerName="main"
Jul 13 17:15:00.151130 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:00.151111    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732715-5jkwd"
Jul 13 17:15:00.154197 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:00.154174    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fkks4\""
Jul 13 17:15:00.159356 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:00.159332    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29732715-5jkwd"]
Jul 13 17:15:00.161485 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:00.161468    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732715-5jkwd"
Jul 13 17:15:00.302691 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:00.302667    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29732715-5jkwd"]
Jul 13 17:15:00.305065 ip-10-0-143-51 kubenswrapper[2573]: W0713 17:15:00.305033    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d910319_587b_4ee0_9514_c0c4cd957b99.slice/crio-cb0c1ddcf710704b9f972c42a0c30696ebb3ce879fa4045a3058c584106fb688 WatchSource:0}: Error finding container cb0c1ddcf710704b9f972c42a0c30696ebb3ce879fa4045a3058c584106fb688: Status 404 returned error can't find the container with id cb0c1ddcf710704b9f972c42a0c30696ebb3ce879fa4045a3058c584106fb688
Jul 13 17:15:00.498688 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:00.498655    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732715-5jkwd" event={"ID":"6d910319-587b-4ee0-9514-c0c4cd957b99","Type":"ContainerStarted","Data":"cb0c1ddcf710704b9f972c42a0c30696ebb3ce879fa4045a3058c584106fb688"}
Jul 13 17:15:01.506031 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:01.505938    2573 generic.go:356] "Generic (PLEG): container finished" podID="6d910319-587b-4ee0-9514-c0c4cd957b99" containerID="2608dc9168bc63d7374cecdce384b8e83ba93ed861169b6c31fa41b13b44d29c" exitCode=0
Jul 13 17:15:01.506031 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:01.506013    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732715-5jkwd" event={"ID":"6d910319-587b-4ee0-9514-c0c4cd957b99","Type":"ContainerDied","Data":"2608dc9168bc63d7374cecdce384b8e83ba93ed861169b6c31fa41b13b44d29c"}
Jul 13 17:15:02.644100 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:02.644072    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732715-5jkwd"
Jul 13 17:15:02.690995 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:02.690965    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:15:02.762977 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:02.762905    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:15:02.857572 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:02.857541    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:15:03.173086 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:03.173054    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnxdg_e1fb6130-2ab7-40f5-831c-ea95ff241f37/ovn-acl-logging/0.log"
Jul 13 17:15:03.176280 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:03.176258    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnxdg_e1fb6130-2ab7-40f5-831c-ea95ff241f37/ovn-acl-logging/0.log"
Jul 13 17:15:03.514971 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:03.514935    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732715-5jkwd" event={"ID":"6d910319-587b-4ee0-9514-c0c4cd957b99","Type":"ContainerDied","Data":"cb0c1ddcf710704b9f972c42a0c30696ebb3ce879fa4045a3058c584106fb688"}
Jul 13 17:15:03.514971 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:03.514961    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732715-5jkwd"
Jul 13 17:15:03.515182 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:03.514985    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cb0c1ddcf710704b9f972c42a0c30696ebb3ce879fa4045a3058c584106fb688"
Jul 13 17:15:12.871209 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:12.871171    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:15:12.928048 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:12.928018    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:15:13.403285 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:13.403247    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:15:13.750189 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:13.750153    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:15:15.171148 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:15.171116    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:15:15.271896 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:15.271865    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:15:34.761468 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:34.761429    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:15:40.468179 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:40.468147    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:15:40.568308 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:40.568271    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:15:40.868550 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:40.868522    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:15:41.120631 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:41.120539    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg"]
Jul 13 17:15:41.120943 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:41.120924    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d910319-587b-4ee0-9514-c0c4cd957b99" containerName="cleanup"
Jul 13 17:15:41.121079 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:41.121044    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d910319-587b-4ee0-9514-c0c4cd957b99" containerName="cleanup"
Jul 13 17:15:41.121143 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:41.121078    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca343d0b-3bb2-4999-b47a-2a21ffa9008b" containerName="istio-proxy"
Jul 13 17:15:41.121143 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:41.121087    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca343d0b-3bb2-4999-b47a-2a21ffa9008b" containerName="istio-proxy"
Jul 13 17:15:41.121241 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:41.121196    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca343d0b-3bb2-4999-b47a-2a21ffa9008b" containerName="istio-proxy"
Jul 13 17:15:41.121241 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:41.121214    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d910319-587b-4ee0-9514-c0c4cd957b99" containerName="cleanup"
Jul 13 17:15:41.123919 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:41.123897    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg"
Jul 13 17:15:41.127593 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:41.127574    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-874fa5-openshift-default-dockercfg-qbdsv\""
Jul 13 17:15:41.139104 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:41.139080    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg"]
Jul 13 17:15:41.155001 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:41.154977    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:15:41.235416 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:41.235385    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m94kx\" (UniqueName: \"kubernetes.io/projected/deeda31a-89c7-471c-9346-eaa23ef5e35a-kube-api-access-m94kx\") pod \"e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg\" (UID: \"deeda31a-89c7-471c-9346-eaa23ef5e35a\") " pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg"
Jul 13 17:15:41.235570 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:41.235437    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/deeda31a-89c7-471c-9346-eaa23ef5e35a-istio-token\") pod \"e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg\" (UID: \"deeda31a-89c7-471c-9346-eaa23ef5e35a\") " pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg"
Jul 13 17:15:41.235570 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:41.235522    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/deeda31a-89c7-471c-9346-eaa23ef5e35a-istio-data\") pod \"e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg\" (UID: \"deeda31a-89c7-471c-9346-eaa23ef5e35a\") " pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg"
Jul 13 17:15:41.235570 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:41.235562    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/deeda31a-89c7-471c-9346-eaa23ef5e35a-istio-podinfo\") pod \"e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg\" (UID: \"deeda31a-89c7-471c-9346-eaa23ef5e35a\") " pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg"
Jul 13 17:15:41.235704 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:41.235617    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/deeda31a-89c7-471c-9346-eaa23ef5e35a-workload-socket\") pod \"e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg\" (UID: \"deeda31a-89c7-471c-9346-eaa23ef5e35a\") " pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg"
Jul 13 17:15:41.235704 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:41.235639    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/deeda31a-89c7-471c-9346-eaa23ef5e35a-istio-envoy\") pod \"e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg\" (UID: \"deeda31a-89c7-471c-9346-eaa23ef5e35a\") " pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg"
Jul 13 17:15:41.235704 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:41.235660    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/deeda31a-89c7-471c-9346-eaa23ef5e35a-istiod-ca-cert\") pod \"e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg\" (UID: \"deeda31a-89c7-471c-9346-eaa23ef5e35a\") " pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg"
Jul 13 17:15:41.235704 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:41.235688    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/deeda31a-89c7-471c-9346-eaa23ef5e35a-credential-socket\") pod \"e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg\" (UID: \"deeda31a-89c7-471c-9346-eaa23ef5e35a\") " pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg"
Jul 13 17:15:41.235930 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:41.235745    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/deeda31a-89c7-471c-9346-eaa23ef5e35a-workload-certs\") pod \"e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg\" (UID: \"deeda31a-89c7-471c-9346-eaa23ef5e35a\") " pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg"
Jul 13 17:15:41.337145 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:41.337113    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/deeda31a-89c7-471c-9346-eaa23ef5e35a-workload-socket\") pod \"e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg\" (UID: \"deeda31a-89c7-471c-9346-eaa23ef5e35a\") " pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg"
Jul 13 17:15:41.337145 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:41.337154    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/deeda31a-89c7-471c-9346-eaa23ef5e35a-istio-envoy\") pod \"e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg\" (UID: \"deeda31a-89c7-471c-9346-eaa23ef5e35a\") " pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg"
Jul 13 17:15:41.337397 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:41.337190    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/deeda31a-89c7-471c-9346-eaa23ef5e35a-istiod-ca-cert\") pod \"e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg\" (UID: \"deeda31a-89c7-471c-9346-eaa23ef5e35a\") " pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg"
Jul 13 17:15:41.337397 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:41.337320    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/deeda31a-89c7-471c-9346-eaa23ef5e35a-credential-socket\") pod \"e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg\" (UID: \"deeda31a-89c7-471c-9346-eaa23ef5e35a\") " pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg"
Jul 13 17:15:41.337397 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:41.337392    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/deeda31a-89c7-471c-9346-eaa23ef5e35a-workload-certs\") pod \"e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg\" (UID: \"deeda31a-89c7-471c-9346-eaa23ef5e35a\") " pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg"
Jul 13 17:15:41.337558 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:41.337462    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m94kx\" (UniqueName: \"kubernetes.io/projected/deeda31a-89c7-471c-9346-eaa23ef5e35a-kube-api-access-m94kx\") pod \"e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg\" (UID: \"deeda31a-89c7-471c-9346-eaa23ef5e35a\") " pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg"
Jul 13 17:15:41.337558 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:41.337514    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/deeda31a-89c7-471c-9346-eaa23ef5e35a-istio-token\") pod \"e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg\" (UID: \"deeda31a-89c7-471c-9346-eaa23ef5e35a\") " pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg"
Jul 13 17:15:41.337558 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:41.337544    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/deeda31a-89c7-471c-9346-eaa23ef5e35a-workload-socket\") pod \"e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg\" (UID: \"deeda31a-89c7-471c-9346-eaa23ef5e35a\") " pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg"
Jul 13 17:15:41.337705 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:41.337587    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/deeda31a-89c7-471c-9346-eaa23ef5e35a-istio-data\") pod \"e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg\" (UID: \"deeda31a-89c7-471c-9346-eaa23ef5e35a\") " pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg"
Jul 13 17:15:41.337705 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:41.337622    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/deeda31a-89c7-471c-9346-eaa23ef5e35a-istio-podinfo\") pod \"e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg\" (UID: \"deeda31a-89c7-471c-9346-eaa23ef5e35a\") " pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg"
Jul 13 17:15:41.337705 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:41.337639    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/deeda31a-89c7-471c-9346-eaa23ef5e35a-credential-socket\") pod \"e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg\" (UID: \"deeda31a-89c7-471c-9346-eaa23ef5e35a\") " pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg"
Jul 13 17:15:41.337918 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:41.337778    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/deeda31a-89c7-471c-9346-eaa23ef5e35a-workload-certs\") pod \"e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg\" (UID: \"deeda31a-89c7-471c-9346-eaa23ef5e35a\") " pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg"
Jul 13 17:15:41.338744 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:41.338690    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/deeda31a-89c7-471c-9346-eaa23ef5e35a-istiod-ca-cert\") pod \"e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg\" (UID: \"deeda31a-89c7-471c-9346-eaa23ef5e35a\") " pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg"
Jul 13 17:15:41.338744 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:41.338737    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/deeda31a-89c7-471c-9346-eaa23ef5e35a-istio-data\") pod \"e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg\" (UID: \"deeda31a-89c7-471c-9346-eaa23ef5e35a\") " pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg"
Jul 13 17:15:41.339741 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:41.339692    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/deeda31a-89c7-471c-9346-eaa23ef5e35a-istio-envoy\") pod \"e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg\" (UID: \"deeda31a-89c7-471c-9346-eaa23ef5e35a\") " pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg"
Jul 13 17:15:41.346827 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:41.346802    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/deeda31a-89c7-471c-9346-eaa23ef5e35a-istio-token\") pod \"e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg\" (UID: \"deeda31a-89c7-471c-9346-eaa23ef5e35a\") " pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg"
Jul 13 17:15:41.350543 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:41.350524    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/deeda31a-89c7-471c-9346-eaa23ef5e35a-istio-podinfo\") pod \"e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg\" (UID: \"deeda31a-89c7-471c-9346-eaa23ef5e35a\") " pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg"
Jul 13 17:15:41.353121 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:41.353095    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m94kx\" (UniqueName: \"kubernetes.io/projected/deeda31a-89c7-471c-9346-eaa23ef5e35a-kube-api-access-m94kx\") pod \"e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg\" (UID: \"deeda31a-89c7-471c-9346-eaa23ef5e35a\") " pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg"
Jul 13 17:15:41.434959 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:41.434892    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg"
Jul 13 17:15:41.575286 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:41.575261    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg"]
Jul 13 17:15:41.577350 ip-10-0-143-51 kubenswrapper[2573]: W0713 17:15:41.577315    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeeda31a_89c7_471c_9346_eaa23ef5e35a.slice/crio-80042761224f4b462064b5b7135a68595f22e8474a88c6ee655c5eaed0b65f90 WatchSource:0}: Error finding container 80042761224f4b462064b5b7135a68595f22e8474a88c6ee655c5eaed0b65f90: Status 404 returned error can't find the container with id 80042761224f4b462064b5b7135a68595f22e8474a88c6ee655c5eaed0b65f90
Jul 13 17:15:41.579412 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:41.579382    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:15:41.579487 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:41.579445    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:15:41.579487 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:41.579473    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:15:41.627481 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:41.627459    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:15:41.685955 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:41.685864    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg" event={"ID":"deeda31a-89c7-471c-9346-eaa23ef5e35a","Type":"ContainerStarted","Data":"180da1317baea99b6ef5f9fe6a2c8739d88c9bd3da344761350b8a722ebcfdd3"}
Jul 13 17:15:41.685955 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:41.685950    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg" event={"ID":"deeda31a-89c7-471c-9346-eaa23ef5e35a","Type":"ContainerStarted","Data":"80042761224f4b462064b5b7135a68595f22e8474a88c6ee655c5eaed0b65f90"}
Jul 13 17:15:41.707070 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:41.707019    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg" podStartSLOduration=0.706999531 podStartE2EDuration="706.999531ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:15:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:15:41.705118281 +0000 UTC m=+2139.063425107" watchObservedRunningTime="2026-07-13 17:15:41.706999531 +0000 UTC m=+2139.065306357"
Jul 13 17:15:42.435083 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:42.435051    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg"
Jul 13 17:15:42.440123 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:42.440095    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg"
Jul 13 17:15:42.690468 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:42.690376    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg"
Jul 13 17:15:42.691345 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:42.691325    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg"
Jul 13 17:15:43.648942 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:43.648912    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:15:43.778940 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:43.778908    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:15:43.954176 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:43.954079    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:15:44.256363 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:44.256335    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:15:44.605103 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:44.605023    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:15:44.709873 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:44.709840    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:15:48.125600 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:48.125572    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:15:48.441761 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:48.441659    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:15:48.722753 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:48.722704    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz"]
Jul 13 17:15:48.726443 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:48.726423    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz"
Jul 13 17:15:48.729353 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:48.729332    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-0c5523-openshift-default-dockercfg-pgcwf\""
Jul 13 17:15:48.738556 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:48.738529    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz"]
Jul 13 17:15:48.756591 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:48.756561    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:15:48.801700 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:48.801676    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11797c58-a683-458b-801a-88fe6cbd292a-istio-data\") pod \"e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz\" (UID: \"11797c58-a683-458b-801a-88fe6cbd292a\") " pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz"
Jul 13 17:15:48.801851 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:48.801708    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11797c58-a683-458b-801a-88fe6cbd292a-istio-token\") pod \"e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz\" (UID: \"11797c58-a683-458b-801a-88fe6cbd292a\") " pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz"
Jul 13 17:15:48.801851 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:48.801764    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11797c58-a683-458b-801a-88fe6cbd292a-credential-socket\") pod \"e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz\" (UID: \"11797c58-a683-458b-801a-88fe6cbd292a\") " pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz"
Jul 13 17:15:48.801851 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:48.801788    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11797c58-a683-458b-801a-88fe6cbd292a-workload-certs\") pod \"e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz\" (UID: \"11797c58-a683-458b-801a-88fe6cbd292a\") " pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz"
Jul 13 17:15:48.801851 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:48.801817    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11797c58-a683-458b-801a-88fe6cbd292a-workload-socket\") pod \"e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz\" (UID: \"11797c58-a683-458b-801a-88fe6cbd292a\") " pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz"
Jul 13 17:15:48.801851 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:48.801837    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11797c58-a683-458b-801a-88fe6cbd292a-istiod-ca-cert\") pod \"e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz\" (UID: \"11797c58-a683-458b-801a-88fe6cbd292a\") " pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz"
Jul 13 17:15:48.801851 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:48.801852    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11797c58-a683-458b-801a-88fe6cbd292a-istio-envoy\") pod \"e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz\" (UID: \"11797c58-a683-458b-801a-88fe6cbd292a\") " pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz"
Jul 13 17:15:48.802168 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:48.801961    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11797c58-a683-458b-801a-88fe6cbd292a-istio-podinfo\") pod \"e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz\" (UID: \"11797c58-a683-458b-801a-88fe6cbd292a\") " pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz"
Jul 13 17:15:48.802168 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:48.802010    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9t28\" (UniqueName: \"kubernetes.io/projected/11797c58-a683-458b-801a-88fe6cbd292a-kube-api-access-m9t28\") pod \"e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz\" (UID: \"11797c58-a683-458b-801a-88fe6cbd292a\") " pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz"
Jul 13 17:15:48.902753 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:48.902706    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11797c58-a683-458b-801a-88fe6cbd292a-istio-podinfo\") pod \"e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz\" (UID: \"11797c58-a683-458b-801a-88fe6cbd292a\") " pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz"
Jul 13 17:15:48.902918 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:48.902777    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9t28\" (UniqueName: \"kubernetes.io/projected/11797c58-a683-458b-801a-88fe6cbd292a-kube-api-access-m9t28\") pod \"e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz\" (UID: \"11797c58-a683-458b-801a-88fe6cbd292a\") " pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz"
Jul 13 17:15:48.902918 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:48.902811    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11797c58-a683-458b-801a-88fe6cbd292a-istio-data\") pod \"e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz\" (UID: \"11797c58-a683-458b-801a-88fe6cbd292a\") " pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz"
Jul 13 17:15:48.902918 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:48.902830    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11797c58-a683-458b-801a-88fe6cbd292a-istio-token\") pod \"e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz\" (UID: \"11797c58-a683-458b-801a-88fe6cbd292a\") " pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz"
Jul 13 17:15:48.902918 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:48.902863    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11797c58-a683-458b-801a-88fe6cbd292a-credential-socket\") pod \"e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz\" (UID: \"11797c58-a683-458b-801a-88fe6cbd292a\") " pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz"
Jul 13 17:15:48.902918 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:48.902892    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11797c58-a683-458b-801a-88fe6cbd292a-workload-certs\") pod \"e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz\" (UID: \"11797c58-a683-458b-801a-88fe6cbd292a\") " pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz"
Jul 13 17:15:48.903171 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:48.902923    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11797c58-a683-458b-801a-88fe6cbd292a-workload-socket\") pod \"e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz\" (UID: \"11797c58-a683-458b-801a-88fe6cbd292a\") " pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz"
Jul 13 17:15:48.903171 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:48.902958    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11797c58-a683-458b-801a-88fe6cbd292a-istiod-ca-cert\") pod \"e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz\" (UID: \"11797c58-a683-458b-801a-88fe6cbd292a\") " pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz"
Jul 13 17:15:48.903278 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:48.903181    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11797c58-a683-458b-801a-88fe6cbd292a-istio-envoy\") pod \"e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz\" (UID: \"11797c58-a683-458b-801a-88fe6cbd292a\") " pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz"
Jul 13 17:15:48.903278 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:48.903258    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11797c58-a683-458b-801a-88fe6cbd292a-istio-data\") pod \"e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz\" (UID: \"11797c58-a683-458b-801a-88fe6cbd292a\") " pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz"
Jul 13 17:15:48.903381 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:48.903295    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11797c58-a683-458b-801a-88fe6cbd292a-credential-socket\") pod \"e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz\" (UID: \"11797c58-a683-458b-801a-88fe6cbd292a\") " pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz"
Jul 13 17:15:48.903655 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:48.903611    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11797c58-a683-458b-801a-88fe6cbd292a-workload-socket\") pod \"e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz\" (UID: \"11797c58-a683-458b-801a-88fe6cbd292a\") " pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz"
Jul 13 17:15:48.903655 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:48.903643    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11797c58-a683-458b-801a-88fe6cbd292a-istiod-ca-cert\") pod \"e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz\" (UID: \"11797c58-a683-458b-801a-88fe6cbd292a\") " pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz"
Jul 13 17:15:48.903837 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:48.903703    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11797c58-a683-458b-801a-88fe6cbd292a-workload-certs\") pod \"e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz\" (UID: \"11797c58-a683-458b-801a-88fe6cbd292a\") " pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz"
Jul 13 17:15:48.905452 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:48.905430    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11797c58-a683-458b-801a-88fe6cbd292a-istio-podinfo\") pod \"e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz\" (UID: \"11797c58-a683-458b-801a-88fe6cbd292a\") " pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz"
Jul 13 17:15:48.905613 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:48.905594    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11797c58-a683-458b-801a-88fe6cbd292a-istio-envoy\") pod \"e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz\" (UID: \"11797c58-a683-458b-801a-88fe6cbd292a\") " pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz"
Jul 13 17:15:48.911612 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:48.911583    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11797c58-a683-458b-801a-88fe6cbd292a-istio-token\") pod \"e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz\" (UID: \"11797c58-a683-458b-801a-88fe6cbd292a\") " pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz"
Jul 13 17:15:48.911873 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:48.911849    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9t28\" (UniqueName: \"kubernetes.io/projected/11797c58-a683-458b-801a-88fe6cbd292a-kube-api-access-m9t28\") pod \"e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz\" (UID: \"11797c58-a683-458b-801a-88fe6cbd292a\") " pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz"
Jul 13 17:15:49.039216 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:49.039104    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz"
Jul 13 17:15:49.133006 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:49.132950    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:15:49.205773 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:49.205742    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz"]
Jul 13 17:15:49.206815 ip-10-0-143-51 kubenswrapper[2573]: W0713 17:15:49.206787    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11797c58_a683_458b_801a_88fe6cbd292a.slice/crio-d95593eea5e96329bf6ee4b7b10edfa0d6bb9b860322102f534f3667e51fd4f2 WatchSource:0}: Error finding container d95593eea5e96329bf6ee4b7b10edfa0d6bb9b860322102f534f3667e51fd4f2: Status 404 returned error can't find the container with id d95593eea5e96329bf6ee4b7b10edfa0d6bb9b860322102f534f3667e51fd4f2
Jul 13 17:15:49.209049 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:49.209018    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:15:49.209143 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:49.209082    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:15:49.209143 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:49.209112    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:15:49.726183 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:49.726147    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz" event={"ID":"11797c58-a683-458b-801a-88fe6cbd292a","Type":"ContainerStarted","Data":"c3f88db2e289649c7f89d20c7d0e763d3dd83b06cfb849f99c9afee89428f43c"}
Jul 13 17:15:49.726329 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:49.726207    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz" event={"ID":"11797c58-a683-458b-801a-88fe6cbd292a","Type":"ContainerStarted","Data":"d95593eea5e96329bf6ee4b7b10edfa0d6bb9b860322102f534f3667e51fd4f2"}
Jul 13 17:15:49.750402 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:49.750341    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz" podStartSLOduration=1.750322293 podStartE2EDuration="1.750322293s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:15:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:15:49.748072522 +0000 UTC m=+2147.106379348" watchObservedRunningTime="2026-07-13 17:15:49.750322293 +0000 UTC m=+2147.108629120"
Jul 13 17:15:50.041365 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:50.041269    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz"
Jul 13 17:15:50.052271 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:50.052239    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz"
Jul 13 17:15:50.731259 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:50.731225    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz"
Jul 13 17:15:50.732054 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:50.732038    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz"
Jul 13 17:15:51.775025 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:51.774987    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:15:51.875622 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:51.875589    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:15:51.978588 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:51.978555    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:15:52.403304 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:52.403276    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:15:52.784062 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:52.784031    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:15:52.998581 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:52.998555    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:15:56.188453 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:56.188424    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:15:56.764516 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:56.764489    2573 generic.go:356] "Generic (PLEG): container finished" podID="deeda31a-89c7-471c-9346-eaa23ef5e35a" containerID="180da1317baea99b6ef5f9fe6a2c8739d88c9bd3da344761350b8a722ebcfdd3" exitCode=0
Jul 13 17:15:56.764689 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:56.764563    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg" event={"ID":"deeda31a-89c7-471c-9346-eaa23ef5e35a","Type":"ContainerDied","Data":"180da1317baea99b6ef5f9fe6a2c8739d88c9bd3da344761350b8a722ebcfdd3"}
Jul 13 17:15:56.765010 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:56.764995    2573 scope.go:117] "RemoveContainer" containerID="180da1317baea99b6ef5f9fe6a2c8739d88c9bd3da344761350b8a722ebcfdd3"
Jul 13 17:15:56.765970 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:56.765933    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:15:56.766075 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:56.766006    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:15:56.766075 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:56.766044    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:15:57.691126 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:57.691085    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg"
Jul 13 17:15:57.771574 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:57.771541    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg" event={"ID":"deeda31a-89c7-471c-9346-eaa23ef5e35a","Type":"ContainerStarted","Data":"baa3d0df5b0cd8bf889f390de18e2f422f34672f225b45c8d697757cf67e74d2"}
Jul 13 17:15:58.435470 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:58.435433    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg"
Jul 13 17:15:58.437037 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:58.437002    2573 patch_prober.go:28] interesting pod/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 13 17:15:58.437185 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:58.437078    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg" podUID="deeda31a-89c7-471c-9346-eaa23ef5e35a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 13 17:15:59.436211 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:59.436173    2573 patch_prober.go:28] interesting pod/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 13 17:15:59.436793 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:15:59.436762    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg" podUID="deeda31a-89c7-471c-9346-eaa23ef5e35a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 13 17:16:00.436282 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:16:00.436248    2573 patch_prober.go:28] interesting pod/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 13 17:16:00.436952 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:16:00.436916    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg" podUID="deeda31a-89c7-471c-9346-eaa23ef5e35a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 13 17:16:01.435759 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:16:01.435683    2573 patch_prober.go:28] interesting pod/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 13 17:16:01.435978 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:16:01.435785    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg" podUID="deeda31a-89c7-471c-9346-eaa23ef5e35a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 13 17:16:02.444684 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:16:02.444651    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg"
Jul 13 17:16:02.445811 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:16:02.445786    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg"
Jul 13 17:16:02.448835 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:16:02.448814    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg"
Jul 13 17:16:05.518190 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:16:05.518160    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:16:05.618009 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:16:05.617967    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:16:06.772869 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:16:06.772833    2573 patch_prober.go:28] interesting pod/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 13 17:16:06.773238 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:16:06.772881    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz" podUID="11797c58-a683-458b-801a-88fe6cbd292a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 13 17:16:07.826637 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:16:07.826551    2573 generic.go:356] "Generic (PLEG): container finished" podID="11797c58-a683-458b-801a-88fe6cbd292a" containerID="c3f88db2e289649c7f89d20c7d0e763d3dd83b06cfb849f99c9afee89428f43c" exitCode=0
Jul 13 17:16:07.826637 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:16:07.826622    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz" event={"ID":"11797c58-a683-458b-801a-88fe6cbd292a","Type":"ContainerDied","Data":"c3f88db2e289649c7f89d20c7d0e763d3dd83b06cfb849f99c9afee89428f43c"}
Jul 13 17:16:07.827091 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:16:07.827006    2573 scope.go:117] "RemoveContainer" containerID="c3f88db2e289649c7f89d20c7d0e763d3dd83b06cfb849f99c9afee89428f43c"
Jul 13 17:16:07.827970 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:16:07.827943    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:16:07.828038 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:16:07.828007    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:16:07.828077 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:16:07.828036    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:16:08.833509 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:16:08.833468    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz" event={"ID":"11797c58-a683-458b-801a-88fe6cbd292a","Type":"ContainerStarted","Data":"70758f334b89ce791e408e5b9614b3f536a0237d2035f1fb131db4aa1a4e94fa"}
Jul 13 17:16:09.040410 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:16:09.040371    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz"
Jul 13 17:16:09.040602 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:16:09.040494    2573 patch_prober.go:28] interesting pod/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 13 17:16:09.040602 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:16:09.040538    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz" podUID="11797c58-a683-458b-801a-88fe6cbd292a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 13 17:16:10.040098 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:16:10.040055    2573 patch_prober.go:28] interesting pod/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 13 17:16:10.040591 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:16:10.040118    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz" podUID="11797c58-a683-458b-801a-88fe6cbd292a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 13 17:16:11.040300 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:16:11.040264    2573 patch_prober.go:28] interesting pod/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 13 17:16:11.040874 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:16:11.040844    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz" podUID="11797c58-a683-458b-801a-88fe6cbd292a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 13 17:16:12.039652 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:16:12.039617    2573 patch_prober.go:28] interesting pod/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 13 17:16:12.039955 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:16:12.039926    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz" podUID="11797c58-a683-458b-801a-88fe6cbd292a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 13 17:16:13.043695 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:16:13.043667    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz"
Jul 13 17:16:13.044159 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:16:13.043957    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz"
Jul 13 17:16:13.044748 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:16:13.044732    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz"
Jul 13 17:16:13.122377 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:16:13.122336    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:16:14.407741 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:16:14.407691    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:16:14.508374 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:16:14.508334    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:16:43.300482 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:16:43.300421    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:17:10.166518 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:10.166473    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:17:11.202165 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:11.202128    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:17:11.231113 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:11.231086    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-874fa5-l74ng"]
Jul 13 17:17:11.234385 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:11.234370    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-874fa5-l74ng"
Jul 13 17:17:11.236985 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:11.236963    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 17:17:11.237112 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:11.237050    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fkks4\""
Jul 13 17:17:11.241823 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:11.241800    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-874fa5-l74ng"]
Jul 13 17:17:11.324910 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:11.324886    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5acbce3-afc9-4d60-8bb1-8a3daf58d7a2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-874fa5-l74ng\" (UID: \"a5acbce3-afc9-4d60-8bb1-8a3daf58d7a2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-874fa5-l74ng"
Jul 13 17:17:11.425780 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:11.425759    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5acbce3-afc9-4d60-8bb1-8a3daf58d7a2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-874fa5-l74ng\" (UID: \"a5acbce3-afc9-4d60-8bb1-8a3daf58d7a2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-874fa5-l74ng"
Jul 13 17:17:11.426338 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:11.426319    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5acbce3-afc9-4d60-8bb1-8a3daf58d7a2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-874fa5-l74ng\" (UID: \"a5acbce3-afc9-4d60-8bb1-8a3daf58d7a2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-874fa5-l74ng"
Jul 13 17:17:11.546639 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:11.546614    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-874fa5-l74ng"
Jul 13 17:17:11.677626 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:11.677601    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-874fa5-l74ng"]
Jul 13 17:17:11.680361 ip-10-0-143-51 kubenswrapper[2573]: W0713 17:17:11.680326    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5acbce3_afc9_4d60_8bb1_8a3daf58d7a2.slice/crio-a6827c04c13ecc800ad973036e2c51bde47afda627e8dce7fafd03f2c124e3e1 WatchSource:0}: Error finding container a6827c04c13ecc800ad973036e2c51bde47afda627e8dce7fafd03f2c124e3e1: Status 404 returned error can't find the container with id a6827c04c13ecc800ad973036e2c51bde47afda627e8dce7fafd03f2c124e3e1
Jul 13 17:17:11.729498 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:11.729472    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:17:11.830941 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:11.830876    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:17:12.144063 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:12.143985    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-874fa5-l74ng" event={"ID":"a5acbce3-afc9-4d60-8bb1-8a3daf58d7a2","Type":"ContainerStarted","Data":"be94a9d94ba9d3fb3bdb22213e6e62289fd43eb710bd4f9bf2cf577d4431b056"}
Jul 13 17:17:12.144063 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:12.144026    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-874fa5-l74ng" event={"ID":"a5acbce3-afc9-4d60-8bb1-8a3daf58d7a2","Type":"ContainerStarted","Data":"a6827c04c13ecc800ad973036e2c51bde47afda627e8dce7fafd03f2c124e3e1"}
Jul 13 17:17:12.159947 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:12.159904    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-874fa5-l74ng" podStartSLOduration=1.159890298 podStartE2EDuration="1.159890298s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:17:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:17:12.157900379 +0000 UTC m=+2229.516207204" watchObservedRunningTime="2026-07-13 17:17:12.159890298 +0000 UTC m=+2229.518197174"
Jul 13 17:17:13.149532 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:13.149503    2573 generic.go:356] "Generic (PLEG): container finished" podID="a5acbce3-afc9-4d60-8bb1-8a3daf58d7a2" containerID="be94a9d94ba9d3fb3bdb22213e6e62289fd43eb710bd4f9bf2cf577d4431b056" exitCode=0
Jul 13 17:17:13.149933 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:13.149555    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-874fa5-l74ng" event={"ID":"a5acbce3-afc9-4d60-8bb1-8a3daf58d7a2","Type":"ContainerDied","Data":"be94a9d94ba9d3fb3bdb22213e6e62289fd43eb710bd4f9bf2cf577d4431b056"}
Jul 13 17:17:14.285015 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:14.284993    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-874fa5-l74ng"
Jul 13 17:17:14.351538 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:14.351510    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5acbce3-afc9-4d60-8bb1-8a3daf58d7a2-maas-api-service-ca\") pod \"a5acbce3-afc9-4d60-8bb1-8a3daf58d7a2\" (UID: \"a5acbce3-afc9-4d60-8bb1-8a3daf58d7a2\") "
Jul 13 17:17:14.351883 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:14.351861    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5acbce3-afc9-4d60-8bb1-8a3daf58d7a2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a5acbce3-afc9-4d60-8bb1-8a3daf58d7a2" (UID: "a5acbce3-afc9-4d60-8bb1-8a3daf58d7a2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:17:14.453120 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:14.453053    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5acbce3-afc9-4d60-8bb1-8a3daf58d7a2-maas-api-service-ca\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:17:15.160019 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:15.159997    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-874fa5-l74ng"
Jul 13 17:17:15.160165 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:15.160034    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-874fa5-l74ng" event={"ID":"a5acbce3-afc9-4d60-8bb1-8a3daf58d7a2","Type":"ContainerDied","Data":"a6827c04c13ecc800ad973036e2c51bde47afda627e8dce7fafd03f2c124e3e1"}
Jul 13 17:17:15.160165 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:15.160094    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a6827c04c13ecc800ad973036e2c51bde47afda627e8dce7fafd03f2c124e3e1"
Jul 13 17:17:21.672332 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:21.672301    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:17:26.330847 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:26.330746    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:17:32.107845 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:32.107811    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:17:32.208532 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:32.208505    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:17:37.075274 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:37.075238    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg"]
Jul 13 17:17:37.075768 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:37.075522    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg" podUID="deeda31a-89c7-471c-9346-eaa23ef5e35a" containerName="istio-proxy" containerID="cri-o://baa3d0df5b0cd8bf889f390de18e2f422f34672f225b45c8d697757cf67e74d2" gracePeriod=30
Jul 13 17:17:37.105038 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:37.105009    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:17:37.325187 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:37.325151    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:17:38.137266 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:38.137225    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:17:38.316221 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:38.316179    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:17:42.289122 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:42.289093    2573 generic.go:356] "Generic (PLEG): container finished" podID="deeda31a-89c7-471c-9346-eaa23ef5e35a" containerID="baa3d0df5b0cd8bf889f390de18e2f422f34672f225b45c8d697757cf67e74d2" exitCode=0
Jul 13 17:17:42.289472 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:42.289144    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg" event={"ID":"deeda31a-89c7-471c-9346-eaa23ef5e35a","Type":"ContainerDied","Data":"baa3d0df5b0cd8bf889f390de18e2f422f34672f225b45c8d697757cf67e74d2"}
Jul 13 17:17:42.289472 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:42.289215    2573 scope.go:117] "RemoveContainer" containerID="180da1317baea99b6ef5f9fe6a2c8739d88c9bd3da344761350b8a722ebcfdd3"
Jul 13 17:17:42.322773 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:42.322751    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg"
Jul 13 17:17:42.396923 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:42.396856    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/deeda31a-89c7-471c-9346-eaa23ef5e35a-workload-socket\") pod \"deeda31a-89c7-471c-9346-eaa23ef5e35a\" (UID: \"deeda31a-89c7-471c-9346-eaa23ef5e35a\") "
Jul 13 17:17:42.396923 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:42.396888    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/deeda31a-89c7-471c-9346-eaa23ef5e35a-istio-token\") pod \"deeda31a-89c7-471c-9346-eaa23ef5e35a\" (UID: \"deeda31a-89c7-471c-9346-eaa23ef5e35a\") "
Jul 13 17:17:42.396923 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:42.396904    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/deeda31a-89c7-471c-9346-eaa23ef5e35a-credential-socket\") pod \"deeda31a-89c7-471c-9346-eaa23ef5e35a\" (UID: \"deeda31a-89c7-471c-9346-eaa23ef5e35a\") "
Jul 13 17:17:42.397159 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:42.396929    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/deeda31a-89c7-471c-9346-eaa23ef5e35a-istio-data\") pod \"deeda31a-89c7-471c-9346-eaa23ef5e35a\" (UID: \"deeda31a-89c7-471c-9346-eaa23ef5e35a\") "
Jul 13 17:17:42.397159 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:42.396956    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/deeda31a-89c7-471c-9346-eaa23ef5e35a-istio-podinfo\") pod \"deeda31a-89c7-471c-9346-eaa23ef5e35a\" (UID: \"deeda31a-89c7-471c-9346-eaa23ef5e35a\") "
Jul 13 17:17:42.397159 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:42.397016    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m94kx\" (UniqueName: \"kubernetes.io/projected/deeda31a-89c7-471c-9346-eaa23ef5e35a-kube-api-access-m94kx\") pod \"deeda31a-89c7-471c-9346-eaa23ef5e35a\" (UID: \"deeda31a-89c7-471c-9346-eaa23ef5e35a\") "
Jul 13 17:17:42.397159 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:42.397047    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/deeda31a-89c7-471c-9346-eaa23ef5e35a-istiod-ca-cert\") pod \"deeda31a-89c7-471c-9346-eaa23ef5e35a\" (UID: \"deeda31a-89c7-471c-9346-eaa23ef5e35a\") "
Jul 13 17:17:42.397159 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:42.397095    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/deeda31a-89c7-471c-9346-eaa23ef5e35a-istio-envoy\") pod \"deeda31a-89c7-471c-9346-eaa23ef5e35a\" (UID: \"deeda31a-89c7-471c-9346-eaa23ef5e35a\") "
Jul 13 17:17:42.397159 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:42.397126    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/deeda31a-89c7-471c-9346-eaa23ef5e35a-workload-certs\") pod \"deeda31a-89c7-471c-9346-eaa23ef5e35a\" (UID: \"deeda31a-89c7-471c-9346-eaa23ef5e35a\") "
Jul 13 17:17:42.397159 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:42.397138    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/deeda31a-89c7-471c-9346-eaa23ef5e35a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "deeda31a-89c7-471c-9346-eaa23ef5e35a" (UID: "deeda31a-89c7-471c-9346-eaa23ef5e35a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:17:42.397519 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:42.397245    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/deeda31a-89c7-471c-9346-eaa23ef5e35a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "deeda31a-89c7-471c-9346-eaa23ef5e35a" (UID: "deeda31a-89c7-471c-9346-eaa23ef5e35a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:17:42.397519 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:42.397491    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/deeda31a-89c7-471c-9346-eaa23ef5e35a-workload-socket\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:17:42.397519 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:42.397507    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/deeda31a-89c7-471c-9346-eaa23ef5e35a-credential-socket\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:17:42.397685 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:42.397517    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/deeda31a-89c7-471c-9346-eaa23ef5e35a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "deeda31a-89c7-471c-9346-eaa23ef5e35a" (UID: "deeda31a-89c7-471c-9346-eaa23ef5e35a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:17:42.397788 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:42.397765    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/deeda31a-89c7-471c-9346-eaa23ef5e35a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "deeda31a-89c7-471c-9346-eaa23ef5e35a" (UID: "deeda31a-89c7-471c-9346-eaa23ef5e35a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:17:42.397941 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:42.397908    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/deeda31a-89c7-471c-9346-eaa23ef5e35a-istio-data" (OuterVolumeSpecName: "istio-data") pod "deeda31a-89c7-471c-9346-eaa23ef5e35a" (UID: "deeda31a-89c7-471c-9346-eaa23ef5e35a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:17:42.399109 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:42.399085    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/deeda31a-89c7-471c-9346-eaa23ef5e35a-istio-token" (OuterVolumeSpecName: "istio-token") pod "deeda31a-89c7-471c-9346-eaa23ef5e35a" (UID: "deeda31a-89c7-471c-9346-eaa23ef5e35a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:17:42.399213 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:42.399192    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/deeda31a-89c7-471c-9346-eaa23ef5e35a-kube-api-access-m94kx" (OuterVolumeSpecName: "kube-api-access-m94kx") pod "deeda31a-89c7-471c-9346-eaa23ef5e35a" (UID: "deeda31a-89c7-471c-9346-eaa23ef5e35a"). InnerVolumeSpecName "kube-api-access-m94kx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:17:42.399261 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:42.399253    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/deeda31a-89c7-471c-9346-eaa23ef5e35a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "deeda31a-89c7-471c-9346-eaa23ef5e35a" (UID: "deeda31a-89c7-471c-9346-eaa23ef5e35a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:17:42.399434 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:42.399415    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/deeda31a-89c7-471c-9346-eaa23ef5e35a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "deeda31a-89c7-471c-9346-eaa23ef5e35a" (UID: "deeda31a-89c7-471c-9346-eaa23ef5e35a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 17:17:42.498156 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:42.498127    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/deeda31a-89c7-471c-9346-eaa23ef5e35a-istio-token\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:17:42.498156 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:42.498151    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/deeda31a-89c7-471c-9346-eaa23ef5e35a-istio-data\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:17:42.498310 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:42.498163    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/deeda31a-89c7-471c-9346-eaa23ef5e35a-istio-podinfo\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:17:42.498310 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:42.498176    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m94kx\" (UniqueName: \"kubernetes.io/projected/deeda31a-89c7-471c-9346-eaa23ef5e35a-kube-api-access-m94kx\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:17:42.498310 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:42.498189    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/deeda31a-89c7-471c-9346-eaa23ef5e35a-istiod-ca-cert\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:17:42.498310 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:42.498200    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/deeda31a-89c7-471c-9346-eaa23ef5e35a-istio-envoy\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:17:42.498310 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:42.498210    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/deeda31a-89c7-471c-9346-eaa23ef5e35a-workload-certs\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:17:43.295386 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:43.295350    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg" event={"ID":"deeda31a-89c7-471c-9346-eaa23ef5e35a","Type":"ContainerDied","Data":"80042761224f4b462064b5b7135a68595f22e8474a88c6ee655c5eaed0b65f90"}
Jul 13 17:17:43.295386 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:43.295371    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg"
Jul 13 17:17:43.295924 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:43.295418    2573 scope.go:117] "RemoveContainer" containerID="baa3d0df5b0cd8bf889f390de18e2f422f34672f225b45c8d697757cf67e74d2"
Jul 13 17:17:43.312972 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:43.312949    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg"]
Jul 13 17:17:43.317253 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:43.317231    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-874fa5-openshift-default-6d788d8b6c-ch4hg"]
Jul 13 17:17:45.147309 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:45.147273    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="deeda31a-89c7-471c-9346-eaa23ef5e35a" path="/var/lib/kubelet/pods/deeda31a-89c7-471c-9346-eaa23ef5e35a/volumes"
Jul 13 17:17:48.322796 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:48.322764    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:17:49.247598 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:49.247566    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:17:52.530559 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:52.530527    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:17:58.233860 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:58.233826    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:17:58.303466 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:17:58.303436    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:03.292324 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:03.292293    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz"]
Jul 13 17:18:03.292803 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:03.292508    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz" podUID="11797c58-a683-458b-801a-88fe6cbd292a" containerName="istio-proxy" containerID="cri-o://70758f334b89ce791e408e5b9614b3f536a0237d2035f1fb131db4aa1a4e94fa" gracePeriod=30
Jul 13 17:18:03.853210 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:03.853177    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:04.001625 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.001586    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:04.103068 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.103035    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:04.217528 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.217449    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx"]
Jul 13 17:18:04.217951 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.217925    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="deeda31a-89c7-471c-9346-eaa23ef5e35a" containerName="istio-proxy"
Jul 13 17:18:04.218031 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.217955    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="deeda31a-89c7-471c-9346-eaa23ef5e35a" containerName="istio-proxy"
Jul 13 17:18:04.218031 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.217968    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="deeda31a-89c7-471c-9346-eaa23ef5e35a" containerName="istio-proxy"
Jul 13 17:18:04.218031 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.217977    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="deeda31a-89c7-471c-9346-eaa23ef5e35a" containerName="istio-proxy"
Jul 13 17:18:04.218031 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.218004    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5acbce3-afc9-4d60-8bb1-8a3daf58d7a2" containerName="revoke-keys"
Jul 13 17:18:04.218031 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.218013    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5acbce3-afc9-4d60-8bb1-8a3daf58d7a2" containerName="revoke-keys"
Jul 13 17:18:04.218188 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.218085    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="deeda31a-89c7-471c-9346-eaa23ef5e35a" containerName="istio-proxy"
Jul 13 17:18:04.218188 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.218095    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5acbce3-afc9-4d60-8bb1-8a3daf58d7a2" containerName="revoke-keys"
Jul 13 17:18:04.222539 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.222524    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx"
Jul 13 17:18:04.226663 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.226644    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-2386aa-openshift-default-dockercfg-h6pbr\""
Jul 13 17:18:04.233704 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.233683    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx"]
Jul 13 17:18:04.243091 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.243065    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:04.276484 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.276460    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/457cec5a-3ab0-4932-b02d-22e23f939d34-istio-podinfo\") pod \"e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx\" (UID: \"457cec5a-3ab0-4932-b02d-22e23f939d34\") " pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx"
Jul 13 17:18:04.276637 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.276491    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/457cec5a-3ab0-4932-b02d-22e23f939d34-credential-socket\") pod \"e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx\" (UID: \"457cec5a-3ab0-4932-b02d-22e23f939d34\") " pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx"
Jul 13 17:18:04.276637 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.276523    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/457cec5a-3ab0-4932-b02d-22e23f939d34-istiod-ca-cert\") pod \"e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx\" (UID: \"457cec5a-3ab0-4932-b02d-22e23f939d34\") " pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx"
Jul 13 17:18:04.276637 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.276547    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/457cec5a-3ab0-4932-b02d-22e23f939d34-workload-socket\") pod \"e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx\" (UID: \"457cec5a-3ab0-4932-b02d-22e23f939d34\") " pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx"
Jul 13 17:18:04.276637 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.276563    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/457cec5a-3ab0-4932-b02d-22e23f939d34-istio-data\") pod \"e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx\" (UID: \"457cec5a-3ab0-4932-b02d-22e23f939d34\") " pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx"
Jul 13 17:18:04.276637 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.276577    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/457cec5a-3ab0-4932-b02d-22e23f939d34-istio-token\") pod \"e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx\" (UID: \"457cec5a-3ab0-4932-b02d-22e23f939d34\") " pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx"
Jul 13 17:18:04.276637 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.276597    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/457cec5a-3ab0-4932-b02d-22e23f939d34-workload-certs\") pod \"e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx\" (UID: \"457cec5a-3ab0-4932-b02d-22e23f939d34\") " pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx"
Jul 13 17:18:04.276637 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.276616    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/457cec5a-3ab0-4932-b02d-22e23f939d34-istio-envoy\") pod \"e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx\" (UID: \"457cec5a-3ab0-4932-b02d-22e23f939d34\") " pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx"
Jul 13 17:18:04.276908 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.276666    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tccn7\" (UniqueName: \"kubernetes.io/projected/457cec5a-3ab0-4932-b02d-22e23f939d34-kube-api-access-tccn7\") pod \"e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx\" (UID: \"457cec5a-3ab0-4932-b02d-22e23f939d34\") " pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx"
Jul 13 17:18:04.378158 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.378125    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/457cec5a-3ab0-4932-b02d-22e23f939d34-workload-socket\") pod \"e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx\" (UID: \"457cec5a-3ab0-4932-b02d-22e23f939d34\") " pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx"
Jul 13 17:18:04.378158 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.378163    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/457cec5a-3ab0-4932-b02d-22e23f939d34-istio-data\") pod \"e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx\" (UID: \"457cec5a-3ab0-4932-b02d-22e23f939d34\") " pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx"
Jul 13 17:18:04.378691 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.378186    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/457cec5a-3ab0-4932-b02d-22e23f939d34-istio-token\") pod \"e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx\" (UID: \"457cec5a-3ab0-4932-b02d-22e23f939d34\") " pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx"
Jul 13 17:18:04.378691 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.378217    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/457cec5a-3ab0-4932-b02d-22e23f939d34-workload-certs\") pod \"e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx\" (UID: \"457cec5a-3ab0-4932-b02d-22e23f939d34\") " pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx"
Jul 13 17:18:04.378691 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.378247    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/457cec5a-3ab0-4932-b02d-22e23f939d34-istio-envoy\") pod \"e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx\" (UID: \"457cec5a-3ab0-4932-b02d-22e23f939d34\") " pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx"
Jul 13 17:18:04.378691 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.378276    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tccn7\" (UniqueName: \"kubernetes.io/projected/457cec5a-3ab0-4932-b02d-22e23f939d34-kube-api-access-tccn7\") pod \"e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx\" (UID: \"457cec5a-3ab0-4932-b02d-22e23f939d34\") " pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx"
Jul 13 17:18:04.378691 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.378388    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/457cec5a-3ab0-4932-b02d-22e23f939d34-istio-podinfo\") pod \"e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx\" (UID: \"457cec5a-3ab0-4932-b02d-22e23f939d34\") " pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx"
Jul 13 17:18:04.378691 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.378424    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/457cec5a-3ab0-4932-b02d-22e23f939d34-credential-socket\") pod \"e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx\" (UID: \"457cec5a-3ab0-4932-b02d-22e23f939d34\") " pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx"
Jul 13 17:18:04.378691 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.378453    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/457cec5a-3ab0-4932-b02d-22e23f939d34-istiod-ca-cert\") pod \"e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx\" (UID: \"457cec5a-3ab0-4932-b02d-22e23f939d34\") " pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx"
Jul 13 17:18:04.378691 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.378538    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/457cec5a-3ab0-4932-b02d-22e23f939d34-workload-socket\") pod \"e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx\" (UID: \"457cec5a-3ab0-4932-b02d-22e23f939d34\") " pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx"
Jul 13 17:18:04.378691 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.378658    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/457cec5a-3ab0-4932-b02d-22e23f939d34-workload-certs\") pod \"e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx\" (UID: \"457cec5a-3ab0-4932-b02d-22e23f939d34\") " pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx"
Jul 13 17:18:04.379244 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.378978    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/457cec5a-3ab0-4932-b02d-22e23f939d34-istio-data\") pod \"e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx\" (UID: \"457cec5a-3ab0-4932-b02d-22e23f939d34\") " pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx"
Jul 13 17:18:04.379244 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.378997    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/457cec5a-3ab0-4932-b02d-22e23f939d34-credential-socket\") pod \"e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx\" (UID: \"457cec5a-3ab0-4932-b02d-22e23f939d34\") " pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx"
Jul 13 17:18:04.379458 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.379437    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/457cec5a-3ab0-4932-b02d-22e23f939d34-istiod-ca-cert\") pod \"e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx\" (UID: \"457cec5a-3ab0-4932-b02d-22e23f939d34\") " pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx"
Jul 13 17:18:04.381082 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.381061    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/457cec5a-3ab0-4932-b02d-22e23f939d34-istio-envoy\") pod \"e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx\" (UID: \"457cec5a-3ab0-4932-b02d-22e23f939d34\") " pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx"
Jul 13 17:18:04.381290 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.381270    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/457cec5a-3ab0-4932-b02d-22e23f939d34-istio-podinfo\") pod \"e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx\" (UID: \"457cec5a-3ab0-4932-b02d-22e23f939d34\") " pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx"
Jul 13 17:18:04.388662 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.388639    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/457cec5a-3ab0-4932-b02d-22e23f939d34-istio-token\") pod \"e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx\" (UID: \"457cec5a-3ab0-4932-b02d-22e23f939d34\") " pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx"
Jul 13 17:18:04.388662 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.388642    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tccn7\" (UniqueName: \"kubernetes.io/projected/457cec5a-3ab0-4932-b02d-22e23f939d34-kube-api-access-tccn7\") pod \"e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx\" (UID: \"457cec5a-3ab0-4932-b02d-22e23f939d34\") " pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx"
Jul 13 17:18:04.533945 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.533903    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx"
Jul 13 17:18:04.626683 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.626631    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:04.681536 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.681510    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx"]
Jul 13 17:18:04.683821 ip-10-0-143-51 kubenswrapper[2573]: W0713 17:18:04.683797    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod457cec5a_3ab0_4932_b02d_22e23f939d34.slice/crio-64a43348db56f664d0cb99984ac207214023b42efb9491e350778c087e37b6d2 WatchSource:0}: Error finding container 64a43348db56f664d0cb99984ac207214023b42efb9491e350778c087e37b6d2: Status 404 returned error can't find the container with id 64a43348db56f664d0cb99984ac207214023b42efb9491e350778c087e37b6d2
Jul 13 17:18:04.685791 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.685747    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:18:04.685890 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.685815    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:18:04.685890 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:04.685843    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:18:05.401379 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:05.401341    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx" event={"ID":"457cec5a-3ab0-4932-b02d-22e23f939d34","Type":"ContainerStarted","Data":"9ad7249abb456695fc2faaeea2592eb8a75c6379994d1a6346c1b68b0aa774b1"}
Jul 13 17:18:05.401771 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:05.401402    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx" event={"ID":"457cec5a-3ab0-4932-b02d-22e23f939d34","Type":"ContainerStarted","Data":"64a43348db56f664d0cb99984ac207214023b42efb9491e350778c087e37b6d2"}
Jul 13 17:18:05.424089 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:05.424042    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx" podStartSLOduration=1.4240272090000001 podStartE2EDuration="1.424027209s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:18:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:18:05.422050218 +0000 UTC m=+2282.780357066" watchObservedRunningTime="2026-07-13 17:18:05.424027209 +0000 UTC m=+2282.782334034"
Jul 13 17:18:05.534899 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:05.534854    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx"
Jul 13 17:18:05.542565 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:05.542537    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx"
Jul 13 17:18:06.405997 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:06.405969    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx"
Jul 13 17:18:06.406996 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:06.406979    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx"
Jul 13 17:18:07.422967 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:07.422933    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:07.511276 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:07.511247    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:07.581822 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:07.581789    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:07.802628 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:07.802591    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:08.127819 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:08.127707    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:08.225029 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:08.225000    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:08.416191 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:08.416165    2573 generic.go:356] "Generic (PLEG): container finished" podID="11797c58-a683-458b-801a-88fe6cbd292a" containerID="70758f334b89ce791e408e5b9614b3f536a0237d2035f1fb131db4aa1a4e94fa" exitCode=0
Jul 13 17:18:08.416328 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:08.416235    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz" event={"ID":"11797c58-a683-458b-801a-88fe6cbd292a","Type":"ContainerDied","Data":"70758f334b89ce791e408e5b9614b3f536a0237d2035f1fb131db4aa1a4e94fa"}
Jul 13 17:18:08.417298 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:08.416297    2573 scope.go:117] "RemoveContainer" containerID="c3f88db2e289649c7f89d20c7d0e763d3dd83b06cfb849f99c9afee89428f43c"
Jul 13 17:18:08.543160 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:08.543137    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz"
Jul 13 17:18:08.616605 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:08.616572    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11797c58-a683-458b-801a-88fe6cbd292a-credential-socket\") pod \"11797c58-a683-458b-801a-88fe6cbd292a\" (UID: \"11797c58-a683-458b-801a-88fe6cbd292a\") "
Jul 13 17:18:08.616756 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:08.616626    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11797c58-a683-458b-801a-88fe6cbd292a-istio-envoy\") pod \"11797c58-a683-458b-801a-88fe6cbd292a\" (UID: \"11797c58-a683-458b-801a-88fe6cbd292a\") "
Jul 13 17:18:08.616756 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:08.616699    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11797c58-a683-458b-801a-88fe6cbd292a-istio-data\") pod \"11797c58-a683-458b-801a-88fe6cbd292a\" (UID: \"11797c58-a683-458b-801a-88fe6cbd292a\") "
Jul 13 17:18:08.616861 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:08.616761    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11797c58-a683-458b-801a-88fe6cbd292a-workload-socket\") pod \"11797c58-a683-458b-801a-88fe6cbd292a\" (UID: \"11797c58-a683-458b-801a-88fe6cbd292a\") "
Jul 13 17:18:08.616861 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:08.616787    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9t28\" (UniqueName: \"kubernetes.io/projected/11797c58-a683-458b-801a-88fe6cbd292a-kube-api-access-m9t28\") pod \"11797c58-a683-458b-801a-88fe6cbd292a\" (UID: \"11797c58-a683-458b-801a-88fe6cbd292a\") "
Jul 13 17:18:08.616861 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:08.616816    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11797c58-a683-458b-801a-88fe6cbd292a-istiod-ca-cert\") pod \"11797c58-a683-458b-801a-88fe6cbd292a\" (UID: \"11797c58-a683-458b-801a-88fe6cbd292a\") "
Jul 13 17:18:08.616861 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:08.616851    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11797c58-a683-458b-801a-88fe6cbd292a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "11797c58-a683-458b-801a-88fe6cbd292a" (UID: "11797c58-a683-458b-801a-88fe6cbd292a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:18:08.617173 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:08.616868    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11797c58-a683-458b-801a-88fe6cbd292a-istio-token\") pod \"11797c58-a683-458b-801a-88fe6cbd292a\" (UID: \"11797c58-a683-458b-801a-88fe6cbd292a\") "
Jul 13 17:18:08.617173 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:08.616899    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11797c58-a683-458b-801a-88fe6cbd292a-workload-certs\") pod \"11797c58-a683-458b-801a-88fe6cbd292a\" (UID: \"11797c58-a683-458b-801a-88fe6cbd292a\") "
Jul 13 17:18:08.617173 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:08.616932    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11797c58-a683-458b-801a-88fe6cbd292a-istio-podinfo\") pod \"11797c58-a683-458b-801a-88fe6cbd292a\" (UID: \"11797c58-a683-458b-801a-88fe6cbd292a\") "
Jul 13 17:18:08.617173 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:08.617062    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11797c58-a683-458b-801a-88fe6cbd292a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "11797c58-a683-458b-801a-88fe6cbd292a" (UID: "11797c58-a683-458b-801a-88fe6cbd292a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:18:08.617369 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:08.617199    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11797c58-a683-458b-801a-88fe6cbd292a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "11797c58-a683-458b-801a-88fe6cbd292a" (UID: "11797c58-a683-458b-801a-88fe6cbd292a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:18:08.617369 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:08.617280    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11797c58-a683-458b-801a-88fe6cbd292a-workload-socket\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:18:08.617369 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:08.617298    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11797c58-a683-458b-801a-88fe6cbd292a-istiod-ca-cert\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:18:08.617369 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:08.617312    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11797c58-a683-458b-801a-88fe6cbd292a-credential-socket\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:18:08.617537 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:08.617421    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11797c58-a683-458b-801a-88fe6cbd292a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "11797c58-a683-458b-801a-88fe6cbd292a" (UID: "11797c58-a683-458b-801a-88fe6cbd292a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:18:08.617537 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:08.617521    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11797c58-a683-458b-801a-88fe6cbd292a-istio-data" (OuterVolumeSpecName: "istio-data") pod "11797c58-a683-458b-801a-88fe6cbd292a" (UID: "11797c58-a683-458b-801a-88fe6cbd292a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:18:08.619364 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:08.619332    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11797c58-a683-458b-801a-88fe6cbd292a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "11797c58-a683-458b-801a-88fe6cbd292a" (UID: "11797c58-a683-458b-801a-88fe6cbd292a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:18:08.619364 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:08.619337    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11797c58-a683-458b-801a-88fe6cbd292a-istio-token" (OuterVolumeSpecName: "istio-token") pod "11797c58-a683-458b-801a-88fe6cbd292a" (UID: "11797c58-a683-458b-801a-88fe6cbd292a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:18:08.619501 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:08.619363    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/11797c58-a683-458b-801a-88fe6cbd292a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "11797c58-a683-458b-801a-88fe6cbd292a" (UID: "11797c58-a683-458b-801a-88fe6cbd292a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 17:18:08.619501 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:08.619395    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11797c58-a683-458b-801a-88fe6cbd292a-kube-api-access-m9t28" (OuterVolumeSpecName: "kube-api-access-m9t28") pod "11797c58-a683-458b-801a-88fe6cbd292a" (UID: "11797c58-a683-458b-801a-88fe6cbd292a"). InnerVolumeSpecName "kube-api-access-m9t28". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:18:08.718565 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:08.718493    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11797c58-a683-458b-801a-88fe6cbd292a-istio-envoy\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:18:08.718565 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:08.718516    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11797c58-a683-458b-801a-88fe6cbd292a-istio-data\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:18:08.718565 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:08.718525    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9t28\" (UniqueName: \"kubernetes.io/projected/11797c58-a683-458b-801a-88fe6cbd292a-kube-api-access-m9t28\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:18:08.718565 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:08.718534    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11797c58-a683-458b-801a-88fe6cbd292a-istio-token\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:18:08.718565 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:08.718542    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11797c58-a683-458b-801a-88fe6cbd292a-workload-certs\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:18:08.718565 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:08.718550    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11797c58-a683-458b-801a-88fe6cbd292a-istio-podinfo\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:18:09.422469 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:09.422387    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz" event={"ID":"11797c58-a683-458b-801a-88fe6cbd292a","Type":"ContainerDied","Data":"d95593eea5e96329bf6ee4b7b10edfa0d6bb9b860322102f534f3667e51fd4f2"}
Jul 13 17:18:09.422469 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:09.422403    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz"
Jul 13 17:18:09.422469 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:09.422452    2573 scope.go:117] "RemoveContainer" containerID="70758f334b89ce791e408e5b9614b3f536a0237d2035f1fb131db4aa1a4e94fa"
Jul 13 17:18:09.452229 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:09.449174    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz"]
Jul 13 17:18:09.454588 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:09.454570    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-0c5523-openshift-default-59cbcf7fbc-lcxrz"]
Jul 13 17:18:11.147734 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:11.147700    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11797c58-a683-458b-801a-88fe6cbd292a" path="/var/lib/kubelet/pods/11797c58-a683-458b-801a-88fe6cbd292a/volumes"
Jul 13 17:18:11.929859 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:11.929823    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:12.418658 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:12.418626    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:12.694844 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:12.694746    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db"]
Jul 13 17:18:12.695203 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:12.695186    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11797c58-a683-458b-801a-88fe6cbd292a" containerName="istio-proxy"
Jul 13 17:18:12.695254 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:12.695206    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="11797c58-a683-458b-801a-88fe6cbd292a" containerName="istio-proxy"
Jul 13 17:18:12.695254 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:12.695218    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11797c58-a683-458b-801a-88fe6cbd292a" containerName="istio-proxy"
Jul 13 17:18:12.695254 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:12.695223    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="11797c58-a683-458b-801a-88fe6cbd292a" containerName="istio-proxy"
Jul 13 17:18:12.695362 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:12.695277    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="11797c58-a683-458b-801a-88fe6cbd292a" containerName="istio-proxy"
Jul 13 17:18:12.695362 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:12.695289    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="deeda31a-89c7-471c-9346-eaa23ef5e35a" containerName="istio-proxy"
Jul 13 17:18:12.699967 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:12.699947    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db"
Jul 13 17:18:12.706706 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:12.706379    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-9c55b0-openshift-default-dockercfg-n5l56\""
Jul 13 17:18:12.714269 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:12.714244    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db"]
Jul 13 17:18:12.725447 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:12.725422    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:12.751655 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:12.751626    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwkxk\" (UniqueName: \"kubernetes.io/projected/29e2205d-664b-44d5-be0b-d0bf7b163eab-kube-api-access-nwkxk\") pod \"e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db\" (UID: \"29e2205d-664b-44d5-be0b-d0bf7b163eab\") " pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db"
Jul 13 17:18:12.751807 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:12.751666    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29e2205d-664b-44d5-be0b-d0bf7b163eab-credential-socket\") pod \"e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db\" (UID: \"29e2205d-664b-44d5-be0b-d0bf7b163eab\") " pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db"
Jul 13 17:18:12.751807 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:12.751706    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29e2205d-664b-44d5-be0b-d0bf7b163eab-istiod-ca-cert\") pod \"e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db\" (UID: \"29e2205d-664b-44d5-be0b-d0bf7b163eab\") " pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db"
Jul 13 17:18:12.751807 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:12.751763    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29e2205d-664b-44d5-be0b-d0bf7b163eab-istio-envoy\") pod \"e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db\" (UID: \"29e2205d-664b-44d5-be0b-d0bf7b163eab\") " pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db"
Jul 13 17:18:12.751926 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:12.751819    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29e2205d-664b-44d5-be0b-d0bf7b163eab-workload-socket\") pod \"e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db\" (UID: \"29e2205d-664b-44d5-be0b-d0bf7b163eab\") " pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db"
Jul 13 17:18:12.751926 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:12.751845    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29e2205d-664b-44d5-be0b-d0bf7b163eab-istio-token\") pod \"e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db\" (UID: \"29e2205d-664b-44d5-be0b-d0bf7b163eab\") " pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db"
Jul 13 17:18:12.751926 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:12.751887    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29e2205d-664b-44d5-be0b-d0bf7b163eab-istio-data\") pod \"e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db\" (UID: \"29e2205d-664b-44d5-be0b-d0bf7b163eab\") " pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db"
Jul 13 17:18:12.751926 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:12.751910    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29e2205d-664b-44d5-be0b-d0bf7b163eab-istio-podinfo\") pod \"e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db\" (UID: \"29e2205d-664b-44d5-be0b-d0bf7b163eab\") " pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db"
Jul 13 17:18:12.752052 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:12.751957    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29e2205d-664b-44d5-be0b-d0bf7b163eab-workload-certs\") pod \"e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db\" (UID: \"29e2205d-664b-44d5-be0b-d0bf7b163eab\") " pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db"
Jul 13 17:18:12.853102 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:12.853065    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwkxk\" (UniqueName: \"kubernetes.io/projected/29e2205d-664b-44d5-be0b-d0bf7b163eab-kube-api-access-nwkxk\") pod \"e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db\" (UID: \"29e2205d-664b-44d5-be0b-d0bf7b163eab\") " pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db"
Jul 13 17:18:12.853102 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:12.853107    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29e2205d-664b-44d5-be0b-d0bf7b163eab-credential-socket\") pod \"e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db\" (UID: \"29e2205d-664b-44d5-be0b-d0bf7b163eab\") " pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db"
Jul 13 17:18:12.853362 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:12.853139    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29e2205d-664b-44d5-be0b-d0bf7b163eab-istiod-ca-cert\") pod \"e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db\" (UID: \"29e2205d-664b-44d5-be0b-d0bf7b163eab\") " pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db"
Jul 13 17:18:12.853362 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:12.853168    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29e2205d-664b-44d5-be0b-d0bf7b163eab-istio-envoy\") pod \"e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db\" (UID: \"29e2205d-664b-44d5-be0b-d0bf7b163eab\") " pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db"
Jul 13 17:18:12.853362 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:12.853194    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29e2205d-664b-44d5-be0b-d0bf7b163eab-workload-socket\") pod \"e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db\" (UID: \"29e2205d-664b-44d5-be0b-d0bf7b163eab\") " pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db"
Jul 13 17:18:12.853362 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:12.853212    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29e2205d-664b-44d5-be0b-d0bf7b163eab-istio-token\") pod \"e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db\" (UID: \"29e2205d-664b-44d5-be0b-d0bf7b163eab\") " pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db"
Jul 13 17:18:12.853362 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:12.853251    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29e2205d-664b-44d5-be0b-d0bf7b163eab-istio-data\") pod \"e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db\" (UID: \"29e2205d-664b-44d5-be0b-d0bf7b163eab\") " pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db"
Jul 13 17:18:12.853362 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:12.853274    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29e2205d-664b-44d5-be0b-d0bf7b163eab-istio-podinfo\") pod \"e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db\" (UID: \"29e2205d-664b-44d5-be0b-d0bf7b163eab\") " pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db"
Jul 13 17:18:12.853362 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:12.853326    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29e2205d-664b-44d5-be0b-d0bf7b163eab-workload-certs\") pod \"e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db\" (UID: \"29e2205d-664b-44d5-be0b-d0bf7b163eab\") " pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db"
Jul 13 17:18:12.853708 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:12.853633    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29e2205d-664b-44d5-be0b-d0bf7b163eab-credential-socket\") pod \"e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db\" (UID: \"29e2205d-664b-44d5-be0b-d0bf7b163eab\") " pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db"
Jul 13 17:18:12.853708 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:12.853694    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29e2205d-664b-44d5-be0b-d0bf7b163eab-workload-socket\") pod \"e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db\" (UID: \"29e2205d-664b-44d5-be0b-d0bf7b163eab\") " pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db"
Jul 13 17:18:12.853857 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:12.853823    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29e2205d-664b-44d5-be0b-d0bf7b163eab-istio-data\") pod \"e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db\" (UID: \"29e2205d-664b-44d5-be0b-d0bf7b163eab\") " pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db"
Jul 13 17:18:12.854124 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:12.854095    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29e2205d-664b-44d5-be0b-d0bf7b163eab-workload-certs\") pod \"e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db\" (UID: \"29e2205d-664b-44d5-be0b-d0bf7b163eab\") " pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db"
Jul 13 17:18:12.854315 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:12.854298    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29e2205d-664b-44d5-be0b-d0bf7b163eab-istiod-ca-cert\") pod \"e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db\" (UID: \"29e2205d-664b-44d5-be0b-d0bf7b163eab\") " pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db"
Jul 13 17:18:12.856012 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:12.855985    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29e2205d-664b-44d5-be0b-d0bf7b163eab-istio-envoy\") pod \"e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db\" (UID: \"29e2205d-664b-44d5-be0b-d0bf7b163eab\") " pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db"
Jul 13 17:18:12.856332 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:12.856315    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29e2205d-664b-44d5-be0b-d0bf7b163eab-istio-podinfo\") pod \"e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db\" (UID: \"29e2205d-664b-44d5-be0b-d0bf7b163eab\") " pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db"
Jul 13 17:18:12.862377 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:12.862353    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwkxk\" (UniqueName: \"kubernetes.io/projected/29e2205d-664b-44d5-be0b-d0bf7b163eab-kube-api-access-nwkxk\") pod \"e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db\" (UID: \"29e2205d-664b-44d5-be0b-d0bf7b163eab\") " pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db"
Jul 13 17:18:12.862377 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:12.862367    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29e2205d-664b-44d5-be0b-d0bf7b163eab-istio-token\") pod \"e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db\" (UID: \"29e2205d-664b-44d5-be0b-d0bf7b163eab\") " pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db"
Jul 13 17:18:13.010434 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:13.010411    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db"
Jul 13 17:18:13.156837 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:13.156815    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db"]
Jul 13 17:18:13.158856 ip-10-0-143-51 kubenswrapper[2573]: W0713 17:18:13.158829    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29e2205d_664b_44d5_be0b_d0bf7b163eab.slice/crio-fb1b567708db30c0611c0fc5e11f687a322e06fdeb4a496c54bad34f84a7e095 WatchSource:0}: Error finding container fb1b567708db30c0611c0fc5e11f687a322e06fdeb4a496c54bad34f84a7e095: Status 404 returned error can't find the container with id fb1b567708db30c0611c0fc5e11f687a322e06fdeb4a496c54bad34f84a7e095
Jul 13 17:18:13.161057 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:13.161029    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:18:13.161139 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:13.161092    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:18:13.161139 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:13.161118    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:18:13.447988 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:13.447893    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db" event={"ID":"29e2205d-664b-44d5-be0b-d0bf7b163eab","Type":"ContainerStarted","Data":"21d1e658b81d7a337ce17b176ee80885e66dd294c12cd9646c5e359a9b2b8721"}
Jul 13 17:18:13.447988 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:13.447959    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db" event={"ID":"29e2205d-664b-44d5-be0b-d0bf7b163eab","Type":"ContainerStarted","Data":"fb1b567708db30c0611c0fc5e11f687a322e06fdeb4a496c54bad34f84a7e095"}
Jul 13 17:18:13.471486 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:13.471421    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db" podStartSLOduration=1.471401298 podStartE2EDuration="1.471401298s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:18:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:18:13.470546438 +0000 UTC m=+2290.828853294" watchObservedRunningTime="2026-07-13 17:18:13.471401298 +0000 UTC m=+2290.829708124"
Jul 13 17:18:13.511440 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:13.511406    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:14.011641 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:14.011604    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db"
Jul 13 17:18:14.016569 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:14.016541    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db"
Jul 13 17:18:14.458416 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:14.457568    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db"
Jul 13 17:18:14.463979 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:14.463959    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db"
Jul 13 17:18:15.434193 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:15.434159    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:15.589631 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:15.589592    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:15.742692 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:15.742656    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:16.261684 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:16.261653    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:16.432762 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:16.432717    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:16.556678 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:16.556553    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:19.936943 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:19.936905    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:21.407780 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:21.407711    2573 patch_prober.go:28] interesting pod/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 13 17:18:21.408192 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:21.407791    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx" podUID="457cec5a-3ab0-4932-b02d-22e23f939d34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 13 17:18:21.499470 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:21.499434    2573 generic.go:356] "Generic (PLEG): container finished" podID="457cec5a-3ab0-4932-b02d-22e23f939d34" containerID="9ad7249abb456695fc2faaeea2592eb8a75c6379994d1a6346c1b68b0aa774b1" exitCode=0
Jul 13 17:18:21.499626 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:21.499507    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx" event={"ID":"457cec5a-3ab0-4932-b02d-22e23f939d34","Type":"ContainerDied","Data":"9ad7249abb456695fc2faaeea2592eb8a75c6379994d1a6346c1b68b0aa774b1"}
Jul 13 17:18:21.499944 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:21.499930    2573 scope.go:117] "RemoveContainer" containerID="9ad7249abb456695fc2faaeea2592eb8a75c6379994d1a6346c1b68b0aa774b1"
Jul 13 17:18:21.500953 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:21.500928    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:18:21.501008 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:21.500992    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:18:21.501046 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:21.501022    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:18:22.505694 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:22.505659    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx" event={"ID":"457cec5a-3ab0-4932-b02d-22e23f939d34","Type":"ContainerStarted","Data":"b9727b32a6326e755347561adb555c1e24347cc3cb447b4874f6f76b0ef3c84d"}
Jul 13 17:18:22.534510 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:22.534484    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx"
Jul 13 17:18:22.534759 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:22.534715    2573 patch_prober.go:28] interesting pod/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 13 17:18:22.534887 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:22.534787    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx" podUID="457cec5a-3ab0-4932-b02d-22e23f939d34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 13 17:18:23.535041 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:23.535011    2573 patch_prober.go:28] interesting pod/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 13 17:18:23.535495 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:23.535067    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx" podUID="457cec5a-3ab0-4932-b02d-22e23f939d34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 13 17:18:24.534782 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:24.534757    2573 patch_prober.go:28] interesting pod/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 13 17:18:24.535083 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:24.535062    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx" podUID="457cec5a-3ab0-4932-b02d-22e23f939d34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 13 17:18:25.534925 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:25.534893    2573 patch_prober.go:28] interesting pod/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 13 17:18:25.535077 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:25.534945    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx" podUID="457cec5a-3ab0-4932-b02d-22e23f939d34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 13 17:18:26.539676 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:26.539634    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx"
Jul 13 17:18:26.540214 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:26.540113    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx"
Jul 13 17:18:26.540987 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:26.540962    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx"
Jul 13 17:18:28.535165 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:28.535136    2573 generic.go:356] "Generic (PLEG): container finished" podID="29e2205d-664b-44d5-be0b-d0bf7b163eab" containerID="21d1e658b81d7a337ce17b176ee80885e66dd294c12cd9646c5e359a9b2b8721" exitCode=0
Jul 13 17:18:28.535576 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:28.535208    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db" event={"ID":"29e2205d-664b-44d5-be0b-d0bf7b163eab","Type":"ContainerDied","Data":"21d1e658b81d7a337ce17b176ee80885e66dd294c12cd9646c5e359a9b2b8721"}
Jul 13 17:18:28.535680 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:28.535664    2573 scope.go:117] "RemoveContainer" containerID="21d1e658b81d7a337ce17b176ee80885e66dd294c12cd9646c5e359a9b2b8721"
Jul 13 17:18:28.536781 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:28.536753    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:18:28.536915 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:28.536829    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:18:28.536915 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:28.536885    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:18:28.726704 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:28.726676    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:28.832234 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:28.832152    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:29.457186 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:29.457152    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db"
Jul 13 17:18:29.544186 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:29.544142    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db" event={"ID":"29e2205d-664b-44d5-be0b-d0bf7b163eab","Type":"ContainerStarted","Data":"83812a9317e4e1f180f2fb52ca6f009cc8b03ce2dda2c8250f7c541f7215de60"}
Jul 13 17:18:30.010639 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:30.010605    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db"
Jul 13 17:18:30.012096 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:30.012067    2573 patch_prober.go:28] interesting pod/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 13 17:18:30.012313 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:30.012290    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db" podUID="29e2205d-664b-44d5-be0b-d0bf7b163eab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 13 17:18:31.011461 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:31.011426    2573 patch_prober.go:28] interesting pod/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 13 17:18:31.011869 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:31.011484    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db" podUID="29e2205d-664b-44d5-be0b-d0bf7b163eab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 13 17:18:32.011139 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:32.011103    2573 patch_prober.go:28] interesting pod/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 13 17:18:32.011317 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:32.011169    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db" podUID="29e2205d-664b-44d5-be0b-d0bf7b163eab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 13 17:18:32.038492 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:32.038454    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:33.011776 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:33.011710    2573 patch_prober.go:28] interesting pod/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 13 17:18:33.011952 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:33.011796    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db" podUID="29e2205d-664b-44d5-be0b-d0bf7b163eab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 13 17:18:33.075860 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:33.075827    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:34.015627 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:34.015596    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db"
Jul 13 17:18:34.015933 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:34.015916    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db"
Jul 13 17:18:34.016523 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:34.016508    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db"
Jul 13 17:18:37.180934 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:37.180902    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:37.776829 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:37.776796    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:37.842969 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:37.842944    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:38.780136 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:38.780110    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:38.871569 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:38.871482    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:39.086533 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:39.086462    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:43.220108 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:43.220078    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:49.012889 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:49.012858    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:49.114285 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:49.114255    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:53.893450 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:53.893418    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx"]
Jul 13 17:18:53.893839 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:53.893642    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx" podUID="457cec5a-3ab0-4932-b02d-22e23f939d34" containerName="istio-proxy" containerID="cri-o://b9727b32a6326e755347561adb555c1e24347cc3cb447b4874f6f76b0ef3c84d" gracePeriod=30
Jul 13 17:18:53.920993 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:53.920968    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:54.155035 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:54.154951    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:54.793771 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:54.793679    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:54.897395 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:54.897354    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:56.542495 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:56.542459    2573 patch_prober.go:28] interesting pod/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 13 17:18:56.542869 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:56.542516    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx" podUID="457cec5a-3ab0-4932-b02d-22e23f939d34" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 17:18:59.158014 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:59.157960    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx"
Jul 13 17:18:59.194460 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:59.194435    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/457cec5a-3ab0-4932-b02d-22e23f939d34-workload-certs\") pod \"457cec5a-3ab0-4932-b02d-22e23f939d34\" (UID: \"457cec5a-3ab0-4932-b02d-22e23f939d34\") "
Jul 13 17:18:59.194590 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:59.194473    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tccn7\" (UniqueName: \"kubernetes.io/projected/457cec5a-3ab0-4932-b02d-22e23f939d34-kube-api-access-tccn7\") pod \"457cec5a-3ab0-4932-b02d-22e23f939d34\" (UID: \"457cec5a-3ab0-4932-b02d-22e23f939d34\") "
Jul 13 17:18:59.194590 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:59.194515    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/457cec5a-3ab0-4932-b02d-22e23f939d34-credential-socket\") pod \"457cec5a-3ab0-4932-b02d-22e23f939d34\" (UID: \"457cec5a-3ab0-4932-b02d-22e23f939d34\") "
Jul 13 17:18:59.194590 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:59.194534    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/457cec5a-3ab0-4932-b02d-22e23f939d34-istio-envoy\") pod \"457cec5a-3ab0-4932-b02d-22e23f939d34\" (UID: \"457cec5a-3ab0-4932-b02d-22e23f939d34\") "
Jul 13 17:18:59.194590 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:59.194559    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/457cec5a-3ab0-4932-b02d-22e23f939d34-istiod-ca-cert\") pod \"457cec5a-3ab0-4932-b02d-22e23f939d34\" (UID: \"457cec5a-3ab0-4932-b02d-22e23f939d34\") "
Jul 13 17:18:59.194803 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:59.194612    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/457cec5a-3ab0-4932-b02d-22e23f939d34-istio-podinfo\") pod \"457cec5a-3ab0-4932-b02d-22e23f939d34\" (UID: \"457cec5a-3ab0-4932-b02d-22e23f939d34\") "
Jul 13 17:18:59.194803 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:59.194635    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/457cec5a-3ab0-4932-b02d-22e23f939d34-istio-token\") pod \"457cec5a-3ab0-4932-b02d-22e23f939d34\" (UID: \"457cec5a-3ab0-4932-b02d-22e23f939d34\") "
Jul 13 17:18:59.194803 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:59.194672    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/457cec5a-3ab0-4932-b02d-22e23f939d34-istio-data\") pod \"457cec5a-3ab0-4932-b02d-22e23f939d34\" (UID: \"457cec5a-3ab0-4932-b02d-22e23f939d34\") "
Jul 13 17:18:59.194803 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:59.194696    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/457cec5a-3ab0-4932-b02d-22e23f939d34-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "457cec5a-3ab0-4932-b02d-22e23f939d34" (UID: "457cec5a-3ab0-4932-b02d-22e23f939d34"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:18:59.194803 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:59.194715    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/457cec5a-3ab0-4932-b02d-22e23f939d34-workload-socket\") pod \"457cec5a-3ab0-4932-b02d-22e23f939d34\" (UID: \"457cec5a-3ab0-4932-b02d-22e23f939d34\") "
Jul 13 17:18:59.195048 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:59.194853    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/457cec5a-3ab0-4932-b02d-22e23f939d34-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "457cec5a-3ab0-4932-b02d-22e23f939d34" (UID: "457cec5a-3ab0-4932-b02d-22e23f939d34"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:18:59.195101 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:59.195058    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/457cec5a-3ab0-4932-b02d-22e23f939d34-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "457cec5a-3ab0-4932-b02d-22e23f939d34" (UID: "457cec5a-3ab0-4932-b02d-22e23f939d34"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:18:59.195170 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:59.195098    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/457cec5a-3ab0-4932-b02d-22e23f939d34-workload-certs\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:18:59.195170 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:59.195118    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/457cec5a-3ab0-4932-b02d-22e23f939d34-credential-socket\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:18:59.195841 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:59.195803    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/457cec5a-3ab0-4932-b02d-22e23f939d34-istio-data" (OuterVolumeSpecName: "istio-data") pod "457cec5a-3ab0-4932-b02d-22e23f939d34" (UID: "457cec5a-3ab0-4932-b02d-22e23f939d34"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:18:59.195841 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:59.195821    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/457cec5a-3ab0-4932-b02d-22e23f939d34-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "457cec5a-3ab0-4932-b02d-22e23f939d34" (UID: "457cec5a-3ab0-4932-b02d-22e23f939d34"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:18:59.197061 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:59.197040    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/457cec5a-3ab0-4932-b02d-22e23f939d34-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "457cec5a-3ab0-4932-b02d-22e23f939d34" (UID: "457cec5a-3ab0-4932-b02d-22e23f939d34"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:18:59.197436 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:59.197413    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/457cec5a-3ab0-4932-b02d-22e23f939d34-istio-token" (OuterVolumeSpecName: "istio-token") pod "457cec5a-3ab0-4932-b02d-22e23f939d34" (UID: "457cec5a-3ab0-4932-b02d-22e23f939d34"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:18:59.197537 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:59.197441    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/457cec5a-3ab0-4932-b02d-22e23f939d34-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "457cec5a-3ab0-4932-b02d-22e23f939d34" (UID: "457cec5a-3ab0-4932-b02d-22e23f939d34"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 17:18:59.197580 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:59.197548    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/457cec5a-3ab0-4932-b02d-22e23f939d34-kube-api-access-tccn7" (OuterVolumeSpecName: "kube-api-access-tccn7") pod "457cec5a-3ab0-4932-b02d-22e23f939d34" (UID: "457cec5a-3ab0-4932-b02d-22e23f939d34"). InnerVolumeSpecName "kube-api-access-tccn7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:18:59.295869 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:59.295836    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/457cec5a-3ab0-4932-b02d-22e23f939d34-istiod-ca-cert\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:18:59.295869 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:59.295864    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/457cec5a-3ab0-4932-b02d-22e23f939d34-istio-podinfo\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:18:59.295869 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:59.295874    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/457cec5a-3ab0-4932-b02d-22e23f939d34-istio-token\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:18:59.296101 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:59.295886    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/457cec5a-3ab0-4932-b02d-22e23f939d34-istio-data\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:18:59.296101 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:59.295898    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/457cec5a-3ab0-4932-b02d-22e23f939d34-workload-socket\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:18:59.296101 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:59.295910    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tccn7\" (UniqueName: \"kubernetes.io/projected/457cec5a-3ab0-4932-b02d-22e23f939d34-kube-api-access-tccn7\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:18:59.296101 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:59.295922    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/457cec5a-3ab0-4932-b02d-22e23f939d34-istio-envoy\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:18:59.693799 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:59.693767    2573 generic.go:356] "Generic (PLEG): container finished" podID="457cec5a-3ab0-4932-b02d-22e23f939d34" containerID="b9727b32a6326e755347561adb555c1e24347cc3cb447b4874f6f76b0ef3c84d" exitCode=0
Jul 13 17:18:59.694265 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:59.693815    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx"
Jul 13 17:18:59.694265 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:59.693824    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx" event={"ID":"457cec5a-3ab0-4932-b02d-22e23f939d34","Type":"ContainerDied","Data":"b9727b32a6326e755347561adb555c1e24347cc3cb447b4874f6f76b0ef3c84d"}
Jul 13 17:18:59.694265 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:59.693869    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx" event={"ID":"457cec5a-3ab0-4932-b02d-22e23f939d34","Type":"ContainerDied","Data":"64a43348db56f664d0cb99984ac207214023b42efb9491e350778c087e37b6d2"}
Jul 13 17:18:59.694265 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:59.693890    2573 scope.go:117] "RemoveContainer" containerID="b9727b32a6326e755347561adb555c1e24347cc3cb447b4874f6f76b0ef3c84d"
Jul 13 17:18:59.703505 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:59.703489    2573 scope.go:117] "RemoveContainer" containerID="9ad7249abb456695fc2faaeea2592eb8a75c6379994d1a6346c1b68b0aa774b1"
Jul 13 17:18:59.711218 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:59.711199    2573 scope.go:117] "RemoveContainer" containerID="b9727b32a6326e755347561adb555c1e24347cc3cb447b4874f6f76b0ef3c84d"
Jul 13 17:18:59.711456 ip-10-0-143-51 kubenswrapper[2573]: E0713 17:18:59.711436    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9727b32a6326e755347561adb555c1e24347cc3cb447b4874f6f76b0ef3c84d\": container with ID starting with b9727b32a6326e755347561adb555c1e24347cc3cb447b4874f6f76b0ef3c84d not found: ID does not exist" containerID="b9727b32a6326e755347561adb555c1e24347cc3cb447b4874f6f76b0ef3c84d"
Jul 13 17:18:59.711503 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:59.711463    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9727b32a6326e755347561adb555c1e24347cc3cb447b4874f6f76b0ef3c84d"} err="failed to get container status \"b9727b32a6326e755347561adb555c1e24347cc3cb447b4874f6f76b0ef3c84d\": rpc error: code = NotFound desc = could not find container \"b9727b32a6326e755347561adb555c1e24347cc3cb447b4874f6f76b0ef3c84d\": container with ID starting with b9727b32a6326e755347561adb555c1e24347cc3cb447b4874f6f76b0ef3c84d not found: ID does not exist"
Jul 13 17:18:59.711503 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:59.711479    2573 scope.go:117] "RemoveContainer" containerID="9ad7249abb456695fc2faaeea2592eb8a75c6379994d1a6346c1b68b0aa774b1"
Jul 13 17:18:59.711678 ip-10-0-143-51 kubenswrapper[2573]: E0713 17:18:59.711662    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ad7249abb456695fc2faaeea2592eb8a75c6379994d1a6346c1b68b0aa774b1\": container with ID starting with 9ad7249abb456695fc2faaeea2592eb8a75c6379994d1a6346c1b68b0aa774b1 not found: ID does not exist" containerID="9ad7249abb456695fc2faaeea2592eb8a75c6379994d1a6346c1b68b0aa774b1"
Jul 13 17:18:59.711738 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:59.711683    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ad7249abb456695fc2faaeea2592eb8a75c6379994d1a6346c1b68b0aa774b1"} err="failed to get container status \"9ad7249abb456695fc2faaeea2592eb8a75c6379994d1a6346c1b68b0aa774b1\": rpc error: code = NotFound desc = could not find container \"9ad7249abb456695fc2faaeea2592eb8a75c6379994d1a6346c1b68b0aa774b1\": container with ID starting with 9ad7249abb456695fc2faaeea2592eb8a75c6379994d1a6346c1b68b0aa774b1 not found: ID does not exist"
Jul 13 17:18:59.717111 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:59.717089    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx"]
Jul 13 17:18:59.721469 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:18:59.721442    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-2386aa-openshift-default-77df8ddf65-ndntx"]
Jul 13 17:19:01.147934 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:01.147893    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="457cec5a-3ab0-4932-b02d-22e23f939d34" path="/var/lib/kubelet/pods/457cec5a-3ab0-4932-b02d-22e23f939d34/volumes"
Jul 13 17:19:04.786138 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:04.786073    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:19:09.363572 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:09.363538    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:19:10.105438 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:10.105411    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:19:10.218993 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:10.218952    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:19:15.475585 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:15.475550    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:19:15.539606 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:15.539577    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:19:20.014324 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:20.014288    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db"]
Jul 13 17:19:20.014808 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:20.014548    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db" podUID="29e2205d-664b-44d5-be0b-d0bf7b163eab" containerName="istio-proxy" containerID="cri-o://83812a9317e4e1f180f2fb52ca6f009cc8b03ce2dda2c8250f7c541f7215de60" gracePeriod=30
Jul 13 17:19:20.030530 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:20.030501    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:19:20.278198 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:20.278106    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:19:20.622753 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:20.622646    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:19:20.901516 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:20.901441    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc"]
Jul 13 17:19:20.901969 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:20.901953    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="457cec5a-3ab0-4932-b02d-22e23f939d34" containerName="istio-proxy"
Jul 13 17:19:20.902027 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:20.901971    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="457cec5a-3ab0-4932-b02d-22e23f939d34" containerName="istio-proxy"
Jul 13 17:19:20.902027 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:20.901984    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="457cec5a-3ab0-4932-b02d-22e23f939d34" containerName="istio-proxy"
Jul 13 17:19:20.902027 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:20.901995    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="457cec5a-3ab0-4932-b02d-22e23f939d34" containerName="istio-proxy"
Jul 13 17:19:20.902125 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:20.902093    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="457cec5a-3ab0-4932-b02d-22e23f939d34" containerName="istio-proxy"
Jul 13 17:19:20.902125 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:20.902110    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="11797c58-a683-458b-801a-88fe6cbd292a" containerName="istio-proxy"
Jul 13 17:19:20.905429 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:20.905405    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc"
Jul 13 17:19:20.908249 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:20.908232    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-aac012-openshift-default-dockercfg-hrghh\""
Jul 13 17:19:20.917650 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:20.917626    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc"]
Jul 13 17:19:20.929980 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:20.929917    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:19:20.983350 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:20.983327    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-istio-envoy\") pod \"e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc\" (UID: \"9da27a18-5a4d-4454-af93-b2c2ad41ae2a\") " pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc"
Jul 13 17:19:20.983473 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:20.983377    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-workload-certs\") pod \"e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc\" (UID: \"9da27a18-5a4d-4454-af93-b2c2ad41ae2a\") " pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc"
Jul 13 17:19:20.983473 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:20.983412    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28jmj\" (UniqueName: \"kubernetes.io/projected/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-kube-api-access-28jmj\") pod \"e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc\" (UID: \"9da27a18-5a4d-4454-af93-b2c2ad41ae2a\") " pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc"
Jul 13 17:19:20.983473 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:20.983446    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-istio-token\") pod \"e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc\" (UID: \"9da27a18-5a4d-4454-af93-b2c2ad41ae2a\") " pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc"
Jul 13 17:19:20.983677 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:20.983548    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-credential-socket\") pod \"e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc\" (UID: \"9da27a18-5a4d-4454-af93-b2c2ad41ae2a\") " pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc"
Jul 13 17:19:20.983677 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:20.983600    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-workload-socket\") pod \"e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc\" (UID: \"9da27a18-5a4d-4454-af93-b2c2ad41ae2a\") " pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc"
Jul 13 17:19:20.983677 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:20.983622    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-istio-data\") pod \"e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc\" (UID: \"9da27a18-5a4d-4454-af93-b2c2ad41ae2a\") " pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc"
Jul 13 17:19:20.983677 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:20.983638    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-istiod-ca-cert\") pod \"e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc\" (UID: \"9da27a18-5a4d-4454-af93-b2c2ad41ae2a\") " pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc"
Jul 13 17:19:20.983874 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:20.983688    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-istio-podinfo\") pod \"e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc\" (UID: \"9da27a18-5a4d-4454-af93-b2c2ad41ae2a\") " pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc"
Jul 13 17:19:21.084712 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:21.084680    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-istio-envoy\") pod \"e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc\" (UID: \"9da27a18-5a4d-4454-af93-b2c2ad41ae2a\") " pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc"
Jul 13 17:19:21.085219 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:21.084767    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-workload-certs\") pod \"e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc\" (UID: \"9da27a18-5a4d-4454-af93-b2c2ad41ae2a\") " pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc"
Jul 13 17:19:21.085219 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:21.084796    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28jmj\" (UniqueName: \"kubernetes.io/projected/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-kube-api-access-28jmj\") pod \"e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc\" (UID: \"9da27a18-5a4d-4454-af93-b2c2ad41ae2a\") " pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc"
Jul 13 17:19:21.085219 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:21.084821    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-istio-token\") pod \"e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc\" (UID: \"9da27a18-5a4d-4454-af93-b2c2ad41ae2a\") " pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc"
Jul 13 17:19:21.085219 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:21.084854    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-credential-socket\") pod \"e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc\" (UID: \"9da27a18-5a4d-4454-af93-b2c2ad41ae2a\") " pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc"
Jul 13 17:19:21.085219 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:21.084901    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-workload-socket\") pod \"e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc\" (UID: \"9da27a18-5a4d-4454-af93-b2c2ad41ae2a\") " pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc"
Jul 13 17:19:21.085219 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:21.084918    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-istio-data\") pod \"e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc\" (UID: \"9da27a18-5a4d-4454-af93-b2c2ad41ae2a\") " pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc"
Jul 13 17:19:21.085219 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:21.084934    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-istiod-ca-cert\") pod \"e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc\" (UID: \"9da27a18-5a4d-4454-af93-b2c2ad41ae2a\") " pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc"
Jul 13 17:19:21.085219 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:21.084973    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-istio-podinfo\") pod \"e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc\" (UID: \"9da27a18-5a4d-4454-af93-b2c2ad41ae2a\") " pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc"
Jul 13 17:19:21.085643 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:21.085319    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-workload-socket\") pod \"e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc\" (UID: \"9da27a18-5a4d-4454-af93-b2c2ad41ae2a\") " pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc"
Jul 13 17:19:21.085643 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:21.085393    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-istio-data\") pod \"e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc\" (UID: \"9da27a18-5a4d-4454-af93-b2c2ad41ae2a\") " pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc"
Jul 13 17:19:21.085643 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:21.085441    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-workload-certs\") pod \"e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc\" (UID: \"9da27a18-5a4d-4454-af93-b2c2ad41ae2a\") " pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc"
Jul 13 17:19:21.085643 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:21.085566    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-credential-socket\") pod \"e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc\" (UID: \"9da27a18-5a4d-4454-af93-b2c2ad41ae2a\") " pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc"
Jul 13 17:19:21.085842 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:21.085667    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-istiod-ca-cert\") pod \"e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc\" (UID: \"9da27a18-5a4d-4454-af93-b2c2ad41ae2a\") " pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc"
Jul 13 17:19:21.086533 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:21.086501    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:19:21.087208 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:21.087187    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-istio-envoy\") pod \"e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc\" (UID: \"9da27a18-5a4d-4454-af93-b2c2ad41ae2a\") " pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc"
Jul 13 17:19:21.087477 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:21.087458    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-istio-podinfo\") pod \"e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc\" (UID: \"9da27a18-5a4d-4454-af93-b2c2ad41ae2a\") " pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc"
Jul 13 17:19:21.093968 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:21.093946    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-istio-token\") pod \"e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc\" (UID: \"9da27a18-5a4d-4454-af93-b2c2ad41ae2a\") " pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc"
Jul 13 17:19:21.094367 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:21.094350    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28jmj\" (UniqueName: \"kubernetes.io/projected/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-kube-api-access-28jmj\") pod \"e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc\" (UID: \"9da27a18-5a4d-4454-af93-b2c2ad41ae2a\") " pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc"
Jul 13 17:19:21.219333 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:21.219248    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc"
Jul 13 17:19:21.359240 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:21.359216    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc"]
Jul 13 17:19:21.361633 ip-10-0-143-51 kubenswrapper[2573]: W0713 17:19:21.361603    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9da27a18_5a4d_4454_af93_b2c2ad41ae2a.slice/crio-ae34c719194a01884ca2c7ea98f9a9540c0b043c2bc7dd5affd096bb05019b0e WatchSource:0}: Error finding container ae34c719194a01884ca2c7ea98f9a9540c0b043c2bc7dd5affd096bb05019b0e: Status 404 returned error can't find the container with id ae34c719194a01884ca2c7ea98f9a9540c0b043c2bc7dd5affd096bb05019b0e
Jul 13 17:19:21.364154 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:21.364116    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:19:21.364241 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:21.364184    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:19:21.364241 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:21.364218    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:19:21.800764 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:21.800713    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc" event={"ID":"9da27a18-5a4d-4454-af93-b2c2ad41ae2a","Type":"ContainerStarted","Data":"f60bb78605fd5ff6339b6d6793abbcc262518697fb65d7b4027b1304a3f97aaf"}
Jul 13 17:19:21.800941 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:21.800779    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc" event={"ID":"9da27a18-5a4d-4454-af93-b2c2ad41ae2a","Type":"ContainerStarted","Data":"ae34c719194a01884ca2c7ea98f9a9540c0b043c2bc7dd5affd096bb05019b0e"}
Jul 13 17:19:21.824064 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:21.824016    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc" podStartSLOduration=1.824001583 podStartE2EDuration="1.824001583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:19:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:19:21.822343022 +0000 UTC m=+2359.180649871" watchObservedRunningTime="2026-07-13 17:19:21.824001583 +0000 UTC m=+2359.182308475"
Jul 13 17:19:22.220279 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:22.220256    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc"
Jul 13 17:19:22.225019 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:22.225000    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc"
Jul 13 17:19:22.805245 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:22.805218    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc"
Jul 13 17:19:22.806086 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:22.806066    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc"
Jul 13 17:19:23.759135 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:23.759088    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:19:23.850625 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:23.850596    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:19:23.951256 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:23.951223    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:19:24.494803 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:24.494776    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:19:24.591794 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:24.591764    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:19:24.701981 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:24.701947    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:19:25.266884 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:25.266859    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db"
Jul 13 17:19:25.422535 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:25.422468    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29e2205d-664b-44d5-be0b-d0bf7b163eab-istio-envoy\") pod \"29e2205d-664b-44d5-be0b-d0bf7b163eab\" (UID: \"29e2205d-664b-44d5-be0b-d0bf7b163eab\") "
Jul 13 17:19:25.422535 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:25.422500    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29e2205d-664b-44d5-be0b-d0bf7b163eab-workload-socket\") pod \"29e2205d-664b-44d5-be0b-d0bf7b163eab\" (UID: \"29e2205d-664b-44d5-be0b-d0bf7b163eab\") "
Jul 13 17:19:25.422740 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:25.422545    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nwkxk\" (UniqueName: \"kubernetes.io/projected/29e2205d-664b-44d5-be0b-d0bf7b163eab-kube-api-access-nwkxk\") pod \"29e2205d-664b-44d5-be0b-d0bf7b163eab\" (UID: \"29e2205d-664b-44d5-be0b-d0bf7b163eab\") "
Jul 13 17:19:25.422740 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:25.422571    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29e2205d-664b-44d5-be0b-d0bf7b163eab-istio-data\") pod \"29e2205d-664b-44d5-be0b-d0bf7b163eab\" (UID: \"29e2205d-664b-44d5-be0b-d0bf7b163eab\") "
Jul 13 17:19:25.422740 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:25.422616    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29e2205d-664b-44d5-be0b-d0bf7b163eab-istiod-ca-cert\") pod \"29e2205d-664b-44d5-be0b-d0bf7b163eab\" (UID: \"29e2205d-664b-44d5-be0b-d0bf7b163eab\") "
Jul 13 17:19:25.422740 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:25.422631    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29e2205d-664b-44d5-be0b-d0bf7b163eab-istio-token\") pod \"29e2205d-664b-44d5-be0b-d0bf7b163eab\" (UID: \"29e2205d-664b-44d5-be0b-d0bf7b163eab\") "
Jul 13 17:19:25.422740 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:25.422648    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29e2205d-664b-44d5-be0b-d0bf7b163eab-istio-podinfo\") pod \"29e2205d-664b-44d5-be0b-d0bf7b163eab\" (UID: \"29e2205d-664b-44d5-be0b-d0bf7b163eab\") "
Jul 13 17:19:25.422740 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:25.422669    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29e2205d-664b-44d5-be0b-d0bf7b163eab-workload-certs\") pod \"29e2205d-664b-44d5-be0b-d0bf7b163eab\" (UID: \"29e2205d-664b-44d5-be0b-d0bf7b163eab\") "
Jul 13 17:19:25.422740 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:25.422695    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29e2205d-664b-44d5-be0b-d0bf7b163eab-credential-socket\") pod \"29e2205d-664b-44d5-be0b-d0bf7b163eab\" (UID: \"29e2205d-664b-44d5-be0b-d0bf7b163eab\") "
Jul 13 17:19:25.423114 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:25.422805    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29e2205d-664b-44d5-be0b-d0bf7b163eab-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "29e2205d-664b-44d5-be0b-d0bf7b163eab" (UID: "29e2205d-664b-44d5-be0b-d0bf7b163eab"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:19:25.423114 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:25.422999    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29e2205d-664b-44d5-be0b-d0bf7b163eab-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "29e2205d-664b-44d5-be0b-d0bf7b163eab" (UID: "29e2205d-664b-44d5-be0b-d0bf7b163eab"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:19:25.423114 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:25.423093    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29e2205d-664b-44d5-be0b-d0bf7b163eab-credential-socket\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:19:25.423114 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:25.423112    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29e2205d-664b-44d5-be0b-d0bf7b163eab-workload-socket\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:19:25.423341 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:25.423193    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29e2205d-664b-44d5-be0b-d0bf7b163eab-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "29e2205d-664b-44d5-be0b-d0bf7b163eab" (UID: "29e2205d-664b-44d5-be0b-d0bf7b163eab"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:19:25.423400 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:25.423353    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29e2205d-664b-44d5-be0b-d0bf7b163eab-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "29e2205d-664b-44d5-be0b-d0bf7b163eab" (UID: "29e2205d-664b-44d5-be0b-d0bf7b163eab"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:19:25.423669 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:25.423637    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29e2205d-664b-44d5-be0b-d0bf7b163eab-istio-data" (OuterVolumeSpecName: "istio-data") pod "29e2205d-664b-44d5-be0b-d0bf7b163eab" (UID: "29e2205d-664b-44d5-be0b-d0bf7b163eab"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:19:25.424713 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:25.424690    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29e2205d-664b-44d5-be0b-d0bf7b163eab-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "29e2205d-664b-44d5-be0b-d0bf7b163eab" (UID: "29e2205d-664b-44d5-be0b-d0bf7b163eab"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:19:25.424846 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:25.424825    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/29e2205d-664b-44d5-be0b-d0bf7b163eab-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "29e2205d-664b-44d5-be0b-d0bf7b163eab" (UID: "29e2205d-664b-44d5-be0b-d0bf7b163eab"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 17:19:25.425061 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:25.425044    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29e2205d-664b-44d5-be0b-d0bf7b163eab-istio-token" (OuterVolumeSpecName: "istio-token") pod "29e2205d-664b-44d5-be0b-d0bf7b163eab" (UID: "29e2205d-664b-44d5-be0b-d0bf7b163eab"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:19:25.425098 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:25.425054    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29e2205d-664b-44d5-be0b-d0bf7b163eab-kube-api-access-nwkxk" (OuterVolumeSpecName: "kube-api-access-nwkxk") pod "29e2205d-664b-44d5-be0b-d0bf7b163eab" (UID: "29e2205d-664b-44d5-be0b-d0bf7b163eab"). InnerVolumeSpecName "kube-api-access-nwkxk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:19:25.523700 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:25.523676    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29e2205d-664b-44d5-be0b-d0bf7b163eab-istio-envoy\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:19:25.523700 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:25.523699    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwkxk\" (UniqueName: \"kubernetes.io/projected/29e2205d-664b-44d5-be0b-d0bf7b163eab-kube-api-access-nwkxk\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:19:25.523860 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:25.523709    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29e2205d-664b-44d5-be0b-d0bf7b163eab-istio-data\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:19:25.523860 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:25.523732    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29e2205d-664b-44d5-be0b-d0bf7b163eab-istiod-ca-cert\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:19:25.523860 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:25.523742    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29e2205d-664b-44d5-be0b-d0bf7b163eab-istio-token\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:19:25.523860 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:25.523750    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29e2205d-664b-44d5-be0b-d0bf7b163eab-istio-podinfo\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:19:25.523860 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:25.523757    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29e2205d-664b-44d5-be0b-d0bf7b163eab-workload-certs\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:19:25.820086 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:25.820050    2573 generic.go:356] "Generic (PLEG): container finished" podID="29e2205d-664b-44d5-be0b-d0bf7b163eab" containerID="83812a9317e4e1f180f2fb52ca6f009cc8b03ce2dda2c8250f7c541f7215de60" exitCode=0
Jul 13 17:19:25.820243 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:25.820099    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db"
Jul 13 17:19:25.820243 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:25.820138    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db" event={"ID":"29e2205d-664b-44d5-be0b-d0bf7b163eab","Type":"ContainerDied","Data":"83812a9317e4e1f180f2fb52ca6f009cc8b03ce2dda2c8250f7c541f7215de60"}
Jul 13 17:19:25.820243 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:25.820196    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db" event={"ID":"29e2205d-664b-44d5-be0b-d0bf7b163eab","Type":"ContainerDied","Data":"fb1b567708db30c0611c0fc5e11f687a322e06fdeb4a496c54bad34f84a7e095"}
Jul 13 17:19:25.820243 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:25.820218    2573 scope.go:117] "RemoveContainer" containerID="83812a9317e4e1f180f2fb52ca6f009cc8b03ce2dda2c8250f7c541f7215de60"
Jul 13 17:19:25.829547 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:25.829528    2573 scope.go:117] "RemoveContainer" containerID="21d1e658b81d7a337ce17b176ee80885e66dd294c12cd9646c5e359a9b2b8721"
Jul 13 17:19:25.837799 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:25.837778    2573 scope.go:117] "RemoveContainer" containerID="83812a9317e4e1f180f2fb52ca6f009cc8b03ce2dda2c8250f7c541f7215de60"
Jul 13 17:19:25.838076 ip-10-0-143-51 kubenswrapper[2573]: E0713 17:19:25.838057    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83812a9317e4e1f180f2fb52ca6f009cc8b03ce2dda2c8250f7c541f7215de60\": container with ID starting with 83812a9317e4e1f180f2fb52ca6f009cc8b03ce2dda2c8250f7c541f7215de60 not found: ID does not exist" containerID="83812a9317e4e1f180f2fb52ca6f009cc8b03ce2dda2c8250f7c541f7215de60"
Jul 13 17:19:25.838139 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:25.838085    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83812a9317e4e1f180f2fb52ca6f009cc8b03ce2dda2c8250f7c541f7215de60"} err="failed to get container status \"83812a9317e4e1f180f2fb52ca6f009cc8b03ce2dda2c8250f7c541f7215de60\": rpc error: code = NotFound desc = could not find container \"83812a9317e4e1f180f2fb52ca6f009cc8b03ce2dda2c8250f7c541f7215de60\": container with ID starting with 83812a9317e4e1f180f2fb52ca6f009cc8b03ce2dda2c8250f7c541f7215de60 not found: ID does not exist"
Jul 13 17:19:25.838139 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:25.838103    2573 scope.go:117] "RemoveContainer" containerID="21d1e658b81d7a337ce17b176ee80885e66dd294c12cd9646c5e359a9b2b8721"
Jul 13 17:19:25.838366 ip-10-0-143-51 kubenswrapper[2573]: E0713 17:19:25.838346    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21d1e658b81d7a337ce17b176ee80885e66dd294c12cd9646c5e359a9b2b8721\": container with ID starting with 21d1e658b81d7a337ce17b176ee80885e66dd294c12cd9646c5e359a9b2b8721 not found: ID does not exist" containerID="21d1e658b81d7a337ce17b176ee80885e66dd294c12cd9646c5e359a9b2b8721"
Jul 13 17:19:25.838440 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:25.838370    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21d1e658b81d7a337ce17b176ee80885e66dd294c12cd9646c5e359a9b2b8721"} err="failed to get container status \"21d1e658b81d7a337ce17b176ee80885e66dd294c12cd9646c5e359a9b2b8721\": rpc error: code = NotFound desc = could not find container \"21d1e658b81d7a337ce17b176ee80885e66dd294c12cd9646c5e359a9b2b8721\": container with ID starting with 21d1e658b81d7a337ce17b176ee80885e66dd294c12cd9646c5e359a9b2b8721 not found: ID does not exist"
Jul 13 17:19:25.856685 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:25.856663    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db"]
Jul 13 17:19:25.865045 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:25.865025    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-9c55b0-openshift-default-57c5f76cdf-6h7db"]
Jul 13 17:19:27.147526 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:27.147491    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29e2205d-664b-44d5-be0b-d0bf7b163eab" path="/var/lib/kubelet/pods/29e2205d-664b-44d5-be0b-d0bf7b163eab/volumes"
Jul 13 17:19:28.263277 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:28.263244    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:19:28.582155 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:28.582065    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:19:28.881748 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:28.881645    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j"]
Jul 13 17:19:28.882643 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:28.882617    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29e2205d-664b-44d5-be0b-d0bf7b163eab" containerName="istio-proxy"
Jul 13 17:19:28.882889 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:28.882874    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="29e2205d-664b-44d5-be0b-d0bf7b163eab" containerName="istio-proxy"
Jul 13 17:19:28.883218 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:28.883205    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="457cec5a-3ab0-4932-b02d-22e23f939d34" containerName="istio-proxy"
Jul 13 17:19:28.883354 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:28.883342    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="29e2205d-664b-44d5-be0b-d0bf7b163eab" containerName="istio-proxy"
Jul 13 17:19:28.883498 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:28.883484    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="29e2205d-664b-44d5-be0b-d0bf7b163eab" containerName="istio-proxy"
Jul 13 17:19:28.889496 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:28.889476    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j"
Jul 13 17:19:28.892385 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:28.892361    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-bd468d-openshift-default-dockercfg-c5w5p\""
Jul 13 17:19:28.894459 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:28.894438    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j"]
Jul 13 17:19:28.912941 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:28.912911    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:19:29.039976 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:29.039932    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:19:29.054094 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:29.054072    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9352c08-8d0e-41c2-9937-acc6915f2012-istio-envoy\") pod \"e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j\" (UID: \"b9352c08-8d0e-41c2-9937-acc6915f2012\") " pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j"
Jul 13 17:19:29.054205 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:29.054108    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9352c08-8d0e-41c2-9937-acc6915f2012-istio-data\") pod \"e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j\" (UID: \"b9352c08-8d0e-41c2-9937-acc6915f2012\") " pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j"
Jul 13 17:19:29.054205 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:29.054133    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9352c08-8d0e-41c2-9937-acc6915f2012-workload-certs\") pod \"e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j\" (UID: \"b9352c08-8d0e-41c2-9937-acc6915f2012\") " pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j"
Jul 13 17:19:29.054205 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:29.054160    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9352c08-8d0e-41c2-9937-acc6915f2012-istio-token\") pod \"e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j\" (UID: \"b9352c08-8d0e-41c2-9937-acc6915f2012\") " pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j"
Jul 13 17:19:29.054205 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:29.054192    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9352c08-8d0e-41c2-9937-acc6915f2012-credential-socket\") pod \"e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j\" (UID: \"b9352c08-8d0e-41c2-9937-acc6915f2012\") " pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j"
Jul 13 17:19:29.054368 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:29.054245    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9352c08-8d0e-41c2-9937-acc6915f2012-workload-socket\") pod \"e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j\" (UID: \"b9352c08-8d0e-41c2-9937-acc6915f2012\") " pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j"
Jul 13 17:19:29.054368 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:29.054289    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpv67\" (UniqueName: \"kubernetes.io/projected/b9352c08-8d0e-41c2-9937-acc6915f2012-kube-api-access-dpv67\") pod \"e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j\" (UID: \"b9352c08-8d0e-41c2-9937-acc6915f2012\") " pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j"
Jul 13 17:19:29.054368 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:29.054321    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9352c08-8d0e-41c2-9937-acc6915f2012-istiod-ca-cert\") pod \"e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j\" (UID: \"b9352c08-8d0e-41c2-9937-acc6915f2012\") " pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j"
Jul 13 17:19:29.054521 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:29.054398    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9352c08-8d0e-41c2-9937-acc6915f2012-istio-podinfo\") pod \"e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j\" (UID: \"b9352c08-8d0e-41c2-9937-acc6915f2012\") " pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j"
Jul 13 17:19:29.154903 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:29.154818    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9352c08-8d0e-41c2-9937-acc6915f2012-istio-podinfo\") pod \"e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j\" (UID: \"b9352c08-8d0e-41c2-9937-acc6915f2012\") " pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j"
Jul 13 17:19:29.154903 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:29.154873    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9352c08-8d0e-41c2-9937-acc6915f2012-istio-envoy\") pod \"e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j\" (UID: \"b9352c08-8d0e-41c2-9937-acc6915f2012\") " pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j"
Jul 13 17:19:29.155106 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:29.154905    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9352c08-8d0e-41c2-9937-acc6915f2012-istio-data\") pod \"e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j\" (UID: \"b9352c08-8d0e-41c2-9937-acc6915f2012\") " pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j"
Jul 13 17:19:29.155106 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:29.155032    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9352c08-8d0e-41c2-9937-acc6915f2012-workload-certs\") pod \"e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j\" (UID: \"b9352c08-8d0e-41c2-9937-acc6915f2012\") " pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j"
Jul 13 17:19:29.155106 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:29.155067    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9352c08-8d0e-41c2-9937-acc6915f2012-istio-token\") pod \"e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j\" (UID: \"b9352c08-8d0e-41c2-9937-acc6915f2012\") " pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j"
Jul 13 17:19:29.155265 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:29.155122    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9352c08-8d0e-41c2-9937-acc6915f2012-credential-socket\") pod \"e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j\" (UID: \"b9352c08-8d0e-41c2-9937-acc6915f2012\") " pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j"
Jul 13 17:19:29.155265 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:29.155150    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9352c08-8d0e-41c2-9937-acc6915f2012-workload-socket\") pod \"e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j\" (UID: \"b9352c08-8d0e-41c2-9937-acc6915f2012\") " pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j"
Jul 13 17:19:29.155265 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:29.155195    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpv67\" (UniqueName: \"kubernetes.io/projected/b9352c08-8d0e-41c2-9937-acc6915f2012-kube-api-access-dpv67\") pod \"e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j\" (UID: \"b9352c08-8d0e-41c2-9937-acc6915f2012\") " pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j"
Jul 13 17:19:29.155265 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:29.155239    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9352c08-8d0e-41c2-9937-acc6915f2012-istiod-ca-cert\") pod \"e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j\" (UID: \"b9352c08-8d0e-41c2-9937-acc6915f2012\") " pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j"
Jul 13 17:19:29.155464 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:29.155333    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9352c08-8d0e-41c2-9937-acc6915f2012-istio-data\") pod \"e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j\" (UID: \"b9352c08-8d0e-41c2-9937-acc6915f2012\") " pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j"
Jul 13 17:19:29.155464 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:29.155384    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9352c08-8d0e-41c2-9937-acc6915f2012-workload-certs\") pod \"e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j\" (UID: \"b9352c08-8d0e-41c2-9937-acc6915f2012\") " pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j"
Jul 13 17:19:29.155641 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:29.155617    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9352c08-8d0e-41c2-9937-acc6915f2012-workload-socket\") pod \"e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j\" (UID: \"b9352c08-8d0e-41c2-9937-acc6915f2012\") " pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j"
Jul 13 17:19:29.155751 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:29.155711    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9352c08-8d0e-41c2-9937-acc6915f2012-credential-socket\") pod \"e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j\" (UID: \"b9352c08-8d0e-41c2-9937-acc6915f2012\") " pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j"
Jul 13 17:19:29.156049 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:29.156028    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9352c08-8d0e-41c2-9937-acc6915f2012-istiod-ca-cert\") pod \"e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j\" (UID: \"b9352c08-8d0e-41c2-9937-acc6915f2012\") " pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j"
Jul 13 17:19:29.157294 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:29.157270    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9352c08-8d0e-41c2-9937-acc6915f2012-istio-envoy\") pod \"e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j\" (UID: \"b9352c08-8d0e-41c2-9937-acc6915f2012\") " pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j"
Jul 13 17:19:29.157538 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:29.157519    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9352c08-8d0e-41c2-9937-acc6915f2012-istio-podinfo\") pod \"e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j\" (UID: \"b9352c08-8d0e-41c2-9937-acc6915f2012\") " pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j"
Jul 13 17:19:29.163306 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:29.163280    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9352c08-8d0e-41c2-9937-acc6915f2012-istio-token\") pod \"e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j\" (UID: \"b9352c08-8d0e-41c2-9937-acc6915f2012\") " pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j"
Jul 13 17:19:29.164225 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:29.164190    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpv67\" (UniqueName: \"kubernetes.io/projected/b9352c08-8d0e-41c2-9937-acc6915f2012-kube-api-access-dpv67\") pod \"e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j\" (UID: \"b9352c08-8d0e-41c2-9937-acc6915f2012\") " pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j"
Jul 13 17:19:29.202301 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:29.202280    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j"
Jul 13 17:19:29.340876 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:29.340852    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j"]
Jul 13 17:19:29.343153 ip-10-0-143-51 kubenswrapper[2573]: W0713 17:19:29.343117    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9352c08_8d0e_41c2_9937_acc6915f2012.slice/crio-aec5ecb60bb741916db860373d8f9fcb181a00c9587751c660da0f3035381d6c WatchSource:0}: Error finding container aec5ecb60bb741916db860373d8f9fcb181a00c9587751c660da0f3035381d6c: Status 404 returned error can't find the container with id aec5ecb60bb741916db860373d8f9fcb181a00c9587751c660da0f3035381d6c
Jul 13 17:19:29.345819 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:29.345783    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:19:29.345908 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:29.345852    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:19:29.345908 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:29.345885    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:19:29.843034 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:29.842994    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j" event={"ID":"b9352c08-8d0e-41c2-9937-acc6915f2012","Type":"ContainerStarted","Data":"a8598f96ee2860cd5f780ed548dfb563e6333b5a0deddd42fa190a2b38cfbc9b"}
Jul 13 17:19:29.843203 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:29.843055    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j" event={"ID":"b9352c08-8d0e-41c2-9937-acc6915f2012","Type":"ContainerStarted","Data":"aec5ecb60bb741916db860373d8f9fcb181a00c9587751c660da0f3035381d6c"}
Jul 13 17:19:29.869055 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:29.869009    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j" podStartSLOduration=1.868995213 podStartE2EDuration="1.868995213s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:19:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:19:29.867943504 +0000 UTC m=+2367.226250346" watchObservedRunningTime="2026-07-13 17:19:29.868995213 +0000 UTC m=+2367.227302037"
Jul 13 17:19:30.203117 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:30.203045    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j"
Jul 13 17:19:30.207928 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:30.207905    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j"
Jul 13 17:19:30.852381 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:30.852343    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j"
Jul 13 17:19:30.857702 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:30.857675    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j"
Jul 13 17:19:31.968741 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:31.968699    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:19:32.070916 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:32.070886    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:19:32.379112 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:32.379082    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:19:32.558074 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:32.558020    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:19:32.657237 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:32.657109    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:19:36.331834 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:36.331804    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:19:37.806937 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:37.806862    2573 patch_prober.go:28] interesting pod/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 13 17:19:37.806937 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:37.806914    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc" podUID="9da27a18-5a4d-4454-af93-b2c2ad41ae2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 13 17:19:37.890860 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:37.890777    2573 generic.go:356] "Generic (PLEG): container finished" podID="9da27a18-5a4d-4454-af93-b2c2ad41ae2a" containerID="f60bb78605fd5ff6339b6d6793abbcc262518697fb65d7b4027b1304a3f97aaf" exitCode=0
Jul 13 17:19:37.890860 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:37.890847    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc" event={"ID":"9da27a18-5a4d-4454-af93-b2c2ad41ae2a","Type":"ContainerDied","Data":"f60bb78605fd5ff6339b6d6793abbcc262518697fb65d7b4027b1304a3f97aaf"}
Jul 13 17:19:37.891273 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:37.891255    2573 scope.go:117] "RemoveContainer" containerID="f60bb78605fd5ff6339b6d6793abbcc262518697fb65d7b4027b1304a3f97aaf"
Jul 13 17:19:37.892253 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:37.892228    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:19:37.892324 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:37.892294    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:19:37.892364 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:37.892324    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:19:38.898431 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:38.898397    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc" event={"ID":"9da27a18-5a4d-4454-af93-b2c2ad41ae2a","Type":"ContainerStarted","Data":"4a1539afaa04daf9e6b4294da74145d8f3fcffd9de455bad9529dc393132122c"}
Jul 13 17:19:39.223309 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:39.222992    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc"
Jul 13 17:19:39.223309 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:39.223182    2573 patch_prober.go:28] interesting pod/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 13 17:19:39.223506 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:39.223307    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc" podUID="9da27a18-5a4d-4454-af93-b2c2ad41ae2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 13 17:19:40.219938 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:40.219901    2573 patch_prober.go:28] interesting pod/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 13 17:19:40.220417 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:40.219963    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc" podUID="9da27a18-5a4d-4454-af93-b2c2ad41ae2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 13 17:19:41.220006 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:41.219971    2573 patch_prober.go:28] interesting pod/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 13 17:19:41.220386 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:41.220020    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc" podUID="9da27a18-5a4d-4454-af93-b2c2ad41ae2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 13 17:19:42.220475 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:42.220445    2573 patch_prober.go:28] interesting pod/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 13 17:19:42.220821 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:42.220524    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc" podUID="9da27a18-5a4d-4454-af93-b2c2ad41ae2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 13 17:19:43.224169 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:43.224139    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc"
Jul 13 17:19:43.224582 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:43.224417    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc"
Jul 13 17:19:43.225056 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:43.225038    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc"
Jul 13 17:19:45.730875 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:45.730843    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:19:45.828210 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:45.828174    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:19:45.853058 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:45.853029    2573 patch_prober.go:28] interesting pod/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 13 17:19:45.853216 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:45.853086    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j" podUID="b9352c08-8d0e-41c2-9937-acc6915f2012" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 13 17:19:45.932329 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:45.932296    2573 generic.go:356] "Generic (PLEG): container finished" podID="b9352c08-8d0e-41c2-9937-acc6915f2012" containerID="a8598f96ee2860cd5f780ed548dfb563e6333b5a0deddd42fa190a2b38cfbc9b" exitCode=0
Jul 13 17:19:45.932460 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:45.932366    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j" event={"ID":"b9352c08-8d0e-41c2-9937-acc6915f2012","Type":"ContainerDied","Data":"a8598f96ee2860cd5f780ed548dfb563e6333b5a0deddd42fa190a2b38cfbc9b"}
Jul 13 17:19:45.932764 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:45.932748    2573 scope.go:117] "RemoveContainer" containerID="a8598f96ee2860cd5f780ed548dfb563e6333b5a0deddd42fa190a2b38cfbc9b"
Jul 13 17:19:45.933735 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:45.933699    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:19:45.933802 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:45.933790    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:19:45.933839 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:45.933821    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 17:19:46.940871 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:46.940836    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j" event={"ID":"b9352c08-8d0e-41c2-9937-acc6915f2012","Type":"ContainerStarted","Data":"b50a50325cad623d7388842be519401906d19ee1c9450cf0f9e8b8ac2b4def11"}
Jul 13 17:19:47.202850 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:47.202769    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j"
Jul 13 17:19:47.202992 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:47.202973    2573 patch_prober.go:28] interesting pod/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 13 17:19:47.203044 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:47.203011    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j" podUID="b9352c08-8d0e-41c2-9937-acc6915f2012" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 13 17:19:48.202581 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:48.202548    2573 patch_prober.go:28] interesting pod/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 13 17:19:48.203012 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:48.202599    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j" podUID="b9352c08-8d0e-41c2-9937-acc6915f2012" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 13 17:19:49.203207 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:49.203174    2573 patch_prober.go:28] interesting pod/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 13 17:19:49.203620 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:49.203223    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j" podUID="b9352c08-8d0e-41c2-9937-acc6915f2012" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 13 17:19:50.203076 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:50.203040    2573 patch_prober.go:28] interesting pod/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 13 17:19:50.203263 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:50.203095    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j" podUID="b9352c08-8d0e-41c2-9937-acc6915f2012" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 13 17:19:51.207026 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:51.206993    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j"
Jul 13 17:19:51.207462 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:51.207242    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j"
Jul 13 17:19:51.207913 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:51.207895    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j"
Jul 13 17:19:53.352567 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:53.352534    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:19:53.453413 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:19:53.453377    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:20:00.425022 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:20:00.424983    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:20:03.203653 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:20:03.203625    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnxdg_e1fb6130-2ab7-40f5-831c-ea95ff241f37/ovn-acl-logging/0.log"
Jul 13 17:20:03.207227 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:20:03.207210    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnxdg_e1fb6130-2ab7-40f5-831c-ea95ff241f37/ovn-acl-logging/0.log"
Jul 13 17:20:19.931434 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:20:19.931400    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:20:30.242425 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:20:30.242347    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:24.064976 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:21:24.064943    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:21.263150 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:22:21.263071    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:22.145988 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:22:22.145954    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:28.207770 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:22:28.207713    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-aac012/sub-test-model-aac012-kserve-7d998685ff-smzpc"]
Jul 13 17:22:28.208128 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:22:28.208073    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29e2205d-664b-44d5-be0b-d0bf7b163eab" containerName="istio-proxy"
Jul 13 17:22:28.208128 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:22:28.208083    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="29e2205d-664b-44d5-be0b-d0bf7b163eab" containerName="istio-proxy"
Jul 13 17:22:28.211168 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:22:28.211150    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-aac012/sub-test-model-aac012-kserve-7d998685ff-smzpc"
Jul 13 17:22:28.215471 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:22:28.215432    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-aac012\"/\"default-dockercfg-vrfqb\""
Jul 13 17:22:28.215471 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:22:28.215462    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-aac012\"/\"sub-test-model-aac012-kserve-self-signed-certs\""
Jul 13 17:22:28.215683 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:22:28.215469    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-aac012\"/\"openshift-service-ca.crt\""
Jul 13 17:22:28.215683 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:22:28.215472    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-aac012\"/\"kube-root-ca.crt\""
Jul 13 17:22:28.223981 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:22:28.223959    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-aac012/sub-test-model-aac012-kserve-7d998685ff-smzpc"]
Jul 13 17:22:28.232365 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:22:28.232344    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:28.324964 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:22:28.324941    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ee31f6e-7351-42a2-b472-466943fa8ffe-home\") pod \"sub-test-model-aac012-kserve-7d998685ff-smzpc\" (UID: \"4ee31f6e-7351-42a2-b472-466943fa8ffe\") " pod="ai-tenant-e2e-shared-a-aac012/sub-test-model-aac012-kserve-7d998685ff-smzpc"
Jul 13 17:22:28.325104 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:22:28.324967    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ee31f6e-7351-42a2-b472-466943fa8ffe-tmp-dir\") pod \"sub-test-model-aac012-kserve-7d998685ff-smzpc\" (UID: \"4ee31f6e-7351-42a2-b472-466943fa8ffe\") " pod="ai-tenant-e2e-shared-a-aac012/sub-test-model-aac012-kserve-7d998685ff-smzpc"
Jul 13 17:22:28.325104 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:22:28.325002    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ee31f6e-7351-42a2-b472-466943fa8ffe-dshm\") pod \"sub-test-model-aac012-kserve-7d998685ff-smzpc\" (UID: \"4ee31f6e-7351-42a2-b472-466943fa8ffe\") " pod="ai-tenant-e2e-shared-a-aac012/sub-test-model-aac012-kserve-7d998685ff-smzpc"
Jul 13 17:22:28.325104 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:22:28.325075    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ee31f6e-7351-42a2-b472-466943fa8ffe-tls-certs\") pod \"sub-test-model-aac012-kserve-7d998685ff-smzpc\" (UID: \"4ee31f6e-7351-42a2-b472-466943fa8ffe\") " pod="ai-tenant-e2e-shared-a-aac012/sub-test-model-aac012-kserve-7d998685ff-smzpc"
Jul 13 17:22:28.325218 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:22:28.325106    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzfx5\" (UniqueName: \"kubernetes.io/projected/4ee31f6e-7351-42a2-b472-466943fa8ffe-kube-api-access-qzfx5\") pod \"sub-test-model-aac012-kserve-7d998685ff-smzpc\" (UID: \"4ee31f6e-7351-42a2-b472-466943fa8ffe\") " pod="ai-tenant-e2e-shared-a-aac012/sub-test-model-aac012-kserve-7d998685ff-smzpc"
Jul 13 17:22:28.325218 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:22:28.325145    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ee31f6e-7351-42a2-b472-466943fa8ffe-model-cache\") pod \"sub-test-model-aac012-kserve-7d998685ff-smzpc\" (UID: \"4ee31f6e-7351-42a2-b472-466943fa8ffe\") " pod="ai-tenant-e2e-shared-a-aac012/sub-test-model-aac012-kserve-7d998685ff-smzpc"
Jul 13 17:22:28.426292 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:22:28.426261    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ee31f6e-7351-42a2-b472-466943fa8ffe-model-cache\") pod \"sub-test-model-aac012-kserve-7d998685ff-smzpc\" (UID: \"4ee31f6e-7351-42a2-b472-466943fa8ffe\") " pod="ai-tenant-e2e-shared-a-aac012/sub-test-model-aac012-kserve-7d998685ff-smzpc"
Jul 13 17:22:28.426481 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:22:28.426319    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ee31f6e-7351-42a2-b472-466943fa8ffe-home\") pod \"sub-test-model-aac012-kserve-7d998685ff-smzpc\" (UID: \"4ee31f6e-7351-42a2-b472-466943fa8ffe\") " pod="ai-tenant-e2e-shared-a-aac012/sub-test-model-aac012-kserve-7d998685ff-smzpc"
Jul 13 17:22:28.426481 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:22:28.426339    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ee31f6e-7351-42a2-b472-466943fa8ffe-tmp-dir\") pod \"sub-test-model-aac012-kserve-7d998685ff-smzpc\" (UID: \"4ee31f6e-7351-42a2-b472-466943fa8ffe\") " pod="ai-tenant-e2e-shared-a-aac012/sub-test-model-aac012-kserve-7d998685ff-smzpc"
Jul 13 17:22:28.426481 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:22:28.426370    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ee31f6e-7351-42a2-b472-466943fa8ffe-dshm\") pod \"sub-test-model-aac012-kserve-7d998685ff-smzpc\" (UID: \"4ee31f6e-7351-42a2-b472-466943fa8ffe\") " pod="ai-tenant-e2e-shared-a-aac012/sub-test-model-aac012-kserve-7d998685ff-smzpc"
Jul 13 17:22:28.426481 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:22:28.426397    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ee31f6e-7351-42a2-b472-466943fa8ffe-tls-certs\") pod \"sub-test-model-aac012-kserve-7d998685ff-smzpc\" (UID: \"4ee31f6e-7351-42a2-b472-466943fa8ffe\") " pod="ai-tenant-e2e-shared-a-aac012/sub-test-model-aac012-kserve-7d998685ff-smzpc"
Jul 13 17:22:28.426481 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:22:28.426414    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzfx5\" (UniqueName: \"kubernetes.io/projected/4ee31f6e-7351-42a2-b472-466943fa8ffe-kube-api-access-qzfx5\") pod \"sub-test-model-aac012-kserve-7d998685ff-smzpc\" (UID: \"4ee31f6e-7351-42a2-b472-466943fa8ffe\") " pod="ai-tenant-e2e-shared-a-aac012/sub-test-model-aac012-kserve-7d998685ff-smzpc"
Jul 13 17:22:28.426799 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:22:28.426776    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ee31f6e-7351-42a2-b472-466943fa8ffe-model-cache\") pod \"sub-test-model-aac012-kserve-7d998685ff-smzpc\" (UID: \"4ee31f6e-7351-42a2-b472-466943fa8ffe\") " pod="ai-tenant-e2e-shared-a-aac012/sub-test-model-aac012-kserve-7d998685ff-smzpc"
Jul 13 17:22:28.426869 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:22:28.426804    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ee31f6e-7351-42a2-b472-466943fa8ffe-home\") pod \"sub-test-model-aac012-kserve-7d998685ff-smzpc\" (UID: \"4ee31f6e-7351-42a2-b472-466943fa8ffe\") " pod="ai-tenant-e2e-shared-a-aac012/sub-test-model-aac012-kserve-7d998685ff-smzpc"
Jul 13 17:22:28.426869 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:22:28.426842    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ee31f6e-7351-42a2-b472-466943fa8ffe-tmp-dir\") pod \"sub-test-model-aac012-kserve-7d998685ff-smzpc\" (UID: \"4ee31f6e-7351-42a2-b472-466943fa8ffe\") " pod="ai-tenant-e2e-shared-a-aac012/sub-test-model-aac012-kserve-7d998685ff-smzpc"
Jul 13 17:22:28.428652 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:22:28.428630    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ee31f6e-7351-42a2-b472-466943fa8ffe-dshm\") pod \"sub-test-model-aac012-kserve-7d998685ff-smzpc\" (UID: \"4ee31f6e-7351-42a2-b472-466943fa8ffe\") " pod="ai-tenant-e2e-shared-a-aac012/sub-test-model-aac012-kserve-7d998685ff-smzpc"
Jul 13 17:22:28.428937 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:22:28.428919    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ee31f6e-7351-42a2-b472-466943fa8ffe-tls-certs\") pod \"sub-test-model-aac012-kserve-7d998685ff-smzpc\" (UID: \"4ee31f6e-7351-42a2-b472-466943fa8ffe\") " pod="ai-tenant-e2e-shared-a-aac012/sub-test-model-aac012-kserve-7d998685ff-smzpc"
Jul 13 17:22:28.435215 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:22:28.435194    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzfx5\" (UniqueName: \"kubernetes.io/projected/4ee31f6e-7351-42a2-b472-466943fa8ffe-kube-api-access-qzfx5\") pod \"sub-test-model-aac012-kserve-7d998685ff-smzpc\" (UID: \"4ee31f6e-7351-42a2-b472-466943fa8ffe\") " pod="ai-tenant-e2e-shared-a-aac012/sub-test-model-aac012-kserve-7d998685ff-smzpc"
Jul 13 17:22:28.520393 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:22:28.520360    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-aac012/sub-test-model-aac012-kserve-7d998685ff-smzpc"
Jul 13 17:22:28.651608 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:22:28.651584    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-aac012/sub-test-model-aac012-kserve-7d998685ff-smzpc"]
Jul 13 17:22:28.653479 ip-10-0-143-51 kubenswrapper[2573]: W0713 17:22:28.653452    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4ee31f6e_7351_42a2_b472_466943fa8ffe.slice/crio-3c23bd29c503b80c9edd965e4f86b08d1ca574a982feb8f2ec9c7d2a972a8ced WatchSource:0}: Error finding container 3c23bd29c503b80c9edd965e4f86b08d1ca574a982feb8f2ec9c7d2a972a8ced: Status 404 returned error can't find the container with id 3c23bd29c503b80c9edd965e4f86b08d1ca574a982feb8f2ec9c7d2a972a8ced
Jul 13 17:22:28.729332 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:22:28.729299    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-aac012/sub-test-model-aac012-kserve-7d998685ff-smzpc" event={"ID":"4ee31f6e-7351-42a2-b472-466943fa8ffe","Type":"ContainerStarted","Data":"5c1161b1d0daa6a3b4c566762efc8d82f5ab7ec89da04a2717625a7de32e1205"}
Jul 13 17:22:28.729455 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:22:28.729350    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-aac012/sub-test-model-aac012-kserve-7d998685ff-smzpc" event={"ID":"4ee31f6e-7351-42a2-b472-466943fa8ffe","Type":"ContainerStarted","Data":"3c23bd29c503b80c9edd965e4f86b08d1ca574a982feb8f2ec9c7d2a972a8ced"}
Jul 13 17:22:28.747637 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:22:28.747582    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-aac012/sub-test-model-aac012-kserve-7d998685ff-smzpc" podStartSLOduration=0.747562183 podStartE2EDuration="747.562183ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:22:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:22:28.746182541 +0000 UTC m=+2546.104489364" watchObservedRunningTime="2026-07-13 17:22:28.747562183 +0000 UTC m=+2546.105869010"
Jul 13 17:22:38.520495 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:22:38.520455    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-aac012/sub-test-model-aac012-kserve-7d998685ff-smzpc"
Jul 13 17:22:38.520965 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:22:38.520539    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-aac012/sub-test-model-aac012-kserve-7d998685ff-smzpc"
Jul 13 17:22:38.533109 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:22:38.533087    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-aac012/sub-test-model-aac012-kserve-7d998685ff-smzpc"
Jul 13 17:22:38.789166 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:22:38.789086    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-aac012/sub-test-model-aac012-kserve-7d998685ff-smzpc"
Jul 13 17:22:53.151141 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:22:53.150535    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:23:17.583093 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:23:17.583062    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:23:17.649547 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:23:17.649508    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:23:22.594015 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:23:22.593981    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:23:35.009145 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:23:35.009111    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-aac012/sub-test-model-aac012-kserve-7d998685ff-smzpc"]
Jul 13 17:23:35.053338 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:23:35.053309    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:23:36.852027 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:23:36.851996    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:23:46.225401 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:23:46.225367    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:23:50.028964 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:23:50.028929    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-aac012/sub-test-model-aac012-kserve-7d998685ff-smzpc" podUID="4ee31f6e-7351-42a2-b472-466943fa8ffe" containerName="main" containerID="cri-o://5c1161b1d0daa6a3b4c566762efc8d82f5ab7ec89da04a2717625a7de32e1205" gracePeriod=45
Jul 13 17:23:50.314853 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:23:50.314816    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-aac012/sub-test-model-aac012-kserve-7d998685ff-smzpc"
Jul 13 17:23:50.341568 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:23:50.341001    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzfx5\" (UniqueName: \"kubernetes.io/projected/4ee31f6e-7351-42a2-b472-466943fa8ffe-kube-api-access-qzfx5\") pod \"4ee31f6e-7351-42a2-b472-466943fa8ffe\" (UID: \"4ee31f6e-7351-42a2-b472-466943fa8ffe\") "
Jul 13 17:23:50.341568 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:23:50.341060    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ee31f6e-7351-42a2-b472-466943fa8ffe-home\") pod \"4ee31f6e-7351-42a2-b472-466943fa8ffe\" (UID: \"4ee31f6e-7351-42a2-b472-466943fa8ffe\") "
Jul 13 17:23:50.341568 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:23:50.341097    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ee31f6e-7351-42a2-b472-466943fa8ffe-tmp-dir\") pod \"4ee31f6e-7351-42a2-b472-466943fa8ffe\" (UID: \"4ee31f6e-7351-42a2-b472-466943fa8ffe\") "
Jul 13 17:23:50.341568 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:23:50.341154    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ee31f6e-7351-42a2-b472-466943fa8ffe-model-cache\") pod \"4ee31f6e-7351-42a2-b472-466943fa8ffe\" (UID: \"4ee31f6e-7351-42a2-b472-466943fa8ffe\") "
Jul 13 17:23:50.341568 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:23:50.341236    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ee31f6e-7351-42a2-b472-466943fa8ffe-tls-certs\") pod \"4ee31f6e-7351-42a2-b472-466943fa8ffe\" (UID: \"4ee31f6e-7351-42a2-b472-466943fa8ffe\") "
Jul 13 17:23:50.342083 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:23:50.341825    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ee31f6e-7351-42a2-b472-466943fa8ffe-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4ee31f6e-7351-42a2-b472-466943fa8ffe" (UID: "4ee31f6e-7351-42a2-b472-466943fa8ffe"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:23:50.342083 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:23:50.342064    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ee31f6e-7351-42a2-b472-466943fa8ffe-model-cache" (OuterVolumeSpecName: "model-cache") pod "4ee31f6e-7351-42a2-b472-466943fa8ffe" (UID: "4ee31f6e-7351-42a2-b472-466943fa8ffe"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:23:50.342197 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:23:50.342178    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ee31f6e-7351-42a2-b472-466943fa8ffe-dshm\") pod \"4ee31f6e-7351-42a2-b472-466943fa8ffe\" (UID: \"4ee31f6e-7351-42a2-b472-466943fa8ffe\") "
Jul 13 17:23:50.342664 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:23:50.342493    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ee31f6e-7351-42a2-b472-466943fa8ffe-tmp-dir\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:23:50.342664 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:23:50.342514    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ee31f6e-7351-42a2-b472-466943fa8ffe-model-cache\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:23:50.342984 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:23:50.342962    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ee31f6e-7351-42a2-b472-466943fa8ffe-home" (OuterVolumeSpecName: "home") pod "4ee31f6e-7351-42a2-b472-466943fa8ffe" (UID: "4ee31f6e-7351-42a2-b472-466943fa8ffe"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:23:50.345890 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:23:50.345850    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ee31f6e-7351-42a2-b472-466943fa8ffe-kube-api-access-qzfx5" (OuterVolumeSpecName: "kube-api-access-qzfx5") pod "4ee31f6e-7351-42a2-b472-466943fa8ffe" (UID: "4ee31f6e-7351-42a2-b472-466943fa8ffe"). InnerVolumeSpecName "kube-api-access-qzfx5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:23:50.346490 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:23:50.346456    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ee31f6e-7351-42a2-b472-466943fa8ffe-dshm" (OuterVolumeSpecName: "dshm") pod "4ee31f6e-7351-42a2-b472-466943fa8ffe" (UID: "4ee31f6e-7351-42a2-b472-466943fa8ffe"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:23:50.347235 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:23:50.347210    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ee31f6e-7351-42a2-b472-466943fa8ffe-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4ee31f6e-7351-42a2-b472-466943fa8ffe" (UID: "4ee31f6e-7351-42a2-b472-466943fa8ffe"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:23:50.443464 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:23:50.443424    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzfx5\" (UniqueName: \"kubernetes.io/projected/4ee31f6e-7351-42a2-b472-466943fa8ffe-kube-api-access-qzfx5\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:23:50.443464 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:23:50.443463    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ee31f6e-7351-42a2-b472-466943fa8ffe-home\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:23:50.443743 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:23:50.443479    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ee31f6e-7351-42a2-b472-466943fa8ffe-tls-certs\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:23:50.443743 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:23:50.443492    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ee31f6e-7351-42a2-b472-466943fa8ffe-dshm\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:23:51.119633 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:23:51.119601    2573 generic.go:356] "Generic (PLEG): container finished" podID="4ee31f6e-7351-42a2-b472-466943fa8ffe" containerID="5c1161b1d0daa6a3b4c566762efc8d82f5ab7ec89da04a2717625a7de32e1205" exitCode=0
Jul 13 17:23:51.120072 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:23:51.119657    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-aac012/sub-test-model-aac012-kserve-7d998685ff-smzpc"
Jul 13 17:23:51.120072 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:23:51.119692    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-aac012/sub-test-model-aac012-kserve-7d998685ff-smzpc" event={"ID":"4ee31f6e-7351-42a2-b472-466943fa8ffe","Type":"ContainerDied","Data":"5c1161b1d0daa6a3b4c566762efc8d82f5ab7ec89da04a2717625a7de32e1205"}
Jul 13 17:23:51.120072 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:23:51.119747    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-aac012/sub-test-model-aac012-kserve-7d998685ff-smzpc" event={"ID":"4ee31f6e-7351-42a2-b472-466943fa8ffe","Type":"ContainerDied","Data":"3c23bd29c503b80c9edd965e4f86b08d1ca574a982feb8f2ec9c7d2a972a8ced"}
Jul 13 17:23:51.120072 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:23:51.119764    2573 scope.go:117] "RemoveContainer" containerID="5c1161b1d0daa6a3b4c566762efc8d82f5ab7ec89da04a2717625a7de32e1205"
Jul 13 17:23:51.128793 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:23:51.128774    2573 scope.go:117] "RemoveContainer" containerID="5c1161b1d0daa6a3b4c566762efc8d82f5ab7ec89da04a2717625a7de32e1205"
Jul 13 17:23:51.129047 ip-10-0-143-51 kubenswrapper[2573]: E0713 17:23:51.129028    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c1161b1d0daa6a3b4c566762efc8d82f5ab7ec89da04a2717625a7de32e1205\": container with ID starting with 5c1161b1d0daa6a3b4c566762efc8d82f5ab7ec89da04a2717625a7de32e1205 not found: ID does not exist" containerID="5c1161b1d0daa6a3b4c566762efc8d82f5ab7ec89da04a2717625a7de32e1205"
Jul 13 17:23:51.129109 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:23:51.129058    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c1161b1d0daa6a3b4c566762efc8d82f5ab7ec89da04a2717625a7de32e1205"} err="failed to get container status \"5c1161b1d0daa6a3b4c566762efc8d82f5ab7ec89da04a2717625a7de32e1205\": rpc error: code = NotFound desc = could not find container \"5c1161b1d0daa6a3b4c566762efc8d82f5ab7ec89da04a2717625a7de32e1205\": container with ID starting with 5c1161b1d0daa6a3b4c566762efc8d82f5ab7ec89da04a2717625a7de32e1205 not found: ID does not exist"
Jul 13 17:23:51.148797 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:23:51.148777    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-aac012/sub-test-model-aac012-kserve-7d998685ff-smzpc"]
Jul 13 17:23:51.148898 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:23:51.148804    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-aac012/sub-test-model-aac012-kserve-7d998685ff-smzpc"]
Jul 13 17:23:53.147579 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:23:53.147546    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ee31f6e-7351-42a2-b472-466943fa8ffe" path="/var/lib/kubelet/pods/4ee31f6e-7351-42a2-b472-466943fa8ffe/volumes"
Jul 13 17:24:10.914144 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:24:10.914109    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:24:11.014734 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:24:11.014702    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:24:15.743508 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:24:15.743471    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:24:46.371992 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:24:46.371955    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:24:46.472736 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:24:46.472698    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:24:54.320603 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:24:54.320572    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:24:54.427684 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:24:54.427657    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:24:57.599953 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:24:57.599920    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:24:58.574769 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:24:58.574738    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:24:58.639731 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:24:58.639680    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:25:03.230136 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:03.230098    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnxdg_e1fb6130-2ab7-40f5-831c-ea95ff241f37/ovn-acl-logging/0.log"
Jul 13 17:25:03.234449 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:03.234430    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnxdg_e1fb6130-2ab7-40f5-831c-ea95ff241f37/ovn-acl-logging/0.log"
Jul 13 17:25:18.397616 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:18.397581    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:25:18.498483 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:18.498448    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:25:28.412366 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:28.412333    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:25:32.898987 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:32.898951    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:25:33.742543 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:33.742509    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:25:38.792149 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:38.792120    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:25:38.891266 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:38.891233    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:25:43.585015 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:43.584984    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc"]
Jul 13 17:25:43.585445 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:43.585183    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc" podUID="9da27a18-5a4d-4454-af93-b2c2ad41ae2a" containerName="istio-proxy" containerID="cri-o://4a1539afaa04daf9e6b4294da74145d8f3fcffd9de455bad9529dc393132122c" gracePeriod=30
Jul 13 17:25:43.608342 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:43.608319    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:25:43.872386 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:43.872281    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:25:44.546594 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:44.546565    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:25:44.648389 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:44.648358    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:25:48.839489 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:48.839465    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc"
Jul 13 17:25:48.962864 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:48.962795    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-istiod-ca-cert\") pod \"9da27a18-5a4d-4454-af93-b2c2ad41ae2a\" (UID: \"9da27a18-5a4d-4454-af93-b2c2ad41ae2a\") "
Jul 13 17:25:48.962864 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:48.962843    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-istio-token\") pod \"9da27a18-5a4d-4454-af93-b2c2ad41ae2a\" (UID: \"9da27a18-5a4d-4454-af93-b2c2ad41ae2a\") "
Jul 13 17:25:48.962864 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:48.962865    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-workload-socket\") pod \"9da27a18-5a4d-4454-af93-b2c2ad41ae2a\" (UID: \"9da27a18-5a4d-4454-af93-b2c2ad41ae2a\") "
Jul 13 17:25:48.963131 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:48.962887    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-istio-data\") pod \"9da27a18-5a4d-4454-af93-b2c2ad41ae2a\" (UID: \"9da27a18-5a4d-4454-af93-b2c2ad41ae2a\") "
Jul 13 17:25:48.963131 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:48.962903    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-istio-podinfo\") pod \"9da27a18-5a4d-4454-af93-b2c2ad41ae2a\" (UID: \"9da27a18-5a4d-4454-af93-b2c2ad41ae2a\") "
Jul 13 17:25:48.963131 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:48.962929    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-workload-certs\") pod \"9da27a18-5a4d-4454-af93-b2c2ad41ae2a\" (UID: \"9da27a18-5a4d-4454-af93-b2c2ad41ae2a\") "
Jul 13 17:25:48.963131 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:48.962980    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-28jmj\" (UniqueName: \"kubernetes.io/projected/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-kube-api-access-28jmj\") pod \"9da27a18-5a4d-4454-af93-b2c2ad41ae2a\" (UID: \"9da27a18-5a4d-4454-af93-b2c2ad41ae2a\") "
Jul 13 17:25:48.963131 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:48.963014    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-credential-socket\") pod \"9da27a18-5a4d-4454-af93-b2c2ad41ae2a\" (UID: \"9da27a18-5a4d-4454-af93-b2c2ad41ae2a\") "
Jul 13 17:25:48.963131 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:48.963081    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-istio-envoy\") pod \"9da27a18-5a4d-4454-af93-b2c2ad41ae2a\" (UID: \"9da27a18-5a4d-4454-af93-b2c2ad41ae2a\") "
Jul 13 17:25:48.963444 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:48.963265    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9da27a18-5a4d-4454-af93-b2c2ad41ae2a" (UID: "9da27a18-5a4d-4454-af93-b2c2ad41ae2a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:25:48.963444 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:48.963346    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9da27a18-5a4d-4454-af93-b2c2ad41ae2a" (UID: "9da27a18-5a4d-4454-af93-b2c2ad41ae2a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:25:48.963444 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:48.963360    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-workload-socket\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:25:48.963589 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:48.963460    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9da27a18-5a4d-4454-af93-b2c2ad41ae2a" (UID: "9da27a18-5a4d-4454-af93-b2c2ad41ae2a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:25:48.963589 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:48.963481    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9da27a18-5a4d-4454-af93-b2c2ad41ae2a" (UID: "9da27a18-5a4d-4454-af93-b2c2ad41ae2a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:25:48.963764 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:48.963717    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-istio-data" (OuterVolumeSpecName: "istio-data") pod "9da27a18-5a4d-4454-af93-b2c2ad41ae2a" (UID: "9da27a18-5a4d-4454-af93-b2c2ad41ae2a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:25:48.965179 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:48.965147    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-kube-api-access-28jmj" (OuterVolumeSpecName: "kube-api-access-28jmj") pod "9da27a18-5a4d-4454-af93-b2c2ad41ae2a" (UID: "9da27a18-5a4d-4454-af93-b2c2ad41ae2a"). InnerVolumeSpecName "kube-api-access-28jmj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:25:48.965291 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:48.965224    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9da27a18-5a4d-4454-af93-b2c2ad41ae2a" (UID: "9da27a18-5a4d-4454-af93-b2c2ad41ae2a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:25:48.965413 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:48.965396    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-istio-token" (OuterVolumeSpecName: "istio-token") pod "9da27a18-5a4d-4454-af93-b2c2ad41ae2a" (UID: "9da27a18-5a4d-4454-af93-b2c2ad41ae2a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:25:48.965469 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:48.965427    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9da27a18-5a4d-4454-af93-b2c2ad41ae2a" (UID: "9da27a18-5a4d-4454-af93-b2c2ad41ae2a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 17:25:49.064121 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:49.064093    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-istio-envoy\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:25:49.064121 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:49.064118    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-istiod-ca-cert\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:25:49.064280 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:49.064131    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-istio-token\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:25:49.064280 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:49.064142    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-istio-data\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:25:49.064280 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:49.064153    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-istio-podinfo\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:25:49.064280 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:49.064165    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-workload-certs\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:25:49.064280 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:49.064177    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28jmj\" (UniqueName: \"kubernetes.io/projected/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-kube-api-access-28jmj\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:25:49.064280 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:49.064191    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9da27a18-5a4d-4454-af93-b2c2ad41ae2a-credential-socket\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:25:49.690004 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:49.689972    2573 generic.go:356] "Generic (PLEG): container finished" podID="9da27a18-5a4d-4454-af93-b2c2ad41ae2a" containerID="4a1539afaa04daf9e6b4294da74145d8f3fcffd9de455bad9529dc393132122c" exitCode=0
Jul 13 17:25:49.690231 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:49.690036    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc"
Jul 13 17:25:49.690231 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:49.690061    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc" event={"ID":"9da27a18-5a4d-4454-af93-b2c2ad41ae2a","Type":"ContainerDied","Data":"4a1539afaa04daf9e6b4294da74145d8f3fcffd9de455bad9529dc393132122c"}
Jul 13 17:25:49.690231 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:49.690116    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc" event={"ID":"9da27a18-5a4d-4454-af93-b2c2ad41ae2a","Type":"ContainerDied","Data":"ae34c719194a01884ca2c7ea98f9a9540c0b043c2bc7dd5affd096bb05019b0e"}
Jul 13 17:25:49.690231 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:49.690138    2573 scope.go:117] "RemoveContainer" containerID="4a1539afaa04daf9e6b4294da74145d8f3fcffd9de455bad9529dc393132122c"
Jul 13 17:25:49.698560 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:49.698542    2573 scope.go:117] "RemoveContainer" containerID="f60bb78605fd5ff6339b6d6793abbcc262518697fb65d7b4027b1304a3f97aaf"
Jul 13 17:25:49.706204 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:49.706025    2573 scope.go:117] "RemoveContainer" containerID="4a1539afaa04daf9e6b4294da74145d8f3fcffd9de455bad9529dc393132122c"
Jul 13 17:25:49.706280 ip-10-0-143-51 kubenswrapper[2573]: E0713 17:25:49.706254    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a1539afaa04daf9e6b4294da74145d8f3fcffd9de455bad9529dc393132122c\": container with ID starting with 4a1539afaa04daf9e6b4294da74145d8f3fcffd9de455bad9529dc393132122c not found: ID does not exist" containerID="4a1539afaa04daf9e6b4294da74145d8f3fcffd9de455bad9529dc393132122c"
Jul 13 17:25:49.706330 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:49.706292    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a1539afaa04daf9e6b4294da74145d8f3fcffd9de455bad9529dc393132122c"} err="failed to get container status \"4a1539afaa04daf9e6b4294da74145d8f3fcffd9de455bad9529dc393132122c\": rpc error: code = NotFound desc = could not find container \"4a1539afaa04daf9e6b4294da74145d8f3fcffd9de455bad9529dc393132122c\": container with ID starting with 4a1539afaa04daf9e6b4294da74145d8f3fcffd9de455bad9529dc393132122c not found: ID does not exist"
Jul 13 17:25:49.706330 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:49.706314    2573 scope.go:117] "RemoveContainer" containerID="f60bb78605fd5ff6339b6d6793abbcc262518697fb65d7b4027b1304a3f97aaf"
Jul 13 17:25:49.706604 ip-10-0-143-51 kubenswrapper[2573]: E0713 17:25:49.706576    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f60bb78605fd5ff6339b6d6793abbcc262518697fb65d7b4027b1304a3f97aaf\": container with ID starting with f60bb78605fd5ff6339b6d6793abbcc262518697fb65d7b4027b1304a3f97aaf not found: ID does not exist" containerID="f60bb78605fd5ff6339b6d6793abbcc262518697fb65d7b4027b1304a3f97aaf"
Jul 13 17:25:49.706683 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:49.706612    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f60bb78605fd5ff6339b6d6793abbcc262518697fb65d7b4027b1304a3f97aaf"} err="failed to get container status \"f60bb78605fd5ff6339b6d6793abbcc262518697fb65d7b4027b1304a3f97aaf\": rpc error: code = NotFound desc = could not find container \"f60bb78605fd5ff6339b6d6793abbcc262518697fb65d7b4027b1304a3f97aaf\": container with ID starting with f60bb78605fd5ff6339b6d6793abbcc262518697fb65d7b4027b1304a3f97aaf not found: ID does not exist"
Jul 13 17:25:49.709396 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:49.709379    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc"]
Jul 13 17:25:49.712704 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:49.712684    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-aac012-openshift-default-84b8d89579-fcrnc"]
Jul 13 17:25:51.147146 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:51.147108    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9da27a18-5a4d-4454-af93-b2c2ad41ae2a" path="/var/lib/kubelet/pods/9da27a18-5a4d-4454-af93-b2c2ad41ae2a/volumes"
Jul 13 17:25:54.569590 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:54.569496    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:25:59.086263 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:25:59.086233    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:05.309521 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:05.309484    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:05.410838 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:05.410786    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:09.771951 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:09.771922    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j"]
Jul 13 17:26:09.772418 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:09.772210    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j" podUID="b9352c08-8d0e-41c2-9937-acc6915f2012" containerName="istio-proxy" containerID="cri-o://b50a50325cad623d7388842be519401906d19ee1c9450cf0f9e8b8ac2b4def11" gracePeriod=30
Jul 13 17:26:09.797887 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:09.797855    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:10.052522 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:10.052443    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:10.480769 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:10.480695    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d54dfccc5-w6v9t_950a2e8e-738d-4d4d-8b85-66087f31a61d/authorino/0.log"
Jul 13 17:26:15.030165 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:15.030142    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j"
Jul 13 17:26:15.174028 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:15.173963    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9352c08-8d0e-41c2-9937-acc6915f2012-istio-data\") pod \"b9352c08-8d0e-41c2-9937-acc6915f2012\" (UID: \"b9352c08-8d0e-41c2-9937-acc6915f2012\") "
Jul 13 17:26:15.174028 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:15.174025    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9352c08-8d0e-41c2-9937-acc6915f2012-istio-token\") pod \"b9352c08-8d0e-41c2-9937-acc6915f2012\" (UID: \"b9352c08-8d0e-41c2-9937-acc6915f2012\") "
Jul 13 17:26:15.174240 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:15.174055    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9352c08-8d0e-41c2-9937-acc6915f2012-workload-socket\") pod \"b9352c08-8d0e-41c2-9937-acc6915f2012\" (UID: \"b9352c08-8d0e-41c2-9937-acc6915f2012\") "
Jul 13 17:26:15.174240 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:15.174087    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9352c08-8d0e-41c2-9937-acc6915f2012-credential-socket\") pod \"b9352c08-8d0e-41c2-9937-acc6915f2012\" (UID: \"b9352c08-8d0e-41c2-9937-acc6915f2012\") "
Jul 13 17:26:15.174240 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:15.174139    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9352c08-8d0e-41c2-9937-acc6915f2012-workload-certs\") pod \"b9352c08-8d0e-41c2-9937-acc6915f2012\" (UID: \"b9352c08-8d0e-41c2-9937-acc6915f2012\") "
Jul 13 17:26:15.174240 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:15.174178    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9352c08-8d0e-41c2-9937-acc6915f2012-istiod-ca-cert\") pod \"b9352c08-8d0e-41c2-9937-acc6915f2012\" (UID: \"b9352c08-8d0e-41c2-9937-acc6915f2012\") "
Jul 13 17:26:15.174240 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:15.174205    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9352c08-8d0e-41c2-9937-acc6915f2012-istio-envoy\") pod \"b9352c08-8d0e-41c2-9937-acc6915f2012\" (UID: \"b9352c08-8d0e-41c2-9937-acc6915f2012\") "
Jul 13 17:26:15.174240 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:15.174231    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dpv67\" (UniqueName: \"kubernetes.io/projected/b9352c08-8d0e-41c2-9937-acc6915f2012-kube-api-access-dpv67\") pod \"b9352c08-8d0e-41c2-9937-acc6915f2012\" (UID: \"b9352c08-8d0e-41c2-9937-acc6915f2012\") "
Jul 13 17:26:15.174544 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:15.174297    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9352c08-8d0e-41c2-9937-acc6915f2012-istio-podinfo\") pod \"b9352c08-8d0e-41c2-9937-acc6915f2012\" (UID: \"b9352c08-8d0e-41c2-9937-acc6915f2012\") "
Jul 13 17:26:15.174544 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:15.174328    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9352c08-8d0e-41c2-9937-acc6915f2012-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b9352c08-8d0e-41c2-9937-acc6915f2012" (UID: "b9352c08-8d0e-41c2-9937-acc6915f2012"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:26:15.174544 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:15.174527    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9352c08-8d0e-41c2-9937-acc6915f2012-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b9352c08-8d0e-41c2-9937-acc6915f2012" (UID: "b9352c08-8d0e-41c2-9937-acc6915f2012"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:26:15.174704 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:15.174588    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9352c08-8d0e-41c2-9937-acc6915f2012-workload-socket\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:26:15.174704 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:15.174659    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9352c08-8d0e-41c2-9937-acc6915f2012-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b9352c08-8d0e-41c2-9937-acc6915f2012" (UID: "b9352c08-8d0e-41c2-9937-acc6915f2012"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:26:15.174704 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:15.174679    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9352c08-8d0e-41c2-9937-acc6915f2012-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b9352c08-8d0e-41c2-9937-acc6915f2012" (UID: "b9352c08-8d0e-41c2-9937-acc6915f2012"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:26:15.175061 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:15.175011    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9352c08-8d0e-41c2-9937-acc6915f2012-istio-data" (OuterVolumeSpecName: "istio-data") pod "b9352c08-8d0e-41c2-9937-acc6915f2012" (UID: "b9352c08-8d0e-41c2-9937-acc6915f2012"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:26:15.176363 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:15.176328    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9352c08-8d0e-41c2-9937-acc6915f2012-istio-token" (OuterVolumeSpecName: "istio-token") pod "b9352c08-8d0e-41c2-9937-acc6915f2012" (UID: "b9352c08-8d0e-41c2-9937-acc6915f2012"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:26:15.176460 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:15.176356    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b9352c08-8d0e-41c2-9937-acc6915f2012-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b9352c08-8d0e-41c2-9937-acc6915f2012" (UID: "b9352c08-8d0e-41c2-9937-acc6915f2012"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 17:26:15.176460 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:15.176407    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9352c08-8d0e-41c2-9937-acc6915f2012-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b9352c08-8d0e-41c2-9937-acc6915f2012" (UID: "b9352c08-8d0e-41c2-9937-acc6915f2012"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:26:15.176460 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:15.176439    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9352c08-8d0e-41c2-9937-acc6915f2012-kube-api-access-dpv67" (OuterVolumeSpecName: "kube-api-access-dpv67") pod "b9352c08-8d0e-41c2-9937-acc6915f2012" (UID: "b9352c08-8d0e-41c2-9937-acc6915f2012"). InnerVolumeSpecName "kube-api-access-dpv67". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:26:15.275880 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:15.275856    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9352c08-8d0e-41c2-9937-acc6915f2012-credential-socket\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:26:15.275880 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:15.275876    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9352c08-8d0e-41c2-9937-acc6915f2012-workload-certs\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:26:15.276020 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:15.275886    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9352c08-8d0e-41c2-9937-acc6915f2012-istiod-ca-cert\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:26:15.276020 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:15.275894    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9352c08-8d0e-41c2-9937-acc6915f2012-istio-envoy\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:26:15.276020 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:15.275901    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpv67\" (UniqueName: \"kubernetes.io/projected/b9352c08-8d0e-41c2-9937-acc6915f2012-kube-api-access-dpv67\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:26:15.276020 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:15.275911    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9352c08-8d0e-41c2-9937-acc6915f2012-istio-podinfo\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:26:15.276020 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:15.275918    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9352c08-8d0e-41c2-9937-acc6915f2012-istio-data\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:26:15.276020 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:15.275925    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9352c08-8d0e-41c2-9937-acc6915f2012-istio-token\") on node \"ip-10-0-143-51.ec2.internal\" DevicePath \"\""
Jul 13 17:26:15.487035 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:15.487018    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-sbb74_28e7eae8-ab8c-486a-888f-78588b907aef/manager/0.log"
Jul 13 17:26:15.611929 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:15.611904    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-cw5v4_cede14aa-0f7b-47da-8c71-ceeaa093534b/manager/0.log"
Jul 13 17:26:15.811965 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:15.811880    2573 generic.go:356] "Generic (PLEG): container finished" podID="b9352c08-8d0e-41c2-9937-acc6915f2012" containerID="b50a50325cad623d7388842be519401906d19ee1c9450cf0f9e8b8ac2b4def11" exitCode=0
Jul 13 17:26:15.811965 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:15.811927    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j"
Jul 13 17:26:15.812195 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:15.811972    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j" event={"ID":"b9352c08-8d0e-41c2-9937-acc6915f2012","Type":"ContainerDied","Data":"b50a50325cad623d7388842be519401906d19ee1c9450cf0f9e8b8ac2b4def11"}
Jul 13 17:26:15.812195 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:15.812029    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j" event={"ID":"b9352c08-8d0e-41c2-9937-acc6915f2012","Type":"ContainerDied","Data":"aec5ecb60bb741916db860373d8f9fcb181a00c9587751c660da0f3035381d6c"}
Jul 13 17:26:15.812195 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:15.812057    2573 scope.go:117] "RemoveContainer" containerID="b50a50325cad623d7388842be519401906d19ee1c9450cf0f9e8b8ac2b4def11"
Jul 13 17:26:15.826162 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:15.826141    2573 scope.go:117] "RemoveContainer" containerID="a8598f96ee2860cd5f780ed548dfb563e6333b5a0deddd42fa190a2b38cfbc9b"
Jul 13 17:26:15.834081 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:15.834062    2573 scope.go:117] "RemoveContainer" containerID="b50a50325cad623d7388842be519401906d19ee1c9450cf0f9e8b8ac2b4def11"
Jul 13 17:26:15.834330 ip-10-0-143-51 kubenswrapper[2573]: E0713 17:26:15.834312    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b50a50325cad623d7388842be519401906d19ee1c9450cf0f9e8b8ac2b4def11\": container with ID starting with b50a50325cad623d7388842be519401906d19ee1c9450cf0f9e8b8ac2b4def11 not found: ID does not exist" containerID="b50a50325cad623d7388842be519401906d19ee1c9450cf0f9e8b8ac2b4def11"
Jul 13 17:26:15.834377 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:15.834339    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b50a50325cad623d7388842be519401906d19ee1c9450cf0f9e8b8ac2b4def11"} err="failed to get container status \"b50a50325cad623d7388842be519401906d19ee1c9450cf0f9e8b8ac2b4def11\": rpc error: code = NotFound desc = could not find container \"b50a50325cad623d7388842be519401906d19ee1c9450cf0f9e8b8ac2b4def11\": container with ID starting with b50a50325cad623d7388842be519401906d19ee1c9450cf0f9e8b8ac2b4def11 not found: ID does not exist"
Jul 13 17:26:15.834377 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:15.834356    2573 scope.go:117] "RemoveContainer" containerID="a8598f96ee2860cd5f780ed548dfb563e6333b5a0deddd42fa190a2b38cfbc9b"
Jul 13 17:26:15.834576 ip-10-0-143-51 kubenswrapper[2573]: E0713 17:26:15.834556    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8598f96ee2860cd5f780ed548dfb563e6333b5a0deddd42fa190a2b38cfbc9b\": container with ID starting with a8598f96ee2860cd5f780ed548dfb563e6333b5a0deddd42fa190a2b38cfbc9b not found: ID does not exist" containerID="a8598f96ee2860cd5f780ed548dfb563e6333b5a0deddd42fa190a2b38cfbc9b"
Jul 13 17:26:15.834617 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:15.834581    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8598f96ee2860cd5f780ed548dfb563e6333b5a0deddd42fa190a2b38cfbc9b"} err="failed to get container status \"a8598f96ee2860cd5f780ed548dfb563e6333b5a0deddd42fa190a2b38cfbc9b\": rpc error: code = NotFound desc = could not find container \"a8598f96ee2860cd5f780ed548dfb563e6333b5a0deddd42fa190a2b38cfbc9b\": container with ID starting with a8598f96ee2860cd5f780ed548dfb563e6333b5a0deddd42fa190a2b38cfbc9b not found: ID does not exist"
Jul 13 17:26:15.838565 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:15.838544    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j"]
Jul 13 17:26:15.844990 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:15.844971    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-bd468d-openshift-default-7d895fbdff-pv62j"]
Jul 13 17:26:15.882203 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:15.882180    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-fs2pt_07d6eb79-d7ea-45ce-8961-f57645b1d55e/server/0.log"
Jul 13 17:26:16.006514 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:16.006486    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-7vb4t_4be7ab36-b9cf-418c-9cd3-e1b69fd2783f/manager/0.log"
Jul 13 17:26:16.256663 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:16.256642    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5857456dfc-lv8xx_e0cc886a-da9e-421c-819b-9dcf35c46c3e/copy-manifests/0.log"
Jul 13 17:26:16.270018 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:16.270000    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5857456dfc-lv8xx_e0cc886a-da9e-421c-819b-9dcf35c46c3e/manager/0.log"
Jul 13 17:26:16.922107 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:16.922080    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29732700-6svjq_850e5ed8-9ea1-49b2-bb45-a4a381cf4339/cleanup/0.log"
Jul 13 17:26:17.050779 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:17.050754    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29732715-5jkwd_6d910319-587b-4ee0-9514-c0c4cd957b99/cleanup/0.log"
Jul 13 17:26:17.146677 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:17.146649    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9352c08-8d0e-41c2-9937-acc6915f2012" path="/var/lib/kubelet/pods/b9352c08-8d0e-41c2-9937-acc6915f2012/volumes"
Jul 13 17:26:17.739023 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:17.738993    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-874fa5-l74ng_a5acbce3-afc9-4d60-8bb1-8a3daf58d7a2/revoke-keys/0.log"
Jul 13 17:26:19.874568 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:19.874541    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d54dfccc5-w6v9t_950a2e8e-738d-4d4d-8b85-66087f31a61d/authorino/0.log"
Jul 13 17:26:19.994584 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:19.994561    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-5c4n5_d52179ea-be4b-4d06-b3a6-850ed89b5e5d/manager/0.log"
Jul 13 17:26:20.129758 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:20.129666    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-95c4p_b10416b9-e190-4d6c-9889-24663835d28d/manager/0.log"
Jul 13 17:26:20.376871 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:20.376842    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-k2lpp_69c2a54f-91d0-4120-9bc9-1aa7f8f72049/registry-server/0.log"
Jul 13 17:26:20.506152 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:20.506125    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-m54nf_6f847864-7026-4f6c-a85d-888d55d40ea9/manager/0.log"
Jul 13 17:26:20.760325 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:20.760255    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-vxgch_cc7045d9-39e1-471d-b61d-b9e8c84f7aa3/manager/0.log"
Jul 13 17:26:21.132780 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:21.132691    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4g57xp_cba63132-bdd7-44f1-a582-63536a10505e/istio-proxy/0.log"
Jul 13 17:26:21.487879 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:21.487859    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8b9cf5f88-brspz_fb54ecc6-f715-4c9d-9b07-55999b66b112/kube-auth-proxy/0.log"
Jul 13 17:26:21.614447 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:21.614425    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-2fcjg_fc1c3cfe-4f36-4c88-907d-5a24887c1f64/istio-proxy/1.log"
Jul 13 17:26:22.316269 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:22.316243    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-29xzw_7f2a90f3-2855-4964-93ce-486f1a244e5e/main/0.log"
Jul 13 17:26:22.896389 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:22.896361    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-678tv_c6b7a8a4-c852-4267-bcaf-aeaa861fcfa6/main/0.log"
Jul 13 17:26:27.289924 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:27.289852    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:27.387555 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:27.387522    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:30.120438 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:30.120410    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mhds4_d3c1aff9-17f5-4a81-abb5-6a8705b1a2cf/global-pull-secret-syncer/0.log"
Jul 13 17:26:30.171737 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:30.171700    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6nkfx_8261c78d-17e9-4ff0-a118-395dedbc2838/konnectivity-agent/0.log"
Jul 13 17:26:30.306492 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:30.306470    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-51.ec2.internal_058d270930df0d9f694c82e607f9f3bc/haproxy/0.log"
Jul 13 17:26:35.392979 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:35.392950    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d54dfccc5-w6v9t_950a2e8e-738d-4d4d-8b85-66087f31a61d/authorino/0.log"
Jul 13 17:26:35.428508 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:35.428487    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-5c4n5_d52179ea-be4b-4d06-b3a6-850ed89b5e5d/manager/0.log"
Jul 13 17:26:35.462768 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:35.462745    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-95c4p_b10416b9-e190-4d6c-9889-24663835d28d/manager/0.log"
Jul 13 17:26:35.541969 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:35.541946    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-k2lpp_69c2a54f-91d0-4120-9bc9-1aa7f8f72049/registry-server/0.log"
Jul 13 17:26:35.685133 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:35.685042    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-m54nf_6f847864-7026-4f6c-a85d-888d55d40ea9/manager/0.log"
Jul 13 17:26:35.778551 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:35.778521    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-vxgch_cc7045d9-39e1-471d-b61d-b9e8c84f7aa3/manager/0.log"
Jul 13 17:26:38.352476 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:38.352446    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nwqs5_13951a00-4d7c-43d6-8f05-90bfaaa5e2e1/node-exporter/0.log"
Jul 13 17:26:38.378896 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:38.378879    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nwqs5_13951a00-4d7c-43d6-8f05-90bfaaa5e2e1/kube-rbac-proxy/0.log"
Jul 13 17:26:38.404445 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:38.404420    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nwqs5_13951a00-4d7c-43d6-8f05-90bfaaa5e2e1/init-textfile/0.log"
Jul 13 17:26:40.567297 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:40.567262    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mqxjc/perf-node-gather-daemonset-6v8hv"]
Jul 13 17:26:40.567669 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:40.567606    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9da27a18-5a4d-4454-af93-b2c2ad41ae2a" containerName="istio-proxy"
Jul 13 17:26:40.567669 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:40.567617    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9da27a18-5a4d-4454-af93-b2c2ad41ae2a" containerName="istio-proxy"
Jul 13 17:26:40.567669 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:40.567627    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9352c08-8d0e-41c2-9937-acc6915f2012" containerName="istio-proxy"
Jul 13 17:26:40.567669 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:40.567633    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9352c08-8d0e-41c2-9937-acc6915f2012" containerName="istio-proxy"
Jul 13 17:26:40.567669 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:40.567640    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9352c08-8d0e-41c2-9937-acc6915f2012" containerName="istio-proxy"
Jul 13 17:26:40.567669 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:40.567647    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9352c08-8d0e-41c2-9937-acc6915f2012" containerName="istio-proxy"
Jul 13 17:26:40.567669 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:40.567659    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ee31f6e-7351-42a2-b472-466943fa8ffe" containerName="main"
Jul 13 17:26:40.567669 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:40.567665    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ee31f6e-7351-42a2-b472-466943fa8ffe" containerName="main"
Jul 13 17:26:40.567669 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:40.567671    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9da27a18-5a4d-4454-af93-b2c2ad41ae2a" containerName="istio-proxy"
Jul 13 17:26:40.567970 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:40.567677    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9da27a18-5a4d-4454-af93-b2c2ad41ae2a" containerName="istio-proxy"
Jul 13 17:26:40.567970 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:40.567749    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9da27a18-5a4d-4454-af93-b2c2ad41ae2a" containerName="istio-proxy"
Jul 13 17:26:40.567970 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:40.567764    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9352c08-8d0e-41c2-9937-acc6915f2012" containerName="istio-proxy"
Jul 13 17:26:40.567970 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:40.567774    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9352c08-8d0e-41c2-9937-acc6915f2012" containerName="istio-proxy"
Jul 13 17:26:40.567970 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:40.567781    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ee31f6e-7351-42a2-b472-466943fa8ffe" containerName="main"
Jul 13 17:26:40.572425 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:40.572403    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mqxjc/perf-node-gather-daemonset-6v8hv"
Jul 13 17:26:40.575102 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:40.575079    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mqxjc\"/\"openshift-service-ca.crt\""
Jul 13 17:26:40.575220 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:40.575088    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mqxjc\"/\"default-dockercfg-8zq4g\""
Jul 13 17:26:40.575912 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:40.575898    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mqxjc\"/\"kube-root-ca.crt\""
Jul 13 17:26:40.580266 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:40.579854    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mqxjc/perf-node-gather-daemonset-6v8hv"]
Jul 13 17:26:40.660814 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:40.660788    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ef2db867-c237-4a66-85dc-cf35284a8278-proc\") pod \"perf-node-gather-daemonset-6v8hv\" (UID: \"ef2db867-c237-4a66-85dc-cf35284a8278\") " pod="openshift-must-gather-mqxjc/perf-node-gather-daemonset-6v8hv"
Jul 13 17:26:40.660941 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:40.660824    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef2db867-c237-4a66-85dc-cf35284a8278-sys\") pod \"perf-node-gather-daemonset-6v8hv\" (UID: \"ef2db867-c237-4a66-85dc-cf35284a8278\") " pod="openshift-must-gather-mqxjc/perf-node-gather-daemonset-6v8hv"
Jul 13 17:26:40.660941 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:40.660892    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef2db867-c237-4a66-85dc-cf35284a8278-lib-modules\") pod \"perf-node-gather-daemonset-6v8hv\" (UID: \"ef2db867-c237-4a66-85dc-cf35284a8278\") " pod="openshift-must-gather-mqxjc/perf-node-gather-daemonset-6v8hv"
Jul 13 17:26:40.660941 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:40.660909    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krls7\" (UniqueName: \"kubernetes.io/projected/ef2db867-c237-4a66-85dc-cf35284a8278-kube-api-access-krls7\") pod \"perf-node-gather-daemonset-6v8hv\" (UID: \"ef2db867-c237-4a66-85dc-cf35284a8278\") " pod="openshift-must-gather-mqxjc/perf-node-gather-daemonset-6v8hv"
Jul 13 17:26:40.660941 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:40.660930    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ef2db867-c237-4a66-85dc-cf35284a8278-podres\") pod \"perf-node-gather-daemonset-6v8hv\" (UID: \"ef2db867-c237-4a66-85dc-cf35284a8278\") " pod="openshift-must-gather-mqxjc/perf-node-gather-daemonset-6v8hv"
Jul 13 17:26:40.761796 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:40.761771    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ef2db867-c237-4a66-85dc-cf35284a8278-proc\") pod \"perf-node-gather-daemonset-6v8hv\" (UID: \"ef2db867-c237-4a66-85dc-cf35284a8278\") " pod="openshift-must-gather-mqxjc/perf-node-gather-daemonset-6v8hv"
Jul 13 17:26:40.761938 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:40.761803    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef2db867-c237-4a66-85dc-cf35284a8278-sys\") pod \"perf-node-gather-daemonset-6v8hv\" (UID: \"ef2db867-c237-4a66-85dc-cf35284a8278\") " pod="openshift-must-gather-mqxjc/perf-node-gather-daemonset-6v8hv"
Jul 13 17:26:40.761938 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:40.761835    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef2db867-c237-4a66-85dc-cf35284a8278-lib-modules\") pod \"perf-node-gather-daemonset-6v8hv\" (UID: \"ef2db867-c237-4a66-85dc-cf35284a8278\") " pod="openshift-must-gather-mqxjc/perf-node-gather-daemonset-6v8hv"
Jul 13 17:26:40.761938 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:40.761852    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krls7\" (UniqueName: \"kubernetes.io/projected/ef2db867-c237-4a66-85dc-cf35284a8278-kube-api-access-krls7\") pod \"perf-node-gather-daemonset-6v8hv\" (UID: \"ef2db867-c237-4a66-85dc-cf35284a8278\") " pod="openshift-must-gather-mqxjc/perf-node-gather-daemonset-6v8hv"
Jul 13 17:26:40.761938 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:40.761885    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ef2db867-c237-4a66-85dc-cf35284a8278-podres\") pod \"perf-node-gather-daemonset-6v8hv\" (UID: \"ef2db867-c237-4a66-85dc-cf35284a8278\") " pod="openshift-must-gather-mqxjc/perf-node-gather-daemonset-6v8hv"
Jul 13 17:26:40.761938 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:40.761903    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef2db867-c237-4a66-85dc-cf35284a8278-sys\") pod \"perf-node-gather-daemonset-6v8hv\" (UID: \"ef2db867-c237-4a66-85dc-cf35284a8278\") " pod="openshift-must-gather-mqxjc/perf-node-gather-daemonset-6v8hv"
Jul 13 17:26:40.761938 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:40.761905    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ef2db867-c237-4a66-85dc-cf35284a8278-proc\") pod \"perf-node-gather-daemonset-6v8hv\" (UID: \"ef2db867-c237-4a66-85dc-cf35284a8278\") " pod="openshift-must-gather-mqxjc/perf-node-gather-daemonset-6v8hv"
Jul 13 17:26:40.762147 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:40.762007    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef2db867-c237-4a66-85dc-cf35284a8278-lib-modules\") pod \"perf-node-gather-daemonset-6v8hv\" (UID: \"ef2db867-c237-4a66-85dc-cf35284a8278\") " pod="openshift-must-gather-mqxjc/perf-node-gather-daemonset-6v8hv"
Jul 13 17:26:40.762147 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:40.762023    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ef2db867-c237-4a66-85dc-cf35284a8278-podres\") pod \"perf-node-gather-daemonset-6v8hv\" (UID: \"ef2db867-c237-4a66-85dc-cf35284a8278\") " pod="openshift-must-gather-mqxjc/perf-node-gather-daemonset-6v8hv"
Jul 13 17:26:40.771189 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:40.771160    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krls7\" (UniqueName: \"kubernetes.io/projected/ef2db867-c237-4a66-85dc-cf35284a8278-kube-api-access-krls7\") pod \"perf-node-gather-daemonset-6v8hv\" (UID: \"ef2db867-c237-4a66-85dc-cf35284a8278\") " pod="openshift-must-gather-mqxjc/perf-node-gather-daemonset-6v8hv"
Jul 13 17:26:40.884446 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:40.884382    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mqxjc/perf-node-gather-daemonset-6v8hv"
Jul 13 17:26:41.015654 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:41.015627    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mqxjc/perf-node-gather-daemonset-6v8hv"]
Jul 13 17:26:41.017662 ip-10-0-143-51 kubenswrapper[2573]: W0713 17:26:41.017624    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podef2db867_c237_4a66_85dc_cf35284a8278.slice/crio-608ac3035467d64314a46c0095c004e2732a4221eafe393334dac6c311c1d690 WatchSource:0}: Error finding container 608ac3035467d64314a46c0095c004e2732a4221eafe393334dac6c311c1d690: Status 404 returned error can't find the container with id 608ac3035467d64314a46c0095c004e2732a4221eafe393334dac6c311c1d690
Jul 13 17:26:41.932293 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:41.932262    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mqxjc/perf-node-gather-daemonset-6v8hv" event={"ID":"ef2db867-c237-4a66-85dc-cf35284a8278","Type":"ContainerStarted","Data":"2ffc28ed8089c6cbb1107f225375f65b00633acb91045eafc777bcda370e4bec"}
Jul 13 17:26:41.932713 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:41.932318    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mqxjc/perf-node-gather-daemonset-6v8hv"
Jul 13 17:26:41.932713 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:41.932336    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mqxjc/perf-node-gather-daemonset-6v8hv" event={"ID":"ef2db867-c237-4a66-85dc-cf35284a8278","Type":"ContainerStarted","Data":"608ac3035467d64314a46c0095c004e2732a4221eafe393334dac6c311c1d690"}
Jul 13 17:26:41.949587 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:41.949546    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mqxjc/perf-node-gather-daemonset-6v8hv" podStartSLOduration=1.949531811 podStartE2EDuration="1.949531811s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:26:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:26:41.94732948 +0000 UTC m=+2799.305636305" watchObservedRunningTime="2026-07-13 17:26:41.949531811 +0000 UTC m=+2799.307838636"
Jul 13 17:26:43.103883 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:43.103856    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b6bxq_bb23cc9b-372e-498c-ac0a-3629e62a6a76/dns/0.log"
Jul 13 17:26:43.126340 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:43.126316    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b6bxq_bb23cc9b-372e-498c-ac0a-3629e62a6a76/kube-rbac-proxy/0.log"
Jul 13 17:26:43.311789 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:43.311756    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q72ql_1a530403-3ff8-4783-a8b2-6ff27c771aff/dns-node-resolver/0.log"
Jul 13 17:26:43.874581 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:43.874553    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7d9b796d7f-mbznk_19c39259-8805-4c8c-90b3-14573e27468b/registry/0.log"
Jul 13 17:26:43.951012 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:43.950987    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hcgx8_2f5f1928-0c10-44c3-a8fb-bcc9b13606fe/node-ca/0.log"
Jul 13 17:26:45.107993 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:45.107967    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4g57xp_cba63132-bdd7-44f1-a582-63536a10505e/istio-proxy/0.log"
Jul 13 17:26:45.293466 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:45.293435    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8b9cf5f88-brspz_fb54ecc6-f715-4c9d-9b07-55999b66b112/kube-auth-proxy/0.log"
Jul 13 17:26:45.349778 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:45.349759    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-2fcjg_fc1c3cfe-4f36-4c88-907d-5a24887c1f64/istio-proxy/0.log"
Jul 13 17:26:45.376274 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:45.376208    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-2fcjg_fc1c3cfe-4f36-4c88-907d-5a24887c1f64/istio-proxy/1.log"
Jul 13 17:26:46.211126 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:46.211096    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5df2r_d7bcf65d-d075-4398-9822-afe9da65a227/serve-healthcheck-canary/0.log"
Jul 13 17:26:46.934451 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:46.934422    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vd6k8_e5b79688-1d51-4578-8a99-3df1c0a55218/kube-rbac-proxy/0.log"
Jul 13 17:26:46.958600 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:46.958572    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vd6k8_e5b79688-1d51-4578-8a99-3df1c0a55218/exporter/0.log"
Jul 13 17:26:46.983357 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:46.983337    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vd6k8_e5b79688-1d51-4578-8a99-3df1c0a55218/extractor/0.log"
Jul 13 17:26:47.946864 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:47.946839    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mqxjc/perf-node-gather-daemonset-6v8hv"
Jul 13 17:26:49.255462 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:49.255441    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-sbb74_28e7eae8-ab8c-486a-888f-78588b907aef/manager/0.log"
Jul 13 17:26:49.387318 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:49.387290    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-cw5v4_cede14aa-0f7b-47da-8c71-ceeaa093534b/manager/0.log"
Jul 13 17:26:49.511350 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:49.511287    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-fs2pt_07d6eb79-d7ea-45ce-8961-f57645b1d55e/server/0.log"
Jul 13 17:26:49.586346 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:49.586325    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-7vb4t_4be7ab36-b9cf-418c-9cd3-e1b69fd2783f/manager/0.log"
Jul 13 17:26:49.732023 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:49.731997    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5857456dfc-lv8xx_e0cc886a-da9e-421c-819b-9dcf35c46c3e/manager/0.log"
Jul 13 17:26:49.779101 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:49.779030    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5857456dfc-lv8xx_e0cc886a-da9e-421c-819b-9dcf35c46c3e/copy-manifests/0.log"
Jul 13 17:26:51.060595 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:51.060566    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4g57xp_cba63132-bdd7-44f1-a582-63536a10505e/istio-proxy/0.log"
Jul 13 17:26:51.198584 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:51.198562    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8b9cf5f88-brspz_fb54ecc6-f715-4c9d-9b07-55999b66b112/kube-auth-proxy/0.log"
Jul 13 17:26:51.219706 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:51.219686    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-2fcjg_fc1c3cfe-4f36-4c88-907d-5a24887c1f64/istio-proxy/0.log"
Jul 13 17:26:51.248835 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:51.248813    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-2fcjg_fc1c3cfe-4f36-4c88-907d-5a24887c1f64/istio-proxy/1.log"
Jul 13 17:26:52.601805 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:52.601714    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4g57xp_cba63132-bdd7-44f1-a582-63536a10505e/istio-proxy/0.log"
Jul 13 17:26:52.736471 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:52.736442    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8b9cf5f88-brspz_fb54ecc6-f715-4c9d-9b07-55999b66b112/kube-auth-proxy/0.log"
Jul 13 17:26:52.770304 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:52.770282    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-2fcjg_fc1c3cfe-4f36-4c88-907d-5a24887c1f64/istio-proxy/0.log"
Jul 13 17:26:52.797915 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:52.797891    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-2fcjg_fc1c3cfe-4f36-4c88-907d-5a24887c1f64/istio-proxy/1.log"
Jul 13 17:26:57.931606 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:57.931574    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6bz7r_45267697-f81d-45c0-98c5-0caf91de14ed/kube-multus/0.log"
Jul 13 17:26:58.326994 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:58.326970    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sfcgf_0209e3f3-bff2-4755-9766-4f0455e937e4/kube-multus-additional-cni-plugins/0.log"
Jul 13 17:26:58.352929 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:58.352909    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sfcgf_0209e3f3-bff2-4755-9766-4f0455e937e4/egress-router-binary-copy/0.log"
Jul 13 17:26:58.380130 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:58.380109    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sfcgf_0209e3f3-bff2-4755-9766-4f0455e937e4/cni-plugins/0.log"
Jul 13 17:26:58.407244 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:58.407226    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sfcgf_0209e3f3-bff2-4755-9766-4f0455e937e4/bond-cni-plugin/0.log"
Jul 13 17:26:58.431288 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:58.431270    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sfcgf_0209e3f3-bff2-4755-9766-4f0455e937e4/routeoverride-cni/0.log"
Jul 13 17:26:58.456531 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:58.456513    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sfcgf_0209e3f3-bff2-4755-9766-4f0455e937e4/whereabouts-cni-bincopy/0.log"
Jul 13 17:26:58.482167 ip-10-0-143-51 kubenswrapper[2573]: I0713 17:26:58.482149    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sfcgf_0209e3f3-bff2-4755-9766-4f0455e937e4/whereabouts-cni/0.log"