Jul 06 19:23:39.506493 ip-10-0-131-150 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 06 19:23:39.506506 ip-10-0-131-150 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 06 19:23:39.506515 ip-10-0-131-150 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 06 19:23:39.506841 ip-10-0-131-150 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 06 19:23:50.725397 ip-10-0-131-150 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 06 19:23:50.725417 ip-10-0-131-150 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot dce4301d1c9a457395535f802156734b --
Jul 06 19:25:42.110391 ip-10-0-131-150 systemd[1]: Starting Kubernetes Kubelet...
Jul 06 19:25:43.920210 ip-10-0-131-150 kubenswrapper[2555]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 19:25:43.920210 ip-10-0-131-150 kubenswrapper[2555]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 06 19:25:43.920210 ip-10-0-131-150 kubenswrapper[2555]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 19:25:43.920210 ip-10-0-131-150 kubenswrapper[2555]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 06 19:25:43.920210 ip-10-0-131-150 kubenswrapper[2555]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 19:25:43.921483 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.921355    2555 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 06 19:25:43.930113 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930081    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:25:43.930113 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930107    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:25:43.930113 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930112    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:25:43.930113 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930116    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:25:43.930113 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930119    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:25:43.930113 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930123    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:25:43.930371 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930126    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:25:43.930371 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930130    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:25:43.930371 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930133    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:25:43.930371 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930137    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:25:43.930371 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930140    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:25:43.930371 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930143    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:25:43.930371 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930146    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:25:43.930371 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930149    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:25:43.930371 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930152    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:25:43.930371 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930155    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:25:43.930371 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930158    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:25:43.930371 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930161    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:25:43.930371 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930164    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:25:43.930371 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930167    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:25:43.930371 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930170    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:25:43.930371 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930175    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:25:43.930371 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930179    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:25:43.930371 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930182    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:25:43.930371 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930185    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:25:43.930371 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930188    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:25:43.930869 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930191    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:25:43.930869 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930194    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:25:43.930869 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930197    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:25:43.930869 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930199    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:25:43.930869 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930202    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:25:43.930869 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930205    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:25:43.930869 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930207    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:25:43.930869 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930210    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:25:43.930869 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930213    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:25:43.930869 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930216    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:25:43.930869 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930218    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:25:43.930869 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930221    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:25:43.930869 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930224    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:25:43.930869 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930228    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:25:43.930869 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930232    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:25:43.930869 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930235    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:25:43.930869 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930238    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:25:43.930869 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930241    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:25:43.930869 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930244    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:25:43.930869 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930246    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:25:43.931415 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930249    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:25:43.931415 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930252    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:25:43.931415 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930255    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:25:43.931415 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930257    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:25:43.931415 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930261    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:25:43.931415 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930264    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:25:43.931415 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930266    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:25:43.931415 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930269    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:25:43.931415 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930272    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:25:43.931415 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930275    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:25:43.931415 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930278    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:25:43.931415 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930280    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:25:43.931415 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930283    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:25:43.931415 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930286    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:25:43.931415 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930289    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:25:43.931415 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930291    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:25:43.931415 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930294    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:25:43.931415 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930297    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:25:43.931415 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930299    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:25:43.931415 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930302    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:25:43.931922 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930305    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:25:43.931922 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930309    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:25:43.931922 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930312    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:25:43.931922 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930314    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:25:43.931922 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930317    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:25:43.931922 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930322    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:25:43.931922 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930325    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:25:43.931922 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930330    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:25:43.931922 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930335    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:25:43.931922 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930338    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:25:43.931922 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930341    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:25:43.931922 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930344    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:25:43.931922 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930347    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:25:43.931922 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930350    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:25:43.931922 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930354    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:25:43.931922 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930357    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:25:43.931922 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930360    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:25:43.931922 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930364    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:25:43.931922 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930367    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:25:43.932437 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930370    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:25:43.932437 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930373    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:25:43.932437 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930376    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:25:43.932437 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930379    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:25:43.932437 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930382    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:25:43.932437 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930385    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:25:43.932437 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930388    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:25:43.932437 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930390    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:25:43.932437 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930393    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:25:43.932437 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930395    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:25:43.932437 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930398    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:25:43.932437 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930401    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:25:43.932437 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930404    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:25:43.932437 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.930406    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:25:43.932437 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931210    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:25:43.932437 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931218    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:25:43.932437 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931221    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:25:43.932437 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931224    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:25:43.932437 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931228    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:25:43.932437 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931231    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:25:43.932947 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931234    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:25:43.932947 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931237    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:25:43.932947 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931240    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:25:43.932947 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931243    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:25:43.932947 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931246    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:25:43.932947 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931249    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:25:43.932947 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931252    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:25:43.932947 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931254    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:25:43.932947 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931257    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:25:43.932947 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931263    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:25:43.932947 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931267    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:25:43.932947 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931271    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:25:43.932947 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931275    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:25:43.932947 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931277    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:25:43.932947 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931280    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:25:43.932947 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931283    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:25:43.932947 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931286    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:25:43.932947 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931289    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:25:43.932947 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931292    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:25:43.932947 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931294    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:25:43.933571 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931297    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:25:43.933571 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931301    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:25:43.933571 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931305    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:25:43.933571 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931308    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:25:43.933571 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931311    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:25:43.933571 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931313    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:25:43.933571 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931316    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:25:43.933571 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931319    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:25:43.933571 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931343    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:25:43.933571 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931348    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:25:43.933571 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931352    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:25:43.933571 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931355    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:25:43.933571 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931358    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:25:43.933571 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931361    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:25:43.933571 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931364    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:25:43.933571 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931367    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:25:43.933571 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931370    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:25:43.933571 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931373    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:25:43.933571 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931376    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:25:43.933571 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931379    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:25:43.934115 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931382    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:25:43.934115 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931385    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:25:43.934115 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931388    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:25:43.934115 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931390    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:25:43.934115 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931393    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:25:43.934115 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931396    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:25:43.934115 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931399    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:25:43.934115 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931402    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:25:43.934115 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931404    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:25:43.934115 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931407    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:25:43.934115 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931410    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:25:43.934115 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931412    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:25:43.934115 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931415    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:25:43.934115 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931418    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:25:43.934115 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931421    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:25:43.934115 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931424    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:25:43.934115 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931427    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:25:43.934115 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931429    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:25:43.934115 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931432    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:25:43.934115 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931435    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:25:43.934632 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931437    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:25:43.934632 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931441    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:25:43.934632 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931444    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:25:43.934632 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931446    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:25:43.934632 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931450    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:25:43.934632 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931452    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:25:43.934632 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931455    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:25:43.934632 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931458    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:25:43.934632 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931460    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:25:43.934632 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931463    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:25:43.934632 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931467    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:25:43.934632 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931470    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:25:43.934632 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931473    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:25:43.934632 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931476    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:25:43.934632 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931478    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:25:43.934632 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931483    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:25:43.934632 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931486    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:25:43.934632 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931490    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:25:43.934632 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931494    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:25:43.935152 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931497    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:25:43.935152 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931500    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:25:43.935152 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931502    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:25:43.935152 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931505    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:25:43.935152 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931508    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:25:43.935152 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931511    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:25:43.935152 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931519    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:25:43.935152 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931521    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:25:43.935152 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931524    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:25:43.935152 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931527    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:25:43.935152 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931530    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:25:43.935152 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931533    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:25:43.935152 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931536    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:25:43.935152 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931538    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:25:43.935152 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931980    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:25:43.935152 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.931999    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:25:43.935152 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932003    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:25:43.935152 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932006    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:25:43.935152 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932009    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:25:43.935637 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932012    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:25:43.935637 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932015    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:25:43.935637 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932018    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:25:43.935637 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932022    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:25:43.935637 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932026    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:25:43.935637 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932029    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:25:43.935637 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932033    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:25:43.935637 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932036    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:25:43.935637 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932039    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:25:43.935637 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932042    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:25:43.935637 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932045    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:25:43.935637 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932048    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:25:43.935637 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932051    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:25:43.935637 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932056    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:25:43.935637 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932059    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:25:43.935637 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932062    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:25:43.935637 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932065    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:25:43.935637 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932068    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:25:43.935637 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932071    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:25:43.936181 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932076    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:25:43.936181 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932079    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:25:43.936181 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932083    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:25:43.936181 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932086    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:25:43.936181 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932089    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:25:43.936181 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932092    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:25:43.936181 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932095    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:25:43.936181 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932098    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:25:43.936181 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932101    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:25:43.936181 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932104    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:25:43.936181 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932107    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:25:43.936181 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932111    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:25:43.936181 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932114    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:25:43.936181 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932117    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:25:43.936181 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932119    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:25:43.936181 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932122    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:25:43.936181 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932126    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:25:43.936181 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932130    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:25:43.936181 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932133    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:25:43.936686 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932135    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:25:43.936686 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932138    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:25:43.936686 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932141    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:25:43.936686 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932144    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:25:43.936686 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932146    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:25:43.936686 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932149    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:25:43.936686 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932152    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:25:43.936686 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932155    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:25:43.936686 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932157    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:25:43.936686 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932160    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:25:43.936686 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932162    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:25:43.936686 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932166    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:25:43.936686 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932168    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:25:43.936686 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932172    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:25:43.936686 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932175    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:25:43.936686 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932178    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:25:43.936686 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932181    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:25:43.936686 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932184    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:25:43.936686 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932186    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:25:43.936686 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932189    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:25:43.937222 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932192    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:25:43.937222 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932195    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:25:43.937222 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932197    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:25:43.937222 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932202    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:25:43.937222 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932205    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:25:43.937222 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932208    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:25:43.937222 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932211    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:25:43.937222 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932213    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:25:43.937222 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932216    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:25:43.937222 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932219    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:25:43.937222 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932221    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:25:43.937222 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932224    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:25:43.937222 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932227    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:25:43.937222 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932230    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:25:43.937222 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932232    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:25:43.937222 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932235    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:25:43.937222 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932238    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:25:43.937222 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932241    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:25:43.937222 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932244    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:25:43.937222 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932248    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:25:43.937774 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932251    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:25:43.937774 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932253    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:25:43.937774 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932256    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:25:43.937774 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932259    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:25:43.937774 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932262    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:25:43.937774 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932267    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:25:43.937774 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932269    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:25:43.937774 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932273    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:25:43.937774 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932275    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:25:43.937774 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932278    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:25:43.937774 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932280    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:25:43.937774 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932283    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:25:43.937774 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932286    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:25:43.937774 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932289    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:25:43.937774 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932291    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:25:43.937774 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.932294    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:25:43.937774 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932375    2555 flags.go:64] FLAG: --address="0.0.0.0"
Jul 06 19:25:43.937774 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932385    2555 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 06 19:25:43.937774 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932392    2555 flags.go:64] FLAG: --anonymous-auth="true"
Jul 06 19:25:43.937774 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932396    2555 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 06 19:25:43.937774 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932401    2555 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 06 19:25:43.938337 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932404    2555 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 06 19:25:43.938337 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932409    2555 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 06 19:25:43.938337 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932413    2555 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 06 19:25:43.938337 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932417    2555 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 06 19:25:43.938337 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932420    2555 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 06 19:25:43.938337 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932424    2555 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 06 19:25:43.938337 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932427    2555 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 06 19:25:43.938337 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932431    2555 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 06 19:25:43.938337 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932434    2555 flags.go:64] FLAG: --cgroup-root=""
Jul 06 19:25:43.938337 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932437    2555 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 06 19:25:43.938337 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932440    2555 flags.go:64] FLAG: --client-ca-file=""
Jul 06 19:25:43.938337 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932445    2555 flags.go:64] FLAG: --cloud-provider="external"
Jul 06 19:25:43.938337 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932448    2555 flags.go:64] FLAG: --cluster-dns="[]"
Jul 06 19:25:43.938337 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932452    2555 flags.go:64] FLAG: --cluster-domain=""
Jul 06 19:25:43.938337 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932456    2555 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 06 19:25:43.938337 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932459    2555 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 06 19:25:43.938337 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932463    2555 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 06 19:25:43.938337 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932467    2555 flags.go:64] FLAG: --container-log-max-files="5"
Jul 06 19:25:43.938337 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932471    2555 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 06 19:25:43.938337 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932474    2555 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 06 19:25:43.938337 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932477    2555 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 06 19:25:43.938337 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932480    2555 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 06 19:25:43.938337 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932484    2555 flags.go:64] FLAG: --contention-profiling="false"
Jul 06 19:25:43.938337 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932487    2555 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 06 19:25:43.938996 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932490    2555 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 06 19:25:43.938996 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932493    2555 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 06 19:25:43.938996 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932497    2555 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 06 19:25:43.938996 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932504    2555 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 06 19:25:43.938996 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932509    2555 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 06 19:25:43.938996 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932514    2555 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 06 19:25:43.938996 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932519    2555 flags.go:64] FLAG: --enable-load-reader="false"
Jul 06 19:25:43.938996 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932523    2555 flags.go:64] FLAG: --enable-server="true"
Jul 06 19:25:43.938996 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932528    2555 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 06 19:25:43.938996 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932537    2555 flags.go:64] FLAG: --event-burst="100"
Jul 06 19:25:43.938996 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932541    2555 flags.go:64] FLAG: --event-qps="50"
Jul 06 19:25:43.938996 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932544    2555 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 06 19:25:43.938996 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932547    2555 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 06 19:25:43.938996 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932550    2555 flags.go:64] FLAG: --eviction-hard=""
Jul 06 19:25:43.938996 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932555    2555 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 06 19:25:43.938996 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932558    2555 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 06 19:25:43.938996 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932561    2555 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 06 19:25:43.938996 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932565    2555 flags.go:64] FLAG: --eviction-soft=""
Jul 06 19:25:43.938996 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932568    2555 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 06 19:25:43.938996 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932571    2555 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 06 19:25:43.938996 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932575    2555 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 06 19:25:43.938996 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932578    2555 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 06 19:25:43.938996 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932581    2555 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 06 19:25:43.938996 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932584    2555 flags.go:64] FLAG: --fail-swap-on="true"
Jul 06 19:25:43.938996 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932588    2555 flags.go:64] FLAG: --feature-gates=""
Jul 06 19:25:43.939663 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932592    2555 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 06 19:25:43.939663 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932597    2555 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 06 19:25:43.939663 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932601    2555 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 06 19:25:43.939663 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932604    2555 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 06 19:25:43.939663 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932608    2555 flags.go:64] FLAG: --healthz-port="10248"
Jul 06 19:25:43.939663 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932611    2555 flags.go:64] FLAG: --help="false"
Jul 06 19:25:43.939663 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932614    2555 flags.go:64] FLAG: --hostname-override="ip-10-0-131-150.ec2.internal"
Jul 06 19:25:43.939663 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932618    2555 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 06 19:25:43.939663 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932621    2555 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 06 19:25:43.939663 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932624    2555 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 06 19:25:43.939663 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932628    2555 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 06 19:25:43.939663 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932631    2555 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 06 19:25:43.939663 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932635    2555 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 06 19:25:43.939663 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932638    2555 flags.go:64] FLAG: --image-service-endpoint=""
Jul 06 19:25:43.939663 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932641    2555 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 06 19:25:43.939663 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932644    2555 flags.go:64] FLAG: --kube-api-burst="100"
Jul 06 19:25:43.939663 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932647    2555 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 06 19:25:43.939663 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932650    2555 flags.go:64] FLAG: --kube-api-qps="50"
Jul 06 19:25:43.939663 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932653    2555 flags.go:64] FLAG: --kube-reserved=""
Jul 06 19:25:43.939663 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932656    2555 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 06 19:25:43.939663 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932659    2555 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 06 19:25:43.939663 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932662    2555 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 06 19:25:43.939663 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932665    2555 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 06 19:25:43.939663 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932668    2555 flags.go:64] FLAG: --lock-file=""
Jul 06 19:25:43.940351 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932671    2555 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 06 19:25:43.940351 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932674    2555 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 06 19:25:43.940351 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932677    2555 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 06 19:25:43.940351 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932684    2555 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 06 19:25:43.940351 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932687    2555 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 06 19:25:43.940351 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932691    2555 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 06 19:25:43.940351 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932694    2555 flags.go:64] FLAG: --logging-format="text"
Jul 06 19:25:43.940351 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932697    2555 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 06 19:25:43.940351 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932701    2555 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 06 19:25:43.940351 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932705    2555 flags.go:64] FLAG: --manifest-url=""
Jul 06 19:25:43.940351 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932708    2555 flags.go:64] FLAG: --manifest-url-header=""
Jul 06 19:25:43.940351 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932713    2555 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 06 19:25:43.940351 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932716    2555 flags.go:64] FLAG: --max-open-files="1000000"
Jul 06 19:25:43.940351 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932720    2555 flags.go:64] FLAG: --max-pods="110"
Jul 06 19:25:43.940351 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932723    2555 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 06 19:25:43.940351 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932727    2555 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 06 19:25:43.940351 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932730    2555 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 06 19:25:43.940351 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932734    2555 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 06 19:25:43.940351 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932737    2555 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 06 19:25:43.940351 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932740    2555 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 06 19:25:43.940351 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932743    2555 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 06 19:25:43.940351 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932753    2555 flags.go:64] FLAG: --node-status-max-images="50"
Jul 06 19:25:43.940351 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932756    2555 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 06 19:25:43.940351 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932759    2555 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 06 19:25:43.940351 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932762    2555 flags.go:64] FLAG: --pod-cidr=""
Jul 06 19:25:43.941060 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932765    2555 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 06 19:25:43.941060 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932771    2555 flags.go:64] FLAG: --pod-manifest-path=""
Jul 06 19:25:43.941060 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932774    2555 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 06 19:25:43.941060 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932778    2555 flags.go:64] FLAG: --pods-per-core="0"
Jul 06 19:25:43.941060 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932781    2555 flags.go:64] FLAG: --port="10250"
Jul 06 19:25:43.941060 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932784    2555 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 06 19:25:43.941060 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932787    2555 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0768f93a521794897"
Jul 06 19:25:43.941060 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932791    2555 flags.go:64] FLAG: --qos-reserved=""
Jul 06 19:25:43.941060 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932794    2555 flags.go:64] FLAG: --read-only-port="10255"
Jul 06 19:25:43.941060 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932797    2555 flags.go:64] FLAG: --register-node="true"
Jul 06 19:25:43.941060 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932800    2555 flags.go:64] FLAG: --register-with-taints=""
Jul 06 19:25:43.941060 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932804    2555 flags.go:64] FLAG: --registry-burst="10"
Jul 06 19:25:43.941060 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932808    2555 flags.go:64] FLAG: --registry-qps="5"
Jul 06 19:25:43.941060 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932811    2555 flags.go:64] FLAG: --reserved-cpus=""
Jul 06 19:25:43.941060 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932814    2555 flags.go:64] FLAG: --reserved-memory=""
Jul 06 19:25:43.941060 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932818    2555 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 06 19:25:43.941060 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932821    2555 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 06 19:25:43.941060 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932826    2555 flags.go:64] FLAG: --rotate-certificates="false"
Jul 06 19:25:43.941060 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932829    2555 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 06 19:25:43.941060 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932832    2555 flags.go:64] FLAG: --runonce="false"
Jul 06 19:25:43.941060 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932835    2555 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 06 19:25:43.941060 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932838    2555 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 06 19:25:43.941060 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932842    2555 flags.go:64] FLAG: --seccomp-default="false"
Jul 06 19:25:43.941060 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932845    2555 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 06 19:25:43.941060 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932848    2555 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 06 19:25:43.941704 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932851    2555 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 06 19:25:43.941704 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932855    2555 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 06 19:25:43.941704 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932858    2555 flags.go:64] FLAG: --storage-driver-password="root"
Jul 06 19:25:43.941704 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932861    2555 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 06 19:25:43.941704 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932864    2555 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 06 19:25:43.941704 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932868    2555 flags.go:64] FLAG: --storage-driver-user="root"
Jul 06 19:25:43.941704 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932871    2555 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 06 19:25:43.941704 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932874    2555 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 06 19:25:43.941704 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932877    2555 flags.go:64] FLAG: --system-cgroups=""
Jul 06 19:25:43.941704 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932880    2555 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 06 19:25:43.941704 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932886    2555 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 06 19:25:43.941704 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932889    2555 flags.go:64] FLAG: --tls-cert-file=""
Jul 06 19:25:43.941704 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932892    2555 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 06 19:25:43.941704 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932896    2555 flags.go:64] FLAG: --tls-min-version=""
Jul 06 19:25:43.941704 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932899    2555 flags.go:64] FLAG: --tls-private-key-file=""
Jul 06 19:25:43.941704 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932902    2555 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 06 19:25:43.941704 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932905    2555 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 06 19:25:43.941704 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932908    2555 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 06 19:25:43.941704 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932912    2555 flags.go:64] FLAG: --v="2"
Jul 06 19:25:43.941704 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932916    2555 flags.go:64] FLAG: --version="false"
Jul 06 19:25:43.941704 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932921    2555 flags.go:64] FLAG: --vmodule=""
Jul 06 19:25:43.941704 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932926    2555 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 06 19:25:43.941704 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.932930    2555 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 06 19:25:43.941704 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933086    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:25:43.942358 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933095    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:25:43.942358 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933098    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:25:43.942358 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933102    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:25:43.942358 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933105    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:25:43.942358 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933107    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:25:43.942358 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933111    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:25:43.942358 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933113    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:25:43.942358 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933116    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:25:43.942358 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933119    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:25:43.942358 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933122    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:25:43.942358 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933125    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:25:43.942358 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933128    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:25:43.942358 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933130    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:25:43.942358 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933133    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:25:43.942358 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933138    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:25:43.942358 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933142    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:25:43.942358 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933146    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:25:43.942358 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933149    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:25:43.942358 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933152    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:25:43.942358 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933154    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:25:43.942926 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933157    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:25:43.942926 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933160    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:25:43.942926 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933163    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:25:43.942926 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933165    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:25:43.942926 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933168    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:25:43.942926 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933171    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:25:43.942926 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933174    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:25:43.942926 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933176    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:25:43.942926 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933181    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:25:43.942926 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933186    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:25:43.942926 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933189    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:25:43.942926 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933192    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:25:43.942926 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933197    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:25:43.942926 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933200    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:25:43.942926 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933203    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:25:43.942926 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933206    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:25:43.942926 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933209    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:25:43.942926 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933212    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:25:43.942926 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933215    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:25:43.942926 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933218    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:25:43.943485 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933221    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:25:43.943485 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933224    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:25:43.943485 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933226    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:25:43.943485 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933229    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:25:43.943485 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933232    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:25:43.943485 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933235    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:25:43.943485 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933237    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:25:43.943485 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933240    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:25:43.943485 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933243    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:25:43.943485 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933245    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:25:43.943485 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933248    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:25:43.943485 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933251    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:25:43.943485 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933253    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:25:43.943485 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933256    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:25:43.943485 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933259    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:25:43.943485 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933261    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:25:43.943485 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933264    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:25:43.943485 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933267    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:25:43.943485 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933270    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:25:43.943485 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933273    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:25:43.944055 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933275    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:25:43.944055 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933279    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:25:43.944055 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933283    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:25:43.944055 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933286    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:25:43.944055 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933290    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:25:43.944055 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933293    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:25:43.944055 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933295    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:25:43.944055 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933299    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:25:43.944055 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933302    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:25:43.944055 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933304    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:25:43.944055 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933307    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:25:43.944055 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933310    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:25:43.944055 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933313    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:25:43.944055 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933315    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:25:43.944055 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933318    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:25:43.944055 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933321    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:25:43.944055 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933324    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:25:43.944055 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933326    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:25:43.944055 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933329    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:25:43.944055 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933332    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:25:43.944578 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933335    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:25:43.944578 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933337    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:25:43.944578 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933340    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:25:43.944578 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933342    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:25:43.944578 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933345    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:25:43.944578 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933348    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:25:43.944578 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933350    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:25:43.944578 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933353    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:25:43.944578 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933356    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:25:43.944578 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933358    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:25:43.944578 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933361    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:25:43.944578 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933363    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:25:43.944578 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933366    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:25:43.944578 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933370    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:25:43.944578 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933373    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:25:43.944578 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933378    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:25:43.944578 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933383    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:25:43.944578 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.933387    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:25:43.945182 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.934253    2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 19:25:43.945182 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.942077    2555 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 06 19:25:43.945182 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.942098    2555 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 06 19:25:43.945182 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.943102    2555 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 06 19:25:43.945182 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.943110    2555 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 06 19:25:43.945182 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943190    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:25:43.945182 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943200    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:25:43.945182 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943203    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:25:43.945182 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943207    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:25:43.945182 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943211    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:25:43.945182 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943215    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:25:43.945182 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943219    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:25:43.945182 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943222    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:25:43.945182 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943226    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:25:43.945554 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943229    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:25:43.945554 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943232    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:25:43.945554 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943235    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:25:43.945554 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943238    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:25:43.945554 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943242    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:25:43.945554 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943245    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:25:43.945554 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943248    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:25:43.945554 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943250    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:25:43.945554 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943253    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:25:43.945554 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943256    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:25:43.945554 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943259    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:25:43.945554 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943262    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:25:43.945554 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943265    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:25:43.945554 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943268    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:25:43.945554 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943270    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:25:43.945554 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943274    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:25:43.945554 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943277    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:25:43.945554 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943280    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:25:43.945554 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943283    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:25:43.945554 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943286    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:25:43.946098 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943289    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:25:43.946098 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943292    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:25:43.946098 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943295    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:25:43.946098 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943298    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:25:43.946098 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943300    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:25:43.946098 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943303    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:25:43.946098 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943306    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:25:43.946098 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943309    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:25:43.946098 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943312    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:25:43.946098 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943315    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:25:43.946098 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943317    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:25:43.946098 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943320    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:25:43.946098 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943323    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:25:43.946098 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943326    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:25:43.946098 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943328    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:25:43.946098 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943331    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:25:43.946098 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943334    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:25:43.946098 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943337    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:25:43.946098 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943339    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:25:43.946597 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943342    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:25:43.946597 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943346    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:25:43.946597 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943351    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:25:43.946597 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943355    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:25:43.946597 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943358    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:25:43.946597 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943361    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:25:43.946597 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943364    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:25:43.946597 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943366    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:25:43.946597 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943369    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:25:43.946597 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943372    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:25:43.946597 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943375    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:25:43.946597 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943379    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:25:43.946597 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943381    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:25:43.946597 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943385    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:25:43.946597 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943388    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:25:43.946597 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943391    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:25:43.946597 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943394    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:25:43.946597 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943398    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:25:43.946597 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943402    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:25:43.946597 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943405    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:25:43.947179 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943409    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:25:43.947179 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943412    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:25:43.947179 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943414    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:25:43.947179 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943417    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:25:43.947179 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943421    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:25:43.947179 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943423    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:25:43.947179 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943427    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:25:43.947179 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943430    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:25:43.947179 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943433    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:25:43.947179 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943435    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:25:43.947179 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943438    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:25:43.947179 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943441    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:25:43.947179 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943444    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:25:43.947179 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943447    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:25:43.947179 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943449    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:25:43.947179 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943453    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:25:43.947179 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943455    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:25:43.947179 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943459    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:25:43.947179 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943462    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:25:43.947179 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943464    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:25:43.947705 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943467    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:25:43.947705 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943469    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:25:43.947705 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943473    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:25:43.947705 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943476    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:25:43.947705 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943478    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:25:43.947705 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943481    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:25:43.947705 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943484    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:25:43.947705 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943487    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:25:43.947705 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943490    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:25:43.947705 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943493    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:25:43.947705 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943496    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:25:43.947705 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.943502    2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 19:25:43.947705 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943653    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:25:43.947705 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943659    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:25:43.947705 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943662    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:25:43.948226 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943665    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:25:43.948226 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943668    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:25:43.948226 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943671    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:25:43.948226 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943674    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:25:43.948226 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943677    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:25:43.948226 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943680    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:25:43.948226 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943683    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:25:43.948226 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943686    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:25:43.948226 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943689    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:25:43.948226 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943691    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:25:43.948226 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943694    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:25:43.948226 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943697    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:25:43.948226 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943700    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:25:43.948226 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943705    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:25:43.948226 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943710    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:25:43.948226 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943715    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:25:43.948226 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943718    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:25:43.948226 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943721    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:25:43.948226 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943725    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:25:43.948731 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943727    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:25:43.948731 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943731    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:25:43.948731 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943733    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:25:43.948731 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943736    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:25:43.948731 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943739    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:25:43.948731 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943742    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:25:43.948731 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943744    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:25:43.948731 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943747    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:25:43.948731 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943750    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:25:43.948731 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943753    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:25:43.948731 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943755    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:25:43.948731 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943758    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:25:43.948731 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943761    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:25:43.948731 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943764    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:25:43.948731 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943767    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:25:43.948731 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943769    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:25:43.948731 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943772    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:25:43.948731 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943775    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:25:43.948731 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943778    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:25:43.948731 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943780    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:25:43.949458 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943783    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:25:43.949458 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943787    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:25:43.949458 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943790    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:25:43.949458 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943793    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:25:43.949458 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943796    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:25:43.949458 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943799    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:25:43.949458 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943802    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:25:43.949458 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943805    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:25:43.949458 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943808    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:25:43.949458 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943811    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:25:43.949458 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943814    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:25:43.949458 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943817    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:25:43.949458 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943819    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:25:43.949458 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943822    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:25:43.949458 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943825    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:25:43.949458 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943828    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:25:43.949458 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943830    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:25:43.949458 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943833    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:25:43.949458 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943836    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:25:43.949458 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943838    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:25:43.949999 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943841    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:25:43.949999 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943844    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:25:43.949999 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943846    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:25:43.949999 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943849    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:25:43.949999 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943852    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:25:43.949999 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943854    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:25:43.949999 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943857    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:25:43.949999 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943860    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:25:43.949999 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943863    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:25:43.949999 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943867    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:25:43.949999 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943871    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:25:43.949999 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943874    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:25:43.949999 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943877    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:25:43.949999 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943880    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:25:43.949999 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943884    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:25:43.949999 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943887    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:25:43.949999 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943890    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:25:43.949999 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943893    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:25:43.949999 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943900    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:25:43.949999 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943903    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:25:43.950523 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943906    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:25:43.950523 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943908    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:25:43.950523 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943911    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:25:43.950523 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943914    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:25:43.950523 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943917    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:25:43.950523 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943920    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:25:43.950523 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943922    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:25:43.950523 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943926    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:25:43.950523 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943928    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:25:43.950523 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943931    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:25:43.950523 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943934    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:25:43.950523 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943937    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:25:43.950523 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943940    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:25:43.950523 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943942    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:25:43.950523 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943945    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:25:43.950523 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943948    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:25:43.950523 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:43.943950    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:25:43.950957 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.943956    2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 19:25:43.950957 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.944117    2555 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 06 19:25:43.950957 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.946348    2555 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 06 19:25:43.950957 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.947874    2555 server.go:1019] "Starting client certificate rotation"
Jul 06 19:25:43.950957 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.948049    2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 19:25:43.950957 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.948102    2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 19:25:43.952724 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.952701    2555 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 19:25:43.954735 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.954706    2555 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 19:25:43.967486 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.967456    2555 log.go:25] "Validated CRI v1 runtime API"
Jul 06 19:25:43.971090 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.971066    2555 log.go:25] "Validated CRI v1 image API"
Jul 06 19:25:43.971967 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.971922    2555 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 06 19:25:43.974920 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.974894    2555 fs.go:135] Filesystem UUIDs: map[6e536e10-024d-493a-8241-8ee046145ba3:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 bc50d0e2-9141-41fe-9eac-a59ae3c5ffa7:/dev/nvme0n1p3]
Jul 06 19:25:43.975025 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.974916    2555 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 06 19:25:43.980685 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.980541    2555 manager.go:216] Machine: {Timestamp:2026-07-06 19:25:43.979349978 +0000 UTC m=+1.755383371 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3095758 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24b640c835337355850ed65287a18f SystemUUID:ec24b640-c835-3373-5585-0ed65287a18f BootID:dce4301d-1c9a-4573-9553-5f802156734b Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:bc:aa:5b:aa:bf Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:bc:aa:5b:aa:bf Speed:0 Mtu:9001} {Name:ovs-system MacAddress:22:bb:2a:2c:bf:64 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 06 19:25:43.980685 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.980677    2555 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 06 19:25:43.980857 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.980776    2555 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 06 19:25:43.981886 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.981852    2555 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 06 19:25:43.982061 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.981887    2555 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-150.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 06 19:25:43.982792 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.982781    2555 topology_manager.go:138] "Creating topology manager with none policy"
Jul 06 19:25:43.982836 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.982794    2555 container_manager_linux.go:309] "Creating device plugin manager"
Jul 06 19:25:43.982836 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.982807    2555 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 19:25:43.983545 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.983531    2555 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 19:25:43.985660 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.985645    2555 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 06 19:25:43.988199 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.988180    2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 19:25:43.989020 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.989006    2555 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 19:25:43.989161 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.989151    2555 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 06 19:25:43.989203 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.989186    2555 kubelet.go:486] "Attempting to sync node with API server"
Jul 06 19:25:43.989245 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.989205    2555 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 06 19:25:43.989245 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.989225    2555 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 06 19:25:43.989245 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.989236    2555 kubelet.go:398] "Adding apiserver pod source"
Jul 06 19:25:43.989245 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.989247    2555 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 06 19:25:43.989702 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.989689    2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 19:25:43.989748 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.989710    2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 19:25:43.992482 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.992458    2555 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 06 19:25:43.994795 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.994778    2555 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 06 19:25:43.994871 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.994859    2555 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 06 19:25:43.996102 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.996087    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 06 19:25:43.996142 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.996105    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 06 19:25:43.996142 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.996112    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 06 19:25:43.996142 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.996117    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 06 19:25:43.996142 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.996126    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 06 19:25:43.996142 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.996132    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 06 19:25:43.996142 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.996141    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 06 19:25:43.996310 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.996147    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 06 19:25:43.996310 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.996155    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 06 19:25:43.996310 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.996161    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 06 19:25:43.996310 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.996208    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 06 19:25:43.996310 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.996218    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 06 19:25:43.997021 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.997005    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 06 19:25:43.997021 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:43.997021    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 06 19:25:44.000802 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.000785    2555 server.go:1268] "Started kubelet"
Jul 06 19:25:44.000997 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.000880    2555 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 06 19:25:44.001092 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:44.001061    2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-150.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 06 19:25:44.001403 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.001154    2555 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-150.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 06 19:25:44.001403 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.001129    2555 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 06 19:25:44.001403 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.001223    2555 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 06 19:25:44.001403 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:44.001273    2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 06 19:25:44.001817 ip-10-0-131-150 systemd[1]: Started Kubernetes Kubelet.
Jul 06 19:25:44.005116 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.005091    2555 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 06 19:25:44.007010 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.006326    2555 server.go:310] "Adding debug handlers to kubelet server"
Jul 06 19:25:44.008471 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:44.008449    2555 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 06 19:25:44.010202 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:44.007207    2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-150.ec2.internal.18bfc9e09cb1255f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-150.ec2.internal,UID:ip-10-0-131-150.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-150.ec2.internal,},FirstTimestamp:2026-07-06 19:25:44.000718175 +0000 UTC m=+1.776751595,LastTimestamp:2026-07-06 19:25:44.000718175 +0000 UTC m=+1.776751595,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-150.ec2.internal,}"
Jul 06 19:25:44.012807 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.012790    2555 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 06 19:25:44.012807 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.012801    2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 06 19:25:44.012962 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:44.012947    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-150.ec2.internal\" not found"
Jul 06 19:25:44.013609 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.013593    2555 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 06 19:25:44.013789 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.013601    2555 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 06 19:25:44.013789 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.013789    2555 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 06 19:25:44.013959 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.013836    2555 factory.go:55] Registering systemd factory
Jul 06 19:25:44.013959 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.013851    2555 factory.go:223] Registration of the systemd container factory successfully
Jul 06 19:25:44.013959 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.013922    2555 reconstruct.go:97] "Volume reconstruction finished"
Jul 06 19:25:44.013959 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.013931    2555 reconciler.go:29] "Reconciler: start to sync state"
Jul 06 19:25:44.014158 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.014114    2555 factory.go:153] Registering CRI-O factory
Jul 06 19:25:44.014158 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.014127    2555 factory.go:223] Registration of the crio container factory successfully
Jul 06 19:25:44.014339 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.014179    2555 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 06 19:25:44.014339 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.014211    2555 factory.go:103] Registering Raw factory
Jul 06 19:25:44.014339 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.014225    2555 manager.go:1196] Started watching for new ooms in manager
Jul 06 19:25:44.015465 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.015007    2555 manager.go:349] Starting recovery of all containers
Jul 06 19:25:44.026264 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.026246    2555 manager.go:354] Recovery completed
Jul 06 19:25:44.026956 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:44.026912    2555 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-150.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 06 19:25:44.027465 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:44.027438    2555 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 06 19:25:44.031224 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.031211    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:25:44.033456 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.033432    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:25:44.033540 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.033473    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:25:44.033540 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.033485    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:25:44.034147 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.034131    2555 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 06 19:25:44.034147 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.034142    2555 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 06 19:25:44.034147 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.034146    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:25:44.034323 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.034160    2555 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 19:25:44.034866 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.034846    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:25:44.034991 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.034897    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:25:44.034991 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.034910    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:25:44.035636 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.035616    2555 policy_none.go:49] "None policy: Start"
Jul 06 19:25:44.035636 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.035637    2555 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 06 19:25:44.035735 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.035649    2555 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 06 19:25:44.036799 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.036788    2555 policy_none.go:47] "Start"
Jul 06 19:25:44.045141 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:44.045063    2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-150.ec2.internal.18bfc9e09ea4ade5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-150.ec2.internal,UID:ip-10-0-131-150.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-150.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-150.ec2.internal,},FirstTimestamp:2026-07-06 19:25:44.033455589 +0000 UTC m=+1.809488987,LastTimestamp:2026-07-06 19:25:44.033455589 +0000 UTC m=+1.809488987,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-150.ec2.internal,}"
Jul 06 19:25:44.057856 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:44.057778    2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-150.ec2.internal.18bfc9e09ea506a1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-150.ec2.internal,UID:ip-10-0-131-150.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-131-150.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-131-150.ec2.internal,},FirstTimestamp:2026-07-06 19:25:44.033478305 +0000 UTC m=+1.809511698,LastTimestamp:2026-07-06 19:25:44.033478305 +0000 UTC m=+1.809511698,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-150.ec2.internal,}"
Jul 06 19:25:44.070883 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:44.070801    2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-150.ec2.internal.18bfc9e09ea52f7d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-150.ec2.internal,UID:ip-10-0-131-150.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-131-150.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-131-150.ec2.internal,},FirstTimestamp:2026-07-06 19:25:44.033488765 +0000 UTC m=+1.809522157,LastTimestamp:2026-07-06 19:25:44.033488765 +0000 UTC m=+1.809522157,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-150.ec2.internal,}"
Jul 06 19:25:44.076740 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.076723    2555 manager.go:337] "Starting Device Plugin manager"
Jul 06 19:25:44.076827 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:44.076768    2555 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 06 19:25:44.076827 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.076781    2555 server.go:87] "Starting device plugin registration server"
Jul 06 19:25:44.077116 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.077102    2555 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 06 19:25:44.077222 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.077123    2555 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 06 19:25:44.077222 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.077209    2555 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 06 19:25:44.077345 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.077314    2555 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 06 19:25:44.077345 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.077324    2555 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 06 19:25:44.078039 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:44.078014    2555 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 06 19:25:44.078123 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:44.078081    2555 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-150.ec2.internal\" not found"
Jul 06 19:25:44.079351 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:44.079258    2555 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-131-150.ec2.internal.18bfc9e09ea4ade5\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-150.ec2.internal.18bfc9e09ea4ade5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-150.ec2.internal,UID:ip-10-0-131-150.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-150.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-150.ec2.internal,},FirstTimestamp:2026-07-06 19:25:44.033455589 +0000 UTC m=+1.809488987,LastTimestamp:2026-07-06 19:25:44.03486329 +0000 UTC m=+1.810896690,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-150.ec2.internal,}"
Jul 06 19:25:44.088538 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.088514    2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kg69c"
Jul 06 19:25:44.094479 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:44.094395    2555 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-131-150.ec2.internal.18bfc9e09ea506a1\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-150.ec2.internal.18bfc9e09ea506a1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-150.ec2.internal,UID:ip-10-0-131-150.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-131-150.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-131-150.ec2.internal,},FirstTimestamp:2026-07-06 19:25:44.033478305 +0000 UTC m=+1.809511698,LastTimestamp:2026-07-06 19:25:44.034904261 +0000 UTC m=+1.810937654,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-150.ec2.internal,}"
Jul 06 19:25:44.099175 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.099154    2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kg69c"
Jul 06 19:25:44.122307 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.122270    2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 06 19:25:44.123601 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.123576    2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 06 19:25:44.123704 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.123619    2555 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 06 19:25:44.123704 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.123648    2555 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 06 19:25:44.123704 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:44.123697    2555 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 06 19:25:44.126556 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.126534    2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:25:44.177711 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.177610    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:25:44.178738 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.178720    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:25:44.178811 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.178757    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:25:44.178811 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.178767    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:25:44.178811 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.178794    2555 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-150.ec2.internal"
Jul 06 19:25:44.190145 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.190123    2555 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-150.ec2.internal"
Jul 06 19:25:44.190266 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:44.190152    2555 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-150.ec2.internal\": node \"ip-10-0-131-150.ec2.internal\" not found"
Jul 06 19:25:44.205721 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:44.205691    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-150.ec2.internal\" not found"
Jul 06 19:25:44.224786 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.224730    2555 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-150.ec2.internal"]
Jul 06 19:25:44.224968 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.224835    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:25:44.226007 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.225990    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:25:44.226083 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.226026    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:25:44.226083 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.226042    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:25:44.227568 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.227551    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:25:44.227709 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.227692    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal"
Jul 06 19:25:44.227758 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.227747    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:25:44.228552 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.228530    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:25:44.228706 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.228530    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:25:44.228706 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.228565    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:25:44.228706 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.228576    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:25:44.228706 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.228597    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:25:44.228706 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.228612    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:25:44.230041 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.230021    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-150.ec2.internal"
Jul 06 19:25:44.230148 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.230059    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:25:44.231009 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.230990    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:25:44.231121 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.231019    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:25:44.231121 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.231033    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:25:44.256064 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:44.256035    2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-150.ec2.internal\" not found" node="ip-10-0-131-150.ec2.internal"
Jul 06 19:25:44.260111 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:44.260088    2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-150.ec2.internal\" not found" node="ip-10-0-131-150.ec2.internal"
Jul 06 19:25:44.305836 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:44.305799    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-150.ec2.internal\" not found"
Jul 06 19:25:44.314897 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.314872    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c460faf59ce7ef5c8a2e42034e3e25e2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal\" (UID: \"c460faf59ce7ef5c8a2e42034e3e25e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal"
Jul 06 19:25:44.315023 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.314906    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eb580d2521422f06e4ec1bc19d959bbf-config\") pod \"kube-apiserver-proxy-ip-10-0-131-150.ec2.internal\" (UID: \"eb580d2521422f06e4ec1bc19d959bbf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-150.ec2.internal"
Jul 06 19:25:44.315023 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.314925    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c460faf59ce7ef5c8a2e42034e3e25e2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal\" (UID: \"c460faf59ce7ef5c8a2e42034e3e25e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal"
Jul 06 19:25:44.406978 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:44.406936    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-150.ec2.internal\" not found"
Jul 06 19:25:44.416021 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.415996    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c460faf59ce7ef5c8a2e42034e3e25e2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal\" (UID: \"c460faf59ce7ef5c8a2e42034e3e25e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal"
Jul 06 19:25:44.416095 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.416017    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c460faf59ce7ef5c8a2e42034e3e25e2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal\" (UID: \"c460faf59ce7ef5c8a2e42034e3e25e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal"
Jul 06 19:25:44.416095 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.416041    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eb580d2521422f06e4ec1bc19d959bbf-config\") pod \"kube-apiserver-proxy-ip-10-0-131-150.ec2.internal\" (UID: \"eb580d2521422f06e4ec1bc19d959bbf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-150.ec2.internal"
Jul 06 19:25:44.416095 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.416070    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c460faf59ce7ef5c8a2e42034e3e25e2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal\" (UID: \"c460faf59ce7ef5c8a2e42034e3e25e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal"
Jul 06 19:25:44.416283 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.416108    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c460faf59ce7ef5c8a2e42034e3e25e2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal\" (UID: \"c460faf59ce7ef5c8a2e42034e3e25e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal"
Jul 06 19:25:44.416283 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.416164    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eb580d2521422f06e4ec1bc19d959bbf-config\") pod \"kube-apiserver-proxy-ip-10-0-131-150.ec2.internal\" (UID: \"eb580d2521422f06e4ec1bc19d959bbf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-150.ec2.internal"
Jul 06 19:25:44.508054 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:44.507959    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-150.ec2.internal\" not found"
Jul 06 19:25:44.562598 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.562553    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal"
Jul 06 19:25:44.564933 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.564895    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-150.ec2.internal"
Jul 06 19:25:44.609047 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:44.609004    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-150.ec2.internal\" not found"
Jul 06 19:25:44.716328 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:44.716294    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-150.ec2.internal\" not found"
Jul 06 19:25:44.820357 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:44.820271    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-150.ec2.internal\" not found"
Jul 06 19:25:44.921079 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:44.921038    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-150.ec2.internal\" not found"
Jul 06 19:25:44.946870 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.946825    2555 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 06 19:25:44.947054 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.946997    2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 19:25:44.969168 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.969138    2555 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:25:44.990181 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:44.990134    2555 apiserver.go:52] "Watching apiserver"
Jul 06 19:25:45.001305 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.001273    2555 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 19:25:45.001719 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.001691    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-4v5kp","openshift-network-diagnostics/network-check-target-pmfn2","openshift-ovn-kubernetes/ovnkube-node-j9wtk","kube-system/konnectivity-agent-7tzh4","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqx4","openshift-cluster-node-tuning-operator/tuned-qxsxj","openshift-dns/node-resolver-5d2dt","openshift-image-registry/node-ca-qtvrs","openshift-multus/multus-additional-cni-plugins-h5prb","openshift-multus/network-metrics-daemon-9tcbq","openshift-network-operator/iptables-alerter-dpp5t","kube-system/global-pull-secret-syncer-btzb4"]
Jul 06 19:25:45.003768 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.003743    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.005004 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.004975    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmfn2"
Jul 06 19:25:45.005117 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:45.005081    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmfn2" podUID="42fc94d7-0161-4334-85d2-5f0df8456dec"
Jul 06 19:25:45.006338 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.006316    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.006840 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.006818    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 19:25:45.006936 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.006822    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 19:25:45.006936 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.006827    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 19:25:45.007097 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.007061    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 19:25:45.007097 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.007092    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6bf7x\""
Jul 06 19:25:45.007739 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.007717    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7tzh4"
Jul 06 19:25:45.009148 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.008704    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 19:25:45.009148 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.009002    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 19:25:45.010921 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.010501    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqx4"
Jul 06 19:25:45.010921 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.010545    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 19:25:45.010921 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.010645    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 19:25:45.010921 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.010668    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ndfl6\""
Jul 06 19:25:45.011252 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.011063    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 19:25:45.011309 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.011254    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 19:25:45.011376 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.011341    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 19:25:45.011772 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.011618    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 19:25:45.011772 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.011627    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qxsxj"
Jul 06 19:25:45.011976 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.011875    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wnr5b\""
Jul 06 19:25:45.012945 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.012923    2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 06 19:25:45.013056 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.012990    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6hw9n\""
Jul 06 19:25:45.013056 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.013025    2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal"
Jul 06 19:25:45.013056 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.012995    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 19:25:45.013220 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.013169    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 06 19:25:45.013452 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.013426    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 19:25:45.013554 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.013510    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5d2dt"
Jul 06 19:25:45.013930 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.013901    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vvzlc\""
Jul 06 19:25:45.014603 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.014585    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:25:45.014706 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.014626    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 19:25:45.015229 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.015212    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qtvrs"
Jul 06 19:25:45.015811 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.015792    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sgjxf\""
Jul 06 19:25:45.016124 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.016105    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 19:25:45.016334 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.016320    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 19:25:45.017052 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.017033    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h5prb"
Jul 06 19:25:45.018152 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.017616    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 19:25:45.018152 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.018069    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 19:25:45.018329 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.018269    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jghw7\""
Jul 06 19:25:45.018373 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.018337    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 19:25:45.019008 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.018959    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tcbq"
Jul 06 19:25:45.019168 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:45.019026    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tcbq" podUID="e3f7af2d-5d72-4c10-88c4-44a193ad2b32"
Jul 06 19:25:45.019168 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.019163    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 19:25:45.019277 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.019248    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7gjz4\""
Jul 06 19:25:45.019608 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.019580    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 19:25:45.020979 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.020952    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dpp5t"
Jul 06 19:25:45.021316 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.021202    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/719bd649-20d3-41d8-8027-8107cc44d106-sys\") pod \"tuned-qxsxj\" (UID: \"719bd649-20d3-41d8-8027-8107cc44d106\") " pod="openshift-cluster-node-tuning-operator/tuned-qxsxj"
Jul 06 19:25:45.021316 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.021236    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/37610e93-f90e-40e9-b80c-816b07d688d0-host-run-netns\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.021316 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.021277    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bb750a78-aa1e-4c55-b771-e06ca00b997a-run-systemd\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.021316 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.021306    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb750a78-aa1e-4c55-b771-e06ca00b997a-run-openvswitch\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.021580 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.021339    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mfxv\" (UniqueName: \"kubernetes.io/projected/ae5d3a7d-3488-4ab3-b388-51db77bb6da4-kube-api-access-5mfxv\") pod \"node-ca-qtvrs\" (UID: \"ae5d3a7d-3488-4ab3-b388-51db77bb6da4\") " pod="openshift-image-registry/node-ca-qtvrs"
Jul 06 19:25:45.021580 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.021368    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/719bd649-20d3-41d8-8027-8107cc44d106-tmp\") pod \"tuned-qxsxj\" (UID: \"719bd649-20d3-41d8-8027-8107cc44d106\") " pod="openshift-cluster-node-tuning-operator/tuned-qxsxj"
Jul 06 19:25:45.021580 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.021433    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/37610e93-f90e-40e9-b80c-816b07d688d0-cnibin\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.021580 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.021493    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/37610e93-f90e-40e9-b80c-816b07d688d0-host-var-lib-kubelet\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.021580 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.021550    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/37610e93-f90e-40e9-b80c-816b07d688d0-multus-daemon-config\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.021831 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.021597    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67mrq\" (UniqueName: \"kubernetes.io/projected/37610e93-f90e-40e9-b80c-816b07d688d0-kube-api-access-67mrq\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.021831 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.021634    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r46bx\" (UniqueName: \"kubernetes.io/projected/42fc94d7-0161-4334-85d2-5f0df8456dec-kube-api-access-r46bx\") pod \"network-check-target-pmfn2\" (UID: \"42fc94d7-0161-4334-85d2-5f0df8456dec\") " pod="openshift-network-diagnostics/network-check-target-pmfn2"
Jul 06 19:25:45.021831 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.021663    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb750a78-aa1e-4c55-b771-e06ca00b997a-host-run-ovn-kubernetes\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.021831 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.021690    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7c732599-67dd-4c7a-9966-0d4f497a8e1d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mrqx4\" (UID: \"7c732599-67dd-4c7a-9966-0d4f497a8e1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqx4"
Jul 06 19:25:45.021831 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.021719    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpwzn\" (UniqueName: \"kubernetes.io/projected/e8893200-b607-4e1e-8a6c-fb4a31110947-kube-api-access-fpwzn\") pod \"node-resolver-5d2dt\" (UID: \"e8893200-b607-4e1e-8a6c-fb4a31110947\") " pod="openshift-dns/node-resolver-5d2dt"
Jul 06 19:25:45.021831 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.021743    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7c732599-67dd-4c7a-9966-0d4f497a8e1d-sys-fs\") pod \"aws-ebs-csi-driver-node-mrqx4\" (UID: \"7c732599-67dd-4c7a-9966-0d4f497a8e1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqx4"
Jul 06 19:25:45.021831 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.021770    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgv2x\" (UniqueName: \"kubernetes.io/projected/7c732599-67dd-4c7a-9966-0d4f497a8e1d-kube-api-access-tgv2x\") pod \"aws-ebs-csi-driver-node-mrqx4\" (UID: \"7c732599-67dd-4c7a-9966-0d4f497a8e1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqx4"
Jul 06 19:25:45.021831 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.021796    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ae5d3a7d-3488-4ab3-b388-51db77bb6da4-serviceca\") pod \"node-ca-qtvrs\" (UID: \"ae5d3a7d-3488-4ab3-b388-51db77bb6da4\") " pod="openshift-image-registry/node-ca-qtvrs"
Jul 06 19:25:45.022279 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.021855    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/719bd649-20d3-41d8-8027-8107cc44d106-etc-systemd\") pod \"tuned-qxsxj\" (UID: \"719bd649-20d3-41d8-8027-8107cc44d106\") " pod="openshift-cluster-node-tuning-operator/tuned-qxsxj"
Jul 06 19:25:45.022279 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.021883    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bb750a78-aa1e-4c55-b771-e06ca00b997a-systemd-units\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.022279 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.021906    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/719bd649-20d3-41d8-8027-8107cc44d106-host\") pod \"tuned-qxsxj\" (UID: \"719bd649-20d3-41d8-8027-8107cc44d106\") " pod="openshift-cluster-node-tuning-operator/tuned-qxsxj"
Jul 06 19:25:45.022279 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.021941    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/719bd649-20d3-41d8-8027-8107cc44d106-lib-modules\") pod \"tuned-qxsxj\" (UID: \"719bd649-20d3-41d8-8027-8107cc44d106\") " pod="openshift-cluster-node-tuning-operator/tuned-qxsxj"
Jul 06 19:25:45.022279 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.021969    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bb750a78-aa1e-4c55-b771-e06ca00b997a-host-cni-netd\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.022279 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.022009    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7c732599-67dd-4c7a-9966-0d4f497a8e1d-device-dir\") pod \"aws-ebs-csi-driver-node-mrqx4\" (UID: \"7c732599-67dd-4c7a-9966-0d4f497a8e1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqx4"
Jul 06 19:25:45.022279 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.022033    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bb750a78-aa1e-4c55-b771-e06ca00b997a-host-kubelet\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.022279 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.022058    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bb750a78-aa1e-4c55-b771-e06ca00b997a-run-ovn\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.022279 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.022092    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bb750a78-aa1e-4c55-b771-e06ca00b997a-node-log\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.022279 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.022124    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2kcs\" (UniqueName: \"kubernetes.io/projected/719bd649-20d3-41d8-8027-8107cc44d106-kube-api-access-v2kcs\") pod \"tuned-qxsxj\" (UID: \"719bd649-20d3-41d8-8027-8107cc44d106\") " pod="openshift-cluster-node-tuning-operator/tuned-qxsxj"
Jul 06 19:25:45.022279 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.022156    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e8893200-b607-4e1e-8a6c-fb4a31110947-hosts-file\") pod \"node-resolver-5d2dt\" (UID: \"e8893200-b607-4e1e-8a6c-fb4a31110947\") " pod="openshift-dns/node-resolver-5d2dt"
Jul 06 19:25:45.022279 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.022229    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37610e93-f90e-40e9-b80c-816b07d688d0-multus-cni-dir\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.022279 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.022250    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/37610e93-f90e-40e9-b80c-816b07d688d0-os-release\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.022829 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.022273    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/37610e93-f90e-40e9-b80c-816b07d688d0-cni-binary-copy\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.022829 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.022340    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bb750a78-aa1e-4c55-b771-e06ca00b997a-ovn-node-metrics-cert\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.022829 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.022362    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/37610e93-f90e-40e9-b80c-816b07d688d0-etc-kubernetes\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.022829 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.022366    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btzb4"
Jul 06 19:25:45.022829 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.022383    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/37610e93-f90e-40e9-b80c-816b07d688d0-host-run-k8s-cni-cncf-io\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.022829 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.022409    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/719bd649-20d3-41d8-8027-8107cc44d106-etc-modprobe-d\") pod \"tuned-qxsxj\" (UID: \"719bd649-20d3-41d8-8027-8107cc44d106\") " pod="openshift-cluster-node-tuning-operator/tuned-qxsxj"
Jul 06 19:25:45.022829 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:45.022429    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btzb4" podUID="0acb06f4-a973-4679-99e1-d7a44e7286ae"
Jul 06 19:25:45.022829 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.022445    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7eff5404-593b-4ff6-b2f8-3ef6d8c2db53-agent-certs\") pod \"konnectivity-agent-7tzh4\" (UID: \"7eff5404-593b-4ff6-b2f8-3ef6d8c2db53\") " pod="kube-system/konnectivity-agent-7tzh4"
Jul 06 19:25:45.022829 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.022489    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7c732599-67dd-4c7a-9966-0d4f497a8e1d-socket-dir\") pod \"aws-ebs-csi-driver-node-mrqx4\" (UID: \"7c732599-67dd-4c7a-9966-0d4f497a8e1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqx4"
Jul 06 19:25:45.022829 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.022513    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/719bd649-20d3-41d8-8027-8107cc44d106-etc-sysconfig\") pod \"tuned-qxsxj\" (UID: \"719bd649-20d3-41d8-8027-8107cc44d106\") " pod="openshift-cluster-node-tuning-operator/tuned-qxsxj"
Jul 06 19:25:45.022829 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.022540    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/719bd649-20d3-41d8-8027-8107cc44d106-etc-sysctl-d\") pod \"tuned-qxsxj\" (UID: \"719bd649-20d3-41d8-8027-8107cc44d106\") " pod="openshift-cluster-node-tuning-operator/tuned-qxsxj"
Jul 06 19:25:45.022829 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.022587    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/37610e93-f90e-40e9-b80c-816b07d688d0-host-var-lib-cni-multus\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.022829 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.022612    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/37610e93-f90e-40e9-b80c-816b07d688d0-hostroot\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.022829 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.022647    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bb750a78-aa1e-4c55-b771-e06ca00b997a-host-cni-bin\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.022829 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.022672    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb750a78-aa1e-4c55-b771-e06ca00b997a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.022829 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.022695    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bb750a78-aa1e-4c55-b771-e06ca00b997a-log-socket\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.022829 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.022726    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tl5lj\" (UniqueName: \"kubernetes.io/projected/bb750a78-aa1e-4c55-b771-e06ca00b997a-kube-api-access-tl5lj\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.023693 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.022755    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7c732599-67dd-4c7a-9966-0d4f497a8e1d-registration-dir\") pod \"aws-ebs-csi-driver-node-mrqx4\" (UID: \"7c732599-67dd-4c7a-9966-0d4f497a8e1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqx4"
Jul 06 19:25:45.023693 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.022777    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/37610e93-f90e-40e9-b80c-816b07d688d0-multus-socket-dir-parent\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.023693 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.022802    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/37610e93-f90e-40e9-b80c-816b07d688d0-host-var-lib-cni-bin\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.023693 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.022838    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/719bd649-20d3-41d8-8027-8107cc44d106-etc-kubernetes\") pod \"tuned-qxsxj\" (UID: \"719bd649-20d3-41d8-8027-8107cc44d106\") " pod="openshift-cluster-node-tuning-operator/tuned-qxsxj"
Jul 06 19:25:45.023693 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.022860    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/719bd649-20d3-41d8-8027-8107cc44d106-etc-tuned\") pod \"tuned-qxsxj\" (UID: \"719bd649-20d3-41d8-8027-8107cc44d106\") " pod="openshift-cluster-node-tuning-operator/tuned-qxsxj"
Jul 06 19:25:45.023693 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.022878    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bb750a78-aa1e-4c55-b771-e06ca00b997a-ovnkube-config\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.023693 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.022900    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bb750a78-aa1e-4c55-b771-e06ca00b997a-env-overrides\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.023693 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.022939    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bb750a78-aa1e-4c55-b771-e06ca00b997a-ovnkube-script-lib\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.023693 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.022957    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37610e93-f90e-40e9-b80c-816b07d688d0-system-cni-dir\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.023693 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.022976    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/37610e93-f90e-40e9-b80c-816b07d688d0-host-run-multus-certs\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.023693 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.022998    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/719bd649-20d3-41d8-8027-8107cc44d106-var-lib-kubelet\") pod \"tuned-qxsxj\" (UID: \"719bd649-20d3-41d8-8027-8107cc44d106\") " pod="openshift-cluster-node-tuning-operator/tuned-qxsxj"
Jul 06 19:25:45.023693 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.023016    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/719bd649-20d3-41d8-8027-8107cc44d106-etc-sysctl-conf\") pod \"tuned-qxsxj\" (UID: \"719bd649-20d3-41d8-8027-8107cc44d106\") " pod="openshift-cluster-node-tuning-operator/tuned-qxsxj"
Jul 06 19:25:45.023693 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.023033    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/719bd649-20d3-41d8-8027-8107cc44d106-run\") pod \"tuned-qxsxj\" (UID: \"719bd649-20d3-41d8-8027-8107cc44d106\") " pod="openshift-cluster-node-tuning-operator/tuned-qxsxj"
Jul 06 19:25:45.023693 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.023050    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8893200-b607-4e1e-8a6c-fb4a31110947-tmp-dir\") pod \"node-resolver-5d2dt\" (UID: \"e8893200-b607-4e1e-8a6c-fb4a31110947\") " pod="openshift-dns/node-resolver-5d2dt"
Jul 06 19:25:45.023693 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.023086    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/37610e93-f90e-40e9-b80c-816b07d688d0-multus-conf-dir\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.023693 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.023111    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7eff5404-593b-4ff6-b2f8-3ef6d8c2db53-konnectivity-ca\") pod \"konnectivity-agent-7tzh4\" (UID: \"7eff5404-593b-4ff6-b2f8-3ef6d8c2db53\") " pod="kube-system/konnectivity-agent-7tzh4"
Jul 06 19:25:45.023693 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.023127    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7c732599-67dd-4c7a-9966-0d4f497a8e1d-etc-selinux\") pod \"aws-ebs-csi-driver-node-mrqx4\" (UID: \"7c732599-67dd-4c7a-9966-0d4f497a8e1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqx4"
Jul 06 19:25:45.024290 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.023143    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bb750a78-aa1e-4c55-b771-e06ca00b997a-host-slash\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.024290 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.023167    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bb750a78-aa1e-4c55-b771-e06ca00b997a-host-run-netns\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.024290 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.023205    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb750a78-aa1e-4c55-b771-e06ca00b997a-var-lib-openvswitch\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.024290 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.023241    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb750a78-aa1e-4c55-b771-e06ca00b997a-etc-openvswitch\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.024290 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.023263    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:25:45.024290 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.023264    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ae5d3a7d-3488-4ab3-b388-51db77bb6da4-host\") pod \"node-ca-qtvrs\" (UID: \"ae5d3a7d-3488-4ab3-b388-51db77bb6da4\") " pod="openshift-image-registry/node-ca-qtvrs"
Jul 06 19:25:45.024290 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.023281    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 19:25:45.024290 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.023328    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rbtgk\""
Jul 06 19:25:45.024290 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.023498    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 19:25:45.025740 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.025722    2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 19:25:45.032036 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.032015    2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 19:25:45.032153 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.032101    2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-150.ec2.internal"
Jul 06 19:25:45.032366 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.032341    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal"]
Jul 06 19:25:45.044322 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.044288    2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 19:25:45.044879 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.044858    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-150.ec2.internal"]
Jul 06 19:25:45.090395 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.090364    2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mvq26"
Jul 06 19:25:45.099332 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.099299    2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mvq26"
Jul 06 19:25:45.101192 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.101147    2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 19:20:44 +0000 UTC" deadline="2028-01-04 05:42:49.39845557 +0000 UTC"
Jul 06 19:25:45.101192 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.101188    2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13114h17m4.297269573s"
Jul 06 19:25:45.114527 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.114503    2555 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 06 19:25:45.124672 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.124255    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bb750a78-aa1e-4c55-b771-e06ca00b997a-ovnkube-script-lib\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.124672 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.124296    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0d8c8a73-34a0-4e58-baf5-a96837c2bc6a-host-slash\") pod \"iptables-alerter-dpp5t\" (UID: \"0d8c8a73-34a0-4e58-baf5-a96837c2bc6a\") " pod="openshift-network-operator/iptables-alerter-dpp5t"
Jul 06 19:25:45.124672 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.124326    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0acb06f4-a973-4679-99e1-d7a44e7286ae-original-pull-secret\") pod \"global-pull-secret-syncer-btzb4\" (UID: \"0acb06f4-a973-4679-99e1-d7a44e7286ae\") " pod="kube-system/global-pull-secret-syncer-btzb4"
Jul 06 19:25:45.124672 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.124357    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/40d45d9f-54f3-4736-b359-b43fc6af5535-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h5prb\" (UID: \"40d45d9f-54f3-4736-b359-b43fc6af5535\") " pod="openshift-multus/multus-additional-cni-plugins-h5prb"
Jul 06 19:25:45.124672 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.124386    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37610e93-f90e-40e9-b80c-816b07d688d0-system-cni-dir\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.124672 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.124424    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/37610e93-f90e-40e9-b80c-816b07d688d0-host-run-multus-certs\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.124672 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.124448    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/719bd649-20d3-41d8-8027-8107cc44d106-var-lib-kubelet\") pod \"tuned-qxsxj\" (UID: \"719bd649-20d3-41d8-8027-8107cc44d106\") " pod="openshift-cluster-node-tuning-operator/tuned-qxsxj"
Jul 06 19:25:45.124672 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.124473    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/719bd649-20d3-41d8-8027-8107cc44d106-etc-sysctl-conf\") pod \"tuned-qxsxj\" (UID: \"719bd649-20d3-41d8-8027-8107cc44d106\") " pod="openshift-cluster-node-tuning-operator/tuned-qxsxj"
Jul 06 19:25:45.124672 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.124496    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/719bd649-20d3-41d8-8027-8107cc44d106-run\") pod \"tuned-qxsxj\" (UID: \"719bd649-20d3-41d8-8027-8107cc44d106\") " pod="openshift-cluster-node-tuning-operator/tuned-qxsxj"
Jul 06 19:25:45.124672 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.124520    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8893200-b607-4e1e-8a6c-fb4a31110947-tmp-dir\") pod \"node-resolver-5d2dt\" (UID: \"e8893200-b607-4e1e-8a6c-fb4a31110947\") " pod="openshift-dns/node-resolver-5d2dt"
Jul 06 19:25:45.124672 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.124544    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/37610e93-f90e-40e9-b80c-816b07d688d0-multus-conf-dir\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.124672 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.124585    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7eff5404-593b-4ff6-b2f8-3ef6d8c2db53-konnectivity-ca\") pod \"konnectivity-agent-7tzh4\" (UID: \"7eff5404-593b-4ff6-b2f8-3ef6d8c2db53\") " pod="kube-system/konnectivity-agent-7tzh4"
Jul 06 19:25:45.124672 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.124609    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7c732599-67dd-4c7a-9966-0d4f497a8e1d-etc-selinux\") pod \"aws-ebs-csi-driver-node-mrqx4\" (UID: \"7c732599-67dd-4c7a-9966-0d4f497a8e1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqx4"
Jul 06 19:25:45.124672 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.124632    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bb750a78-aa1e-4c55-b771-e06ca00b997a-host-slash\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.124672 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.124654    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bb750a78-aa1e-4c55-b771-e06ca00b997a-host-run-netns\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.124672 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.124677    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb750a78-aa1e-4c55-b771-e06ca00b997a-var-lib-openvswitch\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.125577 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.124699    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb750a78-aa1e-4c55-b771-e06ca00b997a-etc-openvswitch\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.125577 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.124729    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ae5d3a7d-3488-4ab3-b388-51db77bb6da4-host\") pod \"node-ca-qtvrs\" (UID: \"ae5d3a7d-3488-4ab3-b388-51db77bb6da4\") " pod="openshift-image-registry/node-ca-qtvrs"
Jul 06 19:25:45.125577 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.124762    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0acb06f4-a973-4679-99e1-d7a44e7286ae-dbus\") pod \"global-pull-secret-syncer-btzb4\" (UID: \"0acb06f4-a973-4679-99e1-d7a44e7286ae\") " pod="kube-system/global-pull-secret-syncer-btzb4"
Jul 06 19:25:45.125577 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.124821    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/719bd649-20d3-41d8-8027-8107cc44d106-var-lib-kubelet\") pod \"tuned-qxsxj\" (UID: \"719bd649-20d3-41d8-8027-8107cc44d106\") " pod="openshift-cluster-node-tuning-operator/tuned-qxsxj"
Jul 06 19:25:45.125577 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.124917    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb750a78-aa1e-4c55-b771-e06ca00b997a-var-lib-openvswitch\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.125577 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.124928    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb750a78-aa1e-4c55-b771-e06ca00b997a-etc-openvswitch\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.125577 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.124923    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bb750a78-aa1e-4c55-b771-e06ca00b997a-host-run-netns\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.125577 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.124982    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ae5d3a7d-3488-4ab3-b388-51db77bb6da4-host\") pod \"node-ca-qtvrs\" (UID: \"ae5d3a7d-3488-4ab3-b388-51db77bb6da4\") " pod="openshift-image-registry/node-ca-qtvrs"
Jul 06 19:25:45.125577 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.125150    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/719bd649-20d3-41d8-8027-8107cc44d106-etc-sysctl-conf\") pod \"tuned-qxsxj\" (UID: \"719bd649-20d3-41d8-8027-8107cc44d106\") " pod="openshift-cluster-node-tuning-operator/tuned-qxsxj"
Jul 06 19:25:45.125577 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.125173    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bb750a78-aa1e-4c55-b771-e06ca00b997a-host-slash\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.125577 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.125201    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/719bd649-20d3-41d8-8027-8107cc44d106-run\") pod \"tuned-qxsxj\" (UID: \"719bd649-20d3-41d8-8027-8107cc44d106\") " pod="openshift-cluster-node-tuning-operator/tuned-qxsxj"
Jul 06 19:25:45.125577 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.125284    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/37610e93-f90e-40e9-b80c-816b07d688d0-host-run-multus-certs\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.125577 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.125404    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/37610e93-f90e-40e9-b80c-816b07d688d0-multus-conf-dir\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.125577 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.125451    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/40d45d9f-54f3-4736-b359-b43fc6af5535-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h5prb\" (UID: \"40d45d9f-54f3-4736-b359-b43fc6af5535\") " pod="openshift-multus/multus-additional-cni-plugins-h5prb"
Jul 06 19:25:45.125577 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.125490    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/719bd649-20d3-41d8-8027-8107cc44d106-sys\") pod \"tuned-qxsxj\" (UID: \"719bd649-20d3-41d8-8027-8107cc44d106\") " pod="openshift-cluster-node-tuning-operator/tuned-qxsxj"
Jul 06 19:25:45.125577 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.125505    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8893200-b607-4e1e-8a6c-fb4a31110947-tmp-dir\") pod \"node-resolver-5d2dt\" (UID: \"e8893200-b607-4e1e-8a6c-fb4a31110947\") " pod="openshift-dns/node-resolver-5d2dt"
Jul 06 19:25:45.125577 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.125518    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/37610e93-f90e-40e9-b80c-816b07d688d0-host-run-netns\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.125577 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.125544    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bb750a78-aa1e-4c55-b771-e06ca00b997a-run-systemd\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.126409 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.125584    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb750a78-aa1e-4c55-b771-e06ca00b997a-run-openvswitch\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.126409 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.125605    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37610e93-f90e-40e9-b80c-816b07d688d0-system-cni-dir\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.126409 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.125616    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mfxv\" (UniqueName: \"kubernetes.io/projected/ae5d3a7d-3488-4ab3-b388-51db77bb6da4-kube-api-access-5mfxv\") pod \"node-ca-qtvrs\" (UID: \"ae5d3a7d-3488-4ab3-b388-51db77bb6da4\") " pod="openshift-image-registry/node-ca-qtvrs"
Jul 06 19:25:45.126409 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.125617    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bb750a78-aa1e-4c55-b771-e06ca00b997a-ovnkube-script-lib\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.126409 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.125645    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bb750a78-aa1e-4c55-b771-e06ca00b997a-run-systemd\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.126409 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.125713    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7c732599-67dd-4c7a-9966-0d4f497a8e1d-etc-selinux\") pod \"aws-ebs-csi-driver-node-mrqx4\" (UID: \"7c732599-67dd-4c7a-9966-0d4f497a8e1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqx4"
Jul 06 19:25:45.126409 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.125725    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40d45d9f-54f3-4736-b359-b43fc6af5535-system-cni-dir\") pod \"multus-additional-cni-plugins-h5prb\" (UID: \"40d45d9f-54f3-4736-b359-b43fc6af5535\") " pod="openshift-multus/multus-additional-cni-plugins-h5prb"
Jul 06 19:25:45.126409 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.125751    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb750a78-aa1e-4c55-b771-e06ca00b997a-run-openvswitch\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.126409 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.125763    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/719bd649-20d3-41d8-8027-8107cc44d106-tmp\") pod \"tuned-qxsxj\" (UID: \"719bd649-20d3-41d8-8027-8107cc44d106\") " pod="openshift-cluster-node-tuning-operator/tuned-qxsxj"
Jul 06 19:25:45.126409 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.125791    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/37610e93-f90e-40e9-b80c-816b07d688d0-host-run-netns\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.126409 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.125806    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7eff5404-593b-4ff6-b2f8-3ef6d8c2db53-konnectivity-ca\") pod \"konnectivity-agent-7tzh4\" (UID: \"7eff5404-593b-4ff6-b2f8-3ef6d8c2db53\") " pod="kube-system/konnectivity-agent-7tzh4"
Jul 06 19:25:45.126409 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.125883    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/37610e93-f90e-40e9-b80c-816b07d688d0-cnibin\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.126409 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.125916    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/37610e93-f90e-40e9-b80c-816b07d688d0-host-var-lib-kubelet\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.126409 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.125966    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/37610e93-f90e-40e9-b80c-816b07d688d0-host-var-lib-kubelet\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.126409 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.125969    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/37610e93-f90e-40e9-b80c-816b07d688d0-cnibin\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.126409 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.125966    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/719bd649-20d3-41d8-8027-8107cc44d106-sys\") pod \"tuned-qxsxj\" (UID: \"719bd649-20d3-41d8-8027-8107cc44d106\") " pod="openshift-cluster-node-tuning-operator/tuned-qxsxj"
Jul 06 19:25:45.126409 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.125992    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/37610e93-f90e-40e9-b80c-816b07d688d0-multus-daemon-config\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.126409 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.126030    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67mrq\" (UniqueName: \"kubernetes.io/projected/37610e93-f90e-40e9-b80c-816b07d688d0-kube-api-access-67mrq\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.127301 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.126058    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r46bx\" (UniqueName: \"kubernetes.io/projected/42fc94d7-0161-4334-85d2-5f0df8456dec-kube-api-access-r46bx\") pod \"network-check-target-pmfn2\" (UID: \"42fc94d7-0161-4334-85d2-5f0df8456dec\") " pod="openshift-network-diagnostics/network-check-target-pmfn2"
Jul 06 19:25:45.127301 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.126084    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb750a78-aa1e-4c55-b771-e06ca00b997a-host-run-ovn-kubernetes\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.127301 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.126127    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb750a78-aa1e-4c55-b771-e06ca00b997a-host-run-ovn-kubernetes\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.127301 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.126158    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7c732599-67dd-4c7a-9966-0d4f497a8e1d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mrqx4\" (UID: \"7c732599-67dd-4c7a-9966-0d4f497a8e1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqx4"
Jul 06 19:25:45.127301 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.126188    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpwzn\" (UniqueName: \"kubernetes.io/projected/e8893200-b607-4e1e-8a6c-fb4a31110947-kube-api-access-fpwzn\") pod \"node-resolver-5d2dt\" (UID: \"e8893200-b607-4e1e-8a6c-fb4a31110947\") " pod="openshift-dns/node-resolver-5d2dt"
Jul 06 19:25:45.127301 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.126214    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7c732599-67dd-4c7a-9966-0d4f497a8e1d-sys-fs\") pod \"aws-ebs-csi-driver-node-mrqx4\" (UID: \"7c732599-67dd-4c7a-9966-0d4f497a8e1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqx4"
Jul 06 19:25:45.127301 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.126242    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgv2x\" (UniqueName: \"kubernetes.io/projected/7c732599-67dd-4c7a-9966-0d4f497a8e1d-kube-api-access-tgv2x\") pod \"aws-ebs-csi-driver-node-mrqx4\" (UID: \"7c732599-67dd-4c7a-9966-0d4f497a8e1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqx4"
Jul 06 19:25:45.127301 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.126269    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ae5d3a7d-3488-4ab3-b388-51db77bb6da4-serviceca\") pod \"node-ca-qtvrs\" (UID: \"ae5d3a7d-3488-4ab3-b388-51db77bb6da4\") " pod="openshift-image-registry/node-ca-qtvrs"
Jul 06 19:25:45.127301 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.126288    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7c732599-67dd-4c7a-9966-0d4f497a8e1d-sys-fs\") pod \"aws-ebs-csi-driver-node-mrqx4\" (UID: \"7c732599-67dd-4c7a-9966-0d4f497a8e1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqx4"
Jul 06 19:25:45.127301 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.126304    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0d8c8a73-34a0-4e58-baf5-a96837c2bc6a-iptables-alerter-script\") pod \"iptables-alerter-dpp5t\" (UID: \"0d8c8a73-34a0-4e58-baf5-a96837c2bc6a\") " pod="openshift-network-operator/iptables-alerter-dpp5t"
Jul 06 19:25:45.127301 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.126241    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7c732599-67dd-4c7a-9966-0d4f497a8e1d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mrqx4\" (UID: \"7c732599-67dd-4c7a-9966-0d4f497a8e1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqx4"
Jul 06 19:25:45.127301 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.126338    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b2zm\" (UniqueName: \"kubernetes.io/projected/0d8c8a73-34a0-4e58-baf5-a96837c2bc6a-kube-api-access-2b2zm\") pod \"iptables-alerter-dpp5t\" (UID: \"0d8c8a73-34a0-4e58-baf5-a96837c2bc6a\") " pod="openshift-network-operator/iptables-alerter-dpp5t"
Jul 06 19:25:45.127301 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.126413    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/40d45d9f-54f3-4736-b359-b43fc6af5535-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h5prb\" (UID: \"40d45d9f-54f3-4736-b359-b43fc6af5535\") " pod="openshift-multus/multus-additional-cni-plugins-h5prb"
Jul 06 19:25:45.127301 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.126448    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/719bd649-20d3-41d8-8027-8107cc44d106-etc-systemd\") pod \"tuned-qxsxj\" (UID: \"719bd649-20d3-41d8-8027-8107cc44d106\") " pod="openshift-cluster-node-tuning-operator/tuned-qxsxj"
Jul 06 19:25:45.127301 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.126482    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bb750a78-aa1e-4c55-b771-e06ca00b997a-systemd-units\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.127301 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.126515    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/719bd649-20d3-41d8-8027-8107cc44d106-etc-systemd\") pod \"tuned-qxsxj\" (UID: \"719bd649-20d3-41d8-8027-8107cc44d106\") " pod="openshift-cluster-node-tuning-operator/tuned-qxsxj"
Jul 06 19:25:45.128235 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.126559    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/40d45d9f-54f3-4736-b359-b43fc6af5535-os-release\") pod \"multus-additional-cni-plugins-h5prb\" (UID: \"40d45d9f-54f3-4736-b359-b43fc6af5535\") " pod="openshift-multus/multus-additional-cni-plugins-h5prb"
Jul 06 19:25:45.128235 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.126577    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bb750a78-aa1e-4c55-b771-e06ca00b997a-systemd-units\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.128235 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.126590    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/719bd649-20d3-41d8-8027-8107cc44d106-host\") pod \"tuned-qxsxj\" (UID: \"719bd649-20d3-41d8-8027-8107cc44d106\") " pod="openshift-cluster-node-tuning-operator/tuned-qxsxj"
Jul 06 19:25:45.128235 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.126643    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/719bd649-20d3-41d8-8027-8107cc44d106-host\") pod \"tuned-qxsxj\" (UID: \"719bd649-20d3-41d8-8027-8107cc44d106\") " pod="openshift-cluster-node-tuning-operator/tuned-qxsxj"
Jul 06 19:25:45.128235 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.126654    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/37610e93-f90e-40e9-b80c-816b07d688d0-multus-daemon-config\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.128235 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.126692    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/719bd649-20d3-41d8-8027-8107cc44d106-lib-modules\") pod \"tuned-qxsxj\" (UID: \"719bd649-20d3-41d8-8027-8107cc44d106\") " pod="openshift-cluster-node-tuning-operator/tuned-qxsxj"
Jul 06 19:25:45.128235 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.126735    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bb750a78-aa1e-4c55-b771-e06ca00b997a-host-cni-netd\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.128235 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.126764    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7c732599-67dd-4c7a-9966-0d4f497a8e1d-device-dir\") pod \"aws-ebs-csi-driver-node-mrqx4\" (UID: \"7c732599-67dd-4c7a-9966-0d4f497a8e1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqx4"
Jul 06 19:25:45.128235 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.126795    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bb750a78-aa1e-4c55-b771-e06ca00b997a-host-kubelet\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.128235 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.126820    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bb750a78-aa1e-4c55-b771-e06ca00b997a-run-ovn\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.128235 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.126831    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/719bd649-20d3-41d8-8027-8107cc44d106-lib-modules\") pod \"tuned-qxsxj\" (UID: \"719bd649-20d3-41d8-8027-8107cc44d106\") " pod="openshift-cluster-node-tuning-operator/tuned-qxsxj"
Jul 06 19:25:45.128235 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.126846    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bb750a78-aa1e-4c55-b771-e06ca00b997a-node-log\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.128235 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.126856    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7c732599-67dd-4c7a-9966-0d4f497a8e1d-device-dir\") pod \"aws-ebs-csi-driver-node-mrqx4\" (UID: \"7c732599-67dd-4c7a-9966-0d4f497a8e1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqx4"
Jul 06 19:25:45.128235 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.126860    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ae5d3a7d-3488-4ab3-b388-51db77bb6da4-serviceca\") pod \"node-ca-qtvrs\" (UID: \"ae5d3a7d-3488-4ab3-b388-51db77bb6da4\") " pod="openshift-image-registry/node-ca-qtvrs"
Jul 06 19:25:45.128235 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.126881    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2kcs\" (UniqueName: \"kubernetes.io/projected/719bd649-20d3-41d8-8027-8107cc44d106-kube-api-access-v2kcs\") pod \"tuned-qxsxj\" (UID: \"719bd649-20d3-41d8-8027-8107cc44d106\") " pod="openshift-cluster-node-tuning-operator/tuned-qxsxj"
Jul 06 19:25:45.128235 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.126910    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e8893200-b607-4e1e-8a6c-fb4a31110947-hosts-file\") pod \"node-resolver-5d2dt\" (UID: \"e8893200-b607-4e1e-8a6c-fb4a31110947\") " pod="openshift-dns/node-resolver-5d2dt"
Jul 06 19:25:45.128235 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.126959    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37610e93-f90e-40e9-b80c-816b07d688d0-multus-cni-dir\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.128235 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.126988    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/37610e93-f90e-40e9-b80c-816b07d688d0-os-release\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.129196 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.127014    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/37610e93-f90e-40e9-b80c-816b07d688d0-cni-binary-copy\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.129196 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.127041    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bb750a78-aa1e-4c55-b771-e06ca00b997a-ovn-node-metrics-cert\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.129196 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.127065    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/37610e93-f90e-40e9-b80c-816b07d688d0-etc-kubernetes\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.129196 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.127096    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/37610e93-f90e-40e9-b80c-816b07d688d0-host-run-k8s-cni-cncf-io\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.129196 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.127113    2555 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 06 19:25:45.129196 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.127129    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/37610e93-f90e-40e9-b80c-816b07d688d0-os-release\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.129196 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.127177    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e8893200-b607-4e1e-8a6c-fb4a31110947-hosts-file\") pod \"node-resolver-5d2dt\" (UID: \"e8893200-b607-4e1e-8a6c-fb4a31110947\") " pod="openshift-dns/node-resolver-5d2dt"
Jul 06 19:25:45.129196 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.127226    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37610e93-f90e-40e9-b80c-816b07d688d0-multus-cni-dir\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.129196 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.127266    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/719bd649-20d3-41d8-8027-8107cc44d106-etc-modprobe-d\") pod \"tuned-qxsxj\" (UID: \"719bd649-20d3-41d8-8027-8107cc44d106\") " pod="openshift-cluster-node-tuning-operator/tuned-qxsxj"
Jul 06 19:25:45.129196 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.127271    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/37610e93-f90e-40e9-b80c-816b07d688d0-etc-kubernetes\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.129196 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.127318    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/37610e93-f90e-40e9-b80c-816b07d688d0-host-run-k8s-cni-cncf-io\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.129196 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.127441    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bb750a78-aa1e-4c55-b771-e06ca00b997a-node-log\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.129196 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.127497    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bb750a78-aa1e-4c55-b771-e06ca00b997a-host-cni-netd\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.129196 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.127548    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bb750a78-aa1e-4c55-b771-e06ca00b997a-host-kubelet\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.129196 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.127618    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bb750a78-aa1e-4c55-b771-e06ca00b997a-run-ovn\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.129196 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.127122    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/719bd649-20d3-41d8-8027-8107cc44d106-etc-modprobe-d\") pod \"tuned-qxsxj\" (UID: \"719bd649-20d3-41d8-8027-8107cc44d106\") " pod="openshift-cluster-node-tuning-operator/tuned-qxsxj"
Jul 06 19:25:45.129196 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.127673    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7eff5404-593b-4ff6-b2f8-3ef6d8c2db53-agent-certs\") pod \"konnectivity-agent-7tzh4\" (UID: \"7eff5404-593b-4ff6-b2f8-3ef6d8c2db53\") " pod="kube-system/konnectivity-agent-7tzh4"
Jul 06 19:25:45.129196 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.127701    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7c732599-67dd-4c7a-9966-0d4f497a8e1d-socket-dir\") pod \"aws-ebs-csi-driver-node-mrqx4\" (UID: \"7c732599-67dd-4c7a-9966-0d4f497a8e1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqx4"
Jul 06 19:25:45.130144 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.127731    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvrbl\" (UniqueName: \"kubernetes.io/projected/e3f7af2d-5d72-4c10-88c4-44a193ad2b32-kube-api-access-fvrbl\") pod \"network-metrics-daemon-9tcbq\" (UID: \"e3f7af2d-5d72-4c10-88c4-44a193ad2b32\") " pod="openshift-multus/network-metrics-daemon-9tcbq"
Jul 06 19:25:45.130144 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.127783    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/40d45d9f-54f3-4736-b359-b43fc6af5535-cni-binary-copy\") pod \"multus-additional-cni-plugins-h5prb\" (UID: \"40d45d9f-54f3-4736-b359-b43fc6af5535\") " pod="openshift-multus/multus-additional-cni-plugins-h5prb"
Jul 06 19:25:45.130144 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.127819    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/719bd649-20d3-41d8-8027-8107cc44d106-etc-sysconfig\") pod \"tuned-qxsxj\" (UID: \"719bd649-20d3-41d8-8027-8107cc44d106\") " pod="openshift-cluster-node-tuning-operator/tuned-qxsxj"
Jul 06 19:25:45.130144 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.127845    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/719bd649-20d3-41d8-8027-8107cc44d106-etc-sysctl-d\") pod \"tuned-qxsxj\" (UID: \"719bd649-20d3-41d8-8027-8107cc44d106\") " pod="openshift-cluster-node-tuning-operator/tuned-qxsxj"
Jul 06 19:25:45.130144 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.127844    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/37610e93-f90e-40e9-b80c-816b07d688d0-cni-binary-copy\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.130144 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.127871    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/37610e93-f90e-40e9-b80c-816b07d688d0-host-var-lib-cni-multus\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.130144 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.127900    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/37610e93-f90e-40e9-b80c-816b07d688d0-hostroot\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.130144 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.127923    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/719bd649-20d3-41d8-8027-8107cc44d106-etc-sysconfig\") pod \"tuned-qxsxj\" (UID: \"719bd649-20d3-41d8-8027-8107cc44d106\") " pod="openshift-cluster-node-tuning-operator/tuned-qxsxj"
Jul 06 19:25:45.130144 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.127954    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bb750a78-aa1e-4c55-b771-e06ca00b997a-host-cni-bin\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.130144 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.127981    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb750a78-aa1e-4c55-b771-e06ca00b997a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.130144 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.128011    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbgw2\" (UniqueName: \"kubernetes.io/projected/40d45d9f-54f3-4736-b359-b43fc6af5535-kube-api-access-fbgw2\") pod \"multus-additional-cni-plugins-h5prb\" (UID: \"40d45d9f-54f3-4736-b359-b43fc6af5535\") " pod="openshift-multus/multus-additional-cni-plugins-h5prb"
Jul 06 19:25:45.130144 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.128021    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/37610e93-f90e-40e9-b80c-816b07d688d0-host-var-lib-cni-multus\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.130144 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.128046    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bb750a78-aa1e-4c55-b771-e06ca00b997a-log-socket\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.130144 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.128099    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tl5lj\" (UniqueName: \"kubernetes.io/projected/bb750a78-aa1e-4c55-b771-e06ca00b997a-kube-api-access-tl5lj\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.130144 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.128126    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7c732599-67dd-4c7a-9966-0d4f497a8e1d-registration-dir\") pod \"aws-ebs-csi-driver-node-mrqx4\" (UID: \"7c732599-67dd-4c7a-9966-0d4f497a8e1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqx4"
Jul 06 19:25:45.130144 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.128136    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/719bd649-20d3-41d8-8027-8107cc44d106-etc-sysctl-d\") pod \"tuned-qxsxj\" (UID: \"719bd649-20d3-41d8-8027-8107cc44d106\") " pod="openshift-cluster-node-tuning-operator/tuned-qxsxj"
Jul 06 19:25:45.130144 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.128152    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0acb06f4-a973-4679-99e1-d7a44e7286ae-kubelet-config\") pod \"global-pull-secret-syncer-btzb4\" (UID: \"0acb06f4-a973-4679-99e1-d7a44e7286ae\") " pod="kube-system/global-pull-secret-syncer-btzb4"
Jul 06 19:25:45.130867 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.128192    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f7af2d-5d72-4c10-88c4-44a193ad2b32-metrics-certs\") pod \"network-metrics-daemon-9tcbq\" (UID: \"e3f7af2d-5d72-4c10-88c4-44a193ad2b32\") " pod="openshift-multus/network-metrics-daemon-9tcbq"
Jul 06 19:25:45.130867 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.128217    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/40d45d9f-54f3-4736-b359-b43fc6af5535-cnibin\") pod \"multus-additional-cni-plugins-h5prb\" (UID: \"40d45d9f-54f3-4736-b359-b43fc6af5535\") " pod="openshift-multus/multus-additional-cni-plugins-h5prb"
Jul 06 19:25:45.130867 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.128293    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7c732599-67dd-4c7a-9966-0d4f497a8e1d-registration-dir\") pod \"aws-ebs-csi-driver-node-mrqx4\" (UID: \"7c732599-67dd-4c7a-9966-0d4f497a8e1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqx4"
Jul 06 19:25:45.130867 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.128342    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bb750a78-aa1e-4c55-b771-e06ca00b997a-log-socket\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.130867 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.128376    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bb750a78-aa1e-4c55-b771-e06ca00b997a-host-cni-bin\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.130867 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.128396    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/37610e93-f90e-40e9-b80c-816b07d688d0-multus-socket-dir-parent\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.130867 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.128411    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb750a78-aa1e-4c55-b771-e06ca00b997a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.130867 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.128455    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/37610e93-f90e-40e9-b80c-816b07d688d0-host-var-lib-cni-bin\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.130867 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.128487    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/719bd649-20d3-41d8-8027-8107cc44d106-etc-kubernetes\") pod \"tuned-qxsxj\" (UID: \"719bd649-20d3-41d8-8027-8107cc44d106\") " pod="openshift-cluster-node-tuning-operator/tuned-qxsxj"
Jul 06 19:25:45.130867 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.128525    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/719bd649-20d3-41d8-8027-8107cc44d106-etc-tuned\") pod \"tuned-qxsxj\" (UID: \"719bd649-20d3-41d8-8027-8107cc44d106\") " pod="openshift-cluster-node-tuning-operator/tuned-qxsxj"
Jul 06 19:25:45.130867 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.128532    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7c732599-67dd-4c7a-9966-0d4f497a8e1d-socket-dir\") pod \"aws-ebs-csi-driver-node-mrqx4\" (UID: \"7c732599-67dd-4c7a-9966-0d4f497a8e1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqx4"
Jul 06 19:25:45.130867 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.128548    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/719bd649-20d3-41d8-8027-8107cc44d106-etc-kubernetes\") pod \"tuned-qxsxj\" (UID: \"719bd649-20d3-41d8-8027-8107cc44d106\") " pod="openshift-cluster-node-tuning-operator/tuned-qxsxj"
Jul 06 19:25:45.130867 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.128558    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bb750a78-aa1e-4c55-b771-e06ca00b997a-ovnkube-config\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.130867 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.128574    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/37610e93-f90e-40e9-b80c-816b07d688d0-host-var-lib-cni-bin\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.130867 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.128587    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bb750a78-aa1e-4c55-b771-e06ca00b997a-env-overrides\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.130867 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.128646    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/37610e93-f90e-40e9-b80c-816b07d688d0-multus-socket-dir-parent\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.130867 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.129046    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bb750a78-aa1e-4c55-b771-e06ca00b997a-env-overrides\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.131508 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.129099    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/37610e93-f90e-40e9-b80c-816b07d688d0-hostroot\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.131508 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.129177    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bb750a78-aa1e-4c55-b771-e06ca00b997a-ovnkube-config\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.131508 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.130730    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/719bd649-20d3-41d8-8027-8107cc44d106-tmp\") pod \"tuned-qxsxj\" (UID: \"719bd649-20d3-41d8-8027-8107cc44d106\") " pod="openshift-cluster-node-tuning-operator/tuned-qxsxj"
Jul 06 19:25:45.131508 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.130765    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bb750a78-aa1e-4c55-b771-e06ca00b997a-ovn-node-metrics-cert\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.131508 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.130938    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7eff5404-593b-4ff6-b2f8-3ef6d8c2db53-agent-certs\") pod \"konnectivity-agent-7tzh4\" (UID: \"7eff5404-593b-4ff6-b2f8-3ef6d8c2db53\") " pod="kube-system/konnectivity-agent-7tzh4"
Jul 06 19:25:45.131508 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.131090    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/719bd649-20d3-41d8-8027-8107cc44d106-etc-tuned\") pod \"tuned-qxsxj\" (UID: \"719bd649-20d3-41d8-8027-8107cc44d106\") " pod="openshift-cluster-node-tuning-operator/tuned-qxsxj"
Jul 06 19:25:45.134878 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:45.134844    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb580d2521422f06e4ec1bc19d959bbf.slice/crio-645768d468dfec6041fb41dbbbe1ae8c835f5bd9ad7ac2fd80167a62feaddc31 WatchSource:0}: Error finding container 645768d468dfec6041fb41dbbbe1ae8c835f5bd9ad7ac2fd80167a62feaddc31: Status 404 returned error can't find the container with id 645768d468dfec6041fb41dbbbe1ae8c835f5bd9ad7ac2fd80167a62feaddc31
Jul 06 19:25:45.135853 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:45.135821    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc460faf59ce7ef5c8a2e42034e3e25e2.slice/crio-60e288a3c3784c3282ec34d03e34d045eed580b01bf743cf10aad0965af6547a WatchSource:0}: Error finding container 60e288a3c3784c3282ec34d03e34d045eed580b01bf743cf10aad0965af6547a: Status 404 returned error can't find the container with id 60e288a3c3784c3282ec34d03e34d045eed580b01bf743cf10aad0965af6547a
Jul 06 19:25:45.136145 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:45.136124    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:25:45.136241 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:45.136153    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:25:45.136241 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:45.136180    2555 projected.go:196] Error preparing data for projected volume kube-api-access-r46bx for pod openshift-network-diagnostics/network-check-target-pmfn2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:25:45.136363 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:45.136253    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/42fc94d7-0161-4334-85d2-5f0df8456dec-kube-api-access-r46bx podName:42fc94d7-0161-4334-85d2-5f0df8456dec nodeName:}" failed. No retries permitted until 2026-07-06 19:25:45.636224698 +0000 UTC m=+3.412258097 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-r46bx" (UniqueName: "kubernetes.io/projected/42fc94d7-0161-4334-85d2-5f0df8456dec-kube-api-access-r46bx") pod "network-check-target-pmfn2" (UID: "42fc94d7-0161-4334-85d2-5f0df8456dec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:25:45.138521 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.138449    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67mrq\" (UniqueName: \"kubernetes.io/projected/37610e93-f90e-40e9-b80c-816b07d688d0-kube-api-access-67mrq\") pod \"multus-4v5kp\" (UID: \"37610e93-f90e-40e9-b80c-816b07d688d0\") " pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.138521 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.138489    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgv2x\" (UniqueName: \"kubernetes.io/projected/7c732599-67dd-4c7a-9966-0d4f497a8e1d-kube-api-access-tgv2x\") pod \"aws-ebs-csi-driver-node-mrqx4\" (UID: \"7c732599-67dd-4c7a-9966-0d4f497a8e1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqx4"
Jul 06 19:25:45.138689 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.138664    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpwzn\" (UniqueName: \"kubernetes.io/projected/e8893200-b607-4e1e-8a6c-fb4a31110947-kube-api-access-fpwzn\") pod \"node-resolver-5d2dt\" (UID: \"e8893200-b607-4e1e-8a6c-fb4a31110947\") " pod="openshift-dns/node-resolver-5d2dt"
Jul 06 19:25:45.139390 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.139341    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mfxv\" (UniqueName: \"kubernetes.io/projected/ae5d3a7d-3488-4ab3-b388-51db77bb6da4-kube-api-access-5mfxv\") pod \"node-ca-qtvrs\" (UID: \"ae5d3a7d-3488-4ab3-b388-51db77bb6da4\") " pod="openshift-image-registry/node-ca-qtvrs"
Jul 06 19:25:45.139704 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.139676    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tl5lj\" (UniqueName: \"kubernetes.io/projected/bb750a78-aa1e-4c55-b771-e06ca00b997a-kube-api-access-tl5lj\") pod \"ovnkube-node-j9wtk\" (UID: \"bb750a78-aa1e-4c55-b771-e06ca00b997a\") " pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.139779 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.139729    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2kcs\" (UniqueName: \"kubernetes.io/projected/719bd649-20d3-41d8-8027-8107cc44d106-kube-api-access-v2kcs\") pod \"tuned-qxsxj\" (UID: \"719bd649-20d3-41d8-8027-8107cc44d106\") " pod="openshift-cluster-node-tuning-operator/tuned-qxsxj"
Jul 06 19:25:45.140615 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.140587    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:25:45.229161 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.229123    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0acb06f4-a973-4679-99e1-d7a44e7286ae-kubelet-config\") pod \"global-pull-secret-syncer-btzb4\" (UID: \"0acb06f4-a973-4679-99e1-d7a44e7286ae\") " pod="kube-system/global-pull-secret-syncer-btzb4"
Jul 06 19:25:45.229161 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.229161    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f7af2d-5d72-4c10-88c4-44a193ad2b32-metrics-certs\") pod \"network-metrics-daemon-9tcbq\" (UID: \"e3f7af2d-5d72-4c10-88c4-44a193ad2b32\") " pod="openshift-multus/network-metrics-daemon-9tcbq"
Jul 06 19:25:45.229397 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.229179    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/40d45d9f-54f3-4736-b359-b43fc6af5535-cnibin\") pod \"multus-additional-cni-plugins-h5prb\" (UID: \"40d45d9f-54f3-4736-b359-b43fc6af5535\") " pod="openshift-multus/multus-additional-cni-plugins-h5prb"
Jul 06 19:25:45.229397 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.229198    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0d8c8a73-34a0-4e58-baf5-a96837c2bc6a-host-slash\") pod \"iptables-alerter-dpp5t\" (UID: \"0d8c8a73-34a0-4e58-baf5-a96837c2bc6a\") " pod="openshift-network-operator/iptables-alerter-dpp5t"
Jul 06 19:25:45.229397 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.229216    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0acb06f4-a973-4679-99e1-d7a44e7286ae-original-pull-secret\") pod \"global-pull-secret-syncer-btzb4\" (UID: \"0acb06f4-a973-4679-99e1-d7a44e7286ae\") " pod="kube-system/global-pull-secret-syncer-btzb4"
Jul 06 19:25:45.229397 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.229272    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/40d45d9f-54f3-4736-b359-b43fc6af5535-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h5prb\" (UID: \"40d45d9f-54f3-4736-b359-b43fc6af5535\") " pod="openshift-multus/multus-additional-cni-plugins-h5prb"
Jul 06 19:25:45.229397 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.229287    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0d8c8a73-34a0-4e58-baf5-a96837c2bc6a-host-slash\") pod \"iptables-alerter-dpp5t\" (UID: \"0d8c8a73-34a0-4e58-baf5-a96837c2bc6a\") " pod="openshift-network-operator/iptables-alerter-dpp5t"
Jul 06 19:25:45.229397 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:45.229298    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:25:45.229397 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.229316    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0acb06f4-a973-4679-99e1-d7a44e7286ae-dbus\") pod \"global-pull-secret-syncer-btzb4\" (UID: \"0acb06f4-a973-4679-99e1-d7a44e7286ae\") " pod="kube-system/global-pull-secret-syncer-btzb4"
Jul 06 19:25:45.229397 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.229344    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/40d45d9f-54f3-4736-b359-b43fc6af5535-cnibin\") pod \"multus-additional-cni-plugins-h5prb\" (UID: \"40d45d9f-54f3-4736-b359-b43fc6af5535\") " pod="openshift-multus/multus-additional-cni-plugins-h5prb"
Jul 06 19:25:45.229397 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.229272    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0acb06f4-a973-4679-99e1-d7a44e7286ae-kubelet-config\") pod \"global-pull-secret-syncer-btzb4\" (UID: \"0acb06f4-a973-4679-99e1-d7a44e7286ae\") " pod="kube-system/global-pull-secret-syncer-btzb4"
Jul 06 19:25:45.229397 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:45.229388    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3f7af2d-5d72-4c10-88c4-44a193ad2b32-metrics-certs podName:e3f7af2d-5d72-4c10-88c4-44a193ad2b32 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:45.729369275 +0000 UTC m=+3.505402653 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3f7af2d-5d72-4c10-88c4-44a193ad2b32-metrics-certs") pod "network-metrics-daemon-9tcbq" (UID: "e3f7af2d-5d72-4c10-88c4-44a193ad2b32") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:25:45.229850 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.229345    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/40d45d9f-54f3-4736-b359-b43fc6af5535-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h5prb\" (UID: \"40d45d9f-54f3-4736-b359-b43fc6af5535\") " pod="openshift-multus/multus-additional-cni-plugins-h5prb"
Jul 06 19:25:45.229850 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.229480    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0acb06f4-a973-4679-99e1-d7a44e7286ae-dbus\") pod \"global-pull-secret-syncer-btzb4\" (UID: \"0acb06f4-a973-4679-99e1-d7a44e7286ae\") " pod="kube-system/global-pull-secret-syncer-btzb4"
Jul 06 19:25:45.229850 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:45.229495    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:25:45.229850 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.229505    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40d45d9f-54f3-4736-b359-b43fc6af5535-system-cni-dir\") pod \"multus-additional-cni-plugins-h5prb\" (UID: \"40d45d9f-54f3-4736-b359-b43fc6af5535\") " pod="openshift-multus/multus-additional-cni-plugins-h5prb"
Jul 06 19:25:45.229850 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:45.229545    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0acb06f4-a973-4679-99e1-d7a44e7286ae-original-pull-secret podName:0acb06f4-a973-4679-99e1-d7a44e7286ae nodeName:}" failed. No retries permitted until 2026-07-06 19:25:45.729531203 +0000 UTC m=+3.505564585 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0acb06f4-a973-4679-99e1-d7a44e7286ae-original-pull-secret") pod "global-pull-secret-syncer-btzb4" (UID: "0acb06f4-a973-4679-99e1-d7a44e7286ae") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:25:45.229850 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.229544    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/40d45d9f-54f3-4736-b359-b43fc6af5535-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h5prb\" (UID: \"40d45d9f-54f3-4736-b359-b43fc6af5535\") " pod="openshift-multus/multus-additional-cni-plugins-h5prb"
Jul 06 19:25:45.229850 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.229565    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40d45d9f-54f3-4736-b359-b43fc6af5535-system-cni-dir\") pod \"multus-additional-cni-plugins-h5prb\" (UID: \"40d45d9f-54f3-4736-b359-b43fc6af5535\") " pod="openshift-multus/multus-additional-cni-plugins-h5prb"
Jul 06 19:25:45.229850 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.229602    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0d8c8a73-34a0-4e58-baf5-a96837c2bc6a-iptables-alerter-script\") pod \"iptables-alerter-dpp5t\" (UID: \"0d8c8a73-34a0-4e58-baf5-a96837c2bc6a\") " pod="openshift-network-operator/iptables-alerter-dpp5t"
Jul 06 19:25:45.229850 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.229635    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b2zm\" (UniqueName: \"kubernetes.io/projected/0d8c8a73-34a0-4e58-baf5-a96837c2bc6a-kube-api-access-2b2zm\") pod \"iptables-alerter-dpp5t\" (UID: \"0d8c8a73-34a0-4e58-baf5-a96837c2bc6a\") " pod="openshift-network-operator/iptables-alerter-dpp5t"
Jul 06 19:25:45.229850 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.229661    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/40d45d9f-54f3-4736-b359-b43fc6af5535-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h5prb\" (UID: \"40d45d9f-54f3-4736-b359-b43fc6af5535\") " pod="openshift-multus/multus-additional-cni-plugins-h5prb"
Jul 06 19:25:45.229850 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.229689    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/40d45d9f-54f3-4736-b359-b43fc6af5535-os-release\") pod \"multus-additional-cni-plugins-h5prb\" (UID: \"40d45d9f-54f3-4736-b359-b43fc6af5535\") " pod="openshift-multus/multus-additional-cni-plugins-h5prb"
Jul 06 19:25:45.229850 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.229732    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvrbl\" (UniqueName: \"kubernetes.io/projected/e3f7af2d-5d72-4c10-88c4-44a193ad2b32-kube-api-access-fvrbl\") pod \"network-metrics-daemon-9tcbq\" (UID: \"e3f7af2d-5d72-4c10-88c4-44a193ad2b32\") " pod="openshift-multus/network-metrics-daemon-9tcbq"
Jul 06 19:25:45.229850 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.229756    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/40d45d9f-54f3-4736-b359-b43fc6af5535-cni-binary-copy\") pod \"multus-additional-cni-plugins-h5prb\" (UID: \"40d45d9f-54f3-4736-b359-b43fc6af5535\") " pod="openshift-multus/multus-additional-cni-plugins-h5prb"
Jul 06 19:25:45.229850 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.229786    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbgw2\" (UniqueName: \"kubernetes.io/projected/40d45d9f-54f3-4736-b359-b43fc6af5535-kube-api-access-fbgw2\") pod \"multus-additional-cni-plugins-h5prb\" (UID: \"40d45d9f-54f3-4736-b359-b43fc6af5535\") " pod="openshift-multus/multus-additional-cni-plugins-h5prb"
Jul 06 19:25:45.230549 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.229987    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/40d45d9f-54f3-4736-b359-b43fc6af5535-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h5prb\" (UID: \"40d45d9f-54f3-4736-b359-b43fc6af5535\") " pod="openshift-multus/multus-additional-cni-plugins-h5prb"
Jul 06 19:25:45.230549 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.230040    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/40d45d9f-54f3-4736-b359-b43fc6af5535-os-release\") pod \"multus-additional-cni-plugins-h5prb\" (UID: \"40d45d9f-54f3-4736-b359-b43fc6af5535\") " pod="openshift-multus/multus-additional-cni-plugins-h5prb"
Jul 06 19:25:45.230549 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.230265    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0d8c8a73-34a0-4e58-baf5-a96837c2bc6a-iptables-alerter-script\") pod \"iptables-alerter-dpp5t\" (UID: \"0d8c8a73-34a0-4e58-baf5-a96837c2bc6a\") " pod="openshift-network-operator/iptables-alerter-dpp5t"
Jul 06 19:25:45.230549 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.230304    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/40d45d9f-54f3-4736-b359-b43fc6af5535-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h5prb\" (UID: \"40d45d9f-54f3-4736-b359-b43fc6af5535\") " pod="openshift-multus/multus-additional-cni-plugins-h5prb"
Jul 06 19:25:45.230549 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.230311    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/40d45d9f-54f3-4736-b359-b43fc6af5535-cni-binary-copy\") pod \"multus-additional-cni-plugins-h5prb\" (UID: \"40d45d9f-54f3-4736-b359-b43fc6af5535\") " pod="openshift-multus/multus-additional-cni-plugins-h5prb"
Jul 06 19:25:45.239119 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.239086    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvrbl\" (UniqueName: \"kubernetes.io/projected/e3f7af2d-5d72-4c10-88c4-44a193ad2b32-kube-api-access-fvrbl\") pod \"network-metrics-daemon-9tcbq\" (UID: \"e3f7af2d-5d72-4c10-88c4-44a193ad2b32\") " pod="openshift-multus/network-metrics-daemon-9tcbq"
Jul 06 19:25:45.239268 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.239252    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b2zm\" (UniqueName: \"kubernetes.io/projected/0d8c8a73-34a0-4e58-baf5-a96837c2bc6a-kube-api-access-2b2zm\") pod \"iptables-alerter-dpp5t\" (UID: \"0d8c8a73-34a0-4e58-baf5-a96837c2bc6a\") " pod="openshift-network-operator/iptables-alerter-dpp5t"
Jul 06 19:25:45.239602 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.239584    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbgw2\" (UniqueName: \"kubernetes.io/projected/40d45d9f-54f3-4736-b359-b43fc6af5535-kube-api-access-fbgw2\") pod \"multus-additional-cni-plugins-h5prb\" (UID: \"40d45d9f-54f3-4736-b359-b43fc6af5535\") " pod="openshift-multus/multus-additional-cni-plugins-h5prb"
Jul 06 19:25:45.323224 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.323185    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4v5kp"
Jul 06 19:25:45.332681 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:45.332648    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37610e93_f90e_40e9_b80c_816b07d688d0.slice/crio-41eb12eff2853a4e4a8307b1cde7317c7c8d00943665e04777d4763f18649d22 WatchSource:0}: Error finding container 41eb12eff2853a4e4a8307b1cde7317c7c8d00943665e04777d4763f18649d22: Status 404 returned error can't find the container with id 41eb12eff2853a4e4a8307b1cde7317c7c8d00943665e04777d4763f18649d22
Jul 06 19:25:45.342193 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.342134    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5d2dt"
Jul 06 19:25:45.350616 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:45.350591    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8893200_b607_4e1e_8a6c_fb4a31110947.slice/crio-5bd32bf91eba86111d8897b6e8959dba31a3abd95eacaa73ada1a3320f0cd1ae WatchSource:0}: Error finding container 5bd32bf91eba86111d8897b6e8959dba31a3abd95eacaa73ada1a3320f0cd1ae: Status 404 returned error can't find the container with id 5bd32bf91eba86111d8897b6e8959dba31a3abd95eacaa73ada1a3320f0cd1ae
Jul 06 19:25:45.355784 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.355763    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:25:45.363820 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:45.363794    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb750a78_aa1e_4c55_b771_e06ca00b997a.slice/crio-fd42f672e3765a9b3e791278a355b89c13675b7da835585c5b2544ca3158793a WatchSource:0}: Error finding container fd42f672e3765a9b3e791278a355b89c13675b7da835585c5b2544ca3158793a: Status 404 returned error can't find the container with id fd42f672e3765a9b3e791278a355b89c13675b7da835585c5b2544ca3158793a
Jul 06 19:25:45.369167 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.369144    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7tzh4"
Jul 06 19:25:45.376787 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:45.376751    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7eff5404_593b_4ff6_b2f8_3ef6d8c2db53.slice/crio-74996d8bdac4b6cba57d3d88cfc0b0317b89c4af827d8bf263579de7b935db09 WatchSource:0}: Error finding container 74996d8bdac4b6cba57d3d88cfc0b0317b89c4af827d8bf263579de7b935db09: Status 404 returned error can't find the container with id 74996d8bdac4b6cba57d3d88cfc0b0317b89c4af827d8bf263579de7b935db09
Jul 06 19:25:45.390189 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.390162    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqx4"
Jul 06 19:25:45.398344 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:45.398314    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c732599_67dd_4c7a_9966_0d4f497a8e1d.slice/crio-00626622c0a9a642e58600aed85fa1b6bf13cd77ccfa5e25d8096c88799f12e8 WatchSource:0}: Error finding container 00626622c0a9a642e58600aed85fa1b6bf13cd77ccfa5e25d8096c88799f12e8: Status 404 returned error can't find the container with id 00626622c0a9a642e58600aed85fa1b6bf13cd77ccfa5e25d8096c88799f12e8
Jul 06 19:25:45.403267 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.403216    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qxsxj"
Jul 06 19:25:45.410492 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:45.410466    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod719bd649_20d3_41d8_8027_8107cc44d106.slice/crio-07f3701ab6652b1de657e3841c64363104d6023c5927144be0e8b01ef8d07839 WatchSource:0}: Error finding container 07f3701ab6652b1de657e3841c64363104d6023c5927144be0e8b01ef8d07839: Status 404 returned error can't find the container with id 07f3701ab6652b1de657e3841c64363104d6023c5927144be0e8b01ef8d07839
Jul 06 19:25:45.419041 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.419018    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qtvrs"
Jul 06 19:25:45.427100 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:45.427063    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae5d3a7d_3488_4ab3_b388_51db77bb6da4.slice/crio-7e62c394cca0c7003963023581018a8eeb1740e972d666be7433cd1d373bbf78 WatchSource:0}: Error finding container 7e62c394cca0c7003963023581018a8eeb1740e972d666be7433cd1d373bbf78: Status 404 returned error can't find the container with id 7e62c394cca0c7003963023581018a8eeb1740e972d666be7433cd1d373bbf78
Jul 06 19:25:45.431952 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.431919    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h5prb"
Jul 06 19:25:45.440152 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:45.440126    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40d45d9f_54f3_4736_b359_b43fc6af5535.slice/crio-a1c069cc00b653e818f80b8ee5c7b395c271e1b1e39101fb3198d92ece4676a2 WatchSource:0}: Error finding container a1c069cc00b653e818f80b8ee5c7b395c271e1b1e39101fb3198d92ece4676a2: Status 404 returned error can't find the container with id a1c069cc00b653e818f80b8ee5c7b395c271e1b1e39101fb3198d92ece4676a2
Jul 06 19:25:45.444713 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.444693    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dpp5t"
Jul 06 19:25:45.454008 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:25:45.453972    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d8c8a73_34a0_4e58_baf5_a96837c2bc6a.slice/crio-4e52aad9e99131b1c8df1bb72e16edaa853666ddaf2d0989ecbe2a0c4320fa23 WatchSource:0}: Error finding container 4e52aad9e99131b1c8df1bb72e16edaa853666ddaf2d0989ecbe2a0c4320fa23: Status 404 returned error can't find the container with id 4e52aad9e99131b1c8df1bb72e16edaa853666ddaf2d0989ecbe2a0c4320fa23
Jul 06 19:25:45.600611 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.600520    2555 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:25:45.733926 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.733870    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r46bx\" (UniqueName: \"kubernetes.io/projected/42fc94d7-0161-4334-85d2-5f0df8456dec-kube-api-access-r46bx\") pod \"network-check-target-pmfn2\" (UID: \"42fc94d7-0161-4334-85d2-5f0df8456dec\") " pod="openshift-network-diagnostics/network-check-target-pmfn2"
Jul 06 19:25:45.734113 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.733979    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f7af2d-5d72-4c10-88c4-44a193ad2b32-metrics-certs\") pod \"network-metrics-daemon-9tcbq\" (UID: \"e3f7af2d-5d72-4c10-88c4-44a193ad2b32\") " pod="openshift-multus/network-metrics-daemon-9tcbq"
Jul 06 19:25:45.734113 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.734028    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0acb06f4-a973-4679-99e1-d7a44e7286ae-original-pull-secret\") pod \"global-pull-secret-syncer-btzb4\" (UID: \"0acb06f4-a973-4679-99e1-d7a44e7286ae\") " pod="kube-system/global-pull-secret-syncer-btzb4"
Jul 06 19:25:45.734113 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:45.734095    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:25:45.734295 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:45.734121    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:25:45.734295 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:45.734135    2555 projected.go:196] Error preparing data for projected volume kube-api-access-r46bx for pod openshift-network-diagnostics/network-check-target-pmfn2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:25:45.734295 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:45.734166    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:25:45.734295 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:45.734202    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/42fc94d7-0161-4334-85d2-5f0df8456dec-kube-api-access-r46bx podName:42fc94d7-0161-4334-85d2-5f0df8456dec nodeName:}" failed. No retries permitted until 2026-07-06 19:25:46.734181088 +0000 UTC m=+4.510214493 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-r46bx" (UniqueName: "kubernetes.io/projected/42fc94d7-0161-4334-85d2-5f0df8456dec-kube-api-access-r46bx") pod "network-check-target-pmfn2" (UID: "42fc94d7-0161-4334-85d2-5f0df8456dec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:25:45.734295 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:45.734225    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0acb06f4-a973-4679-99e1-d7a44e7286ae-original-pull-secret podName:0acb06f4-a973-4679-99e1-d7a44e7286ae nodeName:}" failed. No retries permitted until 2026-07-06 19:25:46.734213676 +0000 UTC m=+4.510247069 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0acb06f4-a973-4679-99e1-d7a44e7286ae-original-pull-secret") pod "global-pull-secret-syncer-btzb4" (UID: "0acb06f4-a973-4679-99e1-d7a44e7286ae") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:25:45.734295 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:45.734227    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:25:45.734295 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:45.734280    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3f7af2d-5d72-4c10-88c4-44a193ad2b32-metrics-certs podName:e3f7af2d-5d72-4c10-88c4-44a193ad2b32 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:46.734263907 +0000 UTC m=+4.510297293 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3f7af2d-5d72-4c10-88c4-44a193ad2b32-metrics-certs") pod "network-metrics-daemon-9tcbq" (UID: "e3f7af2d-5d72-4c10-88c4-44a193ad2b32") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:25:45.952992 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:45.952505    2555 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:25:46.102228 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:46.102171    2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:20:45 +0000 UTC" deadline="2028-03-16 08:54:51.115381718 +0000 UTC"
Jul 06 19:25:46.102228 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:46.102219    2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14845h29m5.013168377s"
Jul 06 19:25:46.157830 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:46.157768    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7tzh4" event={"ID":"7eff5404-593b-4ff6-b2f8-3ef6d8c2db53","Type":"ContainerStarted","Data":"74996d8bdac4b6cba57d3d88cfc0b0317b89c4af827d8bf263579de7b935db09"}
Jul 06 19:25:46.179874 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:46.179824    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk" event={"ID":"bb750a78-aa1e-4c55-b771-e06ca00b997a","Type":"ContainerStarted","Data":"fd42f672e3765a9b3e791278a355b89c13675b7da835585c5b2544ca3158793a"}
Jul 06 19:25:46.184852 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:46.184813    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4v5kp" event={"ID":"37610e93-f90e-40e9-b80c-816b07d688d0","Type":"ContainerStarted","Data":"41eb12eff2853a4e4a8307b1cde7317c7c8d00943665e04777d4763f18649d22"}
Jul 06 19:25:46.195820 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:46.195780    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5d2dt" event={"ID":"e8893200-b607-4e1e-8a6c-fb4a31110947","Type":"ContainerStarted","Data":"5bd32bf91eba86111d8897b6e8959dba31a3abd95eacaa73ada1a3320f0cd1ae"}
Jul 06 19:25:46.217135 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:46.217040    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-150.ec2.internal" event={"ID":"eb580d2521422f06e4ec1bc19d959bbf","Type":"ContainerStarted","Data":"645768d468dfec6041fb41dbbbe1ae8c835f5bd9ad7ac2fd80167a62feaddc31"}
Jul 06 19:25:46.237121 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:46.236980    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal" event={"ID":"c460faf59ce7ef5c8a2e42034e3e25e2","Type":"ContainerStarted","Data":"60e288a3c3784c3282ec34d03e34d045eed580b01bf743cf10aad0965af6547a"}
Jul 06 19:25:46.253103 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:46.253047    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dpp5t" event={"ID":"0d8c8a73-34a0-4e58-baf5-a96837c2bc6a","Type":"ContainerStarted","Data":"4e52aad9e99131b1c8df1bb72e16edaa853666ddaf2d0989ecbe2a0c4320fa23"}
Jul 06 19:25:46.262099 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:46.262055    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h5prb" event={"ID":"40d45d9f-54f3-4736-b359-b43fc6af5535","Type":"ContainerStarted","Data":"a1c069cc00b653e818f80b8ee5c7b395c271e1b1e39101fb3198d92ece4676a2"}
Jul 06 19:25:46.272542 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:46.272494    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qtvrs" event={"ID":"ae5d3a7d-3488-4ab3-b388-51db77bb6da4","Type":"ContainerStarted","Data":"7e62c394cca0c7003963023581018a8eeb1740e972d666be7433cd1d373bbf78"}
Jul 06 19:25:46.297878 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:46.297788    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qxsxj" event={"ID":"719bd649-20d3-41d8-8027-8107cc44d106","Type":"ContainerStarted","Data":"07f3701ab6652b1de657e3841c64363104d6023c5927144be0e8b01ef8d07839"}
Jul 06 19:25:46.338940 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:46.338839    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqx4" event={"ID":"7c732599-67dd-4c7a-9966-0d4f497a8e1d","Type":"ContainerStarted","Data":"00626622c0a9a642e58600aed85fa1b6bf13cd77ccfa5e25d8096c88799f12e8"}
Jul 06 19:25:46.404087 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:46.404025    2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:25:46.743846 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:46.743799    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r46bx\" (UniqueName: \"kubernetes.io/projected/42fc94d7-0161-4334-85d2-5f0df8456dec-kube-api-access-r46bx\") pod \"network-check-target-pmfn2\" (UID: \"42fc94d7-0161-4334-85d2-5f0df8456dec\") " pod="openshift-network-diagnostics/network-check-target-pmfn2"
Jul 06 19:25:46.744083 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:46.743892    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f7af2d-5d72-4c10-88c4-44a193ad2b32-metrics-certs\") pod \"network-metrics-daemon-9tcbq\" (UID: \"e3f7af2d-5d72-4c10-88c4-44a193ad2b32\") " pod="openshift-multus/network-metrics-daemon-9tcbq"
Jul 06 19:25:46.744083 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:46.743929    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0acb06f4-a973-4679-99e1-d7a44e7286ae-original-pull-secret\") pod \"global-pull-secret-syncer-btzb4\" (UID: \"0acb06f4-a973-4679-99e1-d7a44e7286ae\") " pod="kube-system/global-pull-secret-syncer-btzb4"
Jul 06 19:25:46.744213 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:46.744161    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:25:46.744274 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:46.744230    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0acb06f4-a973-4679-99e1-d7a44e7286ae-original-pull-secret podName:0acb06f4-a973-4679-99e1-d7a44e7286ae nodeName:}" failed. No retries permitted until 2026-07-06 19:25:48.744210286 +0000 UTC m=+6.520243680 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0acb06f4-a973-4679-99e1-d7a44e7286ae-original-pull-secret") pod "global-pull-secret-syncer-btzb4" (UID: "0acb06f4-a973-4679-99e1-d7a44e7286ae") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:25:46.744346 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:46.744335    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:25:46.744404 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:46.744353    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:25:46.744404 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:46.744367    2555 projected.go:196] Error preparing data for projected volume kube-api-access-r46bx for pod openshift-network-diagnostics/network-check-target-pmfn2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:25:46.744505 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:46.744404    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/42fc94d7-0161-4334-85d2-5f0df8456dec-kube-api-access-r46bx podName:42fc94d7-0161-4334-85d2-5f0df8456dec nodeName:}" failed. No retries permitted until 2026-07-06 19:25:48.744392182 +0000 UTC m=+6.520425574 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-r46bx" (UniqueName: "kubernetes.io/projected/42fc94d7-0161-4334-85d2-5f0df8456dec-kube-api-access-r46bx") pod "network-check-target-pmfn2" (UID: "42fc94d7-0161-4334-85d2-5f0df8456dec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:25:46.745337 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:46.744845    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:25:46.745337 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:46.744899    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3f7af2d-5d72-4c10-88c4-44a193ad2b32-metrics-certs podName:e3f7af2d-5d72-4c10-88c4-44a193ad2b32 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:48.744882454 +0000 UTC m=+6.520915848 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3f7af2d-5d72-4c10-88c4-44a193ad2b32-metrics-certs") pod "network-metrics-daemon-9tcbq" (UID: "e3f7af2d-5d72-4c10-88c4-44a193ad2b32") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:25:47.103254 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:47.103186    2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:20:45 +0000 UTC" deadline="2028-03-19 07:45:10.439947432 +0000 UTC"
Jul 06 19:25:47.103254 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:47.103251    2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14916h19m23.336700914s"
Jul 06 19:25:47.124750 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:47.124716    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tcbq"
Jul 06 19:25:47.125018 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:47.124867    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tcbq" podUID="e3f7af2d-5d72-4c10-88c4-44a193ad2b32"
Jul 06 19:25:47.125444 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:47.125303    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btzb4"
Jul 06 19:25:47.125444 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:47.125402    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btzb4" podUID="0acb06f4-a973-4679-99e1-d7a44e7286ae"
Jul 06 19:25:47.125622 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:47.125468    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmfn2"
Jul 06 19:25:47.125622 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:47.125539    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmfn2" podUID="42fc94d7-0161-4334-85d2-5f0df8456dec"
Jul 06 19:25:48.761963 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:48.761873    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f7af2d-5d72-4c10-88c4-44a193ad2b32-metrics-certs\") pod \"network-metrics-daemon-9tcbq\" (UID: \"e3f7af2d-5d72-4c10-88c4-44a193ad2b32\") " pod="openshift-multus/network-metrics-daemon-9tcbq"
Jul 06 19:25:48.762570 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:48.762016    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0acb06f4-a973-4679-99e1-d7a44e7286ae-original-pull-secret\") pod \"global-pull-secret-syncer-btzb4\" (UID: \"0acb06f4-a973-4679-99e1-d7a44e7286ae\") " pod="kube-system/global-pull-secret-syncer-btzb4"
Jul 06 19:25:48.762570 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:48.762049    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:25:48.762570 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:48.762091    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r46bx\" (UniqueName: \"kubernetes.io/projected/42fc94d7-0161-4334-85d2-5f0df8456dec-kube-api-access-r46bx\") pod \"network-check-target-pmfn2\" (UID: \"42fc94d7-0161-4334-85d2-5f0df8456dec\") " pod="openshift-network-diagnostics/network-check-target-pmfn2"
Jul 06 19:25:48.762570 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:48.762131    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3f7af2d-5d72-4c10-88c4-44a193ad2b32-metrics-certs podName:e3f7af2d-5d72-4c10-88c4-44a193ad2b32 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:52.762108756 +0000 UTC m=+10.538142137 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3f7af2d-5d72-4c10-88c4-44a193ad2b32-metrics-certs") pod "network-metrics-daemon-9tcbq" (UID: "e3f7af2d-5d72-4c10-88c4-44a193ad2b32") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:25:48.762570 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:48.762209    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:25:48.762570 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:48.762230    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:25:48.762570 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:48.762243    2555 projected.go:196] Error preparing data for projected volume kube-api-access-r46bx for pod openshift-network-diagnostics/network-check-target-pmfn2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:25:48.762570 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:48.762292    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/42fc94d7-0161-4334-85d2-5f0df8456dec-kube-api-access-r46bx podName:42fc94d7-0161-4334-85d2-5f0df8456dec nodeName:}" failed. No retries permitted until 2026-07-06 19:25:52.762277313 +0000 UTC m=+10.538310694 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-r46bx" (UniqueName: "kubernetes.io/projected/42fc94d7-0161-4334-85d2-5f0df8456dec-kube-api-access-r46bx") pod "network-check-target-pmfn2" (UID: "42fc94d7-0161-4334-85d2-5f0df8456dec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:25:48.762570 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:48.762355    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:25:48.762570 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:48.762389    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0acb06f4-a973-4679-99e1-d7a44e7286ae-original-pull-secret podName:0acb06f4-a973-4679-99e1-d7a44e7286ae nodeName:}" failed. No retries permitted until 2026-07-06 19:25:52.76237832 +0000 UTC m=+10.538411702 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0acb06f4-a973-4679-99e1-d7a44e7286ae-original-pull-secret") pod "global-pull-secret-syncer-btzb4" (UID: "0acb06f4-a973-4679-99e1-d7a44e7286ae") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:25:49.125411 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:49.124722    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btzb4"
Jul 06 19:25:49.125411 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:49.124857    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btzb4" podUID="0acb06f4-a973-4679-99e1-d7a44e7286ae"
Jul 06 19:25:49.125411 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:49.125099    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmfn2"
Jul 06 19:25:49.125411 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:49.125099    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tcbq"
Jul 06 19:25:49.125411 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:49.125209    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmfn2" podUID="42fc94d7-0161-4334-85d2-5f0df8456dec"
Jul 06 19:25:49.125411 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:49.125325    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tcbq" podUID="e3f7af2d-5d72-4c10-88c4-44a193ad2b32"
Jul 06 19:25:51.124688 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:51.124173    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btzb4"
Jul 06 19:25:51.124688 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:51.124314    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btzb4" podUID="0acb06f4-a973-4679-99e1-d7a44e7286ae"
Jul 06 19:25:51.124688 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:51.124357    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmfn2"
Jul 06 19:25:51.124688 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:51.124437    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmfn2" podUID="42fc94d7-0161-4334-85d2-5f0df8456dec"
Jul 06 19:25:51.124688 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:51.124464    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tcbq"
Jul 06 19:25:51.124688 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:51.124586    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tcbq" podUID="e3f7af2d-5d72-4c10-88c4-44a193ad2b32"
Jul 06 19:25:52.797606 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:52.797445    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r46bx\" (UniqueName: \"kubernetes.io/projected/42fc94d7-0161-4334-85d2-5f0df8456dec-kube-api-access-r46bx\") pod \"network-check-target-pmfn2\" (UID: \"42fc94d7-0161-4334-85d2-5f0df8456dec\") " pod="openshift-network-diagnostics/network-check-target-pmfn2"
Jul 06 19:25:52.797606 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:52.797532    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f7af2d-5d72-4c10-88c4-44a193ad2b32-metrics-certs\") pod \"network-metrics-daemon-9tcbq\" (UID: \"e3f7af2d-5d72-4c10-88c4-44a193ad2b32\") " pod="openshift-multus/network-metrics-daemon-9tcbq"
Jul 06 19:25:52.797606 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:52.797566    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0acb06f4-a973-4679-99e1-d7a44e7286ae-original-pull-secret\") pod \"global-pull-secret-syncer-btzb4\" (UID: \"0acb06f4-a973-4679-99e1-d7a44e7286ae\") " pod="kube-system/global-pull-secret-syncer-btzb4"
Jul 06 19:25:52.797606 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:52.797597    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:25:52.798273 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:52.797629    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:25:52.798273 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:52.797642    2555 projected.go:196] Error preparing data for projected volume kube-api-access-r46bx for pod openshift-network-diagnostics/network-check-target-pmfn2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:25:52.798273 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:52.797674    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:25:52.798273 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:52.797697    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:25:52.798273 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:52.797710    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/42fc94d7-0161-4334-85d2-5f0df8456dec-kube-api-access-r46bx podName:42fc94d7-0161-4334-85d2-5f0df8456dec nodeName:}" failed. No retries permitted until 2026-07-06 19:26:00.797689106 +0000 UTC m=+18.573722486 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-r46bx" (UniqueName: "kubernetes.io/projected/42fc94d7-0161-4334-85d2-5f0df8456dec-kube-api-access-r46bx") pod "network-check-target-pmfn2" (UID: "42fc94d7-0161-4334-85d2-5f0df8456dec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:25:52.798273 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:52.797732    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0acb06f4-a973-4679-99e1-d7a44e7286ae-original-pull-secret podName:0acb06f4-a973-4679-99e1-d7a44e7286ae nodeName:}" failed. No retries permitted until 2026-07-06 19:26:00.797721165 +0000 UTC m=+18.573754547 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0acb06f4-a973-4679-99e1-d7a44e7286ae-original-pull-secret") pod "global-pull-secret-syncer-btzb4" (UID: "0acb06f4-a973-4679-99e1-d7a44e7286ae") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:25:52.798273 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:52.797748    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3f7af2d-5d72-4c10-88c4-44a193ad2b32-metrics-certs podName:e3f7af2d-5d72-4c10-88c4-44a193ad2b32 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:00.797737907 +0000 UTC m=+18.573771290 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3f7af2d-5d72-4c10-88c4-44a193ad2b32-metrics-certs") pod "network-metrics-daemon-9tcbq" (UID: "e3f7af2d-5d72-4c10-88c4-44a193ad2b32") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:25:53.124158 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:53.124006    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tcbq"
Jul 06 19:25:53.124158 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:53.124070    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btzb4"
Jul 06 19:25:53.124369 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:53.124208    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tcbq" podUID="e3f7af2d-5d72-4c10-88c4-44a193ad2b32"
Jul 06 19:25:53.124670 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:53.124592    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btzb4" podUID="0acb06f4-a973-4679-99e1-d7a44e7286ae"
Jul 06 19:25:53.124670 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:53.124635    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmfn2"
Jul 06 19:25:53.124821 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:53.124734    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmfn2" podUID="42fc94d7-0161-4334-85d2-5f0df8456dec"
Jul 06 19:25:55.124787 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:55.124748    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tcbq"
Jul 06 19:25:55.124787 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:55.124770    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btzb4"
Jul 06 19:25:55.125322 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:55.124758    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmfn2"
Jul 06 19:25:55.125322 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:55.124891    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tcbq" podUID="e3f7af2d-5d72-4c10-88c4-44a193ad2b32"
Jul 06 19:25:55.125322 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:55.124946    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmfn2" podUID="42fc94d7-0161-4334-85d2-5f0df8456dec"
Jul 06 19:25:55.125322 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:55.125020    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btzb4" podUID="0acb06f4-a973-4679-99e1-d7a44e7286ae"
Jul 06 19:25:57.124903 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:57.124865    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btzb4"
Jul 06 19:25:57.124903 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:57.124897    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmfn2"
Jul 06 19:25:57.125409 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:57.124992    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tcbq"
Jul 06 19:25:57.125409 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:57.125011    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btzb4" podUID="0acb06f4-a973-4679-99e1-d7a44e7286ae"
Jul 06 19:25:57.125409 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:57.125105    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tcbq" podUID="e3f7af2d-5d72-4c10-88c4-44a193ad2b32"
Jul 06 19:25:57.125409 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:57.125184    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmfn2" podUID="42fc94d7-0161-4334-85d2-5f0df8456dec"
Jul 06 19:25:59.124731 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:59.124682    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tcbq"
Jul 06 19:25:59.124731 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:59.124723    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btzb4"
Jul 06 19:25:59.125249 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:25:59.124825    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmfn2"
Jul 06 19:25:59.125249 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:59.124835    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tcbq" podUID="e3f7af2d-5d72-4c10-88c4-44a193ad2b32"
Jul 06 19:25:59.125249 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:59.124921    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btzb4" podUID="0acb06f4-a973-4679-99e1-d7a44e7286ae"
Jul 06 19:25:59.125249 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:25:59.125031    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmfn2" podUID="42fc94d7-0161-4334-85d2-5f0df8456dec"
Jul 06 19:26:00.855472 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:00.855439    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f7af2d-5d72-4c10-88c4-44a193ad2b32-metrics-certs\") pod \"network-metrics-daemon-9tcbq\" (UID: \"e3f7af2d-5d72-4c10-88c4-44a193ad2b32\") " pod="openshift-multus/network-metrics-daemon-9tcbq"
Jul 06 19:26:00.855472 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:00.855481    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0acb06f4-a973-4679-99e1-d7a44e7286ae-original-pull-secret\") pod \"global-pull-secret-syncer-btzb4\" (UID: \"0acb06f4-a973-4679-99e1-d7a44e7286ae\") " pod="kube-system/global-pull-secret-syncer-btzb4"
Jul 06 19:26:00.855890 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:00.855521    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r46bx\" (UniqueName: \"kubernetes.io/projected/42fc94d7-0161-4334-85d2-5f0df8456dec-kube-api-access-r46bx\") pod \"network-check-target-pmfn2\" (UID: \"42fc94d7-0161-4334-85d2-5f0df8456dec\") " pod="openshift-network-diagnostics/network-check-target-pmfn2"
Jul 06 19:26:00.855890 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:00.855618    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:26:00.855890 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:00.855653    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:26:00.855890 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:00.855657    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:26:00.855890 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:00.855671    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:26:00.855890 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:00.855683    2555 projected.go:196] Error preparing data for projected volume kube-api-access-r46bx for pod openshift-network-diagnostics/network-check-target-pmfn2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:26:00.855890 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:00.855688    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3f7af2d-5d72-4c10-88c4-44a193ad2b32-metrics-certs podName:e3f7af2d-5d72-4c10-88c4-44a193ad2b32 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:16.855666841 +0000 UTC m=+34.631700235 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3f7af2d-5d72-4c10-88c4-44a193ad2b32-metrics-certs") pod "network-metrics-daemon-9tcbq" (UID: "e3f7af2d-5d72-4c10-88c4-44a193ad2b32") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:26:00.855890 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:00.855712    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0acb06f4-a973-4679-99e1-d7a44e7286ae-original-pull-secret podName:0acb06f4-a973-4679-99e1-d7a44e7286ae nodeName:}" failed. No retries permitted until 2026-07-06 19:26:16.855697822 +0000 UTC m=+34.631731203 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0acb06f4-a973-4679-99e1-d7a44e7286ae-original-pull-secret") pod "global-pull-secret-syncer-btzb4" (UID: "0acb06f4-a973-4679-99e1-d7a44e7286ae") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:26:00.855890 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:00.855726    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/42fc94d7-0161-4334-85d2-5f0df8456dec-kube-api-access-r46bx podName:42fc94d7-0161-4334-85d2-5f0df8456dec nodeName:}" failed. No retries permitted until 2026-07-06 19:26:16.855719447 +0000 UTC m=+34.631752828 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-r46bx" (UniqueName: "kubernetes.io/projected/42fc94d7-0161-4334-85d2-5f0df8456dec-kube-api-access-r46bx") pod "network-check-target-pmfn2" (UID: "42fc94d7-0161-4334-85d2-5f0df8456dec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:26:01.124340 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:01.124248    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btzb4"
Jul 06 19:26:01.124340 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:01.124290    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tcbq"
Jul 06 19:26:01.124564 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:01.124256    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmfn2"
Jul 06 19:26:01.124564 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:01.124406    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btzb4" podUID="0acb06f4-a973-4679-99e1-d7a44e7286ae"
Jul 06 19:26:01.124564 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:01.124495    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmfn2" podUID="42fc94d7-0161-4334-85d2-5f0df8456dec"
Jul 06 19:26:01.124678 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:01.124597    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tcbq" podUID="e3f7af2d-5d72-4c10-88c4-44a193ad2b32"
Jul 06 19:26:03.124696 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:03.124650    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tcbq"
Jul 06 19:26:03.124696 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:03.124674    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmfn2"
Jul 06 19:26:03.125261 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:03.124651    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btzb4"
Jul 06 19:26:03.125261 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:03.124787    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tcbq" podUID="e3f7af2d-5d72-4c10-88c4-44a193ad2b32"
Jul 06 19:26:03.125261 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:03.124893    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btzb4" podUID="0acb06f4-a973-4679-99e1-d7a44e7286ae"
Jul 06 19:26:03.125261 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:03.124993    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmfn2" podUID="42fc94d7-0161-4334-85d2-5f0df8456dec"
Jul 06 19:26:05.123899 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:05.123860    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tcbq"
Jul 06 19:26:05.124379 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:05.123860    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmfn2"
Jul 06 19:26:05.124379 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:05.123868    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btzb4"
Jul 06 19:26:05.124379 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:05.124015    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tcbq" podUID="e3f7af2d-5d72-4c10-88c4-44a193ad2b32"
Jul 06 19:26:05.124379 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:05.124131    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btzb4" podUID="0acb06f4-a973-4679-99e1-d7a44e7286ae"
Jul 06 19:26:05.124379 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:05.124202    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmfn2" podUID="42fc94d7-0161-4334-85d2-5f0df8456dec"
Jul 06 19:26:06.394743 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:06.394440    2555 generic.go:356] "Generic (PLEG): container finished" podID="40d45d9f-54f3-4736-b359-b43fc6af5535" containerID="647e4d38d1caef732edaad2aa69a276716d16c9e83c6a8c9f517593c8104849d" exitCode=0
Jul 06 19:26:06.395455 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:06.394526    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h5prb" event={"ID":"40d45d9f-54f3-4736-b359-b43fc6af5535","Type":"ContainerDied","Data":"647e4d38d1caef732edaad2aa69a276716d16c9e83c6a8c9f517593c8104849d"}
Jul 06 19:26:06.396266 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:06.396244    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qtvrs" event={"ID":"ae5d3a7d-3488-4ab3-b388-51db77bb6da4","Type":"ContainerStarted","Data":"80cf8555e0de257e612fa6329ffcbe048703ab0aeca63ad7cb9ee9137b072905"}
Jul 06 19:26:06.397770 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:06.397750    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qxsxj" event={"ID":"719bd649-20d3-41d8-8027-8107cc44d106","Type":"ContainerStarted","Data":"0cebb0daeca2c03df58d924da4746c1e0897f6d24b121f2a3f1c3699cb3dc8ec"}
Jul 06 19:26:06.399252 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:06.399229    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqx4" event={"ID":"7c732599-67dd-4c7a-9966-0d4f497a8e1d","Type":"ContainerStarted","Data":"2719dc7acb6b666875e9d64b7216d50ff64124dc93ec7db8844a14b246472306"}
Jul 06 19:26:06.400543 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:06.400521    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7tzh4" event={"ID":"7eff5404-593b-4ff6-b2f8-3ef6d8c2db53","Type":"ContainerStarted","Data":"ecc1d258e6bfb0d9b4c0ad37bf0abcab9642c8cc6e389b58edc6e05556615bbf"}
Jul 06 19:26:06.403206 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:06.403190    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j9wtk_bb750a78-aa1e-4c55-b771-e06ca00b997a/ovn-acl-logging/0.log"
Jul 06 19:26:06.403524 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:06.403500    2555 generic.go:356] "Generic (PLEG): container finished" podID="bb750a78-aa1e-4c55-b771-e06ca00b997a" containerID="3c4b5ad4e84e6ff83577b253da039dbf6c7d1c981bac84be3810edf58811a83e" exitCode=1
Jul 06 19:26:06.403624 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:06.403570    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk" event={"ID":"bb750a78-aa1e-4c55-b771-e06ca00b997a","Type":"ContainerStarted","Data":"fa4d7fe35f557b94c5327bbb710927538d80251da4f4aad80ea93dba3e1955ec"}
Jul 06 19:26:06.403670 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:06.403646    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk" event={"ID":"bb750a78-aa1e-4c55-b771-e06ca00b997a","Type":"ContainerStarted","Data":"4770d3300b93443347e337b86fcd0d550cf1b8890f404082677f3619529fac7d"}
Jul 06 19:26:06.403709 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:06.403698    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk" event={"ID":"bb750a78-aa1e-4c55-b771-e06ca00b997a","Type":"ContainerStarted","Data":"964180c3d6d9478bcefab94a29370b92c769605428a596c414cd15b8a4e19c71"}
Jul 06 19:26:06.403763 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:06.403750    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk" event={"ID":"bb750a78-aa1e-4c55-b771-e06ca00b997a","Type":"ContainerStarted","Data":"914d19e5f4f88856ce285bf16ee6340df0987482e16e016236e059548c88120f"}
Jul 06 19:26:06.403802 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:06.403795    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk" event={"ID":"bb750a78-aa1e-4c55-b771-e06ca00b997a","Type":"ContainerDied","Data":"3c4b5ad4e84e6ff83577b253da039dbf6c7d1c981bac84be3810edf58811a83e"}
Jul 06 19:26:06.403856 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:06.403843    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk" event={"ID":"bb750a78-aa1e-4c55-b771-e06ca00b997a","Type":"ContainerStarted","Data":"1ea9e03f7af48e3f460004e01c51e6d7a3c203b41cf6644bc86e51bc6de4ecb6"}
Jul 06 19:26:06.404902 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:06.404884    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4v5kp" event={"ID":"37610e93-f90e-40e9-b80c-816b07d688d0","Type":"ContainerStarted","Data":"4a100bc0c25ab2f2d724c61e5508af67ef55ce45bf07fc5762f5f43c99a2f40f"}
Jul 06 19:26:06.406113 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:06.406095    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5d2dt" event={"ID":"e8893200-b607-4e1e-8a6c-fb4a31110947","Type":"ContainerStarted","Data":"a07b50748035a963e02c5d2354bf4b59ee34704ec8996b70755d8b242df4ca3a"}
Jul 06 19:26:06.407455 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:06.407431    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-150.ec2.internal" event={"ID":"eb580d2521422f06e4ec1bc19d959bbf","Type":"ContainerStarted","Data":"7b3e4f8739514c7fe4b78e8b2af308d83b0fd600ae33b2bc775c95488fdd3fca"}
Jul 06 19:26:06.408953 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:06.408933    2555 generic.go:356] "Generic (PLEG): container finished" podID="c460faf59ce7ef5c8a2e42034e3e25e2" containerID="9a630df69c9f5d069b98e1829a003c03a7af6f4e10f9d3b40bfac34dc6f3f4b3" exitCode=0
Jul 06 19:26:06.409028 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:06.408960    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal" event={"ID":"c460faf59ce7ef5c8a2e42034e3e25e2","Type":"ContainerDied","Data":"9a630df69c9f5d069b98e1829a003c03a7af6f4e10f9d3b40bfac34dc6f3f4b3"}
Jul 06 19:26:06.445876 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:06.445706    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-150.ec2.internal" podStartSLOduration=21.445683195 podStartE2EDuration="21.445683195s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:06.44409406 +0000 UTC m=+24.220127460" watchObservedRunningTime="2026-07-06 19:26:06.445683195 +0000 UTC m=+24.221716596"
Jul 06 19:26:06.473678 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:06.473596    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qxsxj" podStartSLOduration=2.5215779080000003 podStartE2EDuration="22.473570471s" totalImagesPullingTime="19.951992563s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:06.472561859 +0000 UTC m=+24.248595259" watchObservedRunningTime="2026-07-06 19:26:06.473570471 +0000 UTC m=+24.249603872"
Jul 06 19:26:06.493577 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:06.493526    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5d2dt" podStartSLOduration=2.483644623 podStartE2EDuration="22.493509895s" totalImagesPullingTime="20.009865272s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:06.493424417 +0000 UTC m=+24.269457838" watchObservedRunningTime="2026-07-06 19:26:06.493509895 +0000 UTC m=+24.269543294"
Jul 06 19:26:06.522869 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:06.522816    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qtvrs" podStartSLOduration=2.6568399129999998 podStartE2EDuration="22.522799389s" totalImagesPullingTime="19.865959476s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:06.522316088 +0000 UTC m=+24.298349487" watchObservedRunningTime="2026-07-06 19:26:06.522799389 +0000 UTC m=+24.298832787"
Jul 06 19:26:06.570582 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:06.570550    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7tzh4"
Jul 06 19:26:06.571053 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:06.571037    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7tzh4"
Jul 06 19:26:06.602798 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:06.602743    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4v5kp" podStartSLOduration=2.049862014 podStartE2EDuration="22.602724356s" totalImagesPullingTime="20.552862342s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:06.602154075 +0000 UTC m=+24.378187474" watchObservedRunningTime="2026-07-06 19:26:06.602724356 +0000 UTC m=+24.378757755"
Jul 06 19:26:06.653023 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:06.652977    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7tzh4" podStartSLOduration=7.186377816 podStartE2EDuration="22.652957791s" totalImagesPullingTime="15.466579975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:25:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:06.652800732 +0000 UTC m=+24.428834131" watchObservedRunningTime="2026-07-06 19:26:06.652957791 +0000 UTC m=+24.428991223"
Jul 06 19:26:07.124135 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:07.124100    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmfn2"
Jul 06 19:26:07.124316 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:07.124100    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btzb4"
Jul 06 19:26:07.124316 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:07.124229    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmfn2" podUID="42fc94d7-0161-4334-85d2-5f0df8456dec"
Jul 06 19:26:07.124316 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:07.124243    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tcbq"
Jul 06 19:26:07.124479 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:07.124333    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btzb4" podUID="0acb06f4-a973-4679-99e1-d7a44e7286ae"
Jul 06 19:26:07.124479 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:07.124427    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tcbq" podUID="e3f7af2d-5d72-4c10-88c4-44a193ad2b32"
Jul 06 19:26:07.413713 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:07.413619    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dpp5t" event={"ID":"0d8c8a73-34a0-4e58-baf5-a96837c2bc6a","Type":"ContainerStarted","Data":"a51e48d15a9b72dadd2ce0ea7d9dbb7b2901923214dcc1294b50cc61abca1380"}
Jul 06 19:26:07.415968 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:07.415933    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal" event={"ID":"c460faf59ce7ef5c8a2e42034e3e25e2","Type":"ContainerStarted","Data":"6593f3a88f5b586af739065587b373ed42f8554561f8d577ffd3686fccbd72b7"}
Jul 06 19:26:07.416672 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:07.416639    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7tzh4"
Jul 06 19:26:07.417196 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:07.417175    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7tzh4"
Jul 06 19:26:07.491152 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:07.491102    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dpp5t" podStartSLOduration=3.58310527 podStartE2EDuration="23.491083634s" totalImagesPullingTime="19.907978364s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:07.48568525 +0000 UTC m=+25.261718649" watchObservedRunningTime="2026-07-06 19:26:07.491083634 +0000 UTC m=+25.267117033"
Jul 06 19:26:07.541375 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:07.541323    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-150.ec2.internal" podStartSLOduration=22.541303829 podStartE2EDuration="22.541303829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:07.540750061 +0000 UTC m=+25.316783488" watchObservedRunningTime="2026-07-06 19:26:07.541303829 +0000 UTC m=+25.317337228"
Jul 06 19:26:07.750360 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:07.750333    2555 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 06 19:26:08.093433 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:08.093324    2555 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T19:26:07.750350393Z","UUID":"2c879b6f-8c91-4bf4-8a0b-502c36c726c4","Handler":null,"Name":"","Endpoint":""}
Jul 06 19:26:08.095680 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:08.095652    2555 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 06 19:26:08.095822 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:08.095710    2555 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 06 19:26:08.420752 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:08.420714    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqx4" event={"ID":"7c732599-67dd-4c7a-9966-0d4f497a8e1d","Type":"ContainerStarted","Data":"4684929f59502d892a0665f894fd1653c78c190def04ebef4e831812074a8462"}
Jul 06 19:26:08.424873 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:08.424848    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j9wtk_bb750a78-aa1e-4c55-b771-e06ca00b997a/ovn-acl-logging/0.log"
Jul 06 19:26:08.426046 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:08.425554    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk" event={"ID":"bb750a78-aa1e-4c55-b771-e06ca00b997a","Type":"ContainerStarted","Data":"b2aaab142505db3d5aaf2fe3f7d58cac1acbf4933817ee15c733849e748d6d84"}
Jul 06 19:26:09.124897 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:09.124860    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmfn2"
Jul 06 19:26:09.125100 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:09.124860    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btzb4"
Jul 06 19:26:09.125100 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:09.124985    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmfn2" podUID="42fc94d7-0161-4334-85d2-5f0df8456dec"
Jul 06 19:26:09.125249 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:09.125112    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btzb4" podUID="0acb06f4-a973-4679-99e1-d7a44e7286ae"
Jul 06 19:26:09.125249 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:09.124880    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tcbq"
Jul 06 19:26:09.125350 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:09.125265    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tcbq" podUID="e3f7af2d-5d72-4c10-88c4-44a193ad2b32"
Jul 06 19:26:09.429969 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:09.429927    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqx4" event={"ID":"7c732599-67dd-4c7a-9966-0d4f497a8e1d","Type":"ContainerStarted","Data":"077a83e18de958fada952a5c4f6ae8ba1bb27528beb74ec9de6a35802c571f7c"}
Jul 06 19:26:09.458016 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:09.457964    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqx4" podStartSLOduration=3.084480602 podStartE2EDuration="25.457946529s" totalImagesPullingTime="22.373465927s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:09.457397653 +0000 UTC m=+27.233431092" watchObservedRunningTime="2026-07-06 19:26:09.457946529 +0000 UTC m=+27.233979928"
Jul 06 19:26:11.125028 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:11.124847    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmfn2"
Jul 06 19:26:11.125729 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:11.125135    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmfn2" podUID="42fc94d7-0161-4334-85d2-5f0df8456dec"
Jul 06 19:26:11.125729 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:11.124847    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btzb4"
Jul 06 19:26:11.125729 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:11.124872    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tcbq"
Jul 06 19:26:11.125729 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:11.125235    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btzb4" podUID="0acb06f4-a973-4679-99e1-d7a44e7286ae"
Jul 06 19:26:11.125729 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:11.125342    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tcbq" podUID="e3f7af2d-5d72-4c10-88c4-44a193ad2b32"
Jul 06 19:26:11.436214 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:11.436180    2555 generic.go:356] "Generic (PLEG): container finished" podID="40d45d9f-54f3-4736-b359-b43fc6af5535" containerID="6cfe426d62901f21ea0a7bd8f060375ee8a9a2930bbd28d46c2171001d7a8e4c" exitCode=0
Jul 06 19:26:11.436415 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:11.436266    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h5prb" event={"ID":"40d45d9f-54f3-4736-b359-b43fc6af5535","Type":"ContainerDied","Data":"6cfe426d62901f21ea0a7bd8f060375ee8a9a2930bbd28d46c2171001d7a8e4c"}
Jul 06 19:26:11.439875 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:11.439856    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j9wtk_bb750a78-aa1e-4c55-b771-e06ca00b997a/ovn-acl-logging/0.log"
Jul 06 19:26:11.440263 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:11.440234    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk" event={"ID":"bb750a78-aa1e-4c55-b771-e06ca00b997a","Type":"ContainerStarted","Data":"50e31190c1fdd0751394bc2c4bff19ff4214d9e784aac2d8e9dc867357fe9dba"}
Jul 06 19:26:11.440493 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:11.440478    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:26:11.440630 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:11.440608    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:26:11.440687 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:11.440637    2555 scope.go:117] "RemoveContainer" containerID="3c4b5ad4e84e6ff83577b253da039dbf6c7d1c981bac84be3810edf58811a83e"
Jul 06 19:26:11.440743 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:11.440692    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:26:11.456395 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:11.456371    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:26:11.456502 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:11.456484    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:26:12.446552 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:12.446386    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j9wtk_bb750a78-aa1e-4c55-b771-e06ca00b997a/ovn-acl-logging/0.log"
Jul 06 19:26:12.447152 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:12.446939    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk" event={"ID":"bb750a78-aa1e-4c55-b771-e06ca00b997a","Type":"ContainerStarted","Data":"bd888083abb022e72bc29b1ac5bb8782662aee1dd1f208d89e4033f3fa54e28c"}
Jul 06 19:26:12.475163 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:12.475107    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk" podStartSLOduration=8.200743516 podStartE2EDuration="28.475090069s" totalImagesPullingTime="20.274346553s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:12.473700708 +0000 UTC m=+30.249734107" watchObservedRunningTime="2026-07-06 19:26:12.475090069 +0000 UTC m=+30.251123467"
Jul 06 19:26:13.123887 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:13.123855    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btzb4"
Jul 06 19:26:13.124169 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:13.123855    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmfn2"
Jul 06 19:26:13.124169 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:13.123855    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tcbq"
Jul 06 19:26:13.124169 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:13.124004    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btzb4" podUID="0acb06f4-a973-4679-99e1-d7a44e7286ae"
Jul 06 19:26:13.124169 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:13.124107    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tcbq" podUID="e3f7af2d-5d72-4c10-88c4-44a193ad2b32"
Jul 06 19:26:13.124169 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:13.124163    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmfn2" podUID="42fc94d7-0161-4334-85d2-5f0df8456dec"
Jul 06 19:26:13.152720 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:13.152684    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9tcbq"]
Jul 06 19:26:13.155155 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:13.155125    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-btzb4"]
Jul 06 19:26:13.155905 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:13.155882    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pmfn2"]
Jul 06 19:26:13.451310 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:13.451229    2555 generic.go:356] "Generic (PLEG): container finished" podID="40d45d9f-54f3-4736-b359-b43fc6af5535" containerID="8da7a05f135d24662b8a775dc111498bc7cfbcdb6d61c6fa7cc1c9514ca39581" exitCode=0
Jul 06 19:26:13.451735 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:13.451328    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h5prb" event={"ID":"40d45d9f-54f3-4736-b359-b43fc6af5535","Type":"ContainerDied","Data":"8da7a05f135d24662b8a775dc111498bc7cfbcdb6d61c6fa7cc1c9514ca39581"}
Jul 06 19:26:13.451735 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:13.451349    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmfn2"
Jul 06 19:26:13.451735 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:13.451452    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmfn2" podUID="42fc94d7-0161-4334-85d2-5f0df8456dec"
Jul 06 19:26:13.451735 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:13.451506    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tcbq"
Jul 06 19:26:13.451735 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:13.451579    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tcbq" podUID="e3f7af2d-5d72-4c10-88c4-44a193ad2b32"
Jul 06 19:26:13.451735 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:13.451595    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btzb4"
Jul 06 19:26:13.451735 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:13.451684    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btzb4" podUID="0acb06f4-a973-4679-99e1-d7a44e7286ae"
Jul 06 19:26:15.123973 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:15.123868    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmfn2"
Jul 06 19:26:15.123973 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:15.123936    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btzb4"
Jul 06 19:26:15.124367 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:15.123888    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tcbq"
Jul 06 19:26:15.124367 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:15.124036    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmfn2" podUID="42fc94d7-0161-4334-85d2-5f0df8456dec"
Jul 06 19:26:15.124367 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:15.124100    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tcbq" podUID="e3f7af2d-5d72-4c10-88c4-44a193ad2b32"
Jul 06 19:26:15.124367 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:15.124171    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btzb4" podUID="0acb06f4-a973-4679-99e1-d7a44e7286ae"
Jul 06 19:26:15.458878 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:15.458782    2555 generic.go:356] "Generic (PLEG): container finished" podID="40d45d9f-54f3-4736-b359-b43fc6af5535" containerID="7cfddebabda82eb69cc70d288c0076e8e01f87370cd73bf9b8ae06408fb7b3d7" exitCode=0
Jul 06 19:26:15.458878 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:15.458859    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h5prb" event={"ID":"40d45d9f-54f3-4736-b359-b43fc6af5535","Type":"ContainerDied","Data":"7cfddebabda82eb69cc70d288c0076e8e01f87370cd73bf9b8ae06408fb7b3d7"}
Jul 06 19:26:16.877263 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:16.877228    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f7af2d-5d72-4c10-88c4-44a193ad2b32-metrics-certs\") pod \"network-metrics-daemon-9tcbq\" (UID: \"e3f7af2d-5d72-4c10-88c4-44a193ad2b32\") " pod="openshift-multus/network-metrics-daemon-9tcbq"
Jul 06 19:26:16.877706 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:16.877269    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0acb06f4-a973-4679-99e1-d7a44e7286ae-original-pull-secret\") pod \"global-pull-secret-syncer-btzb4\" (UID: \"0acb06f4-a973-4679-99e1-d7a44e7286ae\") " pod="kube-system/global-pull-secret-syncer-btzb4"
Jul 06 19:26:16.877706 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:16.877370    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r46bx\" (UniqueName: \"kubernetes.io/projected/42fc94d7-0161-4334-85d2-5f0df8456dec-kube-api-access-r46bx\") pod \"network-check-target-pmfn2\" (UID: \"42fc94d7-0161-4334-85d2-5f0df8456dec\") " pod="openshift-network-diagnostics/network-check-target-pmfn2"
Jul 06 19:26:16.877706 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:16.877386    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:26:16.877706 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:16.877394    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:26:16.877706 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:16.877444    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0acb06f4-a973-4679-99e1-d7a44e7286ae-original-pull-secret podName:0acb06f4-a973-4679-99e1-d7a44e7286ae nodeName:}" failed. No retries permitted until 2026-07-06 19:26:48.877425698 +0000 UTC m=+66.653459095 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0acb06f4-a973-4679-99e1-d7a44e7286ae-original-pull-secret") pod "global-pull-secret-syncer-btzb4" (UID: "0acb06f4-a973-4679-99e1-d7a44e7286ae") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:26:16.877706 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:16.877462    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3f7af2d-5d72-4c10-88c4-44a193ad2b32-metrics-certs podName:e3f7af2d-5d72-4c10-88c4-44a193ad2b32 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:48.877454106 +0000 UTC m=+66.653487489 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3f7af2d-5d72-4c10-88c4-44a193ad2b32-metrics-certs") pod "network-metrics-daemon-9tcbq" (UID: "e3f7af2d-5d72-4c10-88c4-44a193ad2b32") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:26:16.877706 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:16.877483    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:26:16.877706 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:16.877497    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:26:16.877706 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:16.877508    2555 projected.go:196] Error preparing data for projected volume kube-api-access-r46bx for pod openshift-network-diagnostics/network-check-target-pmfn2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:26:16.877706 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:16.877553    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/42fc94d7-0161-4334-85d2-5f0df8456dec-kube-api-access-r46bx podName:42fc94d7-0161-4334-85d2-5f0df8456dec nodeName:}" failed. No retries permitted until 2026-07-06 19:26:48.877542032 +0000 UTC m=+66.653575414 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-r46bx" (UniqueName: "kubernetes.io/projected/42fc94d7-0161-4334-85d2-5f0df8456dec-kube-api-access-r46bx") pod "network-check-target-pmfn2" (UID: "42fc94d7-0161-4334-85d2-5f0df8456dec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:26:17.124489 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:17.124454    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmfn2"
Jul 06 19:26:17.124681 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:17.124502    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btzb4"
Jul 06 19:26:17.124681 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:17.124461    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tcbq"
Jul 06 19:26:17.124681 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:17.124583    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmfn2" podUID="42fc94d7-0161-4334-85d2-5f0df8456dec"
Jul 06 19:26:17.124831 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:17.124675    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tcbq" podUID="e3f7af2d-5d72-4c10-88c4-44a193ad2b32"
Jul 06 19:26:17.124831 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:17.124757    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-btzb4" podUID="0acb06f4-a973-4679-99e1-d7a44e7286ae"
Jul 06 19:26:18.906521 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:18.906492    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-150.ec2.internal" event="NodeReady"
Jul 06 19:26:18.906963 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:18.906667    2555 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 06 19:26:18.968274 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:18.968241    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6cb4b4f47d-cwsdp"]
Jul 06 19:26:18.971088 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:18.971057    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cb4b4f47d-cwsdp"
Jul 06 19:26:18.974548 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:18.974522    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 06 19:26:18.974759 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:18.974742    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 06 19:26:18.974847 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:18.974831    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qgt64\""
Jul 06 19:26:18.975160 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:18.975140    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 06 19:26:18.976341 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:18.976322    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dfc5bf74-cckf5"]
Jul 06 19:26:18.978659 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:18.978641    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dfc5bf74-cckf5"
Jul 06 19:26:18.978760 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:18.978728    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb69c4684-sgg6d"]
Jul 06 19:26:18.980779 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:18.980754    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb69c4684-sgg6d"
Jul 06 19:26:18.982517 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:18.982495    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 06 19:26:18.991618 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:18.991594    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9b6d97c5-lcx5d"]
Jul 06 19:26:18.993559 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:18.993539    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9b6d97c5-lcx5d"
Jul 06 19:26:18.999648 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:18.999622    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb69c4684-sgg6d"]
Jul 06 19:26:19.006502 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.006481    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 06 19:26:19.007150 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.006749    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 06 19:26:19.007150 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.006807    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 06 19:26:19.007150 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.006881    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 06 19:26:19.007150 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.006882    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 06 19:26:19.007150 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.006904    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 06 19:26:19.007150 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.006983    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-99n4h\""
Jul 06 19:26:19.007150 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.006817    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 06 19:26:19.008892 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.008873    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 06 19:26:19.010266 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.010249    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 06 19:26:19.050482 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.050385    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9b6d97c5-lcx5d"]
Jul 06 19:26:19.051359 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.051313    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6cb4b4f47d-cwsdp"]
Jul 06 19:26:19.052057 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.052036    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dfc5bf74-cckf5"]
Jul 06 19:26:19.054394 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.054364    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kzrzz"]
Jul 06 19:26:19.056588 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.056567    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kzrzz"
Jul 06 19:26:19.060196 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.060159    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 19:26:19.060681 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.060662    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qpv6m"]
Jul 06 19:26:19.060801 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.060728    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cjqsb\""
Jul 06 19:26:19.060801 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.060760    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 19:26:19.062598 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.062579    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qpv6m"
Jul 06 19:26:19.065730 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.065712    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-sttlx\""
Jul 06 19:26:19.065877 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.065840    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 19:26:19.065877 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.065846    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 19:26:19.066023 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.065936    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 19:26:19.076789 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.076764    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qpv6m"]
Jul 06 19:26:19.077589 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.077567    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kzrzz"]
Jul 06 19:26:19.092279 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.092244    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm9lm\" (UniqueName: \"kubernetes.io/projected/01d573f1-6d26-429c-b077-906718bd0625-kube-api-access-tm9lm\") pod \"image-registry-6cb4b4f47d-cwsdp\" (UID: \"01d573f1-6d26-429c-b077-906718bd0625\") " pod="openshift-image-registry/image-registry-6cb4b4f47d-cwsdp"
Jul 06 19:26:19.092279 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.092288    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2zr6\" (UniqueName: \"kubernetes.io/projected/c8b8ef69-09a9-410c-945a-b6388e09574a-kube-api-access-p2zr6\") pod \"managed-serviceaccount-addon-agent-7cb69c4684-sgg6d\" (UID: \"c8b8ef69-09a9-410c-945a-b6388e09574a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb69c4684-sgg6d"
Jul 06 19:26:19.092519 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.092320    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/01d573f1-6d26-429c-b077-906718bd0625-registry-certificates\") pod \"image-registry-6cb4b4f47d-cwsdp\" (UID: \"01d573f1-6d26-429c-b077-906718bd0625\") " pod="openshift-image-registry/image-registry-6cb4b4f47d-cwsdp"
Jul 06 19:26:19.092519 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.092351    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xrcj\" (UniqueName: \"kubernetes.io/projected/b8dc533e-a04d-4f28-813b-c1ff07e8e23a-kube-api-access-7xrcj\") pod \"cluster-proxy-proxy-agent-77dfc5bf74-cckf5\" (UID: \"b8dc533e-a04d-4f28-813b-c1ff07e8e23a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dfc5bf74-cckf5"
Jul 06 19:26:19.092519 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.092378    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/01d573f1-6d26-429c-b077-906718bd0625-bound-sa-token\") pod \"image-registry-6cb4b4f47d-cwsdp\" (UID: \"01d573f1-6d26-429c-b077-906718bd0625\") " pod="openshift-image-registry/image-registry-6cb4b4f47d-cwsdp"
Jul 06 19:26:19.092519 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.092499    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b8dc533e-a04d-4f28-813b-c1ff07e8e23a-ca\") pod \"cluster-proxy-proxy-agent-77dfc5bf74-cckf5\" (UID: \"b8dc533e-a04d-4f28-813b-c1ff07e8e23a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dfc5bf74-cckf5"
Jul 06 19:26:19.092679 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.092534    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3514e05c-eb46-42d8-9f78-01849346fca5-tmp\") pod \"klusterlet-addon-workmgr-7b9b6d97c5-lcx5d\" (UID: \"3514e05c-eb46-42d8-9f78-01849346fca5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9b6d97c5-lcx5d"
Jul 06 19:26:19.092679 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.092574    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b8dc533e-a04d-4f28-813b-c1ff07e8e23a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-77dfc5bf74-cckf5\" (UID: \"b8dc533e-a04d-4f28-813b-c1ff07e8e23a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dfc5bf74-cckf5"
Jul 06 19:26:19.092679 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.092624    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3514e05c-eb46-42d8-9f78-01849346fca5-klusterlet-config\") pod \"klusterlet-addon-workmgr-7b9b6d97c5-lcx5d\" (UID: \"3514e05c-eb46-42d8-9f78-01849346fca5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9b6d97c5-lcx5d"
Jul 06 19:26:19.092812 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.092673    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8dc533e-a04d-4f28-813b-c1ff07e8e23a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-77dfc5bf74-cckf5\" (UID: \"b8dc533e-a04d-4f28-813b-c1ff07e8e23a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dfc5bf74-cckf5"
Jul 06 19:26:19.092812 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.092739    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/01d573f1-6d26-429c-b077-906718bd0625-image-registry-private-configuration\") pod \"image-registry-6cb4b4f47d-cwsdp\" (UID: \"01d573f1-6d26-429c-b077-906718bd0625\") " pod="openshift-image-registry/image-registry-6cb4b4f47d-cwsdp"
Jul 06 19:26:19.092812 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.092773    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/01d573f1-6d26-429c-b077-906718bd0625-trusted-ca\") pod \"image-registry-6cb4b4f47d-cwsdp\" (UID: \"01d573f1-6d26-429c-b077-906718bd0625\") " pod="openshift-image-registry/image-registry-6cb4b4f47d-cwsdp"
Jul 06 19:26:19.092812 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.092796    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9z2q2\" (UniqueName: \"kubernetes.io/projected/3514e05c-eb46-42d8-9f78-01849346fca5-kube-api-access-9z2q2\") pod \"klusterlet-addon-workmgr-7b9b6d97c5-lcx5d\" (UID: \"3514e05c-eb46-42d8-9f78-01849346fca5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9b6d97c5-lcx5d"
Jul 06 19:26:19.093087 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.092872    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/01d573f1-6d26-429c-b077-906718bd0625-registry-tls\") pod \"image-registry-6cb4b4f47d-cwsdp\" (UID: \"01d573f1-6d26-429c-b077-906718bd0625\") " pod="openshift-image-registry/image-registry-6cb4b4f47d-cwsdp"
Jul 06 19:26:19.093087 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.092899    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b8dc533e-a04d-4f28-813b-c1ff07e8e23a-hub\") pod \"cluster-proxy-proxy-agent-77dfc5bf74-cckf5\" (UID: \"b8dc533e-a04d-4f28-813b-c1ff07e8e23a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dfc5bf74-cckf5"
Jul 06 19:26:19.093087 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.092962    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b8dc533e-a04d-4f28-813b-c1ff07e8e23a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-77dfc5bf74-cckf5\" (UID: \"b8dc533e-a04d-4f28-813b-c1ff07e8e23a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dfc5bf74-cckf5"
Jul 06 19:26:19.093087 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.093029    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/01d573f1-6d26-429c-b077-906718bd0625-ca-trust-extracted\") pod \"image-registry-6cb4b4f47d-cwsdp\" (UID: \"01d573f1-6d26-429c-b077-906718bd0625\") " pod="openshift-image-registry/image-registry-6cb4b4f47d-cwsdp"
Jul 06 19:26:19.093087 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.093059    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/01d573f1-6d26-429c-b077-906718bd0625-installation-pull-secrets\") pod \"image-registry-6cb4b4f47d-cwsdp\" (UID: \"01d573f1-6d26-429c-b077-906718bd0625\") " pod="openshift-image-registry/image-registry-6cb4b4f47d-cwsdp"
Jul 06 19:26:19.093270 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.093089    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c8b8ef69-09a9-410c-945a-b6388e09574a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7cb69c4684-sgg6d\" (UID: \"c8b8ef69-09a9-410c-945a-b6388e09574a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb69c4684-sgg6d"
Jul 06 19:26:19.124197 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.124160    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tcbq"
Jul 06 19:26:19.124197 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.124198    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btzb4"
Jul 06 19:26:19.124446 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.124203    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmfn2"
Jul 06 19:26:19.128552 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.128526    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 19:26:19.128704 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.128573    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 19:26:19.128758 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.128703    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 19:26:19.128758 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.128703    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 19:26:19.128860 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.128841    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x44r2\""
Jul 06 19:26:19.128980 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.128967    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kmvz5\""
Jul 06 19:26:19.194182 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.194089    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/01d573f1-6d26-429c-b077-906718bd0625-bound-sa-token\") pod \"image-registry-6cb4b4f47d-cwsdp\" (UID: \"01d573f1-6d26-429c-b077-906718bd0625\") " pod="openshift-image-registry/image-registry-6cb4b4f47d-cwsdp"
Jul 06 19:26:19.194182 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.194135    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvt4l\" (UniqueName: \"kubernetes.io/projected/55eea3e5-2d23-4877-a59c-99fb920ff42e-kube-api-access-qvt4l\") pod \"ingress-canary-qpv6m\" (UID: \"55eea3e5-2d23-4877-a59c-99fb920ff42e\") " pod="openshift-ingress-canary/ingress-canary-qpv6m"
Jul 06 19:26:19.194182 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.194169    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b8dc533e-a04d-4f28-813b-c1ff07e8e23a-ca\") pod \"cluster-proxy-proxy-agent-77dfc5bf74-cckf5\" (UID: \"b8dc533e-a04d-4f28-813b-c1ff07e8e23a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dfc5bf74-cckf5"
Jul 06 19:26:19.194458 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.194293    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3514e05c-eb46-42d8-9f78-01849346fca5-tmp\") pod \"klusterlet-addon-workmgr-7b9b6d97c5-lcx5d\" (UID: \"3514e05c-eb46-42d8-9f78-01849346fca5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9b6d97c5-lcx5d"
Jul 06 19:26:19.194458 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.194335    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b8dc533e-a04d-4f28-813b-c1ff07e8e23a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-77dfc5bf74-cckf5\" (UID: \"b8dc533e-a04d-4f28-813b-c1ff07e8e23a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dfc5bf74-cckf5"
Jul 06 19:26:19.194458 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.194385    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3514e05c-eb46-42d8-9f78-01849346fca5-klusterlet-config\") pod \"klusterlet-addon-workmgr-7b9b6d97c5-lcx5d\" (UID: \"3514e05c-eb46-42d8-9f78-01849346fca5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9b6d97c5-lcx5d"
Jul 06 19:26:19.194458 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.194407    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8dc533e-a04d-4f28-813b-c1ff07e8e23a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-77dfc5bf74-cckf5\" (UID: \"b8dc533e-a04d-4f28-813b-c1ff07e8e23a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dfc5bf74-cckf5"
Jul 06 19:26:19.194458 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.194434    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55eea3e5-2d23-4877-a59c-99fb920ff42e-cert\") pod \"ingress-canary-qpv6m\" (UID: \"55eea3e5-2d23-4877-a59c-99fb920ff42e\") " pod="openshift-ingress-canary/ingress-canary-qpv6m"
Jul 06 19:26:19.194458 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.194454    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmdrv\" (UniqueName: \"kubernetes.io/projected/d8f4fbdd-f51d-47be-9c53-d613bd801d28-kube-api-access-xmdrv\") pod \"dns-default-kzrzz\" (UID: \"d8f4fbdd-f51d-47be-9c53-d613bd801d28\") " pod="openshift-dns/dns-default-kzrzz"
Jul 06 19:26:19.194760 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.194487    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/01d573f1-6d26-429c-b077-906718bd0625-image-registry-private-configuration\") pod \"image-registry-6cb4b4f47d-cwsdp\" (UID: \"01d573f1-6d26-429c-b077-906718bd0625\") " pod="openshift-image-registry/image-registry-6cb4b4f47d-cwsdp"
Jul 06 19:26:19.194760 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.194509    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/01d573f1-6d26-429c-b077-906718bd0625-trusted-ca\") pod \"image-registry-6cb4b4f47d-cwsdp\" (UID: \"01d573f1-6d26-429c-b077-906718bd0625\") " pod="openshift-image-registry/image-registry-6cb4b4f47d-cwsdp"
Jul 06 19:26:19.194760 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.194524    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9z2q2\" (UniqueName: \"kubernetes.io/projected/3514e05c-eb46-42d8-9f78-01849346fca5-kube-api-access-9z2q2\") pod \"klusterlet-addon-workmgr-7b9b6d97c5-lcx5d\" (UID: \"3514e05c-eb46-42d8-9f78-01849346fca5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9b6d97c5-lcx5d"
Jul 06 19:26:19.194760 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.194563    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/01d573f1-6d26-429c-b077-906718bd0625-registry-tls\") pod \"image-registry-6cb4b4f47d-cwsdp\" (UID: \"01d573f1-6d26-429c-b077-906718bd0625\") " pod="openshift-image-registry/image-registry-6cb4b4f47d-cwsdp"
Jul 06 19:26:19.194760 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.194583    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b8dc533e-a04d-4f28-813b-c1ff07e8e23a-hub\") pod \"cluster-proxy-proxy-agent-77dfc5bf74-cckf5\" (UID: \"b8dc533e-a04d-4f28-813b-c1ff07e8e23a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dfc5bf74-cckf5"
Jul 06 19:26:19.194760 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.194607    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b8dc533e-a04d-4f28-813b-c1ff07e8e23a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-77dfc5bf74-cckf5\" (UID: \"b8dc533e-a04d-4f28-813b-c1ff07e8e23a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dfc5bf74-cckf5"
Jul 06 19:26:19.194760 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.194629    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8f4fbdd-f51d-47be-9c53-d613bd801d28-tmp-dir\") pod \"dns-default-kzrzz\" (UID: \"d8f4fbdd-f51d-47be-9c53-d613bd801d28\") " pod="openshift-dns/dns-default-kzrzz"
Jul 06 19:26:19.194760 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.194650    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/01d573f1-6d26-429c-b077-906718bd0625-ca-trust-extracted\") pod \"image-registry-6cb4b4f47d-cwsdp\" (UID: \"01d573f1-6d26-429c-b077-906718bd0625\") " pod="openshift-image-registry/image-registry-6cb4b4f47d-cwsdp"
Jul 06 19:26:19.194760 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.194666    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/01d573f1-6d26-429c-b077-906718bd0625-installation-pull-secrets\") pod \"image-registry-6cb4b4f47d-cwsdp\" (UID: \"01d573f1-6d26-429c-b077-906718bd0625\") " pod="openshift-image-registry/image-registry-6cb4b4f47d-cwsdp"
Jul 06 19:26:19.194760 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.194683    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c8b8ef69-09a9-410c-945a-b6388e09574a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7cb69c4684-sgg6d\" (UID: \"c8b8ef69-09a9-410c-945a-b6388e09574a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb69c4684-sgg6d"
Jul 06 19:26:19.194760 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.194733    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm9lm\" (UniqueName: \"kubernetes.io/projected/01d573f1-6d26-429c-b077-906718bd0625-kube-api-access-tm9lm\") pod \"image-registry-6cb4b4f47d-cwsdp\" (UID: \"01d573f1-6d26-429c-b077-906718bd0625\") " pod="openshift-image-registry/image-registry-6cb4b4f47d-cwsdp"
Jul 06 19:26:19.194760 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.194750    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2zr6\" (UniqueName: \"kubernetes.io/projected/c8b8ef69-09a9-410c-945a-b6388e09574a-kube-api-access-p2zr6\") pod \"managed-serviceaccount-addon-agent-7cb69c4684-sgg6d\" (UID: \"c8b8ef69-09a9-410c-945a-b6388e09574a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb69c4684-sgg6d"
Jul 06 19:26:19.195322 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.194766    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d8f4fbdd-f51d-47be-9c53-d613bd801d28-config-volume\") pod \"dns-default-kzrzz\" (UID: \"d8f4fbdd-f51d-47be-9c53-d613bd801d28\") " pod="openshift-dns/dns-default-kzrzz"
Jul 06 19:26:19.195322 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.194789    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/01d573f1-6d26-429c-b077-906718bd0625-registry-certificates\") pod \"image-registry-6cb4b4f47d-cwsdp\" (UID: \"01d573f1-6d26-429c-b077-906718bd0625\") " pod="openshift-image-registry/image-registry-6cb4b4f47d-cwsdp"
Jul 06 19:26:19.195322 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.194806    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xrcj\" (UniqueName: \"kubernetes.io/projected/b8dc533e-a04d-4f28-813b-c1ff07e8e23a-kube-api-access-7xrcj\") pod \"cluster-proxy-proxy-agent-77dfc5bf74-cckf5\" (UID: \"b8dc533e-a04d-4f28-813b-c1ff07e8e23a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dfc5bf74-cckf5"
Jul 06 19:26:19.195322 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.194827    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8f4fbdd-f51d-47be-9c53-d613bd801d28-metrics-tls\") pod \"dns-default-kzrzz\" (UID: \"d8f4fbdd-f51d-47be-9c53-d613bd801d28\") " pod="openshift-dns/dns-default-kzrzz"
Jul 06 19:26:19.195322 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.194853    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3514e05c-eb46-42d8-9f78-01849346fca5-tmp\") pod \"klusterlet-addon-workmgr-7b9b6d97c5-lcx5d\" (UID: \"3514e05c-eb46-42d8-9f78-01849346fca5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9b6d97c5-lcx5d"
Jul 06 19:26:19.195322 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:19.195256    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:26:19.195322 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:19.195276    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cb4b4f47d-cwsdp: secret "image-registry-tls" not found
Jul 06 19:26:19.195646 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:19.195331    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/01d573f1-6d26-429c-b077-906718bd0625-registry-tls podName:01d573f1-6d26-429c-b077-906718bd0625 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:19.695311147 +0000 UTC m=+37.471344538 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/01d573f1-6d26-429c-b077-906718bd0625-registry-tls") pod "image-registry-6cb4b4f47d-cwsdp" (UID: "01d573f1-6d26-429c-b077-906718bd0625") : secret "image-registry-tls" not found
Jul 06 19:26:19.195646 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.195521    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8dc533e-a04d-4f28-813b-c1ff07e8e23a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-77dfc5bf74-cckf5\" (UID: \"b8dc533e-a04d-4f28-813b-c1ff07e8e23a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dfc5bf74-cckf5"
Jul 06 19:26:19.197960 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.196286    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/01d573f1-6d26-429c-b077-906718bd0625-registry-certificates\") pod \"image-registry-6cb4b4f47d-cwsdp\" (UID: \"01d573f1-6d26-429c-b077-906718bd0625\") " pod="openshift-image-registry/image-registry-6cb4b4f47d-cwsdp"
Jul 06 19:26:19.197960 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.197055    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/01d573f1-6d26-429c-b077-906718bd0625-ca-trust-extracted\") pod \"image-registry-6cb4b4f47d-cwsdp\" (UID: \"01d573f1-6d26-429c-b077-906718bd0625\") " pod="openshift-image-registry/image-registry-6cb4b4f47d-cwsdp"
Jul 06 19:26:19.197960 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.197900    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/01d573f1-6d26-429c-b077-906718bd0625-trusted-ca\") pod \"image-registry-6cb4b4f47d-cwsdp\" (UID: \"01d573f1-6d26-429c-b077-906718bd0625\") " pod="openshift-image-registry/image-registry-6cb4b4f47d-cwsdp"
Jul 06 19:26:19.199631 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.199582    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b8dc533e-a04d-4f28-813b-c1ff07e8e23a-hub\") pod \"cluster-proxy-proxy-agent-77dfc5bf74-cckf5\" (UID: \"b8dc533e-a04d-4f28-813b-c1ff07e8e23a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dfc5bf74-cckf5"
Jul 06 19:26:19.200060 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.200034    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b8dc533e-a04d-4f28-813b-c1ff07e8e23a-ca\") pod \"cluster-proxy-proxy-agent-77dfc5bf74-cckf5\" (UID: \"b8dc533e-a04d-4f28-813b-c1ff07e8e23a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dfc5bf74-cckf5"
Jul 06 19:26:19.200303 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.200279    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b8dc533e-a04d-4f28-813b-c1ff07e8e23a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-77dfc5bf74-cckf5\" (UID: \"b8dc533e-a04d-4f28-813b-c1ff07e8e23a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dfc5bf74-cckf5"
Jul 06 19:26:19.200593 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.200567    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/01d573f1-6d26-429c-b077-906718bd0625-image-registry-private-configuration\") pod \"image-registry-6cb4b4f47d-cwsdp\" (UID: \"01d573f1-6d26-429c-b077-906718bd0625\") " pod="openshift-image-registry/image-registry-6cb4b4f47d-cwsdp"
Jul 06 19:26:19.200937 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.200862    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/01d573f1-6d26-429c-b077-906718bd0625-installation-pull-secrets\") pod \"image-registry-6cb4b4f47d-cwsdp\" (UID: \"01d573f1-6d26-429c-b077-906718bd0625\") " pod="openshift-image-registry/image-registry-6cb4b4f47d-cwsdp"
Jul 06 19:26:19.200937 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.200929    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3514e05c-eb46-42d8-9f78-01849346fca5-klusterlet-config\") pod \"klusterlet-addon-workmgr-7b9b6d97c5-lcx5d\" (UID: \"3514e05c-eb46-42d8-9f78-01849346fca5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9b6d97c5-lcx5d"
Jul 06 19:26:19.201082 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.200966    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b8dc533e-a04d-4f28-813b-c1ff07e8e23a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-77dfc5bf74-cckf5\" (UID: \"b8dc533e-a04d-4f28-813b-c1ff07e8e23a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dfc5bf74-cckf5"
Jul 06 19:26:19.201082 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.201074    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c8b8ef69-09a9-410c-945a-b6388e09574a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7cb69c4684-sgg6d\" (UID: \"c8b8ef69-09a9-410c-945a-b6388e09574a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb69c4684-sgg6d"
Jul 06 19:26:19.203861 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.203831    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/01d573f1-6d26-429c-b077-906718bd0625-bound-sa-token\") pod \"image-registry-6cb4b4f47d-cwsdp\" (UID: \"01d573f1-6d26-429c-b077-906718bd0625\") " pod="openshift-image-registry/image-registry-6cb4b4f47d-cwsdp"
Jul 06 19:26:19.204641 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.204617    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm9lm\" (UniqueName: \"kubernetes.io/projected/01d573f1-6d26-429c-b077-906718bd0625-kube-api-access-tm9lm\") pod \"image-registry-6cb4b4f47d-cwsdp\" (UID: \"01d573f1-6d26-429c-b077-906718bd0625\") " pod="openshift-image-registry/image-registry-6cb4b4f47d-cwsdp"
Jul 06 19:26:19.205232 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.205211    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9z2q2\" (UniqueName: \"kubernetes.io/projected/3514e05c-eb46-42d8-9f78-01849346fca5-kube-api-access-9z2q2\") pod \"klusterlet-addon-workmgr-7b9b6d97c5-lcx5d\" (UID: \"3514e05c-eb46-42d8-9f78-01849346fca5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9b6d97c5-lcx5d"
Jul 06 19:26:19.207639 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.207619    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xrcj\" (UniqueName: \"kubernetes.io/projected/b8dc533e-a04d-4f28-813b-c1ff07e8e23a-kube-api-access-7xrcj\") pod \"cluster-proxy-proxy-agent-77dfc5bf74-cckf5\" (UID: \"b8dc533e-a04d-4f28-813b-c1ff07e8e23a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dfc5bf74-cckf5"
Jul 06 19:26:19.207860 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.207830    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2zr6\" (UniqueName: \"kubernetes.io/projected/c8b8ef69-09a9-410c-945a-b6388e09574a-kube-api-access-p2zr6\") pod \"managed-serviceaccount-addon-agent-7cb69c4684-sgg6d\" (UID: \"c8b8ef69-09a9-410c-945a-b6388e09574a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb69c4684-sgg6d"
Jul 06 19:26:19.264988 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.264956    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:19.296281 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.296241    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8f4fbdd-f51d-47be-9c53-d613bd801d28-tmp-dir\") pod \"dns-default-kzrzz\" (UID: \"d8f4fbdd-f51d-47be-9c53-d613bd801d28\") " pod="openshift-dns/dns-default-kzrzz"
Jul 06 19:26:19.296473 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.296309    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d8f4fbdd-f51d-47be-9c53-d613bd801d28-config-volume\") pod \"dns-default-kzrzz\" (UID: \"d8f4fbdd-f51d-47be-9c53-d613bd801d28\") " pod="openshift-dns/dns-default-kzrzz"
Jul 06 19:26:19.296473 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.296348    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8f4fbdd-f51d-47be-9c53-d613bd801d28-metrics-tls\") pod \"dns-default-kzrzz\" (UID: \"d8f4fbdd-f51d-47be-9c53-d613bd801d28\") " pod="openshift-dns/dns-default-kzrzz"
Jul 06 19:26:19.296473 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.296386    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvt4l\" (UniqueName: \"kubernetes.io/projected/55eea3e5-2d23-4877-a59c-99fb920ff42e-kube-api-access-qvt4l\") pod \"ingress-canary-qpv6m\" (UID: \"55eea3e5-2d23-4877-a59c-99fb920ff42e\") " pod="openshift-ingress-canary/ingress-canary-qpv6m"
Jul 06 19:26:19.296473 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.296431    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55eea3e5-2d23-4877-a59c-99fb920ff42e-cert\") pod \"ingress-canary-qpv6m\" (UID: \"55eea3e5-2d23-4877-a59c-99fb920ff42e\") " pod="openshift-ingress-canary/ingress-canary-qpv6m"
Jul 06 19:26:19.296473 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.296450    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmdrv\" (UniqueName: \"kubernetes.io/projected/d8f4fbdd-f51d-47be-9c53-d613bd801d28-kube-api-access-xmdrv\") pod \"dns-default-kzrzz\" (UID: \"d8f4fbdd-f51d-47be-9c53-d613bd801d28\") " pod="openshift-dns/dns-default-kzrzz"
Jul 06 19:26:19.296473 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:19.296464    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:26:19.296757 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:19.296540    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8f4fbdd-f51d-47be-9c53-d613bd801d28-metrics-tls podName:d8f4fbdd-f51d-47be-9c53-d613bd801d28 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:19.796519033 +0000 UTC m=+37.572552425 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8f4fbdd-f51d-47be-9c53-d613bd801d28-metrics-tls") pod "dns-default-kzrzz" (UID: "d8f4fbdd-f51d-47be-9c53-d613bd801d28") : secret "dns-default-metrics-tls" not found
Jul 06 19:26:19.296757 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.296672    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8f4fbdd-f51d-47be-9c53-d613bd801d28-tmp-dir\") pod \"dns-default-kzrzz\" (UID: \"d8f4fbdd-f51d-47be-9c53-d613bd801d28\") " pod="openshift-dns/dns-default-kzrzz"
Jul 06 19:26:19.297002 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.296980    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d8f4fbdd-f51d-47be-9c53-d613bd801d28-config-volume\") pod \"dns-default-kzrzz\" (UID: \"d8f4fbdd-f51d-47be-9c53-d613bd801d28\") " pod="openshift-dns/dns-default-kzrzz"
Jul 06 19:26:19.299334 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.299313    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55eea3e5-2d23-4877-a59c-99fb920ff42e-cert\") pod \"ingress-canary-qpv6m\" (UID: \"55eea3e5-2d23-4877-a59c-99fb920ff42e\") " pod="openshift-ingress-canary/ingress-canary-qpv6m"
Jul 06 19:26:19.305129 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.305101    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dfc5bf74-cckf5"
Jul 06 19:26:19.313386 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.313345    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb69c4684-sgg6d"
Jul 06 19:26:19.317486 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.317460    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmdrv\" (UniqueName: \"kubernetes.io/projected/d8f4fbdd-f51d-47be-9c53-d613bd801d28-kube-api-access-xmdrv\") pod \"dns-default-kzrzz\" (UID: \"d8f4fbdd-f51d-47be-9c53-d613bd801d28\") " pod="openshift-dns/dns-default-kzrzz"
Jul 06 19:26:19.317658 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.317637    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvt4l\" (UniqueName: \"kubernetes.io/projected/55eea3e5-2d23-4877-a59c-99fb920ff42e-kube-api-access-qvt4l\") pod \"ingress-canary-qpv6m\" (UID: \"55eea3e5-2d23-4877-a59c-99fb920ff42e\") " pod="openshift-ingress-canary/ingress-canary-qpv6m"
Jul 06 19:26:19.331406 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.331361    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9b6d97c5-lcx5d"
Jul 06 19:26:19.374050 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.374013    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qpv6m"
Jul 06 19:26:19.388877 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.388845    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:19.668537 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.668514    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb69c4684-sgg6d"]
Jul 06 19:26:19.671342 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:26:19.671312    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc8b8ef69_09a9_410c_945a_b6388e09574a.slice/crio-ff334644f409bcb2a43d561c9d44e7f972e867970d5436dd1e2448e89c5e2b4e WatchSource:0}: Error finding container ff334644f409bcb2a43d561c9d44e7f972e867970d5436dd1e2448e89c5e2b4e: Status 404 returned error can't find the container with id ff334644f409bcb2a43d561c9d44e7f972e867970d5436dd1e2448e89c5e2b4e
Jul 06 19:26:19.683020 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.682998    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qpv6m"]
Jul 06 19:26:19.686653 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:26:19.686591    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55eea3e5_2d23_4877_a59c_99fb920ff42e.slice/crio-5a908f43a569539cabb16bc8f7d7ae2ecd30f97894d6989f2ab235f6ad6de710 WatchSource:0}: Error finding container 5a908f43a569539cabb16bc8f7d7ae2ecd30f97894d6989f2ab235f6ad6de710: Status 404 returned error can't find the container with id 5a908f43a569539cabb16bc8f7d7ae2ecd30f97894d6989f2ab235f6ad6de710
Jul 06 19:26:19.686815 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.686790    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9b6d97c5-lcx5d"]
Jul 06 19:26:19.691254 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:26:19.691228    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3514e05c_eb46_42d8_9f78_01849346fca5.slice/crio-f9023e6ca39cc63252bafdbf4197dd40693b56a5a72fbf3c1b76f8c4d2f8d7fd WatchSource:0}: Error finding container f9023e6ca39cc63252bafdbf4197dd40693b56a5a72fbf3c1b76f8c4d2f8d7fd: Status 404 returned error can't find the container with id f9023e6ca39cc63252bafdbf4197dd40693b56a5a72fbf3c1b76f8c4d2f8d7fd
Jul 06 19:26:19.694582 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.694559    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dfc5bf74-cckf5"]
Jul 06 19:26:19.698692 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:26:19.698666    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb8dc533e_a04d_4f28_813b_c1ff07e8e23a.slice/crio-6515a850d70e6a8338b10294781dc6b3fa870e847e97c81d7149550dc3504d23 WatchSource:0}: Error finding container 6515a850d70e6a8338b10294781dc6b3fa870e847e97c81d7149550dc3504d23: Status 404 returned error can't find the container with id 6515a850d70e6a8338b10294781dc6b3fa870e847e97c81d7149550dc3504d23
Jul 06 19:26:19.703432 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.703400    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/01d573f1-6d26-429c-b077-906718bd0625-registry-tls\") pod \"image-registry-6cb4b4f47d-cwsdp\" (UID: \"01d573f1-6d26-429c-b077-906718bd0625\") " pod="openshift-image-registry/image-registry-6cb4b4f47d-cwsdp"
Jul 06 19:26:19.703568 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:19.703546    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:26:19.703636 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:19.703571    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cb4b4f47d-cwsdp: secret "image-registry-tls" not found
Jul 06 19:26:19.703636 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:19.703633    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/01d573f1-6d26-429c-b077-906718bd0625-registry-tls podName:01d573f1-6d26-429c-b077-906718bd0625 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:20.703613256 +0000 UTC m=+38.479646640 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/01d573f1-6d26-429c-b077-906718bd0625-registry-tls") pod "image-registry-6cb4b4f47d-cwsdp" (UID: "01d573f1-6d26-429c-b077-906718bd0625") : secret "image-registry-tls" not found
Jul 06 19:26:19.804651 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:19.804622    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8f4fbdd-f51d-47be-9c53-d613bd801d28-metrics-tls\") pod \"dns-default-kzrzz\" (UID: \"d8f4fbdd-f51d-47be-9c53-d613bd801d28\") " pod="openshift-dns/dns-default-kzrzz"
Jul 06 19:26:19.804787 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:19.804768    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:26:19.804844 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:19.804835    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8f4fbdd-f51d-47be-9c53-d613bd801d28-metrics-tls podName:d8f4fbdd-f51d-47be-9c53-d613bd801d28 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:20.80481941 +0000 UTC m=+38.580852787 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8f4fbdd-f51d-47be-9c53-d613bd801d28-metrics-tls") pod "dns-default-kzrzz" (UID: "d8f4fbdd-f51d-47be-9c53-d613bd801d28") : secret "dns-default-metrics-tls" not found
Jul 06 19:26:20.475743 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:20.475663    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dfc5bf74-cckf5" event={"ID":"b8dc533e-a04d-4f28-813b-c1ff07e8e23a","Type":"ContainerStarted","Data":"6515a850d70e6a8338b10294781dc6b3fa870e847e97c81d7149550dc3504d23"}
Jul 06 19:26:20.486548 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:20.485729    2555 generic.go:356] "Generic (PLEG): container finished" podID="40d45d9f-54f3-4736-b359-b43fc6af5535" containerID="1b6c2511efbcbf5a1184017c5927045ff8bf5092c60a630474a0d80bb58da0e8" exitCode=0
Jul 06 19:26:20.486548 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:20.485879    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h5prb" event={"ID":"40d45d9f-54f3-4736-b359-b43fc6af5535","Type":"ContainerDied","Data":"1b6c2511efbcbf5a1184017c5927045ff8bf5092c60a630474a0d80bb58da0e8"}
Jul 06 19:26:20.490756 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:20.490723    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9b6d97c5-lcx5d" event={"ID":"3514e05c-eb46-42d8-9f78-01849346fca5","Type":"ContainerStarted","Data":"f9023e6ca39cc63252bafdbf4197dd40693b56a5a72fbf3c1b76f8c4d2f8d7fd"}
Jul 06 19:26:20.505154 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:20.505112    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb69c4684-sgg6d" event={"ID":"c8b8ef69-09a9-410c-945a-b6388e09574a","Type":"ContainerStarted","Data":"ff334644f409bcb2a43d561c9d44e7f972e867970d5436dd1e2448e89c5e2b4e"}
Jul 06 19:26:20.511427 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:20.511394    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qpv6m" event={"ID":"55eea3e5-2d23-4877-a59c-99fb920ff42e","Type":"ContainerStarted","Data":"5a908f43a569539cabb16bc8f7d7ae2ecd30f97894d6989f2ab235f6ad6de710"}
Jul 06 19:26:20.715077 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:20.715037    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/01d573f1-6d26-429c-b077-906718bd0625-registry-tls\") pod \"image-registry-6cb4b4f47d-cwsdp\" (UID: \"01d573f1-6d26-429c-b077-906718bd0625\") " pod="openshift-image-registry/image-registry-6cb4b4f47d-cwsdp"
Jul 06 19:26:20.715312 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:20.715291    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:26:20.715386 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:20.715316    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cb4b4f47d-cwsdp: secret "image-registry-tls" not found
Jul 06 19:26:20.715386 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:20.715373    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/01d573f1-6d26-429c-b077-906718bd0625-registry-tls podName:01d573f1-6d26-429c-b077-906718bd0625 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:22.715354373 +0000 UTC m=+40.491387755 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/01d573f1-6d26-429c-b077-906718bd0625-registry-tls") pod "image-registry-6cb4b4f47d-cwsdp" (UID: "01d573f1-6d26-429c-b077-906718bd0625") : secret "image-registry-tls" not found
Jul 06 19:26:20.816298 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:20.816243    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8f4fbdd-f51d-47be-9c53-d613bd801d28-metrics-tls\") pod \"dns-default-kzrzz\" (UID: \"d8f4fbdd-f51d-47be-9c53-d613bd801d28\") " pod="openshift-dns/dns-default-kzrzz"
Jul 06 19:26:20.816556 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:20.816432    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:26:20.816556 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:20.816516    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8f4fbdd-f51d-47be-9c53-d613bd801d28-metrics-tls podName:d8f4fbdd-f51d-47be-9c53-d613bd801d28 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:22.816495219 +0000 UTC m=+40.592528599 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8f4fbdd-f51d-47be-9c53-d613bd801d28-metrics-tls") pod "dns-default-kzrzz" (UID: "d8f4fbdd-f51d-47be-9c53-d613bd801d28") : secret "dns-default-metrics-tls" not found
Jul 06 19:26:21.532475 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:21.531122    2555 generic.go:356] "Generic (PLEG): container finished" podID="40d45d9f-54f3-4736-b359-b43fc6af5535" containerID="9574ef901af308a7e333efec79f77ed80c216f282d122066d7b15f74e32fe10d" exitCode=0
Jul 06 19:26:21.532475 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:21.531249    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h5prb" event={"ID":"40d45d9f-54f3-4736-b359-b43fc6af5535","Type":"ContainerDied","Data":"9574ef901af308a7e333efec79f77ed80c216f282d122066d7b15f74e32fe10d"}
Jul 06 19:26:22.541008 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:22.540290    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h5prb" event={"ID":"40d45d9f-54f3-4736-b359-b43fc6af5535","Type":"ContainerStarted","Data":"5a80699e8bd5d65021c2d2f659400b139280e66316ef6b346aad72aea5b29a42"}
Jul 06 19:26:22.569691 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:22.569632    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-h5prb" podStartSLOduration=7.574202206 podStartE2EDuration="38.56961295s" totalImagesPullingTime="30.995410744s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:44 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:22.568416605 +0000 UTC m=+40.344450027" watchObservedRunningTime="2026-07-06 19:26:22.56961295 +0000 UTC m=+40.345646331"
Jul 06 19:26:22.696692 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:22.696653    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:22.734885 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:22.734850    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/01d573f1-6d26-429c-b077-906718bd0625-registry-tls\") pod \"image-registry-6cb4b4f47d-cwsdp\" (UID: \"01d573f1-6d26-429c-b077-906718bd0625\") " pod="openshift-image-registry/image-registry-6cb4b4f47d-cwsdp"
Jul 06 19:26:22.735084 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:22.734997    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:26:22.735084 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:22.735011    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cb4b4f47d-cwsdp: secret "image-registry-tls" not found
Jul 06 19:26:22.735084 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:22.735073    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/01d573f1-6d26-429c-b077-906718bd0625-registry-tls podName:01d573f1-6d26-429c-b077-906718bd0625 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:26.735052937 +0000 UTC m=+44.511086315 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/01d573f1-6d26-429c-b077-906718bd0625-registry-tls") pod "image-registry-6cb4b4f47d-cwsdp" (UID: "01d573f1-6d26-429c-b077-906718bd0625") : secret "image-registry-tls" not found
Jul 06 19:26:22.797542 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:22.797444    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:22.837016 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:22.836387    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8f4fbdd-f51d-47be-9c53-d613bd801d28-metrics-tls\") pod \"dns-default-kzrzz\" (UID: \"d8f4fbdd-f51d-47be-9c53-d613bd801d28\") " pod="openshift-dns/dns-default-kzrzz"
Jul 06 19:26:22.837016 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:22.836576    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:26:22.837016 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:22.836641    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8f4fbdd-f51d-47be-9c53-d613bd801d28-metrics-tls podName:d8f4fbdd-f51d-47be-9c53-d613bd801d28 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:26.836622851 +0000 UTC m=+44.612656230 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8f4fbdd-f51d-47be-9c53-d613bd801d28-metrics-tls") pod "dns-default-kzrzz" (UID: "d8f4fbdd-f51d-47be-9c53-d613bd801d28") : secret "dns-default-metrics-tls" not found
Jul 06 19:26:22.898536 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:22.898490    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:23.317900 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:23.317860    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:24.014385 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:24.014302    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:24.133630 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:24.133596    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:25.040728 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:25.040693    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:25.204311 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:25.204269    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:25.316382 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:25.316305    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:26.181830 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:26.181790    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:26.333899 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:26.333861    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:26.770796 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:26.770757    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/01d573f1-6d26-429c-b077-906718bd0625-registry-tls\") pod \"image-registry-6cb4b4f47d-cwsdp\" (UID: \"01d573f1-6d26-429c-b077-906718bd0625\") " pod="openshift-image-registry/image-registry-6cb4b4f47d-cwsdp"
Jul 06 19:26:26.770989 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:26.770904    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:26:26.770989 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:26.770935    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cb4b4f47d-cwsdp: secret "image-registry-tls" not found
Jul 06 19:26:26.771060 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:26.770993    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/01d573f1-6d26-429c-b077-906718bd0625-registry-tls podName:01d573f1-6d26-429c-b077-906718bd0625 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:34.770972462 +0000 UTC m=+52.547005842 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/01d573f1-6d26-429c-b077-906718bd0625-registry-tls") pod "image-registry-6cb4b4f47d-cwsdp" (UID: "01d573f1-6d26-429c-b077-906718bd0625") : secret "image-registry-tls" not found
Jul 06 19:26:26.871540 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:26.871501    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8f4fbdd-f51d-47be-9c53-d613bd801d28-metrics-tls\") pod \"dns-default-kzrzz\" (UID: \"d8f4fbdd-f51d-47be-9c53-d613bd801d28\") " pod="openshift-dns/dns-default-kzrzz"
Jul 06 19:26:26.871714 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:26.871667    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:26:26.871759 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:26.871738    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8f4fbdd-f51d-47be-9c53-d613bd801d28-metrics-tls podName:d8f4fbdd-f51d-47be-9c53-d613bd801d28 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:34.871717426 +0000 UTC m=+52.647750804 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8f4fbdd-f51d-47be-9c53-d613bd801d28-metrics-tls") pod "dns-default-kzrzz" (UID: "d8f4fbdd-f51d-47be-9c53-d613bd801d28") : secret "dns-default-metrics-tls" not found
Jul 06 19:26:27.032861 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:27.032822    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:27.242747 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:27.242712    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:27.338354 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:27.338253    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:27.441458 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:27.441430    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:27.540420 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:27.540387    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:28.561085 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:28.561041    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dfc5bf74-cckf5" event={"ID":"b8dc533e-a04d-4f28-813b-c1ff07e8e23a","Type":"ContainerStarted","Data":"00fd65c19d2fcf2a0a8eb1135ed391621a1058f173a5c39de641e450ad270b6d"}
Jul 06 19:26:28.561590 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:28.561095    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dfc5bf74-cckf5" event={"ID":"b8dc533e-a04d-4f28-813b-c1ff07e8e23a","Type":"ContainerStarted","Data":"0b49da4a5b87215c88395a6d5b2718a8ef42607efa9bcdeb1ab268a3f9a715c2"}
Jul 06 19:26:28.561590 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:28.561116    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dfc5bf74-cckf5" event={"ID":"b8dc533e-a04d-4f28-813b-c1ff07e8e23a","Type":"ContainerStarted","Data":"534ea80ec002131ab5cc39c01317123ad2f84569d3a8b82354dc3f2816f9fe66"}
Jul 06 19:26:28.562559 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:28.562526    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9b6d97c5-lcx5d" event={"ID":"3514e05c-eb46-42d8-9f78-01849346fca5","Type":"ContainerStarted","Data":"ae6b92a36d947364af6b5f7366b95e5a24fbbb2047ccdfffe409e3b0b679028f"}
Jul 06 19:26:28.562649 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:28.562612    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9b6d97c5-lcx5d"
Jul 06 19:26:28.564283 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:28.564253    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb69c4684-sgg6d" event={"ID":"c8b8ef69-09a9-410c-945a-b6388e09574a","Type":"ContainerStarted","Data":"854bc8f70964422d6beacb59112e8c2e31c00e5d7b92465e89bafb927080e642"}
Jul 06 19:26:28.564654 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:28.564626    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9b6d97c5-lcx5d"
Jul 06 19:26:28.565817 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:28.565798    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qpv6m" event={"ID":"55eea3e5-2d23-4877-a59c-99fb920ff42e","Type":"ContainerStarted","Data":"1445a3099061e64feabbc27d13a50106c670fb83ad6b2a5cba1d928d0b0fe148"}
Jul 06 19:26:28.581866 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:28.581812    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dfc5bf74-cckf5" podStartSLOduration=23.820998619 podStartE2EDuration="31.581797832s" totalImagesPullingTime="7.760799213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:25:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:28.58117482 +0000 UTC m=+46.357208243" watchObservedRunningTime="2026-07-06 19:26:28.581797832 +0000 UTC m=+46.357831230"
Jul 06 19:26:28.598458 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:28.598410    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb69c4684-sgg6d" podStartSLOduration=23.81071559 podStartE2EDuration="31.598393157s" totalImagesPullingTime="7.787677567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:25:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:28.597729937 +0000 UTC m=+46.373763347" watchObservedRunningTime="2026-07-06 19:26:28.598393157 +0000 UTC m=+46.374426556"
Jul 06 19:26:28.618652 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:28.618598    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9b6d97c5-lcx5d" podStartSLOduration=23.835228278 podStartE2EDuration="31.618583396s" totalImagesPullingTime="7.783355118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:25:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:28.617950006 +0000 UTC m=+46.393983406" watchObservedRunningTime="2026-07-06 19:26:28.618583396 +0000 UTC m=+46.394616795"
Jul 06 19:26:28.638078 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:28.638028    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qpv6m" podStartSLOduration=1.865132679 podStartE2EDuration="9.638010074s" totalImagesPullingTime="7.772877395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:26:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:28.637233361 +0000 UTC m=+46.413266787" watchObservedRunningTime="2026-07-06 19:26:28.638010074 +0000 UTC m=+46.414043473"
Jul 06 19:26:33.079414 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:33.079384    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:33.178433 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:33.178403    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:34.835596 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:34.835558    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/01d573f1-6d26-429c-b077-906718bd0625-registry-tls\") pod \"image-registry-6cb4b4f47d-cwsdp\" (UID: \"01d573f1-6d26-429c-b077-906718bd0625\") " pod="openshift-image-registry/image-registry-6cb4b4f47d-cwsdp"
Jul 06 19:26:34.836015 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:34.835686    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:26:34.836015 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:34.835699    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cb4b4f47d-cwsdp: secret "image-registry-tls" not found
Jul 06 19:26:34.836015 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:34.835765    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/01d573f1-6d26-429c-b077-906718bd0625-registry-tls podName:01d573f1-6d26-429c-b077-906718bd0625 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:50.835747379 +0000 UTC m=+68.611780773 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/01d573f1-6d26-429c-b077-906718bd0625-registry-tls") pod "image-registry-6cb4b4f47d-cwsdp" (UID: "01d573f1-6d26-429c-b077-906718bd0625") : secret "image-registry-tls" not found
Jul 06 19:26:34.936090 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:34.936052    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8f4fbdd-f51d-47be-9c53-d613bd801d28-metrics-tls\") pod \"dns-default-kzrzz\" (UID: \"d8f4fbdd-f51d-47be-9c53-d613bd801d28\") " pod="openshift-dns/dns-default-kzrzz"
Jul 06 19:26:34.936240 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:34.936208    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:26:34.936306 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:34.936294    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8f4fbdd-f51d-47be-9c53-d613bd801d28-metrics-tls podName:d8f4fbdd-f51d-47be-9c53-d613bd801d28 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:50.936278334 +0000 UTC m=+68.712311710 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8f4fbdd-f51d-47be-9c53-d613bd801d28-metrics-tls") pod "dns-default-kzrzz" (UID: "d8f4fbdd-f51d-47be-9c53-d613bd801d28") : secret "dns-default-metrics-tls" not found
Jul 06 19:26:36.972783 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:36.972749    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:37.073143 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:37.073120    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:41.107369 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:41.107338    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:41.206200 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:41.206164    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:43.468028 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:43.467999    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j9wtk"
Jul 06 19:26:43.626120 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:43.626080    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:43.726037 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:43.726011    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:48.949462 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:48.949410    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f7af2d-5d72-4c10-88c4-44a193ad2b32-metrics-certs\") pod \"network-metrics-daemon-9tcbq\" (UID: \"e3f7af2d-5d72-4c10-88c4-44a193ad2b32\") " pod="openshift-multus/network-metrics-daemon-9tcbq"
Jul 06 19:26:48.949462 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:48.949468    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0acb06f4-a973-4679-99e1-d7a44e7286ae-original-pull-secret\") pod \"global-pull-secret-syncer-btzb4\" (UID: \"0acb06f4-a973-4679-99e1-d7a44e7286ae\") " pod="kube-system/global-pull-secret-syncer-btzb4"
Jul 06 19:26:48.950011 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:48.949504    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r46bx\" (UniqueName: \"kubernetes.io/projected/42fc94d7-0161-4334-85d2-5f0df8456dec-kube-api-access-r46bx\") pod \"network-check-target-pmfn2\" (UID: \"42fc94d7-0161-4334-85d2-5f0df8456dec\") " pod="openshift-network-diagnostics/network-check-target-pmfn2"
Jul 06 19:26:48.954203 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:48.954176    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 19:26:48.954340 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:48.954308    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 19:26:48.954389 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:48.954340    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 19:26:48.960318 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:48.960290    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 06 19:26:48.960433 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:48.960376    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3f7af2d-5d72-4c10-88c4-44a193ad2b32-metrics-certs podName:e3f7af2d-5d72-4c10-88c4-44a193ad2b32 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:52.960353475 +0000 UTC m=+130.736386851 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3f7af2d-5d72-4c10-88c4-44a193ad2b32-metrics-certs") pod "network-metrics-daemon-9tcbq" (UID: "e3f7af2d-5d72-4c10-88c4-44a193ad2b32") : secret "metrics-daemon-secret" not found
Jul 06 19:26:48.962397 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:48.962376    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 19:26:48.963696 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:48.963665    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0acb06f4-a973-4679-99e1-d7a44e7286ae-original-pull-secret\") pod \"global-pull-secret-syncer-btzb4\" (UID: \"0acb06f4-a973-4679-99e1-d7a44e7286ae\") " pod="kube-system/global-pull-secret-syncer-btzb4"
Jul 06 19:26:48.972926 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:48.972884    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r46bx\" (UniqueName: \"kubernetes.io/projected/42fc94d7-0161-4334-85d2-5f0df8456dec-kube-api-access-r46bx\") pod \"network-check-target-pmfn2\" (UID: \"42fc94d7-0161-4334-85d2-5f0df8456dec\") " pod="openshift-network-diagnostics/network-check-target-pmfn2"
Jul 06 19:26:49.145541 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:49.145485    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-btzb4"
Jul 06 19:26:49.153337 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:49.153318    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x44r2\""
Jul 06 19:26:49.160426 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:49.160385    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmfn2"
Jul 06 19:26:49.280528 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:49.280492    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-btzb4"]
Jul 06 19:26:49.283494 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:26:49.283466    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0acb06f4_a973_4679_99e1_d7a44e7286ae.slice/crio-b7a7e208b3ea71b1fb000b8d80aa237d875c866b4ac6fa524923bae8af2357cd WatchSource:0}: Error finding container b7a7e208b3ea71b1fb000b8d80aa237d875c866b4ac6fa524923bae8af2357cd: Status 404 returned error can't find the container with id b7a7e208b3ea71b1fb000b8d80aa237d875c866b4ac6fa524923bae8af2357cd
Jul 06 19:26:49.296812 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:49.296777    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pmfn2"]
Jul 06 19:26:49.302425 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:26:49.302398    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42fc94d7_0161_4334_85d2_5f0df8456dec.slice/crio-93614cf1072ecddddd07cf1a51d7fefae227f56957131cf54574c8cd08329a89 WatchSource:0}: Error finding container 93614cf1072ecddddd07cf1a51d7fefae227f56957131cf54574c8cd08329a89: Status 404 returned error can't find the container with id 93614cf1072ecddddd07cf1a51d7fefae227f56957131cf54574c8cd08329a89
Jul 06 19:26:49.633781 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:49.633743    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pmfn2" event={"ID":"42fc94d7-0161-4334-85d2-5f0df8456dec","Type":"ContainerStarted","Data":"93614cf1072ecddddd07cf1a51d7fefae227f56957131cf54574c8cd08329a89"}
Jul 06 19:26:49.635029 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:49.635000    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-btzb4" event={"ID":"0acb06f4-a973-4679-99e1-d7a44e7286ae","Type":"ContainerStarted","Data":"b7a7e208b3ea71b1fb000b8d80aa237d875c866b4ac6fa524923bae8af2357cd"}
Jul 06 19:26:50.162107 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:50.162072    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:50.239123 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:50.239083    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:50.866221 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:50.866179    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/01d573f1-6d26-429c-b077-906718bd0625-registry-tls\") pod \"image-registry-6cb4b4f47d-cwsdp\" (UID: \"01d573f1-6d26-429c-b077-906718bd0625\") " pod="openshift-image-registry/image-registry-6cb4b4f47d-cwsdp"
Jul 06 19:26:50.866457 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:50.866357    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:26:50.866457 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:50.866378    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cb4b4f47d-cwsdp: secret "image-registry-tls" not found
Jul 06 19:26:50.866457 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:50.866446    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/01d573f1-6d26-429c-b077-906718bd0625-registry-tls podName:01d573f1-6d26-429c-b077-906718bd0625 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:22.866427022 +0000 UTC m=+100.642460417 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/01d573f1-6d26-429c-b077-906718bd0625-registry-tls") pod "image-registry-6cb4b4f47d-cwsdp" (UID: "01d573f1-6d26-429c-b077-906718bd0625") : secret "image-registry-tls" not found
Jul 06 19:26:50.967362 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:50.967320    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8f4fbdd-f51d-47be-9c53-d613bd801d28-metrics-tls\") pod \"dns-default-kzrzz\" (UID: \"d8f4fbdd-f51d-47be-9c53-d613bd801d28\") " pod="openshift-dns/dns-default-kzrzz"
Jul 06 19:26:50.967555 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:50.967488    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:26:50.967619 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:26:50.967566    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8f4fbdd-f51d-47be-9c53-d613bd801d28-metrics-tls podName:d8f4fbdd-f51d-47be-9c53-d613bd801d28 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:22.967545692 +0000 UTC m=+100.743579087 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8f4fbdd-f51d-47be-9c53-d613bd801d28-metrics-tls") pod "dns-default-kzrzz" (UID: "d8f4fbdd-f51d-47be-9c53-d613bd801d28") : secret "dns-default-metrics-tls" not found
Jul 06 19:26:54.654108 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:54.654072    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pmfn2" event={"ID":"42fc94d7-0161-4334-85d2-5f0df8456dec","Type":"ContainerStarted","Data":"63543144dee6aa2c1cff0fd0a701ce14f237cdce4229305a1265b0815198a57d"}
Jul 06 19:26:54.654566 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:54.654193    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pmfn2"
Jul 06 19:26:54.655708 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:54.655671    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-btzb4" event={"ID":"0acb06f4-a973-4679-99e1-d7a44e7286ae","Type":"ContainerStarted","Data":"b296d06c72d790026aea1e77be42472ca7ca9f90d308c51a37950a4e651d866a"}
Jul 06 19:26:54.673955 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:54.673885    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pmfn2" podStartSLOduration=66.344386401 podStartE2EDuration="1m10.673870034s" totalImagesPullingTime="4.329483633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:25:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:54.673375254 +0000 UTC m=+72.449408654" watchObservedRunningTime="2026-07-06 19:26:54.673870034 +0000 UTC m=+72.449903460"
Jul 06 19:26:54.691599 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:26:54.691542    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-btzb4" podStartSLOduration=66.339359272 podStartE2EDuration="1m10.691521851s" totalImagesPullingTime="4.352162579s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:54.691281263 +0000 UTC m=+72.467314663" watchObservedRunningTime="2026-07-06 19:26:54.691521851 +0000 UTC m=+72.467555253"
Jul 06 19:27:02.049712 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:02.049676    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:02.148273 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:02.148240    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:02.219255 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:02.219224    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:22.900674 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:22.900581    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/01d573f1-6d26-429c-b077-906718bd0625-registry-tls\") pod \"image-registry-6cb4b4f47d-cwsdp\" (UID: \"01d573f1-6d26-429c-b077-906718bd0625\") " pod="openshift-image-registry/image-registry-6cb4b4f47d-cwsdp"
Jul 06 19:27:22.901046 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:27:22.900762    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:27:22.901046 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:27:22.900781    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cb4b4f47d-cwsdp: secret "image-registry-tls" not found
Jul 06 19:27:22.901046 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:27:22.900865    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/01d573f1-6d26-429c-b077-906718bd0625-registry-tls podName:01d573f1-6d26-429c-b077-906718bd0625 nodeName:}" failed. No retries permitted until 2026-07-06 19:28:26.900849006 +0000 UTC m=+164.676882384 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/01d573f1-6d26-429c-b077-906718bd0625-registry-tls") pod "image-registry-6cb4b4f47d-cwsdp" (UID: "01d573f1-6d26-429c-b077-906718bd0625") : secret "image-registry-tls" not found
Jul 06 19:27:23.001806 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:23.001761    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8f4fbdd-f51d-47be-9c53-d613bd801d28-metrics-tls\") pod \"dns-default-kzrzz\" (UID: \"d8f4fbdd-f51d-47be-9c53-d613bd801d28\") " pod="openshift-dns/dns-default-kzrzz"
Jul 06 19:27:23.002076 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:27:23.001938    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:27:23.002076 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:27:23.002012    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8f4fbdd-f51d-47be-9c53-d613bd801d28-metrics-tls podName:d8f4fbdd-f51d-47be-9c53-d613bd801d28 nodeName:}" failed. No retries permitted until 2026-07-06 19:28:27.001993669 +0000 UTC m=+164.778027045 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8f4fbdd-f51d-47be-9c53-d613bd801d28-metrics-tls") pod "dns-default-kzrzz" (UID: "d8f4fbdd-f51d-47be-9c53-d613bd801d28") : secret "dns-default-metrics-tls" not found
Jul 06 19:27:25.660477 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:25.660446    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pmfn2"
Jul 06 19:27:39.081701 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:39.081665    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:40.308976 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:40.308903    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:41.335354 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:41.335323    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:41.430182 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:41.430152    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:43.763929 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:43.763876    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-g5bhj"]
Jul 06 19:27:43.766004 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:43.765987    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-g5bhj"
Jul 06 19:27:43.772517 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:43.772491    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 19:27:43.772642 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:43.772580    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 19:27:43.772770 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:43.772752    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xtdxx\""
Jul 06 19:27:43.773052 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:43.773035    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 19:27:43.773102 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:43.773074    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 19:27:43.781773 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:43.781744    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-g5bhj"]
Jul 06 19:27:43.802431 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:43.802404    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:43.860261 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:43.860224    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d1e0130c-e466-447b-92f0-4326dfbb3413-data-volume\") pod \"insights-runtime-extractor-g5bhj\" (UID: \"d1e0130c-e466-447b-92f0-4326dfbb3413\") " pod="openshift-insights/insights-runtime-extractor-g5bhj"
Jul 06 19:27:43.860261 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:43.860272    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d1e0130c-e466-447b-92f0-4326dfbb3413-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g5bhj\" (UID: \"d1e0130c-e466-447b-92f0-4326dfbb3413\") " pod="openshift-insights/insights-runtime-extractor-g5bhj"
Jul 06 19:27:43.860474 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:43.860386    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nxlz\" (UniqueName: \"kubernetes.io/projected/d1e0130c-e466-447b-92f0-4326dfbb3413-kube-api-access-8nxlz\") pod \"insights-runtime-extractor-g5bhj\" (UID: \"d1e0130c-e466-447b-92f0-4326dfbb3413\") " pod="openshift-insights/insights-runtime-extractor-g5bhj"
Jul 06 19:27:43.860474 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:43.860429    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d1e0130c-e466-447b-92f0-4326dfbb3413-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g5bhj\" (UID: \"d1e0130c-e466-447b-92f0-4326dfbb3413\") " pod="openshift-insights/insights-runtime-extractor-g5bhj"
Jul 06 19:27:43.860474 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:43.860455    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d1e0130c-e466-447b-92f0-4326dfbb3413-crio-socket\") pod \"insights-runtime-extractor-g5bhj\" (UID: \"d1e0130c-e466-447b-92f0-4326dfbb3413\") " pod="openshift-insights/insights-runtime-extractor-g5bhj"
Jul 06 19:27:43.868637 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:43.868607    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:43.960758 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:43.960725    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nxlz\" (UniqueName: \"kubernetes.io/projected/d1e0130c-e466-447b-92f0-4326dfbb3413-kube-api-access-8nxlz\") pod \"insights-runtime-extractor-g5bhj\" (UID: \"d1e0130c-e466-447b-92f0-4326dfbb3413\") " pod="openshift-insights/insights-runtime-extractor-g5bhj"
Jul 06 19:27:43.960937 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:43.960772    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d1e0130c-e466-447b-92f0-4326dfbb3413-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g5bhj\" (UID: \"d1e0130c-e466-447b-92f0-4326dfbb3413\") " pod="openshift-insights/insights-runtime-extractor-g5bhj"
Jul 06 19:27:43.960937 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:43.960796    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d1e0130c-e466-447b-92f0-4326dfbb3413-crio-socket\") pod \"insights-runtime-extractor-g5bhj\" (UID: \"d1e0130c-e466-447b-92f0-4326dfbb3413\") " pod="openshift-insights/insights-runtime-extractor-g5bhj"
Jul 06 19:27:43.960937 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:43.960828    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d1e0130c-e466-447b-92f0-4326dfbb3413-data-volume\") pod \"insights-runtime-extractor-g5bhj\" (UID: \"d1e0130c-e466-447b-92f0-4326dfbb3413\") " pod="openshift-insights/insights-runtime-extractor-g5bhj"
Jul 06 19:27:43.960937 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:43.960850    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d1e0130c-e466-447b-92f0-4326dfbb3413-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g5bhj\" (UID: \"d1e0130c-e466-447b-92f0-4326dfbb3413\") " pod="openshift-insights/insights-runtime-extractor-g5bhj"
Jul 06 19:27:43.961131 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:43.960938    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d1e0130c-e466-447b-92f0-4326dfbb3413-crio-socket\") pod \"insights-runtime-extractor-g5bhj\" (UID: \"d1e0130c-e466-447b-92f0-4326dfbb3413\") " pod="openshift-insights/insights-runtime-extractor-g5bhj"
Jul 06 19:27:43.961131 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:27:43.960962    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:27:43.961131 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:27:43.960978    2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:27:43.961131 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:27:43.961038    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1e0130c-e466-447b-92f0-4326dfbb3413-insights-runtime-extractor-tls podName:d1e0130c-e466-447b-92f0-4326dfbb3413 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:44.461019689 +0000 UTC m=+122.237053065 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d1e0130c-e466-447b-92f0-4326dfbb3413-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g5bhj" (UID: "d1e0130c-e466-447b-92f0-4326dfbb3413") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:27:43.961131 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:27:43.961059    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d1e0130c-e466-447b-92f0-4326dfbb3413-kube-rbac-proxy-cm podName:d1e0130c-e466-447b-92f0-4326dfbb3413 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:44.461052321 +0000 UTC m=+122.237085723 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d1e0130c-e466-447b-92f0-4326dfbb3413-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g5bhj" (UID: "d1e0130c-e466-447b-92f0-4326dfbb3413") : configmap "kube-rbac-proxy" not found
Jul 06 19:27:43.961364 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:43.961213    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d1e0130c-e466-447b-92f0-4326dfbb3413-data-volume\") pod \"insights-runtime-extractor-g5bhj\" (UID: \"d1e0130c-e466-447b-92f0-4326dfbb3413\") " pod="openshift-insights/insights-runtime-extractor-g5bhj"
Jul 06 19:27:43.983616 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:43.983588    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nxlz\" (UniqueName: \"kubernetes.io/projected/d1e0130c-e466-447b-92f0-4326dfbb3413-kube-api-access-8nxlz\") pod \"insights-runtime-extractor-g5bhj\" (UID: \"d1e0130c-e466-447b-92f0-4326dfbb3413\") " pod="openshift-insights/insights-runtime-extractor-g5bhj"
Jul 06 19:27:44.201513 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:44.201479    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:44.314047 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:44.314010    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:44.407631 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:44.407606    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:44.465844 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:44.465754    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d1e0130c-e466-447b-92f0-4326dfbb3413-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g5bhj\" (UID: \"d1e0130c-e466-447b-92f0-4326dfbb3413\") " pod="openshift-insights/insights-runtime-extractor-g5bhj"
Jul 06 19:27:44.466176 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:44.466152    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d1e0130c-e466-447b-92f0-4326dfbb3413-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g5bhj\" (UID: \"d1e0130c-e466-447b-92f0-4326dfbb3413\") " pod="openshift-insights/insights-runtime-extractor-g5bhj"
Jul 06 19:27:44.466390 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:27:44.466367    2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:27:44.466544 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:27:44.466534    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d1e0130c-e466-447b-92f0-4326dfbb3413-kube-rbac-proxy-cm podName:d1e0130c-e466-447b-92f0-4326dfbb3413 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:45.466505488 +0000 UTC m=+123.242538879 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d1e0130c-e466-447b-92f0-4326dfbb3413-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g5bhj" (UID: "d1e0130c-e466-447b-92f0-4326dfbb3413") : configmap "kube-rbac-proxy" not found
Jul 06 19:27:44.467182 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:27:44.467161    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:27:44.467356 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:27:44.467345    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1e0130c-e466-447b-92f0-4326dfbb3413-insights-runtime-extractor-tls podName:d1e0130c-e466-447b-92f0-4326dfbb3413 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:45.467326952 +0000 UTC m=+123.243360344 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d1e0130c-e466-447b-92f0-4326dfbb3413-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g5bhj" (UID: "d1e0130c-e466-447b-92f0-4326dfbb3413") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:27:44.580034 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:44.579997    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:44.688415 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:44.688385    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:45.241241 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:45.241205    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:45.368125 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:45.368088    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:45.474650 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:45.474607    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d1e0130c-e466-447b-92f0-4326dfbb3413-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g5bhj\" (UID: \"d1e0130c-e466-447b-92f0-4326dfbb3413\") " pod="openshift-insights/insights-runtime-extractor-g5bhj"
Jul 06 19:27:45.474816 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:45.474671    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d1e0130c-e466-447b-92f0-4326dfbb3413-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g5bhj\" (UID: \"d1e0130c-e466-447b-92f0-4326dfbb3413\") " pod="openshift-insights/insights-runtime-extractor-g5bhj"
Jul 06 19:27:45.474816 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:27:45.474734    2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:27:45.474816 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:27:45.474761    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:27:45.474816 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:27:45.474813    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d1e0130c-e466-447b-92f0-4326dfbb3413-kube-rbac-proxy-cm podName:d1e0130c-e466-447b-92f0-4326dfbb3413 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:47.474797055 +0000 UTC m=+125.250830432 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d1e0130c-e466-447b-92f0-4326dfbb3413-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g5bhj" (UID: "d1e0130c-e466-447b-92f0-4326dfbb3413") : configmap "kube-rbac-proxy" not found
Jul 06 19:27:45.474984 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:27:45.474828    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1e0130c-e466-447b-92f0-4326dfbb3413-insights-runtime-extractor-tls podName:d1e0130c-e466-447b-92f0-4326dfbb3413 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:47.474822117 +0000 UTC m=+125.250855494 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d1e0130c-e466-447b-92f0-4326dfbb3413-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g5bhj" (UID: "d1e0130c-e466-447b-92f0-4326dfbb3413") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:27:45.547679 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:45.547653    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5d2dt_e8893200-b607-4e1e-8a6c-fb4a31110947/dns-node-resolver/0.log"
Jul 06 19:27:46.228081 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:46.228047    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:46.341192 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:46.341158    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:46.747119 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:46.747090    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qtvrs_ae5d3a7d-3488-4ab3-b388-51db77bb6da4/node-ca/0.log"
Jul 06 19:27:47.490620 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:47.490580    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d1e0130c-e466-447b-92f0-4326dfbb3413-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g5bhj\" (UID: \"d1e0130c-e466-447b-92f0-4326dfbb3413\") " pod="openshift-insights/insights-runtime-extractor-g5bhj"
Jul 06 19:27:47.491074 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:47.490656    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d1e0130c-e466-447b-92f0-4326dfbb3413-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g5bhj\" (UID: \"d1e0130c-e466-447b-92f0-4326dfbb3413\") " pod="openshift-insights/insights-runtime-extractor-g5bhj"
Jul 06 19:27:47.491074 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:27:47.490696    2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:27:47.491074 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:27:47.490763    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d1e0130c-e466-447b-92f0-4326dfbb3413-kube-rbac-proxy-cm podName:d1e0130c-e466-447b-92f0-4326dfbb3413 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:51.490746809 +0000 UTC m=+129.266780186 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d1e0130c-e466-447b-92f0-4326dfbb3413-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g5bhj" (UID: "d1e0130c-e466-447b-92f0-4326dfbb3413") : configmap "kube-rbac-proxy" not found
Jul 06 19:27:47.491074 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:27:47.490783    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:27:47.491074 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:27:47.490831    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1e0130c-e466-447b-92f0-4326dfbb3413-insights-runtime-extractor-tls podName:d1e0130c-e466-447b-92f0-4326dfbb3413 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:51.490816882 +0000 UTC m=+129.266850265 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d1e0130c-e466-447b-92f0-4326dfbb3413-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g5bhj" (UID: "d1e0130c-e466-447b-92f0-4326dfbb3413") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:27:47.551801 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:47.551779    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qpv6m_55eea3e5-2d23-4877-a59c-99fb920ff42e/serve-healthcheck-canary/0.log"
Jul 06 19:27:47.712319 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:47.712288    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:48.702151 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:48.702116    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:48.814281 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:48.814243    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:49.002129 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:49.002049    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:49.143987 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:49.143952    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:49.361032 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:49.360998    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:49.448519 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:49.448485    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:49.848262 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:49.848231    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:50.544748 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:50.544709    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:50.794544 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:50.794510    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:51.195785 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:51.195752    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:51.416033 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:51.415994    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:51.523151 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:51.523124    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d1e0130c-e466-447b-92f0-4326dfbb3413-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g5bhj\" (UID: \"d1e0130c-e466-447b-92f0-4326dfbb3413\") " pod="openshift-insights/insights-runtime-extractor-g5bhj"
Jul 06 19:27:51.523312 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:51.523196    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d1e0130c-e466-447b-92f0-4326dfbb3413-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g5bhj\" (UID: \"d1e0130c-e466-447b-92f0-4326dfbb3413\") " pod="openshift-insights/insights-runtime-extractor-g5bhj"
Jul 06 19:27:51.523312 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:27:51.523281    2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:27:51.523387 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:27:51.523364    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d1e0130c-e466-447b-92f0-4326dfbb3413-kube-rbac-proxy-cm podName:d1e0130c-e466-447b-92f0-4326dfbb3413 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:59.523344074 +0000 UTC m=+137.299377451 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d1e0130c-e466-447b-92f0-4326dfbb3413-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g5bhj" (UID: "d1e0130c-e466-447b-92f0-4326dfbb3413") : configmap "kube-rbac-proxy" not found
Jul 06 19:27:51.523387 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:27:51.523292    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:27:51.523456 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:27:51.523400    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1e0130c-e466-447b-92f0-4326dfbb3413-insights-runtime-extractor-tls podName:d1e0130c-e466-447b-92f0-4326dfbb3413 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:59.523392056 +0000 UTC m=+137.299425434 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d1e0130c-e466-447b-92f0-4326dfbb3413-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g5bhj" (UID: "d1e0130c-e466-447b-92f0-4326dfbb3413") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:27:51.601231 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:51.601199    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:51.804386 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:51.804294    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:52.592922 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:52.592875    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:52.695732 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:52.695700    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:52.804965 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:52.804929    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:53.008810 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:53.008710    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:53.035117 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:53.035073    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f7af2d-5d72-4c10-88c4-44a193ad2b32-metrics-certs\") pod \"network-metrics-daemon-9tcbq\" (UID: \"e3f7af2d-5d72-4c10-88c4-44a193ad2b32\") " pod="openshift-multus/network-metrics-daemon-9tcbq"
Jul 06 19:27:53.035266 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:27:53.035209    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 06 19:27:53.035331 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:27:53.035282    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3f7af2d-5d72-4c10-88c4-44a193ad2b32-metrics-certs podName:e3f7af2d-5d72-4c10-88c4-44a193ad2b32 nodeName:}" failed. No retries permitted until 2026-07-06 19:29:55.035260523 +0000 UTC m=+252.811293903 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3f7af2d-5d72-4c10-88c4-44a193ad2b32-metrics-certs") pod "network-metrics-daemon-9tcbq" (UID: "e3f7af2d-5d72-4c10-88c4-44a193ad2b32") : secret "metrics-daemon-secret" not found
Jul 06 19:27:53.216256 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:53.216222    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:53.320087 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:53.320055    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:53.649787 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:53.649708    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:53.946515 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:53.946435    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:54.439834 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:54.439801    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:54.795352 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:54.795320    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:54.853453 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:54.853424    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:55.008033 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:55.008004    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:55.195196 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:55.195119    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:55.594413 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:55.594383    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:56.401717 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:56.401685    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:56.829103 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:56.829070    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:57.016435 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:57.016400    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:57.116075 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:57.115994    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:57.214256 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:57.214223    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:57.429823 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:57.429742    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:58.396482 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:58.396448    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:58.595754 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:58.595721    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:58.879883 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:58.879845    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:59.192983 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:59.192890    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:59.307118 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:59.307074    2555 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dfc5bf74-cckf5" podUID="b8dc533e-a04d-4f28-813b-c1ff07e8e23a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 06 19:27:59.397500 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:59.397469    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:59.582000 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:59.581965    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d1e0130c-e466-447b-92f0-4326dfbb3413-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g5bhj\" (UID: \"d1e0130c-e466-447b-92f0-4326dfbb3413\") " pod="openshift-insights/insights-runtime-extractor-g5bhj"
Jul 06 19:27:59.582144 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:59.582039    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d1e0130c-e466-447b-92f0-4326dfbb3413-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g5bhj\" (UID: \"d1e0130c-e466-447b-92f0-4326dfbb3413\") " pod="openshift-insights/insights-runtime-extractor-g5bhj"
Jul 06 19:27:59.582511 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:59.582491    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d1e0130c-e466-447b-92f0-4326dfbb3413-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g5bhj\" (UID: \"d1e0130c-e466-447b-92f0-4326dfbb3413\") " pod="openshift-insights/insights-runtime-extractor-g5bhj"
Jul 06 19:27:59.584249 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:59.584228    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d1e0130c-e466-447b-92f0-4326dfbb3413-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g5bhj\" (UID: \"d1e0130c-e466-447b-92f0-4326dfbb3413\") " pod="openshift-insights/insights-runtime-extractor-g5bhj"
Jul 06 19:27:59.677725 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:59.677689    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xtdxx\""
Jul 06 19:27:59.685652 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:59.685633    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-g5bhj"
Jul 06 19:27:59.810701 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:59.810670    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-g5bhj"]
Jul 06 19:27:59.814039 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:27:59.814010    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1e0130c_e466_447b_92f0_4326dfbb3413.slice/crio-45f335cdc3a676c9b2f7b09b96bdd5970a360c27554062bc12273f30c1b1a0e1 WatchSource:0}: Error finding container 45f335cdc3a676c9b2f7b09b96bdd5970a360c27554062bc12273f30c1b1a0e1: Status 404 returned error can't find the container with id 45f335cdc3a676c9b2f7b09b96bdd5970a360c27554062bc12273f30c1b1a0e1
Jul 06 19:27:59.848026 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:27:59.847932    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g5bhj" event={"ID":"d1e0130c-e466-447b-92f0-4326dfbb3413","Type":"ContainerStarted","Data":"45f335cdc3a676c9b2f7b09b96bdd5970a360c27554062bc12273f30c1b1a0e1"}
Jul 06 19:28:01.429085 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:01.429054    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:01.530573 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:01.530527    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:01.594662 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:01.594628    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:01.720198 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:01.720091    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:02.096604 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:02.096569    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:02.197600 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:02.197565    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:02.323032 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:02.322989    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:02.440763 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:02.440679    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:03.054581 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:03.054551    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:03.155221 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:03.155188    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:03.217320 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:03.217279    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:03.304265 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:03.304232    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:03.520093 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:03.520062    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:03.621337 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:03.621304    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:03.862125 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:03.862089    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g5bhj" event={"ID":"d1e0130c-e466-447b-92f0-4326dfbb3413","Type":"ContainerStarted","Data":"12d52f6c5364444692a619509c1a0ef212a6d2a850506269a493644b5169c19e"}
Jul 06 19:28:04.867530 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:04.867488    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g5bhj" event={"ID":"d1e0130c-e466-447b-92f0-4326dfbb3413","Type":"ContainerStarted","Data":"00fe4b39f24cfd8f20fca1b2f839dbadd60016bcefb626df2bbfc387a8afc80e"}
Jul 06 19:28:06.653818 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:06.653777    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:06.751373 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:06.751286    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:06.860887 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:06.860854    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:06.875852 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:06.875825    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g5bhj" event={"ID":"d1e0130c-e466-447b-92f0-4326dfbb3413","Type":"ContainerStarted","Data":"e140e741961dc6fcbf063120d387b28a1d13540de320cbdcad4228c003824ce8"}
Jul 06 19:28:06.896768 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:06.896717    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-g5bhj" podStartSLOduration=17.347351792 podStartE2EDuration="23.896701681s" totalImagesPullingTime="6.549349889s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:27:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:06.895762002 +0000 UTC m=+144.671795436" watchObservedRunningTime="2026-07-06 19:28:06.896701681 +0000 UTC m=+144.672735080"
Jul 06 19:28:08.301364 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:08.301330    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:08.404670 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:08.404641    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:08.490565 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:08.490523    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:09.306998 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:09.306961    2555 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dfc5bf74-cckf5" podUID="b8dc533e-a04d-4f28-813b-c1ff07e8e23a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 06 19:28:09.739119 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:09.739039    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:09.832093 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:09.832059    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:12.534461 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:12.534425    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:12.604368 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:12.604334    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:13.746761 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:13.746726    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:13.848027 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:13.847992    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:13.929959 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:13.929926    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:14.376062 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:14.376028    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:14.490725 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:14.490691    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:18.967548 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:18.967514    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:19.065085 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:19.065056    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:19.253311 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:19.253236    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:19.306373 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:19.306339    2555 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dfc5bf74-cckf5" podUID="b8dc533e-a04d-4f28-813b-c1ff07e8e23a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 06 19:28:19.306480 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:19.306403    2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dfc5bf74-cckf5"
Jul 06 19:28:19.306897 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:19.306869    2555 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"00fd65c19d2fcf2a0a8eb1135ed391621a1058f173a5c39de641e450ad270b6d"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dfc5bf74-cckf5" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 06 19:28:19.306960 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:19.306938    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dfc5bf74-cckf5" podUID="b8dc533e-a04d-4f28-813b-c1ff07e8e23a" containerName="service-proxy" containerID="cri-o://00fd65c19d2fcf2a0a8eb1135ed391621a1058f173a5c39de641e450ad270b6d" gracePeriod=30
Jul 06 19:28:19.916405 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:19.916373    2555 generic.go:356] "Generic (PLEG): container finished" podID="b8dc533e-a04d-4f28-813b-c1ff07e8e23a" containerID="00fd65c19d2fcf2a0a8eb1135ed391621a1058f173a5c39de641e450ad270b6d" exitCode=2
Jul 06 19:28:19.916590 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:19.916440    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dfc5bf74-cckf5" event={"ID":"b8dc533e-a04d-4f28-813b-c1ff07e8e23a","Type":"ContainerDied","Data":"00fd65c19d2fcf2a0a8eb1135ed391621a1058f173a5c39de641e450ad270b6d"}
Jul 06 19:28:19.916590 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:19.916485    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dfc5bf74-cckf5" event={"ID":"b8dc533e-a04d-4f28-813b-c1ff07e8e23a","Type":"ContainerStarted","Data":"1e90d481d7247fae962b308f0b0ca57ea003d82991e58915d142a51b4f471662"}
Jul 06 19:28:20.154754 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:20.154717    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:20.243849 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:20.243780    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:20.537843 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:20.537817    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:20.653263 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:20.653223    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:21.245464 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:21.245431    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:21.984155 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:28:21.984099    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6cb4b4f47d-cwsdp" podUID="01d573f1-6d26-429c-b077-906718bd0625"
Jul 06 19:28:22.069318 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:28:22.069264    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-kzrzz" podUID="d8f4fbdd-f51d-47be-9c53-d613bd801d28"
Jul 06 19:28:22.134823 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:28:22.134784    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-9tcbq" podUID="e3f7af2d-5d72-4c10-88c4-44a193ad2b32"
Jul 06 19:28:22.925888 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:22.925792    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kzrzz"
Jul 06 19:28:22.925888 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:22.925793    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cb4b4f47d-cwsdp"
Jul 06 19:28:22.954419 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:22.954391    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:23.080121 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:23.080087    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:23.296355 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:23.296322    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:23.743871 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:23.743783    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:23.872617 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:23.872584    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ml8rq"]
Jul 06 19:28:23.875041 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:23.875020    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ml8rq"
Jul 06 19:28:23.893586 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:28:23.893540    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"node-exporter-ml8rq\" is forbidden: User \"system:node:ip-10-0-131-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-131-150.ec2.internal' and this object" podUID="ea0949d5-75de-4ba1-aeff-f44de9e9db27" pod="openshift-monitoring/node-exporter-ml8rq"
Jul 06 19:28:23.893586 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:28:23.893562    2555 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"metrics-client-ca\" is forbidden: User \"system:node:ip-10-0-131-150.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-131-150.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" type="*v1.ConfigMap"
Jul 06 19:28:23.893586 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:28:23.893553    2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-kube-rbac-proxy-config\" is forbidden: User \"system:node:ip-10-0-131-150.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-131-150.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" type="*v1.Secret"
Jul 06 19:28:23.893586 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:28:23.893553    2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-tls\" is forbidden: User \"system:node:ip-10-0-131-150.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-131-150.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" type="*v1.Secret"
Jul 06 19:28:23.893586 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:28:23.893553    2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-dockercfg-hnkzb\" is forbidden: User \"system:node:ip-10-0-131-150.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-131-150.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hnkzb\"" type="*v1.Secret"
Jul 06 19:28:23.893865 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:28:23.893589    2555 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-131-150.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-131-150.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 06 19:28:23.893865 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:28:23.893589    2555 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-131-150.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-131-150.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jul 06 19:28:23.893999 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:28:23.893978    2555 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"node-exporter-accelerators-collector-config\" is forbidden: User \"system:node:ip-10-0-131-150.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-131-150.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" type="*v1.ConfigMap"
Jul 06 19:28:23.966932 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:23.966881    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ea0949d5-75de-4ba1-aeff-f44de9e9db27-node-exporter-tls\") pod \"node-exporter-ml8rq\" (UID: \"ea0949d5-75de-4ba1-aeff-f44de9e9db27\") " pod="openshift-monitoring/node-exporter-ml8rq"
Jul 06 19:28:23.967302 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:23.966941    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea0949d5-75de-4ba1-aeff-f44de9e9db27-metrics-client-ca\") pod \"node-exporter-ml8rq\" (UID: \"ea0949d5-75de-4ba1-aeff-f44de9e9db27\") " pod="openshift-monitoring/node-exporter-ml8rq"
Jul 06 19:28:23.967302 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:23.967009    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ea0949d5-75de-4ba1-aeff-f44de9e9db27-node-exporter-textfile\") pod \"node-exporter-ml8rq\" (UID: \"ea0949d5-75de-4ba1-aeff-f44de9e9db27\") " pod="openshift-monitoring/node-exporter-ml8rq"
Jul 06 19:28:23.967302 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:23.967079    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ea0949d5-75de-4ba1-aeff-f44de9e9db27-node-exporter-wtmp\") pod \"node-exporter-ml8rq\" (UID: \"ea0949d5-75de-4ba1-aeff-f44de9e9db27\") " pod="openshift-monitoring/node-exporter-ml8rq"
Jul 06 19:28:23.967302 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:23.967123    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ea0949d5-75de-4ba1-aeff-f44de9e9db27-root\") pod \"node-exporter-ml8rq\" (UID: \"ea0949d5-75de-4ba1-aeff-f44de9e9db27\") " pod="openshift-monitoring/node-exporter-ml8rq"
Jul 06 19:28:23.967302 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:23.967144    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fx9vw\" (UniqueName: \"kubernetes.io/projected/ea0949d5-75de-4ba1-aeff-f44de9e9db27-kube-api-access-fx9vw\") pod \"node-exporter-ml8rq\" (UID: \"ea0949d5-75de-4ba1-aeff-f44de9e9db27\") " pod="openshift-monitoring/node-exporter-ml8rq"
Jul 06 19:28:23.967302 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:23.967172    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ea0949d5-75de-4ba1-aeff-f44de9e9db27-node-exporter-accelerators-collector-config\") pod \"node-exporter-ml8rq\" (UID: \"ea0949d5-75de-4ba1-aeff-f44de9e9db27\") " pod="openshift-monitoring/node-exporter-ml8rq"
Jul 06 19:28:23.967302 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:23.967199    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea0949d5-75de-4ba1-aeff-f44de9e9db27-sys\") pod \"node-exporter-ml8rq\" (UID: \"ea0949d5-75de-4ba1-aeff-f44de9e9db27\") " pod="openshift-monitoring/node-exporter-ml8rq"
Jul 06 19:28:23.967302 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:23.967223    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea0949d5-75de-4ba1-aeff-f44de9e9db27-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ml8rq\" (UID: \"ea0949d5-75de-4ba1-aeff-f44de9e9db27\") " pod="openshift-monitoring/node-exporter-ml8rq"
Jul 06 19:28:24.068143 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:24.068104    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ea0949d5-75de-4ba1-aeff-f44de9e9db27-node-exporter-tls\") pod \"node-exporter-ml8rq\" (UID: \"ea0949d5-75de-4ba1-aeff-f44de9e9db27\") " pod="openshift-monitoring/node-exporter-ml8rq"
Jul 06 19:28:24.068143 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:24.068141    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea0949d5-75de-4ba1-aeff-f44de9e9db27-metrics-client-ca\") pod \"node-exporter-ml8rq\" (UID: \"ea0949d5-75de-4ba1-aeff-f44de9e9db27\") " pod="openshift-monitoring/node-exporter-ml8rq"
Jul 06 19:28:24.068378 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:24.068161    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ea0949d5-75de-4ba1-aeff-f44de9e9db27-node-exporter-textfile\") pod \"node-exporter-ml8rq\" (UID: \"ea0949d5-75de-4ba1-aeff-f44de9e9db27\") " pod="openshift-monitoring/node-exporter-ml8rq"
Jul 06 19:28:24.068378 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:24.068211    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ea0949d5-75de-4ba1-aeff-f44de9e9db27-node-exporter-wtmp\") pod \"node-exporter-ml8rq\" (UID: \"ea0949d5-75de-4ba1-aeff-f44de9e9db27\") " pod="openshift-monitoring/node-exporter-ml8rq"
Jul 06 19:28:24.068378 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:24.068233    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ea0949d5-75de-4ba1-aeff-f44de9e9db27-root\") pod \"node-exporter-ml8rq\" (UID: \"ea0949d5-75de-4ba1-aeff-f44de9e9db27\") " pod="openshift-monitoring/node-exporter-ml8rq"
Jul 06 19:28:24.068378 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:24.068252    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fx9vw\" (UniqueName: \"kubernetes.io/projected/ea0949d5-75de-4ba1-aeff-f44de9e9db27-kube-api-access-fx9vw\") pod \"node-exporter-ml8rq\" (UID: \"ea0949d5-75de-4ba1-aeff-f44de9e9db27\") " pod="openshift-monitoring/node-exporter-ml8rq"
Jul 06 19:28:24.068378 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:24.068276    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ea0949d5-75de-4ba1-aeff-f44de9e9db27-node-exporter-accelerators-collector-config\") pod \"node-exporter-ml8rq\" (UID: \"ea0949d5-75de-4ba1-aeff-f44de9e9db27\") " pod="openshift-monitoring/node-exporter-ml8rq"
Jul 06 19:28:24.068378 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:24.068289    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ea0949d5-75de-4ba1-aeff-f44de9e9db27-root\") pod \"node-exporter-ml8rq\" (UID: \"ea0949d5-75de-4ba1-aeff-f44de9e9db27\") " pod="openshift-monitoring/node-exporter-ml8rq"
Jul 06 19:28:24.068378 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:24.068296    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea0949d5-75de-4ba1-aeff-f44de9e9db27-sys\") pod \"node-exporter-ml8rq\" (UID: \"ea0949d5-75de-4ba1-aeff-f44de9e9db27\") " pod="openshift-monitoring/node-exporter-ml8rq"
Jul 06 19:28:24.068378 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:24.068327    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea0949d5-75de-4ba1-aeff-f44de9e9db27-sys\") pod \"node-exporter-ml8rq\" (UID: \"ea0949d5-75de-4ba1-aeff-f44de9e9db27\") " pod="openshift-monitoring/node-exporter-ml8rq"
Jul 06 19:28:24.068378 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:24.068344    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea0949d5-75de-4ba1-aeff-f44de9e9db27-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ml8rq\" (UID: \"ea0949d5-75de-4ba1-aeff-f44de9e9db27\") " pod="openshift-monitoring/node-exporter-ml8rq"
Jul 06 19:28:24.068378 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:24.068353    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ea0949d5-75de-4ba1-aeff-f44de9e9db27-node-exporter-wtmp\") pod \"node-exporter-ml8rq\" (UID: \"ea0949d5-75de-4ba1-aeff-f44de9e9db27\") " pod="openshift-monitoring/node-exporter-ml8rq"
Jul 06 19:28:24.068790 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:24.068511    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ea0949d5-75de-4ba1-aeff-f44de9e9db27-node-exporter-textfile\") pod \"node-exporter-ml8rq\" (UID: \"ea0949d5-75de-4ba1-aeff-f44de9e9db27\") " pod="openshift-monitoring/node-exporter-ml8rq"
Jul 06 19:28:24.089408 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:24.089375    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:24.327337 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:24.327248    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:24.587442 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:24.587344    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:24.710302 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:24.710264    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 19:28:24.717144 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:24.717121    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hnkzb\""
Jul 06 19:28:24.719615 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:24.719595    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ea0949d5-75de-4ba1-aeff-f44de9e9db27-node-exporter-accelerators-collector-config\") pod \"node-exporter-ml8rq\" (UID: \"ea0949d5-75de-4ba1-aeff-f44de9e9db27\") " pod="openshift-monitoring/node-exporter-ml8rq"
Jul 06 19:28:24.722964 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:24.722940    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:24.738007 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:24.737981    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 19:28:24.829618 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:24.829581    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:24.859958 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:24.859854    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 19:28:24.870953 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:24.870900    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea0949d5-75de-4ba1-aeff-f44de9e9db27-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ml8rq\" (UID: \"ea0949d5-75de-4ba1-aeff-f44de9e9db27\") " pod="openshift-monitoring/node-exporter-ml8rq"
Jul 06 19:28:24.893348 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:24.893313    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 19:28:24.901642 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:24.901619    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fx9vw\" (UniqueName: \"kubernetes.io/projected/ea0949d5-75de-4ba1-aeff-f44de9e9db27-kube-api-access-fx9vw\") pod \"node-exporter-ml8rq\" (UID: \"ea0949d5-75de-4ba1-aeff-f44de9e9db27\") " pod="openshift-monitoring/node-exporter-ml8rq"
Jul 06 19:28:24.951792 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:24.951756    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 19:28:24.959409 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:24.959383    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea0949d5-75de-4ba1-aeff-f44de9e9db27-metrics-client-ca\") pod \"node-exporter-ml8rq\" (UID: \"ea0949d5-75de-4ba1-aeff-f44de9e9db27\") " pod="openshift-monitoring/node-exporter-ml8rq"
Jul 06 19:28:25.008472 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:25.008439    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:25.068815 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:28:25.068781    2555 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: failed to sync secret cache: timed out waiting for the condition
Jul 06 19:28:25.068897 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:28:25.068869    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea0949d5-75de-4ba1-aeff-f44de9e9db27-node-exporter-tls podName:ea0949d5-75de-4ba1-aeff-f44de9e9db27 nodeName:}" failed. No retries permitted until 2026-07-06 19:28:25.568853372 +0000 UTC m=+163.344886749 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ea0949d5-75de-4ba1-aeff-f44de9e9db27-node-exporter-tls") pod "node-exporter-ml8rq" (UID: "ea0949d5-75de-4ba1-aeff-f44de9e9db27") : failed to sync secret cache: timed out waiting for the condition
Jul 06 19:28:25.254896 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:25.254818    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:25.441550 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:25.441518    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:25.449681 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:25.449655    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 19:28:25.578191 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:25.578160    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ea0949d5-75de-4ba1-aeff-f44de9e9db27-node-exporter-tls\") pod \"node-exporter-ml8rq\" (UID: \"ea0949d5-75de-4ba1-aeff-f44de9e9db27\") " pod="openshift-monitoring/node-exporter-ml8rq"
Jul 06 19:28:25.580392 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:25.580371    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ea0949d5-75de-4ba1-aeff-f44de9e9db27-node-exporter-tls\") pod \"node-exporter-ml8rq\" (UID: \"ea0949d5-75de-4ba1-aeff-f44de9e9db27\") " pod="openshift-monitoring/node-exporter-ml8rq"
Jul 06 19:28:25.684065 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:25.684028    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ml8rq"
Jul 06 19:28:25.698406 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:28:25.698376    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea0949d5_75de_4ba1_aeff_f44de9e9db27.slice/crio-c75dbac3f719e5e656a06d652409dc6dc2da1c1ad0e6624d1a1cafb78f12bc18 WatchSource:0}: Error finding container c75dbac3f719e5e656a06d652409dc6dc2da1c1ad0e6624d1a1cafb78f12bc18: Status 404 returned error can't find the container with id c75dbac3f719e5e656a06d652409dc6dc2da1c1ad0e6624d1a1cafb78f12bc18
Jul 06 19:28:25.935595 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:25.935503    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ml8rq" event={"ID":"ea0949d5-75de-4ba1-aeff-f44de9e9db27","Type":"ContainerStarted","Data":"c75dbac3f719e5e656a06d652409dc6dc2da1c1ad0e6624d1a1cafb78f12bc18"}
Jul 06 19:28:26.529421 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:26.529386    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:26.633719 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:26.633677    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:26.789721 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:26.789640    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:26.940490 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:26.940449    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ml8rq" event={"ID":"ea0949d5-75de-4ba1-aeff-f44de9e9db27","Type":"ContainerStarted","Data":"daad182ca51c758662557fd0bfa10a1a30aa07d3dc3c9e23559be00e27e7c6b4"}
Jul 06 19:28:26.990879 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:26.990842    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/01d573f1-6d26-429c-b077-906718bd0625-registry-tls\") pod \"image-registry-6cb4b4f47d-cwsdp\" (UID: \"01d573f1-6d26-429c-b077-906718bd0625\") " pod="openshift-image-registry/image-registry-6cb4b4f47d-cwsdp"
Jul 06 19:28:26.993099 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:26.993071    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/01d573f1-6d26-429c-b077-906718bd0625-registry-tls\") pod \"image-registry-6cb4b4f47d-cwsdp\" (UID: \"01d573f1-6d26-429c-b077-906718bd0625\") " pod="openshift-image-registry/image-registry-6cb4b4f47d-cwsdp"
Jul 06 19:28:27.043367 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:27.043273    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:27.092230 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:27.092195    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8f4fbdd-f51d-47be-9c53-d613bd801d28-metrics-tls\") pod \"dns-default-kzrzz\" (UID: \"d8f4fbdd-f51d-47be-9c53-d613bd801d28\") " pod="openshift-dns/dns-default-kzrzz"
Jul 06 19:28:27.094491 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:27.094466    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8f4fbdd-f51d-47be-9c53-d613bd801d28-metrics-tls\") pod \"dns-default-kzrzz\" (UID: \"d8f4fbdd-f51d-47be-9c53-d613bd801d28\") " pod="openshift-dns/dns-default-kzrzz"
Jul 06 19:28:27.129521 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:27.129490    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cjqsb\""
Jul 06 19:28:27.130067 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:27.130048    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qgt64\""
Jul 06 19:28:27.137188 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:27.137160    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cb4b4f47d-cwsdp"
Jul 06 19:28:27.137318 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:27.137247    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kzrzz"
Jul 06 19:28:27.288989 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:27.288953    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6cb4b4f47d-cwsdp"]
Jul 06 19:28:27.292421 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:28:27.292388    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01d573f1_6d26_429c_b077_906718bd0625.slice/crio-6ed384b7066e163c5ed8e5528a482fc969017d7b163a9c7318b8e31600565b04 WatchSource:0}: Error finding container 6ed384b7066e163c5ed8e5528a482fc969017d7b163a9c7318b8e31600565b04: Status 404 returned error can't find the container with id 6ed384b7066e163c5ed8e5528a482fc969017d7b163a9c7318b8e31600565b04
Jul 06 19:28:27.295285 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:27.295141    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kzrzz"]
Jul 06 19:28:27.297122 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:28:27.297098    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8f4fbdd_f51d_47be_9c53_d613bd801d28.slice/crio-12fef83258ac725aba78e28265f77b8885b17d2f69475af65e5439692ea5f29e WatchSource:0}: Error finding container 12fef83258ac725aba78e28265f77b8885b17d2f69475af65e5439692ea5f29e: Status 404 returned error can't find the container with id 12fef83258ac725aba78e28265f77b8885b17d2f69475af65e5439692ea5f29e
Jul 06 19:28:27.945871 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:27.945788    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kzrzz" event={"ID":"d8f4fbdd-f51d-47be-9c53-d613bd801d28","Type":"ContainerStarted","Data":"12fef83258ac725aba78e28265f77b8885b17d2f69475af65e5439692ea5f29e"}
Jul 06 19:28:27.947432 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:27.947405    2555 generic.go:356] "Generic (PLEG): container finished" podID="3514e05c-eb46-42d8-9f78-01849346fca5" containerID="ae6b92a36d947364af6b5f7366b95e5a24fbbb2047ccdfffe409e3b0b679028f" exitCode=1
Jul 06 19:28:27.947567 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:27.947483    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9b6d97c5-lcx5d" event={"ID":"3514e05c-eb46-42d8-9f78-01849346fca5","Type":"ContainerDied","Data":"ae6b92a36d947364af6b5f7366b95e5a24fbbb2047ccdfffe409e3b0b679028f"}
Jul 06 19:28:27.947954 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:27.947852    2555 scope.go:117] "RemoveContainer" containerID="ae6b92a36d947364af6b5f7366b95e5a24fbbb2047ccdfffe409e3b0b679028f"
Jul 06 19:28:27.949111 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:27.949081    2555 generic.go:356] "Generic (PLEG): container finished" podID="c8b8ef69-09a9-410c-945a-b6388e09574a" containerID="854bc8f70964422d6beacb59112e8c2e31c00e5d7b92465e89bafb927080e642" exitCode=255
Jul 06 19:28:27.949232 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:27.949159    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb69c4684-sgg6d" event={"ID":"c8b8ef69-09a9-410c-945a-b6388e09574a","Type":"ContainerDied","Data":"854bc8f70964422d6beacb59112e8c2e31c00e5d7b92465e89bafb927080e642"}
Jul 06 19:28:27.949492 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:27.949472    2555 scope.go:117] "RemoveContainer" containerID="854bc8f70964422d6beacb59112e8c2e31c00e5d7b92465e89bafb927080e642"
Jul 06 19:28:27.951067 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:27.951042    2555 generic.go:356] "Generic (PLEG): container finished" podID="ea0949d5-75de-4ba1-aeff-f44de9e9db27" containerID="daad182ca51c758662557fd0bfa10a1a30aa07d3dc3c9e23559be00e27e7c6b4" exitCode=0
Jul 06 19:28:27.951166 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:27.951121    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ml8rq" event={"ID":"ea0949d5-75de-4ba1-aeff-f44de9e9db27","Type":"ContainerDied","Data":"daad182ca51c758662557fd0bfa10a1a30aa07d3dc3c9e23559be00e27e7c6b4"}
Jul 06 19:28:27.952963 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:27.952941    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cb4b4f47d-cwsdp" event={"ID":"01d573f1-6d26-429c-b077-906718bd0625","Type":"ContainerStarted","Data":"7fd5604955b35cf6fba8d30e8429580a735f80dcaa4ab97270862188d7dfa48b"}
Jul 06 19:28:27.953060 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:27.952981    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cb4b4f47d-cwsdp" event={"ID":"01d573f1-6d26-429c-b077-906718bd0625","Type":"ContainerStarted","Data":"6ed384b7066e163c5ed8e5528a482fc969017d7b163a9c7318b8e31600565b04"}
Jul 06 19:28:27.953122 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:27.953065    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6cb4b4f47d-cwsdp"
Jul 06 19:28:28.026427 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:28.026373    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6cb4b4f47d-cwsdp" podStartSLOduration=164.026350158 podStartE2EDuration="2m44.026350158s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:25:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:28.025633645 +0000 UTC m=+165.801667044" watchObservedRunningTime="2026-07-06 19:28:28.026350158 +0000 UTC m=+165.802383559"
Jul 06 19:28:28.285375 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:28.285336    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:28.434903 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:28.434857    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:28.563659 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:28.563560    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9b6d97c5-lcx5d"
Jul 06 19:28:28.597897 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:28.597864    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:28.957464 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:28.957435    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kzrzz" event={"ID":"d8f4fbdd-f51d-47be-9c53-d613bd801d28","Type":"ContainerStarted","Data":"94010146ece30e19f91f0a4f22c175e952838e519fbe0200cb3ead95db7b068e"}
Jul 06 19:28:28.959068 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:28.959040    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9b6d97c5-lcx5d" event={"ID":"3514e05c-eb46-42d8-9f78-01849346fca5","Type":"ContainerStarted","Data":"e2a8d4c643785d831cb669f01e251b966003926494bdc1fff2ac8eb87571d2a4"}
Jul 06 19:28:28.959600 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:28.959550    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9b6d97c5-lcx5d"
Jul 06 19:28:28.960021 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:28.959994    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b9b6d97c5-lcx5d"
Jul 06 19:28:28.965799 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:28.965764    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb69c4684-sgg6d" event={"ID":"c8b8ef69-09a9-410c-945a-b6388e09574a","Type":"ContainerStarted","Data":"86af824e09e6433f1fe07b9ca15fc6673ea13a7819dd916a594a08f159ea5b6d"}
Jul 06 19:28:28.968139 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:28.968110    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ml8rq" event={"ID":"ea0949d5-75de-4ba1-aeff-f44de9e9db27","Type":"ContainerStarted","Data":"2bb0a4e925829494772e916c14d0a6f79a318c8f9894bfd8a2047403805f307b"}
Jul 06 19:28:28.968337 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:28.968318    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ml8rq" event={"ID":"ea0949d5-75de-4ba1-aeff-f44de9e9db27","Type":"ContainerStarted","Data":"12db25d639a9866c5b92b9e6d90d1af0c26f925747a72dbb5fbde6d30e72f032"}
Jul 06 19:28:29.042480 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:29.042413    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ml8rq" podStartSLOduration=4.836488465 podStartE2EDuration="6.042391027s" totalImagesPullingTime="1.138975512s" totalInitContainerRuntime="66.92705ms" isStatefulPod=true podCreationTimestamp="2026-07-06 19:28:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:29.042325472 +0000 UTC m=+166.818358890" watchObservedRunningTime="2026-07-06 19:28:29.042391027 +0000 UTC m=+166.818424424"
Jul 06 19:28:29.775119 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:29.775086    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:29.973625 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:29.973589    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kzrzz" event={"ID":"d8f4fbdd-f51d-47be-9c53-d613bd801d28","Type":"ContainerStarted","Data":"cef71ce6da1aca1ff1f74681495bab6fe6369550be72bb4f9ecf2aff47dfbf18"}
Jul 06 19:28:29.974103 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:29.973687    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kzrzz"
Jul 06 19:28:30.008556 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:30.008510    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-kzrzz" podStartSLOduration=129.504612719 podStartE2EDuration="2m11.008493456s" totalImagesPullingTime="1.503880737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:26:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:30.00677604 +0000 UTC m=+167.782809439" watchObservedRunningTime="2026-07-06 19:28:30.008493456 +0000 UTC m=+167.784526855"
Jul 06 19:28:30.911077 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:30.911043    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:31.007064 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:31.007031    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:33.069154 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:33.069118    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:33.168318 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:33.168285    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:34.125663 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:34.125579    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tcbq"
Jul 06 19:28:39.978820 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:39.978788    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kzrzz"
Jul 06 19:28:40.494879 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:40.494840    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:40.676615 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:40.676580    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:42.257880 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:42.257844    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:42.360156 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:42.360121    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:44.675536 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:44.675494    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:44.783935 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:44.783866    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:44.884839 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:44.884806    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:45.861136 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:45.861101    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:45.959946 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:45.959892    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:47.142026 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:47.141990    2555 patch_prober.go:28] interesting pod/image-registry-6cb4b4f47d-cwsdp container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 06 19:28:47.142382 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:47.142044    2555 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6cb4b4f47d-cwsdp" podUID="01d573f1-6d26-429c-b077-906718bd0625" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 19:28:48.973097 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:48.973073    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6cb4b4f47d-cwsdp"
Jul 06 19:28:49.180455 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:49.180421    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:49.377457 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:49.377423    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:49.411028 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:49.411005    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kzrzz_d8f4fbdd-f51d-47be-9c53-d613bd801d28/dns/0.log"
Jul 06 19:28:49.634781 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:49.634714    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kzrzz_d8f4fbdd-f51d-47be-9c53-d613bd801d28/kube-rbac-proxy/0.log"
Jul 06 19:28:50.604748 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:50.604724    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5d2dt_e8893200-b607-4e1e-8a6c-fb4a31110947/dns-node-resolver/0.log"
Jul 06 19:28:51.605446 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:51.605417    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qpv6m_55eea3e5-2d23-4877-a59c-99fb920ff42e/serve-healthcheck-canary/0.log"
Jul 06 19:28:56.987902 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:56.987870    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6cb4b4f47d-cwsdp"]
Jul 06 19:28:57.061016 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:57.060982    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:57.185219 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:57.185192    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:57.312650 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:57.312627    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:57.635390 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:57.635314    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:57.763837 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:28:57.763805    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:29:00.447310 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:00.447267    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:29:00.550213 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:00.550113    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:29:03.229788 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:03.229754    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:29:03.497949 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:03.497852    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:29:07.177392 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:07.177357    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:29:07.315506 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:07.315476    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:29:09.609691 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:09.609654    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:29:09.855871 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:09.855787    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:29:13.814954 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:13.814896    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:29:13.891851 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:13.891799    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:29:18.111703 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:18.111662    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:29:18.245445 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:18.245411    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:29:22.007674 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:22.007605    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6cb4b4f47d-cwsdp" podUID="01d573f1-6d26-429c-b077-906718bd0625" containerName="registry" containerID="cri-o://7fd5604955b35cf6fba8d30e8429580a735f80dcaa4ab97270862188d7dfa48b" gracePeriod=30
Jul 06 19:29:23.147094 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:23.147062    2555 generic.go:356] "Generic (PLEG): container finished" podID="01d573f1-6d26-429c-b077-906718bd0625" containerID="7fd5604955b35cf6fba8d30e8429580a735f80dcaa4ab97270862188d7dfa48b" exitCode=0
Jul 06 19:29:23.147491 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:23.147137    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cb4b4f47d-cwsdp" event={"ID":"01d573f1-6d26-429c-b077-906718bd0625","Type":"ContainerDied","Data":"7fd5604955b35cf6fba8d30e8429580a735f80dcaa4ab97270862188d7dfa48b"}
Jul 06 19:29:23.254180 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:23.254156    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cb4b4f47d-cwsdp"
Jul 06 19:29:23.320404 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:23.320375    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/01d573f1-6d26-429c-b077-906718bd0625-registry-tls\") pod \"01d573f1-6d26-429c-b077-906718bd0625\" (UID: \"01d573f1-6d26-429c-b077-906718bd0625\") "
Jul 06 19:29:23.320594 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:23.320417    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/01d573f1-6d26-429c-b077-906718bd0625-image-registry-private-configuration\") pod \"01d573f1-6d26-429c-b077-906718bd0625\" (UID: \"01d573f1-6d26-429c-b077-906718bd0625\") "
Jul 06 19:29:23.320594 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:23.320444    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/01d573f1-6d26-429c-b077-906718bd0625-installation-pull-secrets\") pod \"01d573f1-6d26-429c-b077-906718bd0625\" (UID: \"01d573f1-6d26-429c-b077-906718bd0625\") "
Jul 06 19:29:23.320594 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:23.320484    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/01d573f1-6d26-429c-b077-906718bd0625-ca-trust-extracted\") pod \"01d573f1-6d26-429c-b077-906718bd0625\" (UID: \"01d573f1-6d26-429c-b077-906718bd0625\") "
Jul 06 19:29:23.320594 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:23.320519    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/01d573f1-6d26-429c-b077-906718bd0625-registry-certificates\") pod \"01d573f1-6d26-429c-b077-906718bd0625\" (UID: \"01d573f1-6d26-429c-b077-906718bd0625\") "
Jul 06 19:29:23.320594 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:23.320564    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tm9lm\" (UniqueName: \"kubernetes.io/projected/01d573f1-6d26-429c-b077-906718bd0625-kube-api-access-tm9lm\") pod \"01d573f1-6d26-429c-b077-906718bd0625\" (UID: \"01d573f1-6d26-429c-b077-906718bd0625\") "
Jul 06 19:29:23.320594 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:23.320585    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/01d573f1-6d26-429c-b077-906718bd0625-trusted-ca\") pod \"01d573f1-6d26-429c-b077-906718bd0625\" (UID: \"01d573f1-6d26-429c-b077-906718bd0625\") "
Jul 06 19:29:23.320886 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:23.320612    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/01d573f1-6d26-429c-b077-906718bd0625-bound-sa-token\") pod \"01d573f1-6d26-429c-b077-906718bd0625\" (UID: \"01d573f1-6d26-429c-b077-906718bd0625\") "
Jul 06 19:29:23.321346 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:23.321306    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01d573f1-6d26-429c-b077-906718bd0625-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "01d573f1-6d26-429c-b077-906718bd0625" (UID: "01d573f1-6d26-429c-b077-906718bd0625"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:29:23.321455 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:23.321334    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01d573f1-6d26-429c-b077-906718bd0625-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "01d573f1-6d26-429c-b077-906718bd0625" (UID: "01d573f1-6d26-429c-b077-906718bd0625"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:29:23.323442 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:23.323378    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01d573f1-6d26-429c-b077-906718bd0625-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "01d573f1-6d26-429c-b077-906718bd0625" (UID: "01d573f1-6d26-429c-b077-906718bd0625"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:29:23.323553 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:23.323516    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01d573f1-6d26-429c-b077-906718bd0625-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "01d573f1-6d26-429c-b077-906718bd0625" (UID: "01d573f1-6d26-429c-b077-906718bd0625"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:29:23.323553 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:23.323541    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01d573f1-6d26-429c-b077-906718bd0625-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "01d573f1-6d26-429c-b077-906718bd0625" (UID: "01d573f1-6d26-429c-b077-906718bd0625"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:29:23.323764 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:23.323670    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01d573f1-6d26-429c-b077-906718bd0625-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "01d573f1-6d26-429c-b077-906718bd0625" (UID: "01d573f1-6d26-429c-b077-906718bd0625"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:29:23.323844 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:23.323821    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01d573f1-6d26-429c-b077-906718bd0625-kube-api-access-tm9lm" (OuterVolumeSpecName: "kube-api-access-tm9lm") pod "01d573f1-6d26-429c-b077-906718bd0625" (UID: "01d573f1-6d26-429c-b077-906718bd0625"). InnerVolumeSpecName "kube-api-access-tm9lm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:29:23.331280 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:23.331253    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01d573f1-6d26-429c-b077-906718bd0625-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "01d573f1-6d26-429c-b077-906718bd0625" (UID: "01d573f1-6d26-429c-b077-906718bd0625"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:29:23.421191 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:23.421086    2555 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/01d573f1-6d26-429c-b077-906718bd0625-ca-trust-extracted\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:29:23.421191 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:23.421130    2555 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/01d573f1-6d26-429c-b077-906718bd0625-registry-certificates\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:29:23.421191 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:23.421146    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tm9lm\" (UniqueName: \"kubernetes.io/projected/01d573f1-6d26-429c-b077-906718bd0625-kube-api-access-tm9lm\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:29:23.421191 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:23.421158    2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/01d573f1-6d26-429c-b077-906718bd0625-trusted-ca\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:29:23.421191 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:23.421172    2555 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/01d573f1-6d26-429c-b077-906718bd0625-bound-sa-token\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:29:23.421191 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:23.421184    2555 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/01d573f1-6d26-429c-b077-906718bd0625-registry-tls\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:29:23.421191 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:23.421198    2555 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/01d573f1-6d26-429c-b077-906718bd0625-image-registry-private-configuration\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:29:23.421541 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:23.421212    2555 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/01d573f1-6d26-429c-b077-906718bd0625-installation-pull-secrets\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:29:24.151181 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:24.151152    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cb4b4f47d-cwsdp"
Jul 06 19:29:24.151181 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:24.151163    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cb4b4f47d-cwsdp" event={"ID":"01d573f1-6d26-429c-b077-906718bd0625","Type":"ContainerDied","Data":"6ed384b7066e163c5ed8e5528a482fc969017d7b163a9c7318b8e31600565b04"}
Jul 06 19:29:24.151604 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:24.151217    2555 scope.go:117] "RemoveContainer" containerID="7fd5604955b35cf6fba8d30e8429580a735f80dcaa4ab97270862188d7dfa48b"
Jul 06 19:29:24.192235 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:24.192204    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6cb4b4f47d-cwsdp"]
Jul 06 19:29:24.197415 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:24.197389    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6cb4b4f47d-cwsdp"]
Jul 06 19:29:26.128785 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:26.128750    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01d573f1-6d26-429c-b077-906718bd0625" path="/var/lib/kubelet/pods/01d573f1-6d26-429c-b077-906718bd0625/volumes"
Jul 06 19:29:34.708223 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:34.708186    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:29:34.793784 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:34.793748    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:29:39.708199 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:39.708169    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:29:39.865540 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:39.865500    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:29:42.629575 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:42.629541    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:29:47.338717 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:47.338685    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:29:47.429634 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:47.429599    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:29:48.080176 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:48.080146    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:29:48.183342 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:48.183304    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:29:55.052008 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:55.051964    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f7af2d-5d72-4c10-88c4-44a193ad2b32-metrics-certs\") pod \"network-metrics-daemon-9tcbq\" (UID: \"e3f7af2d-5d72-4c10-88c4-44a193ad2b32\") " pod="openshift-multus/network-metrics-daemon-9tcbq"
Jul 06 19:29:55.054254 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:55.054230    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3f7af2d-5d72-4c10-88c4-44a193ad2b32-metrics-certs\") pod \"network-metrics-daemon-9tcbq\" (UID: \"e3f7af2d-5d72-4c10-88c4-44a193ad2b32\") " pod="openshift-multus/network-metrics-daemon-9tcbq"
Jul 06 19:29:55.129125 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:55.129094    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kmvz5\""
Jul 06 19:29:55.137121 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:55.137098    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tcbq"
Jul 06 19:29:55.266822 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:55.266792    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9tcbq"]
Jul 06 19:29:55.269943 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:29:55.269904    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3f7af2d_5d72_4c10_88c4_44a193ad2b32.slice/crio-33d2ebd01e1cea59f02334bf26e010a4915dbb05b885af4df160b43719cc722d WatchSource:0}: Error finding container 33d2ebd01e1cea59f02334bf26e010a4915dbb05b885af4df160b43719cc722d: Status 404 returned error can't find the container with id 33d2ebd01e1cea59f02334bf26e010a4915dbb05b885af4df160b43719cc722d
Jul 06 19:29:56.257547 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:56.257462    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9tcbq" event={"ID":"e3f7af2d-5d72-4c10-88c4-44a193ad2b32","Type":"ContainerStarted","Data":"0c6931427b36c7b14f7daa6707c27ef2a1454369fa2c4285bdf008fbddc99457"}
Jul 06 19:29:56.257547 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:56.257521    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9tcbq" event={"ID":"e3f7af2d-5d72-4c10-88c4-44a193ad2b32","Type":"ContainerStarted","Data":"33d2ebd01e1cea59f02334bf26e010a4915dbb05b885af4df160b43719cc722d"}
Jul 06 19:29:57.262320 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:57.262282    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9tcbq" event={"ID":"e3f7af2d-5d72-4c10-88c4-44a193ad2b32","Type":"ContainerStarted","Data":"1eb5dfbf502419e351535d13fac50c91c6e218261314581d0f04c4e7a2badb22"}
Jul 06 19:29:57.281778 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:57.281728    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9tcbq" podStartSLOduration=252.398043697 podStartE2EDuration="4m13.281710904s" totalImagesPullingTime="883.667207ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:25:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:29:57.280978588 +0000 UTC m=+255.057012000" watchObservedRunningTime="2026-07-06 19:29:57.281710904 +0000 UTC m=+255.057744280"
Jul 06 19:29:57.404393 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:57.404361    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:29:57.483403 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:29:57.483377    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:01.725031 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:30:01.724995    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:01.835761 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:30:01.835714    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:03.234036 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:30:03.234001    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:03.342428 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:30:03.342386    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:09.636861 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:30:09.636777    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:09.743729 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:30:09.743696    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:11.723163 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:30:11.723129    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:13.112169 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:30:13.112133    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:13.212175 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:30:13.212143    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:19.509129 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:30:19.509081    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:19.620830 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:30:19.620799    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:44.025200 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:30:44.025170    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j9wtk_bb750a78-aa1e-4c55-b771-e06ca00b997a/ovn-acl-logging/0.log"
Jul 06 19:30:44.028263 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:30:44.028242    2555 kubelet.go:1648] "Image garbage collection succeeded"
Jul 06 19:30:44.042772 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:30:44.042743    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j9wtk_bb750a78-aa1e-4c55-b771-e06ca00b997a/ovn-acl-logging/0.log"
Jul 06 19:30:46.842449 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:30:46.842416    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:47.119307 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:30:47.119218    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:13.795521 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:13.795486    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:14.881353 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:14.881318    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:18.227710 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:18.227674    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:18.360474 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:18.360442    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:19.791164 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:19.791128    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:20.042887 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:20.042799    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:20.876461 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:20.876425    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:21.078796 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:21.078728    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:23.192895 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:23.192859    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:23.446308 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:23.446222    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:23.964161 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:23.964122    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:24.064927 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:24.064891    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:28.939501 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:28.939466    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:29.028522 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:29.028486    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:30.550489 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:30.550456    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:31.221209 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:31.221178    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-p5hzd"]
Jul 06 19:31:31.221428 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:31.221416    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01d573f1-6d26-429c-b077-906718bd0625" containerName="registry"
Jul 06 19:31:31.221477 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:31.221429    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="01d573f1-6d26-429c-b077-906718bd0625" containerName="registry"
Jul 06 19:31:31.221509 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:31.221478    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="01d573f1-6d26-429c-b077-906718bd0625" containerName="registry"
Jul 06 19:31:31.224216 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:31.224196    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-p5hzd"
Jul 06 19:31:31.234890 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:31.234867    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-hl5zp\""
Jul 06 19:31:31.235066 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:31.235050    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 06 19:31:31.235502 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:31.235489    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 06 19:31:31.272163 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:31.272125    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-p5hzd"]
Jul 06 19:31:31.331130 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:31.331088    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr4v8\" (UniqueName: \"kubernetes.io/projected/a6f9c8e0-532c-4a96-a098-342e6c8e3eba-kube-api-access-dr4v8\") pod \"cert-manager-55b4d954d5-p5hzd\" (UID: \"a6f9c8e0-532c-4a96-a098-342e6c8e3eba\") " pod="cert-manager/cert-manager-55b4d954d5-p5hzd"
Jul 06 19:31:31.331283 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:31.331149    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a6f9c8e0-532c-4a96-a098-342e6c8e3eba-bound-sa-token\") pod \"cert-manager-55b4d954d5-p5hzd\" (UID: \"a6f9c8e0-532c-4a96-a098-342e6c8e3eba\") " pod="cert-manager/cert-manager-55b4d954d5-p5hzd"
Jul 06 19:31:31.432119 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:31.432087    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a6f9c8e0-532c-4a96-a098-342e6c8e3eba-bound-sa-token\") pod \"cert-manager-55b4d954d5-p5hzd\" (UID: \"a6f9c8e0-532c-4a96-a098-342e6c8e3eba\") " pod="cert-manager/cert-manager-55b4d954d5-p5hzd"
Jul 06 19:31:31.432247 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:31.432128    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr4v8\" (UniqueName: \"kubernetes.io/projected/a6f9c8e0-532c-4a96-a098-342e6c8e3eba-kube-api-access-dr4v8\") pod \"cert-manager-55b4d954d5-p5hzd\" (UID: \"a6f9c8e0-532c-4a96-a098-342e6c8e3eba\") " pod="cert-manager/cert-manager-55b4d954d5-p5hzd"
Jul 06 19:31:31.444826 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:31.444797    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a6f9c8e0-532c-4a96-a098-342e6c8e3eba-bound-sa-token\") pod \"cert-manager-55b4d954d5-p5hzd\" (UID: \"a6f9c8e0-532c-4a96-a098-342e6c8e3eba\") " pod="cert-manager/cert-manager-55b4d954d5-p5hzd"
Jul 06 19:31:31.446736 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:31.446708    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr4v8\" (UniqueName: \"kubernetes.io/projected/a6f9c8e0-532c-4a96-a098-342e6c8e3eba-kube-api-access-dr4v8\") pod \"cert-manager-55b4d954d5-p5hzd\" (UID: \"a6f9c8e0-532c-4a96-a098-342e6c8e3eba\") " pod="cert-manager/cert-manager-55b4d954d5-p5hzd"
Jul 06 19:31:31.533024 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:31.532982    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-p5hzd"
Jul 06 19:31:31.712282 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:31.712252    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-p5hzd"]
Jul 06 19:31:31.713248 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:31:31.713218    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda6f9c8e0_532c_4a96_a098_342e6c8e3eba.slice/crio-90bbe69efd32d1ed2ab5653a4a342e10bc0b72c527b122483fb43919e528ab9f WatchSource:0}: Error finding container 90bbe69efd32d1ed2ab5653a4a342e10bc0b72c527b122483fb43919e528ab9f: Status 404 returned error can't find the container with id 90bbe69efd32d1ed2ab5653a4a342e10bc0b72c527b122483fb43919e528ab9f
Jul 06 19:31:31.715105 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:31.715087    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:31:32.572370 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:32.572335    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-p5hzd" event={"ID":"a6f9c8e0-532c-4a96-a098-342e6c8e3eba","Type":"ContainerStarted","Data":"90bbe69efd32d1ed2ab5653a4a342e10bc0b72c527b122483fb43919e528ab9f"}
Jul 06 19:31:33.174974 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:33.174869    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:33.293435 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:33.293388    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:34.602515 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:34.602441    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tgfvm"]
Jul 06 19:31:34.605947 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:34.605926    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tgfvm"
Jul 06 19:31:34.610186 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:34.610165    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:31:34.610938 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:34.610904    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 06 19:31:34.610938 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:34.610903    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-jt8qt\""
Jul 06 19:31:34.620468 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:34.620447    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tgfvm"]
Jul 06 19:31:34.658153 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:34.658120    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dwv6\" (UniqueName: \"kubernetes.io/projected/bcbade22-7345-4c27-b92b-e9551fadd075-kube-api-access-7dwv6\") pod \"openshift-lws-operator-fd8ccff4c-tgfvm\" (UID: \"bcbade22-7345-4c27-b92b-e9551fadd075\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tgfvm"
Jul 06 19:31:34.658297 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:34.658164    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bcbade22-7345-4c27-b92b-e9551fadd075-tmp\") pod \"openshift-lws-operator-fd8ccff4c-tgfvm\" (UID: \"bcbade22-7345-4c27-b92b-e9551fadd075\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tgfvm"
Jul 06 19:31:34.759215 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:34.759184    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dwv6\" (UniqueName: \"kubernetes.io/projected/bcbade22-7345-4c27-b92b-e9551fadd075-kube-api-access-7dwv6\") pod \"openshift-lws-operator-fd8ccff4c-tgfvm\" (UID: \"bcbade22-7345-4c27-b92b-e9551fadd075\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tgfvm"
Jul 06 19:31:34.759215 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:34.759220    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bcbade22-7345-4c27-b92b-e9551fadd075-tmp\") pod \"openshift-lws-operator-fd8ccff4c-tgfvm\" (UID: \"bcbade22-7345-4c27-b92b-e9551fadd075\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tgfvm"
Jul 06 19:31:34.759614 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:34.759594    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bcbade22-7345-4c27-b92b-e9551fadd075-tmp\") pod \"openshift-lws-operator-fd8ccff4c-tgfvm\" (UID: \"bcbade22-7345-4c27-b92b-e9551fadd075\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tgfvm"
Jul 06 19:31:34.768372 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:34.768341    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dwv6\" (UniqueName: \"kubernetes.io/projected/bcbade22-7345-4c27-b92b-e9551fadd075-kube-api-access-7dwv6\") pod \"openshift-lws-operator-fd8ccff4c-tgfvm\" (UID: \"bcbade22-7345-4c27-b92b-e9551fadd075\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tgfvm"
Jul 06 19:31:34.915330 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:34.915239    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tgfvm"
Jul 06 19:31:35.045336 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:35.045301    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tgfvm"]
Jul 06 19:31:35.047996 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:31:35.047967    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbcbade22_7345_4c27_b92b_e9551fadd075.slice/crio-96dc5f53489d5732aef2440f0c6f881cee7bce09fc5bb29641741ec8eb43c257 WatchSource:0}: Error finding container 96dc5f53489d5732aef2440f0c6f881cee7bce09fc5bb29641741ec8eb43c257: Status 404 returned error can't find the container with id 96dc5f53489d5732aef2440f0c6f881cee7bce09fc5bb29641741ec8eb43c257
Jul 06 19:31:35.583465 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:35.583428    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-p5hzd" event={"ID":"a6f9c8e0-532c-4a96-a098-342e6c8e3eba","Type":"ContainerStarted","Data":"9e92efe52b7f26ef8c8c778e0b5fdd3e1b2823cfeda971a70b1cba91e285068f"}
Jul 06 19:31:35.584655 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:35.584636    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tgfvm" event={"ID":"bcbade22-7345-4c27-b92b-e9551fadd075","Type":"ContainerStarted","Data":"96dc5f53489d5732aef2440f0c6f881cee7bce09fc5bb29641741ec8eb43c257"}
Jul 06 19:31:35.601094 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:35.601049    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-p5hzd" podStartSLOduration=1.650716279 podStartE2EDuration="4.601034625s" totalImagesPullingTime="2.950318346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:31:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:31:35.600886715 +0000 UTC m=+353.376920115" watchObservedRunningTime="2026-07-06 19:31:35.601034625 +0000 UTC m=+353.377068024"
Jul 06 19:31:38.603179 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:38.603109    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tgfvm" event={"ID":"bcbade22-7345-4c27-b92b-e9551fadd075","Type":"ContainerStarted","Data":"d1496abd2116f441b1bb8369e6ff564341733d32c649ce0b12bd511896d36378"}
Jul 06 19:31:38.632373 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:38.632313    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tgfvm" podStartSLOduration=2.091102675 podStartE2EDuration="4.63229183s" totalImagesPullingTime="2.541189155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:31:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:31:38.629711848 +0000 UTC m=+356.405745248" watchObservedRunningTime="2026-07-06 19:31:38.63229183 +0000 UTC m=+356.408325233"
Jul 06 19:31:39.505704 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:39.505668    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:39.664358 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:39.664324    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:41.729510 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:41.729474    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:53.807648 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:53.807607    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:54.262706 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:54.262629    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:54.537714 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:54.537687    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:54.998325 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:54.998236    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:55.201482 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:55.201448    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79c9ddb849-cx94f"]
Jul 06 19:31:55.207683 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:55.207657    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-cx94f"
Jul 06 19:31:55.212726 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:55.212699    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gfdrn\""
Jul 06 19:31:55.215851 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:55.215830    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 06 19:31:55.215851 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:55.215844    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 06 19:31:55.217743 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:55.217725    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 06 19:31:55.218769 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:55.218756    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 06 19:31:55.308823 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:55.308796    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79c9ddb849-cx94f"]
Jul 06 19:31:55.324023 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:55.323995    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c7dee535-a870-4e31-9a68-5aaaaff90be2-webhook-cert\") pod \"opendatahub-operator-controller-manager-79c9ddb849-cx94f\" (UID: \"c7dee535-a870-4e31-9a68-5aaaaff90be2\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-cx94f"
Jul 06 19:31:55.324180 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:55.324075    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr27n\" (UniqueName: \"kubernetes.io/projected/c7dee535-a870-4e31-9a68-5aaaaff90be2-kube-api-access-mr27n\") pod \"opendatahub-operator-controller-manager-79c9ddb849-cx94f\" (UID: \"c7dee535-a870-4e31-9a68-5aaaaff90be2\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-cx94f"
Jul 06 19:31:55.324180 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:55.324126    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c7dee535-a870-4e31-9a68-5aaaaff90be2-manifests\") pod \"opendatahub-operator-controller-manager-79c9ddb849-cx94f\" (UID: \"c7dee535-a870-4e31-9a68-5aaaaff90be2\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-cx94f"
Jul 06 19:31:55.324180 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:55.324155    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c7dee535-a870-4e31-9a68-5aaaaff90be2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79c9ddb849-cx94f\" (UID: \"c7dee535-a870-4e31-9a68-5aaaaff90be2\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-cx94f"
Jul 06 19:31:55.324180 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:55.324181    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c7dee535-a870-4e31-9a68-5aaaaff90be2-tmp\") pod \"opendatahub-operator-controller-manager-79c9ddb849-cx94f\" (UID: \"c7dee535-a870-4e31-9a68-5aaaaff90be2\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-cx94f"
Jul 06 19:31:55.403011 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:55.402978    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:55.424547 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:55.424522    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c7dee535-a870-4e31-9a68-5aaaaff90be2-manifests\") pod \"opendatahub-operator-controller-manager-79c9ddb849-cx94f\" (UID: \"c7dee535-a870-4e31-9a68-5aaaaff90be2\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-cx94f"
Jul 06 19:31:55.424644 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:55.424556    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c7dee535-a870-4e31-9a68-5aaaaff90be2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79c9ddb849-cx94f\" (UID: \"c7dee535-a870-4e31-9a68-5aaaaff90be2\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-cx94f"
Jul 06 19:31:55.424644 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:55.424581    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c7dee535-a870-4e31-9a68-5aaaaff90be2-tmp\") pod \"opendatahub-operator-controller-manager-79c9ddb849-cx94f\" (UID: \"c7dee535-a870-4e31-9a68-5aaaaff90be2\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-cx94f"
Jul 06 19:31:55.424724 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:55.424688    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c7dee535-a870-4e31-9a68-5aaaaff90be2-webhook-cert\") pod \"opendatahub-operator-controller-manager-79c9ddb849-cx94f\" (UID: \"c7dee535-a870-4e31-9a68-5aaaaff90be2\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-cx94f"
Jul 06 19:31:55.424759 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:55.424747    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr27n\" (UniqueName: \"kubernetes.io/projected/c7dee535-a870-4e31-9a68-5aaaaff90be2-kube-api-access-mr27n\") pod \"opendatahub-operator-controller-manager-79c9ddb849-cx94f\" (UID: \"c7dee535-a870-4e31-9a68-5aaaaff90be2\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-cx94f"
Jul 06 19:31:55.425031 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:55.425005    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c7dee535-a870-4e31-9a68-5aaaaff90be2-manifests\") pod \"opendatahub-operator-controller-manager-79c9ddb849-cx94f\" (UID: \"c7dee535-a870-4e31-9a68-5aaaaff90be2\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-cx94f"
Jul 06 19:31:55.427037 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:55.427008    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c7dee535-a870-4e31-9a68-5aaaaff90be2-tmp\") pod \"opendatahub-operator-controller-manager-79c9ddb849-cx94f\" (UID: \"c7dee535-a870-4e31-9a68-5aaaaff90be2\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-cx94f"
Jul 06 19:31:55.427178 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:55.427158    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c7dee535-a870-4e31-9a68-5aaaaff90be2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79c9ddb849-cx94f\" (UID: \"c7dee535-a870-4e31-9a68-5aaaaff90be2\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-cx94f"
Jul 06 19:31:55.427238 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:55.427213    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c7dee535-a870-4e31-9a68-5aaaaff90be2-webhook-cert\") pod \"opendatahub-operator-controller-manager-79c9ddb849-cx94f\" (UID: \"c7dee535-a870-4e31-9a68-5aaaaff90be2\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-cx94f"
Jul 06 19:31:55.523360 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:55.523333    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr27n\" (UniqueName: \"kubernetes.io/projected/c7dee535-a870-4e31-9a68-5aaaaff90be2-kube-api-access-mr27n\") pod \"opendatahub-operator-controller-manager-79c9ddb849-cx94f\" (UID: \"c7dee535-a870-4e31-9a68-5aaaaff90be2\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-cx94f"
Jul 06 19:31:55.817638 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:55.817601    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-cx94f"
Jul 06 19:31:56.011676 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:56.011651    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79c9ddb849-cx94f"]
Jul 06 19:31:56.014155 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:31:56.014128    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7dee535_a870_4e31_9a68_5aaaaff90be2.slice/crio-f509997defb0d40205fc87b2550bd4f2c9de40160eb44e37c7964ec449c8cf94 WatchSource:0}: Error finding container f509997defb0d40205fc87b2550bd4f2c9de40160eb44e37c7964ec449c8cf94: Status 404 returned error can't find the container with id f509997defb0d40205fc87b2550bd4f2c9de40160eb44e37c7964ec449c8cf94
Jul 06 19:31:56.352126 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:56.352091    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:56.531596 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:56.531556    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:56.665127 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:56.665039    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-cx94f" event={"ID":"c7dee535-a870-4e31-9a68-5aaaaff90be2","Type":"ContainerStarted","Data":"f509997defb0d40205fc87b2550bd4f2c9de40160eb44e37c7964ec449c8cf94"}
Jul 06 19:31:56.812600 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:56.812565    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:57.131625 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:57.131576    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:59.680005 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:31:59.679965    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-cx94f" event={"ID":"c7dee535-a870-4e31-9a68-5aaaaff90be2","Type":"ContainerStarted","Data":"e824c762e1e4d497b654f60ee878bcc56c96006cd09111351e3962689f3fcb98"}
Jul 06 19:32:00.685363 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:00.685323    2555 generic.go:356] "Generic (PLEG): container finished" podID="c7dee535-a870-4e31-9a68-5aaaaff90be2" containerID="e824c762e1e4d497b654f60ee878bcc56c96006cd09111351e3962689f3fcb98" exitCode=0
Jul 06 19:32:00.685744 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:00.685396    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-cx94f" event={"ID":"c7dee535-a870-4e31-9a68-5aaaaff90be2","Type":"ContainerDied","Data":"e824c762e1e4d497b654f60ee878bcc56c96006cd09111351e3962689f3fcb98"}
Jul 06 19:32:01.690360 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:01.690322    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-cx94f" event={"ID":"c7dee535-a870-4e31-9a68-5aaaaff90be2","Type":"ContainerStarted","Data":"6a4e387f2d8805edb05144a4714c3e10dc67679f1ca494b3555520be4cc522cb"}
Jul 06 19:32:01.690745 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:01.690476    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-cx94f"
Jul 06 19:32:01.727814 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:01.727740    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-cx94f" podStartSLOduration=2.428070284 podStartE2EDuration="6.727716118s" totalImagesPullingTime="3.279444609s" totalInitContainerRuntime="1.020201225s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:31:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:32:01.726347088 +0000 UTC m=+379.502380513" watchObservedRunningTime="2026-07-06 19:32:01.727716118 +0000 UTC m=+379.503749518"
Jul 06 19:32:07.699518 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:07.699482    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:12.698522 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:12.698490    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-cx94f"
Jul 06 19:32:15.940225 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:15.940191    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:16.164013 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:16.163974    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:17.005874 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:17.005841    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:17.312545 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:17.312511    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-68c9f86fd7-c2cxh"]
Jul 06 19:32:17.316719 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:17.316700    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-68c9f86fd7-c2cxh"
Jul 06 19:32:17.321554 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:17.321524    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 06 19:32:17.321691 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:17.321621    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 06 19:32:17.322524 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:17.322504    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 06 19:32:17.322791 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:17.322769    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-nfq7k\""
Jul 06 19:32:17.325309 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:17.325289    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 06 19:32:17.362382 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:17.362347    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-68c9f86fd7-c2cxh"]
Jul 06 19:32:17.391618 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:17.391587    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-td4n7\" (UniqueName: \"kubernetes.io/projected/3735bed5-1e21-47cb-9288-d6a433b3126a-kube-api-access-td4n7\") pod \"kube-auth-proxy-68c9f86fd7-c2cxh\" (UID: \"3735bed5-1e21-47cb-9288-d6a433b3126a\") " pod="openshift-ingress/kube-auth-proxy-68c9f86fd7-c2cxh"
Jul 06 19:32:17.391791 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:17.391630    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3735bed5-1e21-47cb-9288-d6a433b3126a-tls-certs\") pod \"kube-auth-proxy-68c9f86fd7-c2cxh\" (UID: \"3735bed5-1e21-47cb-9288-d6a433b3126a\") " pod="openshift-ingress/kube-auth-proxy-68c9f86fd7-c2cxh"
Jul 06 19:32:17.391791 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:17.391650    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3735bed5-1e21-47cb-9288-d6a433b3126a-tmp\") pod \"kube-auth-proxy-68c9f86fd7-c2cxh\" (UID: \"3735bed5-1e21-47cb-9288-d6a433b3126a\") " pod="openshift-ingress/kube-auth-proxy-68c9f86fd7-c2cxh"
Jul 06 19:32:17.440845 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:17.440806    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-s5bxj"]
Jul 06 19:32:17.443940 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:17.443905    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-s5bxj"
Jul 06 19:32:17.447422 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:17.447402    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 06 19:32:17.450537 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:17.450518    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-rttrs\""
Jul 06 19:32:17.492660 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:17.492626    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-td4n7\" (UniqueName: \"kubernetes.io/projected/3735bed5-1e21-47cb-9288-d6a433b3126a-kube-api-access-td4n7\") pod \"kube-auth-proxy-68c9f86fd7-c2cxh\" (UID: \"3735bed5-1e21-47cb-9288-d6a433b3126a\") " pod="openshift-ingress/kube-auth-proxy-68c9f86fd7-c2cxh"
Jul 06 19:32:17.492865 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:17.492668    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtnlr\" (UniqueName: \"kubernetes.io/projected/86789700-3004-4ad7-be6d-8484c1d1ae9c-kube-api-access-gtnlr\") pod \"odh-model-controller-7998c67dc4-s5bxj\" (UID: \"86789700-3004-4ad7-be6d-8484c1d1ae9c\") " pod="opendatahub/odh-model-controller-7998c67dc4-s5bxj"
Jul 06 19:32:17.492865 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:17.492696    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3735bed5-1e21-47cb-9288-d6a433b3126a-tls-certs\") pod \"kube-auth-proxy-68c9f86fd7-c2cxh\" (UID: \"3735bed5-1e21-47cb-9288-d6a433b3126a\") " pod="openshift-ingress/kube-auth-proxy-68c9f86fd7-c2cxh"
Jul 06 19:32:17.492865 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:17.492712    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3735bed5-1e21-47cb-9288-d6a433b3126a-tmp\") pod \"kube-auth-proxy-68c9f86fd7-c2cxh\" (UID: \"3735bed5-1e21-47cb-9288-d6a433b3126a\") " pod="openshift-ingress/kube-auth-proxy-68c9f86fd7-c2cxh"
Jul 06 19:32:17.492865 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:17.492732    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86789700-3004-4ad7-be6d-8484c1d1ae9c-cert\") pod \"odh-model-controller-7998c67dc4-s5bxj\" (UID: \"86789700-3004-4ad7-be6d-8484c1d1ae9c\") " pod="opendatahub/odh-model-controller-7998c67dc4-s5bxj"
Jul 06 19:32:17.492865 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:32:17.492817    2555 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 06 19:32:17.493109 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:32:17.492884    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3735bed5-1e21-47cb-9288-d6a433b3126a-tls-certs podName:3735bed5-1e21-47cb-9288-d6a433b3126a nodeName:}" failed. No retries permitted until 2026-07-06 19:32:17.992866769 +0000 UTC m=+395.768900145 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/3735bed5-1e21-47cb-9288-d6a433b3126a-tls-certs") pod "kube-auth-proxy-68c9f86fd7-c2cxh" (UID: "3735bed5-1e21-47cb-9288-d6a433b3126a") : secret "kube-auth-proxy-tls" not found
Jul 06 19:32:17.494970 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:17.494953    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3735bed5-1e21-47cb-9288-d6a433b3126a-tmp\") pod \"kube-auth-proxy-68c9f86fd7-c2cxh\" (UID: \"3735bed5-1e21-47cb-9288-d6a433b3126a\") " pod="openshift-ingress/kube-auth-proxy-68c9f86fd7-c2cxh"
Jul 06 19:32:17.518369 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:17.518331    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-td4n7\" (UniqueName: \"kubernetes.io/projected/3735bed5-1e21-47cb-9288-d6a433b3126a-kube-api-access-td4n7\") pod \"kube-auth-proxy-68c9f86fd7-c2cxh\" (UID: \"3735bed5-1e21-47cb-9288-d6a433b3126a\") " pod="openshift-ingress/kube-auth-proxy-68c9f86fd7-c2cxh"
Jul 06 19:32:17.549740 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:17.549694    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:17.579444 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:17.579348    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-s5bxj"]
Jul 06 19:32:17.593341 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:17.593304    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86789700-3004-4ad7-be6d-8484c1d1ae9c-cert\") pod \"odh-model-controller-7998c67dc4-s5bxj\" (UID: \"86789700-3004-4ad7-be6d-8484c1d1ae9c\") " pod="opendatahub/odh-model-controller-7998c67dc4-s5bxj"
Jul 06 19:32:17.593485 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:17.593384    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtnlr\" (UniqueName: \"kubernetes.io/projected/86789700-3004-4ad7-be6d-8484c1d1ae9c-kube-api-access-gtnlr\") pod \"odh-model-controller-7998c67dc4-s5bxj\" (UID: \"86789700-3004-4ad7-be6d-8484c1d1ae9c\") " pod="opendatahub/odh-model-controller-7998c67dc4-s5bxj"
Jul 06 19:32:17.593485 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:32:17.593448    2555 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 06 19:32:17.593553 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:32:17.593511    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86789700-3004-4ad7-be6d-8484c1d1ae9c-cert podName:86789700-3004-4ad7-be6d-8484c1d1ae9c nodeName:}" failed. No retries permitted until 2026-07-06 19:32:18.093495848 +0000 UTC m=+395.869529245 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/86789700-3004-4ad7-be6d-8484c1d1ae9c-cert") pod "odh-model-controller-7998c67dc4-s5bxj" (UID: "86789700-3004-4ad7-be6d-8484c1d1ae9c") : secret "odh-model-controller-webhook-cert" not found
Jul 06 19:32:17.614753 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:17.614718    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtnlr\" (UniqueName: \"kubernetes.io/projected/86789700-3004-4ad7-be6d-8484c1d1ae9c-kube-api-access-gtnlr\") pod \"odh-model-controller-7998c67dc4-s5bxj\" (UID: \"86789700-3004-4ad7-be6d-8484c1d1ae9c\") " pod="opendatahub/odh-model-controller-7998c67dc4-s5bxj"
Jul 06 19:32:17.746580 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:17.746545    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:17.902304 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:17.902210    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:17.996702 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:17.996663    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3735bed5-1e21-47cb-9288-d6a433b3126a-tls-certs\") pod \"kube-auth-proxy-68c9f86fd7-c2cxh\" (UID: \"3735bed5-1e21-47cb-9288-d6a433b3126a\") " pod="openshift-ingress/kube-auth-proxy-68c9f86fd7-c2cxh"
Jul 06 19:32:17.999146 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:17.999118    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3735bed5-1e21-47cb-9288-d6a433b3126a-tls-certs\") pod \"kube-auth-proxy-68c9f86fd7-c2cxh\" (UID: \"3735bed5-1e21-47cb-9288-d6a433b3126a\") " pod="openshift-ingress/kube-auth-proxy-68c9f86fd7-c2cxh"
Jul 06 19:32:18.097376 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:18.097321    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86789700-3004-4ad7-be6d-8484c1d1ae9c-cert\") pod \"odh-model-controller-7998c67dc4-s5bxj\" (UID: \"86789700-3004-4ad7-be6d-8484c1d1ae9c\") " pod="opendatahub/odh-model-controller-7998c67dc4-s5bxj"
Jul 06 19:32:18.099845 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:18.099821    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86789700-3004-4ad7-be6d-8484c1d1ae9c-cert\") pod \"odh-model-controller-7998c67dc4-s5bxj\" (UID: \"86789700-3004-4ad7-be6d-8484c1d1ae9c\") " pod="opendatahub/odh-model-controller-7998c67dc4-s5bxj"
Jul 06 19:32:18.106211 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:18.106186    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:18.227531 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:18.227430    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-68c9f86fd7-c2cxh"
Jul 06 19:32:18.354573 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:18.354535    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-s5bxj"
Jul 06 19:32:18.375362 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:18.375333    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-68c9f86fd7-c2cxh"]
Jul 06 19:32:18.377197 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:32:18.377160    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3735bed5_1e21_47cb_9288_d6a433b3126a.slice/crio-daa73c292685f0b2161f40f18ea5ecafb57ad721b8108455a1cab439de75ec20 WatchSource:0}: Error finding container daa73c292685f0b2161f40f18ea5ecafb57ad721b8108455a1cab439de75ec20: Status 404 returned error can't find the container with id daa73c292685f0b2161f40f18ea5ecafb57ad721b8108455a1cab439de75ec20
Jul 06 19:32:18.498205 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:18.498183    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-s5bxj"]
Jul 06 19:32:18.500395 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:32:18.500369    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86789700_3004_4ad7_be6d_8484c1d1ae9c.slice/crio-21661ee75ce8dc64989cae9a86c0e1a0f999055158e1d9b2321a8add3104db9c WatchSource:0}: Error finding container 21661ee75ce8dc64989cae9a86c0e1a0f999055158e1d9b2321a8add3104db9c: Status 404 returned error can't find the container with id 21661ee75ce8dc64989cae9a86c0e1a0f999055158e1d9b2321a8add3104db9c
Jul 06 19:32:18.628892 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:18.628843    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:18.738491 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:18.738439    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-bxj9s"]
Jul 06 19:32:18.742713 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:18.742689    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-bxj9s"
Jul 06 19:32:18.745930 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:18.745881    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-6r7qx\""
Jul 06 19:32:18.746174 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:18.746158    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 06 19:32:18.751900 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:18.751867    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-bxj9s"]
Jul 06 19:32:18.756417 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:18.756387    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-s5bxj" event={"ID":"86789700-3004-4ad7-be6d-8484c1d1ae9c","Type":"ContainerStarted","Data":"21661ee75ce8dc64989cae9a86c0e1a0f999055158e1d9b2321a8add3104db9c"}
Jul 06 19:32:18.757602 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:18.757577    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-68c9f86fd7-c2cxh" event={"ID":"3735bed5-1e21-47cb-9288-d6a433b3126a","Type":"ContainerStarted","Data":"daa73c292685f0b2161f40f18ea5ecafb57ad721b8108455a1cab439de75ec20"}
Jul 06 19:32:18.802000 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:18.801960    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tqvw\" (UniqueName: \"kubernetes.io/projected/9b16bf4a-9f95-4ae2-af21-a3cbfbafa00c-kube-api-access-5tqvw\") pod \"model-serving-api-54d89bd5fc-bxj9s\" (UID: \"9b16bf4a-9f95-4ae2-af21-a3cbfbafa00c\") " pod="opendatahub/model-serving-api-54d89bd5fc-bxj9s"
Jul 06 19:32:18.802164 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:18.802015    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b16bf4a-9f95-4ae2-af21-a3cbfbafa00c-tls-certs\") pod \"model-serving-api-54d89bd5fc-bxj9s\" (UID: \"9b16bf4a-9f95-4ae2-af21-a3cbfbafa00c\") " pod="opendatahub/model-serving-api-54d89bd5fc-bxj9s"
Jul 06 19:32:18.902539 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:18.902503    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b16bf4a-9f95-4ae2-af21-a3cbfbafa00c-tls-certs\") pod \"model-serving-api-54d89bd5fc-bxj9s\" (UID: \"9b16bf4a-9f95-4ae2-af21-a3cbfbafa00c\") " pod="opendatahub/model-serving-api-54d89bd5fc-bxj9s"
Jul 06 19:32:18.902744 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:18.902561    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tqvw\" (UniqueName: \"kubernetes.io/projected/9b16bf4a-9f95-4ae2-af21-a3cbfbafa00c-kube-api-access-5tqvw\") pod \"model-serving-api-54d89bd5fc-bxj9s\" (UID: \"9b16bf4a-9f95-4ae2-af21-a3cbfbafa00c\") " pod="opendatahub/model-serving-api-54d89bd5fc-bxj9s"
Jul 06 19:32:18.902744 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:32:18.902689    2555 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 06 19:32:18.902862 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:32:18.902774    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b16bf4a-9f95-4ae2-af21-a3cbfbafa00c-tls-certs podName:9b16bf4a-9f95-4ae2-af21-a3cbfbafa00c nodeName:}" failed. No retries permitted until 2026-07-06 19:32:19.40275079 +0000 UTC m=+397.178784171 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/9b16bf4a-9f95-4ae2-af21-a3cbfbafa00c-tls-certs") pod "model-serving-api-54d89bd5fc-bxj9s" (UID: "9b16bf4a-9f95-4ae2-af21-a3cbfbafa00c") : secret "model-serving-api-tls" not found
Jul 06 19:32:18.923792 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:18.922639    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tqvw\" (UniqueName: \"kubernetes.io/projected/9b16bf4a-9f95-4ae2-af21-a3cbfbafa00c-kube-api-access-5tqvw\") pod \"model-serving-api-54d89bd5fc-bxj9s\" (UID: \"9b16bf4a-9f95-4ae2-af21-a3cbfbafa00c\") " pod="opendatahub/model-serving-api-54d89bd5fc-bxj9s"
Jul 06 19:32:19.034790 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:19.034741    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:19.091809 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:19.091763    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hj8l8"]
Jul 06 19:32:19.095150 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:19.095122    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8l8"
Jul 06 19:32:19.102563 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:19.102256    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 06 19:32:19.103692 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:19.103062    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 06 19:32:19.103692 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:19.103271    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 06 19:32:19.103692 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:19.103354    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-mjzgz\""
Jul 06 19:32:19.103692 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:19.103609    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 19:32:19.104020 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:19.103999    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a1dd733b-eb32-41bd-81d1-8059b64ddd2a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-hj8l8\" (UID: \"a1dd733b-eb32-41bd-81d1-8059b64ddd2a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8l8"
Jul 06 19:32:19.104110 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:19.104039    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1dd733b-eb32-41bd-81d1-8059b64ddd2a-local-certs\") pod \"istiod-openshift-gateway-7574459656-hj8l8\" (UID: \"a1dd733b-eb32-41bd-81d1-8059b64ddd2a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8l8"
Jul 06 19:32:19.104110 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:19.104060    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65sq7\" (UniqueName: \"kubernetes.io/projected/a1dd733b-eb32-41bd-81d1-8059b64ddd2a-kube-api-access-65sq7\") pod \"istiod-openshift-gateway-7574459656-hj8l8\" (UID: \"a1dd733b-eb32-41bd-81d1-8059b64ddd2a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8l8"
Jul 06 19:32:19.104110 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:19.104097    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1dd733b-eb32-41bd-81d1-8059b64ddd2a-istio-token\") pod \"istiod-openshift-gateway-7574459656-hj8l8\" (UID: \"a1dd733b-eb32-41bd-81d1-8059b64ddd2a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8l8"
Jul 06 19:32:19.104373 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:19.104146    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a1dd733b-eb32-41bd-81d1-8059b64ddd2a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-hj8l8\" (UID: \"a1dd733b-eb32-41bd-81d1-8059b64ddd2a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8l8"
Jul 06 19:32:19.104373 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:19.104182    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a1dd733b-eb32-41bd-81d1-8059b64ddd2a-cacerts\") pod \"istiod-openshift-gateway-7574459656-hj8l8\" (UID: \"a1dd733b-eb32-41bd-81d1-8059b64ddd2a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8l8"
Jul 06 19:32:19.104373 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:19.104298    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a1dd733b-eb32-41bd-81d1-8059b64ddd2a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-hj8l8\" (UID: \"a1dd733b-eb32-41bd-81d1-8059b64ddd2a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8l8"
Jul 06 19:32:19.117309 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:19.117262    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hj8l8"]
Jul 06 19:32:19.152946 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:19.152891    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:19.205368 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:19.205328    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a1dd733b-eb32-41bd-81d1-8059b64ddd2a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-hj8l8\" (UID: \"a1dd733b-eb32-41bd-81d1-8059b64ddd2a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8l8"
Jul 06 19:32:19.205541 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:19.205439    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a1dd733b-eb32-41bd-81d1-8059b64ddd2a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-hj8l8\" (UID: \"a1dd733b-eb32-41bd-81d1-8059b64ddd2a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8l8"
Jul 06 19:32:19.205541 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:19.205463    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1dd733b-eb32-41bd-81d1-8059b64ddd2a-local-certs\") pod \"istiod-openshift-gateway-7574459656-hj8l8\" (UID: \"a1dd733b-eb32-41bd-81d1-8059b64ddd2a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8l8"
Jul 06 19:32:19.205541 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:19.205477    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65sq7\" (UniqueName: \"kubernetes.io/projected/a1dd733b-eb32-41bd-81d1-8059b64ddd2a-kube-api-access-65sq7\") pod \"istiod-openshift-gateway-7574459656-hj8l8\" (UID: \"a1dd733b-eb32-41bd-81d1-8059b64ddd2a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8l8"
Jul 06 19:32:19.205541 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:19.205517    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1dd733b-eb32-41bd-81d1-8059b64ddd2a-istio-token\") pod \"istiod-openshift-gateway-7574459656-hj8l8\" (UID: \"a1dd733b-eb32-41bd-81d1-8059b64ddd2a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8l8"
Jul 06 19:32:19.205541 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:19.205538    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a1dd733b-eb32-41bd-81d1-8059b64ddd2a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-hj8l8\" (UID: \"a1dd733b-eb32-41bd-81d1-8059b64ddd2a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8l8"
Jul 06 19:32:19.205766 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:19.205560    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a1dd733b-eb32-41bd-81d1-8059b64ddd2a-cacerts\") pod \"istiod-openshift-gateway-7574459656-hj8l8\" (UID: \"a1dd733b-eb32-41bd-81d1-8059b64ddd2a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8l8"
Jul 06 19:32:19.208153 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:19.206763    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a1dd733b-eb32-41bd-81d1-8059b64ddd2a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-hj8l8\" (UID: \"a1dd733b-eb32-41bd-81d1-8059b64ddd2a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8l8"
Jul 06 19:32:19.208855 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:19.208810    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1dd733b-eb32-41bd-81d1-8059b64ddd2a-local-certs\") pod \"istiod-openshift-gateway-7574459656-hj8l8\" (UID: \"a1dd733b-eb32-41bd-81d1-8059b64ddd2a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8l8"
Jul 06 19:32:19.210244 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:19.210210    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a1dd733b-eb32-41bd-81d1-8059b64ddd2a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-hj8l8\" (UID: \"a1dd733b-eb32-41bd-81d1-8059b64ddd2a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8l8"
Jul 06 19:32:19.211567 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:19.211538    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a1dd733b-eb32-41bd-81d1-8059b64ddd2a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-hj8l8\" (UID: \"a1dd733b-eb32-41bd-81d1-8059b64ddd2a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8l8"
Jul 06 19:32:19.212007 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:19.211985    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a1dd733b-eb32-41bd-81d1-8059b64ddd2a-cacerts\") pod \"istiod-openshift-gateway-7574459656-hj8l8\" (UID: \"a1dd733b-eb32-41bd-81d1-8059b64ddd2a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8l8"
Jul 06 19:32:19.220202 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:19.220056    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1dd733b-eb32-41bd-81d1-8059b64ddd2a-istio-token\") pod \"istiod-openshift-gateway-7574459656-hj8l8\" (UID: \"a1dd733b-eb32-41bd-81d1-8059b64ddd2a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8l8"
Jul 06 19:32:19.222081 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:19.222028    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65sq7\" (UniqueName: \"kubernetes.io/projected/a1dd733b-eb32-41bd-81d1-8059b64ddd2a-kube-api-access-65sq7\") pod \"istiod-openshift-gateway-7574459656-hj8l8\" (UID: \"a1dd733b-eb32-41bd-81d1-8059b64ddd2a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8l8"
Jul 06 19:32:19.406616 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:19.406520    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b16bf4a-9f95-4ae2-af21-a3cbfbafa00c-tls-certs\") pod \"model-serving-api-54d89bd5fc-bxj9s\" (UID: \"9b16bf4a-9f95-4ae2-af21-a3cbfbafa00c\") " pod="opendatahub/model-serving-api-54d89bd5fc-bxj9s"
Jul 06 19:32:19.407526 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:19.407502    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8l8"
Jul 06 19:32:19.409469 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:19.409437    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b16bf4a-9f95-4ae2-af21-a3cbfbafa00c-tls-certs\") pod \"model-serving-api-54d89bd5fc-bxj9s\" (UID: \"9b16bf4a-9f95-4ae2-af21-a3cbfbafa00c\") " pod="opendatahub/model-serving-api-54d89bd5fc-bxj9s"
Jul 06 19:32:19.624350 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:19.624250    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hj8l8"]
Jul 06 19:32:19.629544 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:32:19.629508    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1dd733b_eb32_41bd_81d1_8059b64ddd2a.slice/crio-e891c296a992acda2ced2d40d4729d362934b63ed7453bed0a93dcf341f75962 WatchSource:0}: Error finding container e891c296a992acda2ced2d40d4729d362934b63ed7453bed0a93dcf341f75962: Status 404 returned error can't find the container with id e891c296a992acda2ced2d40d4729d362934b63ed7453bed0a93dcf341f75962
Jul 06 19:32:19.656026 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:19.655692    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-bxj9s"
Jul 06 19:32:19.766291 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:19.766241    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8l8" event={"ID":"a1dd733b-eb32-41bd-81d1-8059b64ddd2a","Type":"ContainerStarted","Data":"e891c296a992acda2ced2d40d4729d362934b63ed7453bed0a93dcf341f75962"}
Jul 06 19:32:19.828659 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:19.828618    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-bxj9s"]
Jul 06 19:32:19.834092 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:32:19.833994    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b16bf4a_9f95_4ae2_af21_a3cbfbafa00c.slice/crio-ed665a2d7897274465a66d12c9cfef9b61b4dc6504a780d0d041dac2ff961a09 WatchSource:0}: Error finding container ed665a2d7897274465a66d12c9cfef9b61b4dc6504a780d0d041dac2ff961a09: Status 404 returned error can't find the container with id ed665a2d7897274465a66d12c9cfef9b61b4dc6504a780d0d041dac2ff961a09
Jul 06 19:32:20.683058 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:20.683024    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:20.773355 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:20.773316    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-bxj9s" event={"ID":"9b16bf4a-9f95-4ae2-af21-a3cbfbafa00c","Type":"ContainerStarted","Data":"ed665a2d7897274465a66d12c9cfef9b61b4dc6504a780d0d041dac2ff961a09"}
Jul 06 19:32:22.785783 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:22.785744    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-s5bxj" event={"ID":"86789700-3004-4ad7-be6d-8484c1d1ae9c","Type":"ContainerStarted","Data":"7813decac1e71fc5fc5703cde45c393fcf03f0fa7e648f91650eabcbf62da057"}
Jul 06 19:32:22.786266 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:22.785832    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-s5bxj"
Jul 06 19:32:22.787707 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:22.787673    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-68c9f86fd7-c2cxh" event={"ID":"3735bed5-1e21-47cb-9288-d6a433b3126a","Type":"ContainerStarted","Data":"d866ff2bcbdf4d7eb62b59c45e916a3d557b534af52d31585d119ae825bea2e4"}
Jul 06 19:32:22.842168 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:22.842049    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-68c9f86fd7-c2cxh" podStartSLOduration=1.847337616 podStartE2EDuration="5.842026431s" totalImagesPullingTime="3.994688815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:32:22.840661366 +0000 UTC m=+400.616694791" watchObservedRunningTime="2026-07-06 19:32:22.842026431 +0000 UTC m=+400.618059831"
Jul 06 19:32:22.842364 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:22.842224    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-s5bxj" podStartSLOduration=1.968687954 podStartE2EDuration="5.842213112s" totalImagesPullingTime="3.873525158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:32:22.8086438 +0000 UTC m=+400.584677199" watchObservedRunningTime="2026-07-06 19:32:22.842213112 +0000 UTC m=+400.618246512"
Jul 06 19:32:24.220211 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:24.220173    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:32:24.220586 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:24.220252    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:32:24.797933 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:24.797880    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8l8" event={"ID":"a1dd733b-eb32-41bd-81d1-8059b64ddd2a","Type":"ContainerStarted","Data":"d802545f5569da8e0be181151e37d2633a5f32a0b8f372de175b356538440c55"}
Jul 06 19:32:24.798107 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:24.797989    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8l8"
Jul 06 19:32:24.799613 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:24.799585    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-bxj9s" event={"ID":"9b16bf4a-9f95-4ae2-af21-a3cbfbafa00c","Type":"ContainerStarted","Data":"0416f1a987ebd65ca3fda366484dcc97a81d16293ff47489b1204af2c00c624d"}
Jul 06 19:32:24.799736 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:24.799693    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-bxj9s"
Jul 06 19:32:24.825481 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:24.825423    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8l8" podStartSLOduration=1.238062746 podStartE2EDuration="5.825402155s" totalImagesPullingTime="4.587339409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:32:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:32:24.824342207 +0000 UTC m=+402.600375607" watchObservedRunningTime="2026-07-06 19:32:24.825402155 +0000 UTC m=+402.601435554"
Jul 06 19:32:25.075282 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:25.075192    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:25.292204 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:25.292170    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:25.805536 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:25.805503    2555 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-hj8l8 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 19:32:25.805689 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:25.805554    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8l8" podUID="a1dd733b-eb32-41bd-81d1-8059b64ddd2a" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 19:32:26.803545 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:26.803465    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-bxj9s" podStartSLOduration=4.419904011 podStartE2EDuration="8.803445181s" totalImagesPullingTime="4.38354117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:32:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:32:24.846091958 +0000 UTC m=+402.622125352" watchObservedRunningTime="2026-07-06 19:32:26.803445181 +0000 UTC m=+404.579478584"
Jul 06 19:32:26.804845 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:26.804820    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf496pgf"]
Jul 06 19:32:26.808052 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:26.808030    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf496pgf"
Jul 06 19:32:26.812267 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:26.812246    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-24rvp\""
Jul 06 19:32:26.862222 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:26.862187    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf496pgf"]
Jul 06 19:32:26.869487 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:26.869453    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01a9fe94-8e63-47fc-a801-6b333efea455-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf496pgf\" (UID: \"01a9fe94-8e63-47fc-a801-6b333efea455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf496pgf"
Jul 06 19:32:26.869487 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:26.869491    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01a9fe94-8e63-47fc-a801-6b333efea455-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf496pgf\" (UID: \"01a9fe94-8e63-47fc-a801-6b333efea455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf496pgf"
Jul 06 19:32:26.869733 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:26.869511    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01a9fe94-8e63-47fc-a801-6b333efea455-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf496pgf\" (UID: \"01a9fe94-8e63-47fc-a801-6b333efea455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf496pgf"
Jul 06 19:32:26.869733 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:26.869554    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvrld\" (UniqueName: \"kubernetes.io/projected/01a9fe94-8e63-47fc-a801-6b333efea455-kube-api-access-gvrld\") pod \"data-science-gateway-data-science-gateway-class-6576859cf496pgf\" (UID: \"01a9fe94-8e63-47fc-a801-6b333efea455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf496pgf"
Jul 06 19:32:26.869733 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:26.869640    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01a9fe94-8e63-47fc-a801-6b333efea455-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf496pgf\" (UID: \"01a9fe94-8e63-47fc-a801-6b333efea455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf496pgf"
Jul 06 19:32:26.869733 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:26.869723    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01a9fe94-8e63-47fc-a801-6b333efea455-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf496pgf\" (UID: \"01a9fe94-8e63-47fc-a801-6b333efea455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf496pgf"
Jul 06 19:32:26.869951 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:26.869760    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01a9fe94-8e63-47fc-a801-6b333efea455-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf496pgf\" (UID: \"01a9fe94-8e63-47fc-a801-6b333efea455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf496pgf"
Jul 06 19:32:26.869951 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:26.869790    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01a9fe94-8e63-47fc-a801-6b333efea455-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf496pgf\" (UID: \"01a9fe94-8e63-47fc-a801-6b333efea455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf496pgf"
Jul 06 19:32:26.869951 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:26.869815    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01a9fe94-8e63-47fc-a801-6b333efea455-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf496pgf\" (UID: \"01a9fe94-8e63-47fc-a801-6b333efea455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf496pgf"
Jul 06 19:32:26.888196 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:26.888156    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:26.970234 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:26.970200    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01a9fe94-8e63-47fc-a801-6b333efea455-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf496pgf\" (UID: \"01a9fe94-8e63-47fc-a801-6b333efea455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf496pgf"
Jul 06 19:32:26.970440 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:26.970244    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01a9fe94-8e63-47fc-a801-6b333efea455-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf496pgf\" (UID: \"01a9fe94-8e63-47fc-a801-6b333efea455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf496pgf"
Jul 06 19:32:26.970440 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:26.970268    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01a9fe94-8e63-47fc-a801-6b333efea455-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf496pgf\" (UID: \"01a9fe94-8e63-47fc-a801-6b333efea455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf496pgf"
Jul 06 19:32:26.970440 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:26.970289    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01a9fe94-8e63-47fc-a801-6b333efea455-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf496pgf\" (UID: \"01a9fe94-8e63-47fc-a801-6b333efea455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf496pgf"
Jul 06 19:32:26.970440 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:26.970308    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01a9fe94-8e63-47fc-a801-6b333efea455-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf496pgf\" (UID: \"01a9fe94-8e63-47fc-a801-6b333efea455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf496pgf"
Jul 06 19:32:26.970440 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:26.970337    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01a9fe94-8e63-47fc-a801-6b333efea455-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf496pgf\" (UID: \"01a9fe94-8e63-47fc-a801-6b333efea455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf496pgf"
Jul 06 19:32:26.970440 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:26.970365    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01a9fe94-8e63-47fc-a801-6b333efea455-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf496pgf\" (UID: \"01a9fe94-8e63-47fc-a801-6b333efea455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf496pgf"
Jul 06 19:32:26.970440 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:26.970388    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01a9fe94-8e63-47fc-a801-6b333efea455-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf496pgf\" (UID: \"01a9fe94-8e63-47fc-a801-6b333efea455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf496pgf"
Jul 06 19:32:26.970440 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:26.970417    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvrld\" (UniqueName: \"kubernetes.io/projected/01a9fe94-8e63-47fc-a801-6b333efea455-kube-api-access-gvrld\") pod \"data-science-gateway-data-science-gateway-class-6576859cf496pgf\" (UID: \"01a9fe94-8e63-47fc-a801-6b333efea455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf496pgf"
Jul 06 19:32:26.970838 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:26.970740    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01a9fe94-8e63-47fc-a801-6b333efea455-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf496pgf\" (UID: \"01a9fe94-8e63-47fc-a801-6b333efea455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf496pgf"
Jul 06 19:32:26.970838 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:26.970805    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01a9fe94-8e63-47fc-a801-6b333efea455-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf496pgf\" (UID: \"01a9fe94-8e63-47fc-a801-6b333efea455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf496pgf"
Jul 06 19:32:26.970974 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:26.970858    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01a9fe94-8e63-47fc-a801-6b333efea455-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf496pgf\" (UID: \"01a9fe94-8e63-47fc-a801-6b333efea455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf496pgf"
Jul 06 19:32:26.971060 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:26.971038    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01a9fe94-8e63-47fc-a801-6b333efea455-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf496pgf\" (UID: \"01a9fe94-8e63-47fc-a801-6b333efea455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf496pgf"
Jul 06 19:32:26.971125 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:26.971111    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01a9fe94-8e63-47fc-a801-6b333efea455-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf496pgf\" (UID: \"01a9fe94-8e63-47fc-a801-6b333efea455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf496pgf"
Jul 06 19:32:26.972513 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:26.972496    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01a9fe94-8e63-47fc-a801-6b333efea455-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf496pgf\" (UID: \"01a9fe94-8e63-47fc-a801-6b333efea455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf496pgf"
Jul 06 19:32:26.973108 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:26.973085    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01a9fe94-8e63-47fc-a801-6b333efea455-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf496pgf\" (UID: \"01a9fe94-8e63-47fc-a801-6b333efea455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf496pgf"
Jul 06 19:32:26.992325 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:26.992294    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01a9fe94-8e63-47fc-a801-6b333efea455-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf496pgf\" (UID: \"01a9fe94-8e63-47fc-a801-6b333efea455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf496pgf"
Jul 06 19:32:26.992468 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:26.992354    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvrld\" (UniqueName: \"kubernetes.io/projected/01a9fe94-8e63-47fc-a801-6b333efea455-kube-api-access-gvrld\") pod \"data-science-gateway-data-science-gateway-class-6576859cf496pgf\" (UID: \"01a9fe94-8e63-47fc-a801-6b333efea455\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf496pgf"
Jul 06 19:32:27.118159 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:27.118076    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf496pgf"
Jul 06 19:32:27.123209 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:27.123179    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:27.277548 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:27.277411    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf496pgf"]
Jul 06 19:32:27.279616 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:32:27.279586    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01a9fe94_8e63_47fc_a801_6b333efea455.slice/crio-7be8efb605ebab31da75b64f9d76e3b49ca05ca2352735fdb2bbb14032b45eb2 WatchSource:0}: Error finding container 7be8efb605ebab31da75b64f9d76e3b49ca05ca2352735fdb2bbb14032b45eb2: Status 404 returned error can't find the container with id 7be8efb605ebab31da75b64f9d76e3b49ca05ca2352735fdb2bbb14032b45eb2
Jul 06 19:32:27.306644 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:27.306612    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:27.812738 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:27.812691    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf496pgf" event={"ID":"01a9fe94-8e63-47fc-a801-6b333efea455","Type":"ContainerStarted","Data":"7be8efb605ebab31da75b64f9d76e3b49ca05ca2352735fdb2bbb14032b45eb2"}
Jul 06 19:32:28.804540 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:28.804503    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8l8"
Jul 06 19:32:30.160798 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:30.160764    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:32:30.161187 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:30.160852    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:32:30.161187 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:30.160901    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:32:30.829095 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:30.829058    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf496pgf" event={"ID":"01a9fe94-8e63-47fc-a801-6b333efea455","Type":"ContainerStarted","Data":"a41fdbe98314f19f537ca65ce9e479bafd09ad72d5a63051221c2377c62bc8b0"}
Jul 06 19:32:30.863497 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:30.863430    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf496pgf" podStartSLOduration=1.9845640420000001 podStartE2EDuration="4.863405887s" totalImagesPullingTime="2.878841845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:32:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:32:30.86181392 +0000 UTC m=+408.637847346" watchObservedRunningTime="2026-07-06 19:32:30.863405887 +0000 UTC m=+408.639439287"
Jul 06 19:32:31.119202 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:31.119116    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf496pgf"
Jul 06 19:32:31.123669 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:31.123640    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf496pgf"
Jul 06 19:32:31.538448 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:31.538416    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:31.672268 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:31.672234    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:31.707796 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:31.707756    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-w9qgc"]
Jul 06 19:32:31.711453 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:31.711421    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w9qgc"
Jul 06 19:32:31.720348 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:31.720319    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 06 19:32:31.720843 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:31.720605    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-8t6kv\""
Jul 06 19:32:31.722555 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:31.722532    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-cn4dn"]
Jul 06 19:32:31.725576 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:31.725561    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cn4dn"
Jul 06 19:32:31.730485 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:31.730463    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-kslx8\""
Jul 06 19:32:31.730746 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:31.730727    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 06 19:32:31.737029 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:31.736851    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-w9qgc"]
Jul 06 19:32:31.746601 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:31.746571    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-cn4dn"]
Jul 06 19:32:31.812844 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:31.812752    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15f0cac8-027a-43a0-aecb-269352712038-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-cn4dn\" (UID: \"15f0cac8-027a-43a0-aecb-269352712038\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cn4dn"
Jul 06 19:32:31.812844 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:31.812792    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-756rr\" (UniqueName: \"kubernetes.io/projected/82abcd40-00bb-43f3-8b0d-8753994fb246-kube-api-access-756rr\") pod \"kserve-controller-manager-d6f4b65b8-w9qgc\" (UID: \"82abcd40-00bb-43f3-8b0d-8753994fb246\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w9qgc"
Jul 06 19:32:31.812844 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:31.812820    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfr75\" (UniqueName: \"kubernetes.io/projected/15f0cac8-027a-43a0-aecb-269352712038-kube-api-access-wfr75\") pod \"llmisvc-controller-manager-777c6bd7d5-cn4dn\" (UID: \"15f0cac8-027a-43a0-aecb-269352712038\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cn4dn"
Jul 06 19:32:31.813091 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:31.812920    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/82abcd40-00bb-43f3-8b0d-8753994fb246-cert\") pod \"kserve-controller-manager-d6f4b65b8-w9qgc\" (UID: \"82abcd40-00bb-43f3-8b0d-8753994fb246\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w9qgc"
Jul 06 19:32:31.820890 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:31.820850    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:31.833318 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:31.833286    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf496pgf"
Jul 06 19:32:31.834220 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:31.834202    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf496pgf"
Jul 06 19:32:31.914249 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:31.914218    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/82abcd40-00bb-43f3-8b0d-8753994fb246-cert\") pod \"kserve-controller-manager-d6f4b65b8-w9qgc\" (UID: \"82abcd40-00bb-43f3-8b0d-8753994fb246\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w9qgc"
Jul 06 19:32:31.914435 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:31.914297    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15f0cac8-027a-43a0-aecb-269352712038-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-cn4dn\" (UID: \"15f0cac8-027a-43a0-aecb-269352712038\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cn4dn"
Jul 06 19:32:31.914435 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:31.914319    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-756rr\" (UniqueName: \"kubernetes.io/projected/82abcd40-00bb-43f3-8b0d-8753994fb246-kube-api-access-756rr\") pod \"kserve-controller-manager-d6f4b65b8-w9qgc\" (UID: \"82abcd40-00bb-43f3-8b0d-8753994fb246\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w9qgc"
Jul 06 19:32:31.914435 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:32:31.914356    2555 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 06 19:32:31.914435 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:32:31.914432    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82abcd40-00bb-43f3-8b0d-8753994fb246-cert podName:82abcd40-00bb-43f3-8b0d-8753994fb246 nodeName:}" failed. No retries permitted until 2026-07-06 19:32:32.414411372 +0000 UTC m=+410.190444755 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/82abcd40-00bb-43f3-8b0d-8753994fb246-cert") pod "kserve-controller-manager-d6f4b65b8-w9qgc" (UID: "82abcd40-00bb-43f3-8b0d-8753994fb246") : secret "kserve-webhook-server-cert" not found
Jul 06 19:32:31.914638 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:31.914605    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfr75\" (UniqueName: \"kubernetes.io/projected/15f0cac8-027a-43a0-aecb-269352712038-kube-api-access-wfr75\") pod \"llmisvc-controller-manager-777c6bd7d5-cn4dn\" (UID: \"15f0cac8-027a-43a0-aecb-269352712038\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cn4dn"
Jul 06 19:32:31.916854 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:31.916828    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15f0cac8-027a-43a0-aecb-269352712038-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-cn4dn\" (UID: \"15f0cac8-027a-43a0-aecb-269352712038\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cn4dn"
Jul 06 19:32:31.937771 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:31.937737    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-756rr\" (UniqueName: \"kubernetes.io/projected/82abcd40-00bb-43f3-8b0d-8753994fb246-kube-api-access-756rr\") pod \"kserve-controller-manager-d6f4b65b8-w9qgc\" (UID: \"82abcd40-00bb-43f3-8b0d-8753994fb246\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w9qgc"
Jul 06 19:32:31.940771 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:31.940740    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfr75\" (UniqueName: \"kubernetes.io/projected/15f0cac8-027a-43a0-aecb-269352712038-kube-api-access-wfr75\") pod \"llmisvc-controller-manager-777c6bd7d5-cn4dn\" (UID: \"15f0cac8-027a-43a0-aecb-269352712038\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cn4dn"
Jul 06 19:32:32.041672 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:32.041630    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cn4dn"
Jul 06 19:32:32.113648 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:32.113618    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:32.269934 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:32.269752    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-cn4dn"]
Jul 06 19:32:32.272513 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:32:32.272486    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod15f0cac8_027a_43a0_aecb_269352712038.slice/crio-9a9a76802bf7a6de56bac10a7de10baefc814d3c52480a430ec2bebabbe654f6 WatchSource:0}: Error finding container 9a9a76802bf7a6de56bac10a7de10baefc814d3c52480a430ec2bebabbe654f6: Status 404 returned error can't find the container with id 9a9a76802bf7a6de56bac10a7de10baefc814d3c52480a430ec2bebabbe654f6
Jul 06 19:32:32.321361 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:32.321328    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:32.418083 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:32.418002    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/82abcd40-00bb-43f3-8b0d-8753994fb246-cert\") pod \"kserve-controller-manager-d6f4b65b8-w9qgc\" (UID: \"82abcd40-00bb-43f3-8b0d-8753994fb246\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w9qgc"
Jul 06 19:32:32.420500 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:32.420473    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/82abcd40-00bb-43f3-8b0d-8753994fb246-cert\") pod \"kserve-controller-manager-d6f4b65b8-w9qgc\" (UID: \"82abcd40-00bb-43f3-8b0d-8753994fb246\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w9qgc"
Jul 06 19:32:32.500331 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:32.500295    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hj8l8"]
Jul 06 19:32:32.500517 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:32.500494    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8l8" podUID="a1dd733b-eb32-41bd-81d1-8059b64ddd2a" containerName="discovery" containerID="cri-o://d802545f5569da8e0be181151e37d2633a5f32a0b8f372de175b356538440c55" gracePeriod=30
Jul 06 19:32:32.622240 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:32.622207    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w9qgc"
Jul 06 19:32:32.782465 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:32.782432    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8l8"
Jul 06 19:32:32.820809 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:32.820775    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a1dd733b-eb32-41bd-81d1-8059b64ddd2a-istio-csr-ca-configmap\") pod \"a1dd733b-eb32-41bd-81d1-8059b64ddd2a\" (UID: \"a1dd733b-eb32-41bd-81d1-8059b64ddd2a\") "
Jul 06 19:32:32.820809 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:32.820811    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a1dd733b-eb32-41bd-81d1-8059b64ddd2a-istio-csr-dns-cert\") pod \"a1dd733b-eb32-41bd-81d1-8059b64ddd2a\" (UID: \"a1dd733b-eb32-41bd-81d1-8059b64ddd2a\") "
Jul 06 19:32:32.821058 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:32.820836    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a1dd733b-eb32-41bd-81d1-8059b64ddd2a-istio-kubeconfig\") pod \"a1dd733b-eb32-41bd-81d1-8059b64ddd2a\" (UID: \"a1dd733b-eb32-41bd-81d1-8059b64ddd2a\") "
Jul 06 19:32:32.821058 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:32.820861    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1dd733b-eb32-41bd-81d1-8059b64ddd2a-istio-token\") pod \"a1dd733b-eb32-41bd-81d1-8059b64ddd2a\" (UID: \"a1dd733b-eb32-41bd-81d1-8059b64ddd2a\") "
Jul 06 19:32:32.821058 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:32.820938    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1dd733b-eb32-41bd-81d1-8059b64ddd2a-local-certs\") pod \"a1dd733b-eb32-41bd-81d1-8059b64ddd2a\" (UID: \"a1dd733b-eb32-41bd-81d1-8059b64ddd2a\") "
Jul 06 19:32:32.821058 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:32.820991    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65sq7\" (UniqueName: \"kubernetes.io/projected/a1dd733b-eb32-41bd-81d1-8059b64ddd2a-kube-api-access-65sq7\") pod \"a1dd733b-eb32-41bd-81d1-8059b64ddd2a\" (UID: \"a1dd733b-eb32-41bd-81d1-8059b64ddd2a\") "
Jul 06 19:32:32.821058 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:32.821015    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a1dd733b-eb32-41bd-81d1-8059b64ddd2a-cacerts\") pod \"a1dd733b-eb32-41bd-81d1-8059b64ddd2a\" (UID: \"a1dd733b-eb32-41bd-81d1-8059b64ddd2a\") "
Jul 06 19:32:32.821309 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:32.821246    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1dd733b-eb32-41bd-81d1-8059b64ddd2a-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "a1dd733b-eb32-41bd-81d1-8059b64ddd2a" (UID: "a1dd733b-eb32-41bd-81d1-8059b64ddd2a"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:32:32.823153 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:32.823119    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1dd733b-eb32-41bd-81d1-8059b64ddd2a-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "a1dd733b-eb32-41bd-81d1-8059b64ddd2a" (UID: "a1dd733b-eb32-41bd-81d1-8059b64ddd2a"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:32:32.823291 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:32.823195    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1dd733b-eb32-41bd-81d1-8059b64ddd2a-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "a1dd733b-eb32-41bd-81d1-8059b64ddd2a" (UID: "a1dd733b-eb32-41bd-81d1-8059b64ddd2a"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:32:32.823460 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:32.823439    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1dd733b-eb32-41bd-81d1-8059b64ddd2a-istio-token" (OuterVolumeSpecName: "istio-token") pod "a1dd733b-eb32-41bd-81d1-8059b64ddd2a" (UID: "a1dd733b-eb32-41bd-81d1-8059b64ddd2a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:32:32.823554 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:32.823474    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1dd733b-eb32-41bd-81d1-8059b64ddd2a-local-certs" (OuterVolumeSpecName: "local-certs") pod "a1dd733b-eb32-41bd-81d1-8059b64ddd2a" (UID: "a1dd733b-eb32-41bd-81d1-8059b64ddd2a"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:32:32.823554 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:32.823528    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1dd733b-eb32-41bd-81d1-8059b64ddd2a-cacerts" (OuterVolumeSpecName: "cacerts") pod "a1dd733b-eb32-41bd-81d1-8059b64ddd2a" (UID: "a1dd733b-eb32-41bd-81d1-8059b64ddd2a"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:32:32.823554 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:32.823532    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1dd733b-eb32-41bd-81d1-8059b64ddd2a-kube-api-access-65sq7" (OuterVolumeSpecName: "kube-api-access-65sq7") pod "a1dd733b-eb32-41bd-81d1-8059b64ddd2a" (UID: "a1dd733b-eb32-41bd-81d1-8059b64ddd2a"). InnerVolumeSpecName "kube-api-access-65sq7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:32:32.832128 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:32.832090    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-w9qgc"]
Jul 06 19:32:32.833069 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:32:32.833041    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82abcd40_00bb_43f3_8b0d_8753994fb246.slice/crio-97a651659833400d889a51a79e6494f48eb6a46056abe201ce05f4fb4457f3c5 WatchSource:0}: Error finding container 97a651659833400d889a51a79e6494f48eb6a46056abe201ce05f4fb4457f3c5: Status 404 returned error can't find the container with id 97a651659833400d889a51a79e6494f48eb6a46056abe201ce05f4fb4457f3c5
Jul 06 19:32:32.838708 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:32.838679    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cn4dn" event={"ID":"15f0cac8-027a-43a0-aecb-269352712038","Type":"ContainerStarted","Data":"9a9a76802bf7a6de56bac10a7de10baefc814d3c52480a430ec2bebabbe654f6"}
Jul 06 19:32:32.840179 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:32.840153    2555 generic.go:356] "Generic (PLEG): container finished" podID="a1dd733b-eb32-41bd-81d1-8059b64ddd2a" containerID="d802545f5569da8e0be181151e37d2633a5f32a0b8f372de175b356538440c55" exitCode=0
Jul 06 19:32:32.840275 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:32.840199    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8l8"
Jul 06 19:32:32.840275 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:32.840225    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8l8" event={"ID":"a1dd733b-eb32-41bd-81d1-8059b64ddd2a","Type":"ContainerDied","Data":"d802545f5569da8e0be181151e37d2633a5f32a0b8f372de175b356538440c55"}
Jul 06 19:32:32.840275 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:32.840271    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8l8" event={"ID":"a1dd733b-eb32-41bd-81d1-8059b64ddd2a","Type":"ContainerDied","Data":"e891c296a992acda2ced2d40d4729d362934b63ed7453bed0a93dcf341f75962"}
Jul 06 19:32:32.840415 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:32.840291    2555 scope.go:117] "RemoveContainer" containerID="d802545f5569da8e0be181151e37d2633a5f32a0b8f372de175b356538440c55"
Jul 06 19:32:32.849853 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:32.849830    2555 scope.go:117] "RemoveContainer" containerID="d802545f5569da8e0be181151e37d2633a5f32a0b8f372de175b356538440c55"
Jul 06 19:32:32.850227 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:32:32.850204    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d802545f5569da8e0be181151e37d2633a5f32a0b8f372de175b356538440c55\": container with ID starting with d802545f5569da8e0be181151e37d2633a5f32a0b8f372de175b356538440c55 not found: ID does not exist" containerID="d802545f5569da8e0be181151e37d2633a5f32a0b8f372de175b356538440c55"
Jul 06 19:32:32.850306 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:32.850239    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d802545f5569da8e0be181151e37d2633a5f32a0b8f372de175b356538440c55"} err="failed to get container status \"d802545f5569da8e0be181151e37d2633a5f32a0b8f372de175b356538440c55\": rpc error: code = NotFound desc = could not find container \"d802545f5569da8e0be181151e37d2633a5f32a0b8f372de175b356538440c55\": container with ID starting with d802545f5569da8e0be181151e37d2633a5f32a0b8f372de175b356538440c55 not found: ID does not exist"
Jul 06 19:32:32.891718 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:32.891673    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hj8l8"]
Jul 06 19:32:32.922436 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:32.922403    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65sq7\" (UniqueName: \"kubernetes.io/projected/a1dd733b-eb32-41bd-81d1-8059b64ddd2a-kube-api-access-65sq7\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:32:32.922657 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:32.922639    2555 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a1dd733b-eb32-41bd-81d1-8059b64ddd2a-cacerts\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:32:32.922764 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:32.922751    2555 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a1dd733b-eb32-41bd-81d1-8059b64ddd2a-istio-csr-ca-configmap\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:32:32.922848 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:32.922835    2555 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a1dd733b-eb32-41bd-81d1-8059b64ddd2a-istio-csr-dns-cert\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:32:32.922953 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:32.922939    2555 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a1dd733b-eb32-41bd-81d1-8059b64ddd2a-istio-kubeconfig\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:32:32.923056 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:32.923035    2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1dd733b-eb32-41bd-81d1-8059b64ddd2a-istio-token\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:32:32.923056 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:32.923058    2555 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1dd733b-eb32-41bd-81d1-8059b64ddd2a-local-certs\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:32:32.953034 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:32.952953    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hj8l8"]
Jul 06 19:32:33.026871 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:33.026825    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:33.212739 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:33.212652    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:33.387775 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:33.387741    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:33.794594 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:33.794567    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-s5bxj"
Jul 06 19:32:33.846678 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:33.846646    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w9qgc" event={"ID":"82abcd40-00bb-43f3-8b0d-8753994fb246","Type":"ContainerStarted","Data":"97a651659833400d889a51a79e6494f48eb6a46056abe201ce05f4fb4457f3c5"}
Jul 06 19:32:34.130806 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:34.130725    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1dd733b-eb32-41bd-81d1-8059b64ddd2a" path="/var/lib/kubelet/pods/a1dd733b-eb32-41bd-81d1-8059b64ddd2a/volumes"
Jul 06 19:32:35.808522 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:35.808488    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-bxj9s"
Jul 06 19:32:36.864235 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:36.864192    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w9qgc" event={"ID":"82abcd40-00bb-43f3-8b0d-8753994fb246","Type":"ContainerStarted","Data":"bd41dc9d8dba3c33efaad6a57eb79b600928a636f7b11af70255c82c996a896c"}
Jul 06 19:32:36.864696 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:36.864262    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w9qgc"
Jul 06 19:32:36.865694 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:36.865670    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cn4dn" event={"ID":"15f0cac8-027a-43a0-aecb-269352712038","Type":"ContainerStarted","Data":"c26a6092243558141aa9d9485edee47658f81b693675073d4d3cb312d862144f"}
Jul 06 19:32:36.865795 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:36.865728    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cn4dn"
Jul 06 19:32:36.893504 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:36.893378    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w9qgc" podStartSLOduration=2.6571830050000003 podStartE2EDuration="5.893357152s" totalImagesPullingTime="3.236174147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:32:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:32:36.892852579 +0000 UTC m=+414.668885991" watchObservedRunningTime="2026-07-06 19:32:36.893357152 +0000 UTC m=+414.669390552"
Jul 06 19:32:36.916967 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:36.916894    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cn4dn" podStartSLOduration=2.122548665 podStartE2EDuration="5.916876352s" totalImagesPullingTime="3.794327687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:32:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:32:36.91527526 +0000 UTC m=+414.691308660" watchObservedRunningTime="2026-07-06 19:32:36.916876352 +0000 UTC m=+414.692909751"
Jul 06 19:32:56.398289 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:32:56.398255    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:07.872271 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:07.872183    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cn4dn"
Jul 06 19:33:07.875199 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:07.875177    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w9qgc"
Jul 06 19:33:17.596410 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:17.596378    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:17.686868 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:17.686833    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:17.687875 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:17.687830    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hh89s"]
Jul 06 19:33:17.688163 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:17.688151    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1dd733b-eb32-41bd-81d1-8059b64ddd2a" containerName="discovery"
Jul 06 19:33:17.688163 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:17.688164    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1dd733b-eb32-41bd-81d1-8059b64ddd2a" containerName="discovery"
Jul 06 19:33:17.688253 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:17.688210    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1dd733b-eb32-41bd-81d1-8059b64ddd2a" containerName="discovery"
Jul 06 19:33:17.691598 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:17.691578    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hh89s"
Jul 06 19:33:17.695453 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:17.695431    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-qnjb6\""
Jul 06 19:33:17.695801 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:17.695782    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 19:33:17.695801 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:17.695800    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 19:33:17.704226 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:17.704191    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hh89s"]
Jul 06 19:33:17.777430 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:17.777399    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:17.801535 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:17.801500    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp6dh\" (UniqueName: \"kubernetes.io/projected/9efc536d-3f16-48fa-980c-9d0f9c5360dd-kube-api-access-qp6dh\") pod \"kuadrant-operator-catalog-hh89s\" (UID: \"9efc536d-3f16-48fa-980c-9d0f9c5360dd\") " pod="kuadrant-system/kuadrant-operator-catalog-hh89s"
Jul 06 19:33:17.902400 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:17.902304    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp6dh\" (UniqueName: \"kubernetes.io/projected/9efc536d-3f16-48fa-980c-9d0f9c5360dd-kube-api-access-qp6dh\") pod \"kuadrant-operator-catalog-hh89s\" (UID: \"9efc536d-3f16-48fa-980c-9d0f9c5360dd\") " pod="kuadrant-system/kuadrant-operator-catalog-hh89s"
Jul 06 19:33:17.911689 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:17.911669    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp6dh\" (UniqueName: \"kubernetes.io/projected/9efc536d-3f16-48fa-980c-9d0f9c5360dd-kube-api-access-qp6dh\") pod \"kuadrant-operator-catalog-hh89s\" (UID: \"9efc536d-3f16-48fa-980c-9d0f9c5360dd\") " pod="kuadrant-system/kuadrant-operator-catalog-hh89s"
Jul 06 19:33:18.004064 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:18.004017    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hh89s"
Jul 06 19:33:18.037377 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:18.037346    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hh89s"]
Jul 06 19:33:18.157114 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:18.157091    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hh89s"]
Jul 06 19:33:18.159172 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:33:18.159143    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9efc536d_3f16_48fa_980c_9d0f9c5360dd.slice/crio-2fbf50da373a378d075410a6dc41e9f5de9ad46dbf11d8e662de0fd0a904eec7 WatchSource:0}: Error finding container 2fbf50da373a378d075410a6dc41e9f5de9ad46dbf11d8e662de0fd0a904eec7: Status 404 returned error can't find the container with id 2fbf50da373a378d075410a6dc41e9f5de9ad46dbf11d8e662de0fd0a904eec7
Jul 06 19:33:18.253886 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:18.253855    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dtrsp"]
Jul 06 19:33:18.256679 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:18.256662    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dtrsp"
Jul 06 19:33:18.266578 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:18.266554    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dtrsp"]
Jul 06 19:33:18.406387 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:18.406348    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw8pg\" (UniqueName: \"kubernetes.io/projected/eb895176-dd4d-419e-b20d-163e769fa24e-kube-api-access-mw8pg\") pod \"kuadrant-operator-catalog-dtrsp\" (UID: \"eb895176-dd4d-419e-b20d-163e769fa24e\") " pod="kuadrant-system/kuadrant-operator-catalog-dtrsp"
Jul 06 19:33:18.507091 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:18.507010    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw8pg\" (UniqueName: \"kubernetes.io/projected/eb895176-dd4d-419e-b20d-163e769fa24e-kube-api-access-mw8pg\") pod \"kuadrant-operator-catalog-dtrsp\" (UID: \"eb895176-dd4d-419e-b20d-163e769fa24e\") " pod="kuadrant-system/kuadrant-operator-catalog-dtrsp"
Jul 06 19:33:18.515365 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:18.515340    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw8pg\" (UniqueName: \"kubernetes.io/projected/eb895176-dd4d-419e-b20d-163e769fa24e-kube-api-access-mw8pg\") pod \"kuadrant-operator-catalog-dtrsp\" (UID: \"eb895176-dd4d-419e-b20d-163e769fa24e\") " pod="kuadrant-system/kuadrant-operator-catalog-dtrsp"
Jul 06 19:33:18.566520 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:18.566488    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dtrsp"
Jul 06 19:33:18.707514 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:18.707368    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dtrsp"]
Jul 06 19:33:18.709921 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:33:18.709881    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb895176_dd4d_419e_b20d_163e769fa24e.slice/crio-1ea98f427bf53600534969436835f55d42c003d48b552af7bee73c3fdf7e0dfa WatchSource:0}: Error finding container 1ea98f427bf53600534969436835f55d42c003d48b552af7bee73c3fdf7e0dfa: Status 404 returned error can't find the container with id 1ea98f427bf53600534969436835f55d42c003d48b552af7bee73c3fdf7e0dfa
Jul 06 19:33:19.041674 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:19.041558    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hh89s" event={"ID":"9efc536d-3f16-48fa-980c-9d0f9c5360dd","Type":"ContainerStarted","Data":"2fbf50da373a378d075410a6dc41e9f5de9ad46dbf11d8e662de0fd0a904eec7"}
Jul 06 19:33:19.042900 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:19.042867    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dtrsp" event={"ID":"eb895176-dd4d-419e-b20d-163e769fa24e","Type":"ContainerStarted","Data":"1ea98f427bf53600534969436835f55d42c003d48b552af7bee73c3fdf7e0dfa"}
Jul 06 19:33:21.059420 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:21.059375    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dtrsp" event={"ID":"eb895176-dd4d-419e-b20d-163e769fa24e","Type":"ContainerStarted","Data":"25f18319b6d34a4211848e9b59fc7e507b852fceb937be96937f6b38205fb77c"}
Jul 06 19:33:21.061011 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:21.060979    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hh89s" event={"ID":"9efc536d-3f16-48fa-980c-9d0f9c5360dd","Type":"ContainerStarted","Data":"faf3add002494f071e53c91babe0e0b91633a63c08e20787594816285da4bc92"}
Jul 06 19:33:21.061142 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:21.061055    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-hh89s" podUID="9efc536d-3f16-48fa-980c-9d0f9c5360dd" containerName="registry-server" containerID="cri-o://faf3add002494f071e53c91babe0e0b91633a63c08e20787594816285da4bc92" gracePeriod=2
Jul 06 19:33:21.076762 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:21.076717    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-dtrsp" podStartSLOduration=1.52858195 podStartE2EDuration="3.076700804s" totalImagesPullingTime="1.548118854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:33:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:21.075552702 +0000 UTC m=+458.851586121" watchObservedRunningTime="2026-07-06 19:33:21.076700804 +0000 UTC m=+458.852734203"
Jul 06 19:33:21.093588 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:21.093538    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-hh89s" podStartSLOduration=2.006995256 podStartE2EDuration="4.093522055s" totalImagesPullingTime="2.086526799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:33:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:21.091902536 +0000 UTC m=+458.867935946" watchObservedRunningTime="2026-07-06 19:33:21.093522055 +0000 UTC m=+458.869555454"
Jul 06 19:33:21.304260 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:21.304236    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hh89s"
Jul 06 19:33:21.330901 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:21.330815    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qp6dh\" (UniqueName: \"kubernetes.io/projected/9efc536d-3f16-48fa-980c-9d0f9c5360dd-kube-api-access-qp6dh\") pod \"9efc536d-3f16-48fa-980c-9d0f9c5360dd\" (UID: \"9efc536d-3f16-48fa-980c-9d0f9c5360dd\") "
Jul 06 19:33:21.332952 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:21.332921    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9efc536d-3f16-48fa-980c-9d0f9c5360dd-kube-api-access-qp6dh" (OuterVolumeSpecName: "kube-api-access-qp6dh") pod "9efc536d-3f16-48fa-980c-9d0f9c5360dd" (UID: "9efc536d-3f16-48fa-980c-9d0f9c5360dd"). InnerVolumeSpecName "kube-api-access-qp6dh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:33:21.431576 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:21.431540    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qp6dh\" (UniqueName: \"kubernetes.io/projected/9efc536d-3f16-48fa-980c-9d0f9c5360dd-kube-api-access-qp6dh\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:33:22.066702 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:22.066668    2555 generic.go:356] "Generic (PLEG): container finished" podID="9efc536d-3f16-48fa-980c-9d0f9c5360dd" containerID="faf3add002494f071e53c91babe0e0b91633a63c08e20787594816285da4bc92" exitCode=0
Jul 06 19:33:22.067120 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:22.066712    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hh89s"
Jul 06 19:33:22.067120 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:22.066753    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hh89s" event={"ID":"9efc536d-3f16-48fa-980c-9d0f9c5360dd","Type":"ContainerDied","Data":"faf3add002494f071e53c91babe0e0b91633a63c08e20787594816285da4bc92"}
Jul 06 19:33:22.067120 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:22.066800    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hh89s" event={"ID":"9efc536d-3f16-48fa-980c-9d0f9c5360dd","Type":"ContainerDied","Data":"2fbf50da373a378d075410a6dc41e9f5de9ad46dbf11d8e662de0fd0a904eec7"}
Jul 06 19:33:22.067120 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:22.066825    2555 scope.go:117] "RemoveContainer" containerID="faf3add002494f071e53c91babe0e0b91633a63c08e20787594816285da4bc92"
Jul 06 19:33:22.075407 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:22.075383    2555 scope.go:117] "RemoveContainer" containerID="faf3add002494f071e53c91babe0e0b91633a63c08e20787594816285da4bc92"
Jul 06 19:33:22.075670 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:33:22.075652    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"faf3add002494f071e53c91babe0e0b91633a63c08e20787594816285da4bc92\": container with ID starting with faf3add002494f071e53c91babe0e0b91633a63c08e20787594816285da4bc92 not found: ID does not exist" containerID="faf3add002494f071e53c91babe0e0b91633a63c08e20787594816285da4bc92"
Jul 06 19:33:22.075716 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:22.075679    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"faf3add002494f071e53c91babe0e0b91633a63c08e20787594816285da4bc92"} err="failed to get container status \"faf3add002494f071e53c91babe0e0b91633a63c08e20787594816285da4bc92\": rpc error: code = NotFound desc = could not find container \"faf3add002494f071e53c91babe0e0b91633a63c08e20787594816285da4bc92\": container with ID starting with faf3add002494f071e53c91babe0e0b91633a63c08e20787594816285da4bc92 not found: ID does not exist"
Jul 06 19:33:22.088840 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:22.088812    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hh89s"]
Jul 06 19:33:22.092528 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:22.092503    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hh89s"]
Jul 06 19:33:22.130340 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:22.130298    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9efc536d-3f16-48fa-980c-9d0f9c5360dd" path="/var/lib/kubelet/pods/9efc536d-3f16-48fa-980c-9d0f9c5360dd/volumes"
Jul 06 19:33:28.567313 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:28.567274    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-dtrsp"
Jul 06 19:33:28.567815 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:28.567352    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-dtrsp"
Jul 06 19:33:28.589922 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:28.589874    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-dtrsp"
Jul 06 19:33:29.117662 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:29.117635    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-dtrsp"
Jul 06 19:33:46.033183 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:46.033145    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:46.232282 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:46.232251    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:46.351809 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:46.351722    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:46.561931 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:46.561874    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:46.946558 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:46.946524    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:47.069437 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:47.069399    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:48.335887 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:48.335852    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-8g2wm"]
Jul 06 19:33:48.336294 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:48.336147    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9efc536d-3f16-48fa-980c-9d0f9c5360dd" containerName="registry-server"
Jul 06 19:33:48.336294 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:48.336158    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="9efc536d-3f16-48fa-980c-9d0f9c5360dd" containerName="registry-server"
Jul 06 19:33:48.336294 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:48.336214    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="9efc536d-3f16-48fa-980c-9d0f9c5360dd" containerName="registry-server"
Jul 06 19:33:48.340256 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:48.340234    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8g2wm"
Jul 06 19:33:48.342574 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:48.342555    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 06 19:33:48.342708 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:48.342643    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-lkc82\""
Jul 06 19:33:48.354238 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:48.354210    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-8g2wm"]
Jul 06 19:33:48.422024 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:48.421983    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wwxv\" (UniqueName: \"kubernetes.io/projected/ca3842fa-ba34-4eea-85a5-cfce35b511f8-kube-api-access-7wwxv\") pod \"dns-operator-controller-manager-864dd78c4c-8g2wm\" (UID: \"ca3842fa-ba34-4eea-85a5-cfce35b511f8\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8g2wm"
Jul 06 19:33:48.522363 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:48.522324    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wwxv\" (UniqueName: \"kubernetes.io/projected/ca3842fa-ba34-4eea-85a5-cfce35b511f8-kube-api-access-7wwxv\") pod \"dns-operator-controller-manager-864dd78c4c-8g2wm\" (UID: \"ca3842fa-ba34-4eea-85a5-cfce35b511f8\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8g2wm"
Jul 06 19:33:48.533780 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:48.533757    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wwxv\" (UniqueName: \"kubernetes.io/projected/ca3842fa-ba34-4eea-85a5-cfce35b511f8-kube-api-access-7wwxv\") pod \"dns-operator-controller-manager-864dd78c4c-8g2wm\" (UID: \"ca3842fa-ba34-4eea-85a5-cfce35b511f8\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8g2wm"
Jul 06 19:33:48.650839 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:48.650754    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8g2wm"
Jul 06 19:33:48.782891 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:48.782867    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-8g2wm"]
Jul 06 19:33:48.785446 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:33:48.785404    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca3842fa_ba34_4eea_85a5_cfce35b511f8.slice/crio-9814a93a3b02d5f87cca8d4d31ce9efc3421325054a392ad3d8f4edc0708bfde WatchSource:0}: Error finding container 9814a93a3b02d5f87cca8d4d31ce9efc3421325054a392ad3d8f4edc0708bfde: Status 404 returned error can't find the container with id 9814a93a3b02d5f87cca8d4d31ce9efc3421325054a392ad3d8f4edc0708bfde
Jul 06 19:33:49.192339 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:49.192305    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8g2wm" event={"ID":"ca3842fa-ba34-4eea-85a5-cfce35b511f8","Type":"ContainerStarted","Data":"9814a93a3b02d5f87cca8d4d31ce9efc3421325054a392ad3d8f4edc0708bfde"}
Jul 06 19:33:49.967946 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:49.967886    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:51.203556 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:51.203522    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8g2wm" event={"ID":"ca3842fa-ba34-4eea-85a5-cfce35b511f8","Type":"ContainerStarted","Data":"4971fc63d08444bb6a65020f02a92cf6b8a75fe105abdc4a5b4b99fef12edcab"}
Jul 06 19:33:51.204027 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:51.203659    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8g2wm"
Jul 06 19:33:52.072599 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:52.072544    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8g2wm" podStartSLOduration=2.329773557 podStartE2EDuration="4.072526563s" totalImagesPullingTime="1.742753006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:33:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:51.230187219 +0000 UTC m=+489.006220619" watchObservedRunningTime="2026-07-06 19:33:52.072526563 +0000 UTC m=+489.848559961"
Jul 06 19:33:52.072953 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:52.072938    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jknk7"]
Jul 06 19:33:52.076285 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:52.076261    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jknk7"
Jul 06 19:33:52.079070 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:52.079050    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-g8mn9\""
Jul 06 19:33:52.088585 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:52.088558    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jknk7"]
Jul 06 19:33:52.149462 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:52.149427    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq9mx\" (UniqueName: \"kubernetes.io/projected/4b4f4528-91cf-4d9f-823c-266283fa1648-kube-api-access-tq9mx\") pod \"limitador-operator-controller-manager-859d7b78bd-jknk7\" (UID: \"4b4f4528-91cf-4d9f-823c-266283fa1648\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jknk7"
Jul 06 19:33:52.250467 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:52.250423    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tq9mx\" (UniqueName: \"kubernetes.io/projected/4b4f4528-91cf-4d9f-823c-266283fa1648-kube-api-access-tq9mx\") pod \"limitador-operator-controller-manager-859d7b78bd-jknk7\" (UID: \"4b4f4528-91cf-4d9f-823c-266283fa1648\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jknk7"
Jul 06 19:33:52.263028 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:52.263002    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq9mx\" (UniqueName: \"kubernetes.io/projected/4b4f4528-91cf-4d9f-823c-266283fa1648-kube-api-access-tq9mx\") pod \"limitador-operator-controller-manager-859d7b78bd-jknk7\" (UID: \"4b4f4528-91cf-4d9f-823c-266283fa1648\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jknk7"
Jul 06 19:33:52.385986 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:52.385873    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jknk7"
Jul 06 19:33:52.491942 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:52.491874    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:52.518178 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:52.518153    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jknk7"]
Jul 06 19:33:52.520784 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:33:52.520757    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b4f4528_91cf_4d9f_823c_266283fa1648.slice/crio-67721b15636e6bcc9fd76c3efa78577040a9d67de44a96fbc1d8aa753855bd4b WatchSource:0}: Error finding container 67721b15636e6bcc9fd76c3efa78577040a9d67de44a96fbc1d8aa753855bd4b: Status 404 returned error can't find the container with id 67721b15636e6bcc9fd76c3efa78577040a9d67de44a96fbc1d8aa753855bd4b
Jul 06 19:33:53.007152 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:53.007109    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:53.213074 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:53.213040    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jknk7" event={"ID":"4b4f4528-91cf-4d9f-823c-266283fa1648","Type":"ContainerStarted","Data":"67721b15636e6bcc9fd76c3efa78577040a9d67de44a96fbc1d8aa753855bd4b"}
Jul 06 19:33:53.268216 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:53.268141    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:55.223075 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:55.223035    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jknk7" event={"ID":"4b4f4528-91cf-4d9f-823c-266283fa1648","Type":"ContainerStarted","Data":"eeb7e82bbaa955f45699a7d07a99b2fa63268c0552d47c04fd4b17419e517429"}
Jul 06 19:33:55.223461 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:55.223161    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jknk7"
Jul 06 19:33:55.251977 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:55.251923    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jknk7" podStartSLOduration=1.461218801 podStartE2EDuration="3.251890204s" totalImagesPullingTime="1.790671403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:33:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:55.250696269 +0000 UTC m=+493.026729699" watchObservedRunningTime="2026-07-06 19:33:55.251890204 +0000 UTC m=+493.027923603"
Jul 06 19:33:56.059470 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:56.059433    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-zbsh7"]
Jul 06 19:33:56.062856 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:56.062837    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zbsh7"
Jul 06 19:33:56.065676 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:56.065655    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-pgvvm\""
Jul 06 19:33:56.082795 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:56.082761    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbvsd\" (UniqueName: \"kubernetes.io/projected/046e62b5-715c-458e-b98e-e1a64164578b-kube-api-access-hbvsd\") pod \"authorino-operator-75cc8d5cb7-zbsh7\" (UID: \"046e62b5-715c-458e-b98e-e1a64164578b\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-zbsh7"
Jul 06 19:33:56.112602 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:56.112572    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-zbsh7"]
Jul 06 19:33:56.183733 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:56.183701    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbvsd\" (UniqueName: \"kubernetes.io/projected/046e62b5-715c-458e-b98e-e1a64164578b-kube-api-access-hbvsd\") pod \"authorino-operator-75cc8d5cb7-zbsh7\" (UID: \"046e62b5-715c-458e-b98e-e1a64164578b\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-zbsh7"
Jul 06 19:33:56.195452 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:56.195414    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbvsd\" (UniqueName: \"kubernetes.io/projected/046e62b5-715c-458e-b98e-e1a64164578b-kube-api-access-hbvsd\") pod \"authorino-operator-75cc8d5cb7-zbsh7\" (UID: \"046e62b5-715c-458e-b98e-e1a64164578b\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-zbsh7"
Jul 06 19:33:56.372388 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:56.372302    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zbsh7"
Jul 06 19:33:56.506572 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:56.506548    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-zbsh7"]
Jul 06 19:33:56.509076 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:33:56.509045    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod046e62b5_715c_458e_b98e_e1a64164578b.slice/crio-d40eefceeaa6894fecd7e49e259170111ce51ea157d7a363f273ffd0159340e9 WatchSource:0}: Error finding container d40eefceeaa6894fecd7e49e259170111ce51ea157d7a363f273ffd0159340e9: Status 404 returned error can't find the container with id d40eefceeaa6894fecd7e49e259170111ce51ea157d7a363f273ffd0159340e9
Jul 06 19:33:56.745898 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:56.745808    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:57.188960 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:57.188905    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:57.233851 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:57.233813    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zbsh7" event={"ID":"046e62b5-715c-458e-b98e-e1a64164578b","Type":"ContainerStarted","Data":"d40eefceeaa6894fecd7e49e259170111ce51ea157d7a363f273ffd0159340e9"}
Jul 06 19:33:57.285097 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:57.285044    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:57.396244 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:57.396201    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:57.740926 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:57.740880    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:59.243988 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:59.243954    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zbsh7" event={"ID":"046e62b5-715c-458e-b98e-e1a64164578b","Type":"ContainerStarted","Data":"60223b5243dc90cec9e8bf6d69414639d3dac318341025f22603c8425f0de96e"}
Jul 06 19:33:59.244378 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:59.244085    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zbsh7"
Jul 06 19:33:59.262781 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:33:59.262730    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zbsh7" podStartSLOduration=1.13879907 podStartE2EDuration="3.262714461s" totalImagesPullingTime="2.123915391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:33:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:59.261061389 +0000 UTC m=+497.037094808" watchObservedRunningTime="2026-07-06 19:33:59.262714461 +0000 UTC m=+497.038747860"
Jul 06 19:34:00.357202 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:00.357172    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:02.210548 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:02.210518    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8g2wm"
Jul 06 19:34:02.326430 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:02.326396    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:04.335673 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:04.335637    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:04.456625 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:04.456592    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:06.230704 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:06.230674    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jknk7"
Jul 06 19:34:07.689800 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:07.689766    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:07.791269 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:07.791234    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:10.250438 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:10.250409    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zbsh7"
Jul 06 19:34:10.444165 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:10.444126    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-7wpw2"]
Jul 06 19:34:10.447366 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:10.447349    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7wpw2"
Jul 06 19:34:10.449901 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:10.449875    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qbkj7\""
Jul 06 19:34:10.450826 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:10.450807    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 06 19:34:10.451107 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:10.451091    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 06 19:34:10.458459 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:10.458436    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-7wpw2"]
Jul 06 19:34:10.468262 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:10.468216    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:10.504712 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:10.504614    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/60f0a46a-ae42-482f-8997-a292c08c379e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-7wpw2\" (UID: \"60f0a46a-ae42-482f-8997-a292c08c379e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7wpw2"
Jul 06 19:34:10.504712 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:10.504664    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/60f0a46a-ae42-482f-8997-a292c08c379e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-7wpw2\" (UID: \"60f0a46a-ae42-482f-8997-a292c08c379e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7wpw2"
Jul 06 19:34:10.504884 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:10.504755    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rmw5\" (UniqueName: \"kubernetes.io/projected/60f0a46a-ae42-482f-8997-a292c08c379e-kube-api-access-8rmw5\") pod \"kuadrant-console-plugin-66b5774985-7wpw2\" (UID: \"60f0a46a-ae42-482f-8997-a292c08c379e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7wpw2"
Jul 06 19:34:10.605986 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:10.605941    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/60f0a46a-ae42-482f-8997-a292c08c379e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-7wpw2\" (UID: \"60f0a46a-ae42-482f-8997-a292c08c379e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7wpw2"
Jul 06 19:34:10.605986 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:10.605994    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/60f0a46a-ae42-482f-8997-a292c08c379e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-7wpw2\" (UID: \"60f0a46a-ae42-482f-8997-a292c08c379e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7wpw2"
Jul 06 19:34:10.606219 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:10.606026    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rmw5\" (UniqueName: \"kubernetes.io/projected/60f0a46a-ae42-482f-8997-a292c08c379e-kube-api-access-8rmw5\") pod \"kuadrant-console-plugin-66b5774985-7wpw2\" (UID: \"60f0a46a-ae42-482f-8997-a292c08c379e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7wpw2"
Jul 06 19:34:10.606219 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:34:10.606070    2555 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 06 19:34:10.606219 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:34:10.606148    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60f0a46a-ae42-482f-8997-a292c08c379e-plugin-serving-cert podName:60f0a46a-ae42-482f-8997-a292c08c379e nodeName:}" failed. No retries permitted until 2026-07-06 19:34:11.106129555 +0000 UTC m=+508.882162932 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/60f0a46a-ae42-482f-8997-a292c08c379e-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-7wpw2" (UID: "60f0a46a-ae42-482f-8997-a292c08c379e") : secret "plugin-serving-cert" not found
Jul 06 19:34:10.606781 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:10.606757    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/60f0a46a-ae42-482f-8997-a292c08c379e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-7wpw2\" (UID: \"60f0a46a-ae42-482f-8997-a292c08c379e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7wpw2"
Jul 06 19:34:10.637137 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:10.637107    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rmw5\" (UniqueName: \"kubernetes.io/projected/60f0a46a-ae42-482f-8997-a292c08c379e-kube-api-access-8rmw5\") pod \"kuadrant-console-plugin-66b5774985-7wpw2\" (UID: \"60f0a46a-ae42-482f-8997-a292c08c379e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7wpw2"
Jul 06 19:34:10.818507 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:10.818470    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:11.109656 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:11.109561    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/60f0a46a-ae42-482f-8997-a292c08c379e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-7wpw2\" (UID: \"60f0a46a-ae42-482f-8997-a292c08c379e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7wpw2"
Jul 06 19:34:11.112107 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:11.112073    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/60f0a46a-ae42-482f-8997-a292c08c379e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-7wpw2\" (UID: \"60f0a46a-ae42-482f-8997-a292c08c379e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7wpw2"
Jul 06 19:34:11.356548 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:11.356487    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7wpw2"
Jul 06 19:34:11.505947 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:11.505898    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-7wpw2"]
Jul 06 19:34:11.509541 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:34:11.509508    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod60f0a46a_ae42_482f_8997_a292c08c379e.slice/crio-36b70650021d44fa7c1066441616d545621f12940611768b389daafeab3d3aa6 WatchSource:0}: Error finding container 36b70650021d44fa7c1066441616d545621f12940611768b389daafeab3d3aa6: Status 404 returned error can't find the container with id 36b70650021d44fa7c1066441616d545621f12940611768b389daafeab3d3aa6
Jul 06 19:34:12.307828 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:12.307766    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7wpw2" event={"ID":"60f0a46a-ae42-482f-8997-a292c08c379e","Type":"ContainerStarted","Data":"36b70650021d44fa7c1066441616d545621f12940611768b389daafeab3d3aa6"}
Jul 06 19:34:12.533486 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:12.533429    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:12.659341 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:12.659249    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:13.103954 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:13.103922    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:13.193277 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:13.193235    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:17.616838 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:17.616786    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:17.742356 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:17.742321    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:21.098713 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:21.098660    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jknk7"]
Jul 06 19:34:21.099242 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:21.099026    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jknk7" podUID="4b4f4528-91cf-4d9f-823c-266283fa1648" containerName="manager" containerID="cri-o://eeb7e82bbaa955f45699a7d07a99b2fa63268c0552d47c04fd4b17419e517429" gracePeriod=2
Jul 06 19:34:21.118730 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:21.118658    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jknk7"]
Jul 06 19:34:21.148105 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:21.148071    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvjk6"]
Jul 06 19:34:21.148508 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:21.148492    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b4f4528-91cf-4d9f-823c-266283fa1648" containerName="manager"
Jul 06 19:34:21.148508 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:21.148509    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b4f4528-91cf-4d9f-823c-266283fa1648" containerName="manager"
Jul 06 19:34:21.148659 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:21.148576    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b4f4528-91cf-4d9f-823c-266283fa1648" containerName="manager"
Jul 06 19:34:21.155313 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:21.154956    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvjk6"
Jul 06 19:34:21.182410 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:34:21.182359    2555 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"4b4f4528-91cf-4d9f-823c-266283fa1648\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-jknk7\": pods \"limitador-operator-controller-manager-859d7b78bd-jknk7\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jknk7"
Jul 06 19:34:21.233456 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:21.233413    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvjk6"]
Jul 06 19:34:21.263827 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:34:21.263779    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jknk7\" is forbidden: User \"system:node:ip-10-0-131-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-150.ec2.internal' and this object" podUID="4b4f4528-91cf-4d9f-823c-266283fa1648" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jknk7"
Jul 06 19:34:21.304955 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:21.304894    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmlnt\" (UniqueName: \"kubernetes.io/projected/7bdc1b96-b5ff-4080-a877-61100abc752f-kube-api-access-lmlnt\") pod \"limitador-operator-controller-manager-859d7b78bd-vvjk6\" (UID: \"7bdc1b96-b5ff-4080-a877-61100abc752f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvjk6"
Jul 06 19:34:21.405875 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:21.405780    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmlnt\" (UniqueName: \"kubernetes.io/projected/7bdc1b96-b5ff-4080-a877-61100abc752f-kube-api-access-lmlnt\") pod \"limitador-operator-controller-manager-859d7b78bd-vvjk6\" (UID: \"7bdc1b96-b5ff-4080-a877-61100abc752f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvjk6"
Jul 06 19:34:21.433794 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:21.433754    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmlnt\" (UniqueName: \"kubernetes.io/projected/7bdc1b96-b5ff-4080-a877-61100abc752f-kube-api-access-lmlnt\") pod \"limitador-operator-controller-manager-859d7b78bd-vvjk6\" (UID: \"7bdc1b96-b5ff-4080-a877-61100abc752f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvjk6"
Jul 06 19:34:21.505846 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:21.505793    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvjk6"
Jul 06 19:34:26.824429 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:26.824385    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:26.948707 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:26.948668    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:30.382290 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:30.382247    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:30.479288 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:30.479246    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:32.926399 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:32.926372    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jknk7"
Jul 06 19:34:32.933107 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:34:32.933071    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jknk7\" is forbidden: User \"system:node:ip-10-0-131-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-150.ec2.internal' and this object" podUID="4b4f4528-91cf-4d9f-823c-266283fa1648" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jknk7"
Jul 06 19:34:32.955931 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:32.955856    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvjk6"]
Jul 06 19:34:32.958131 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:34:32.958101    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bdc1b96_b5ff_4080_a877_61100abc752f.slice/crio-64e7d538ff908f9969540e4745840300f6548358e809405adf66c5772c98a3a9 WatchSource:0}: Error finding container 64e7d538ff908f9969540e4745840300f6548358e809405adf66c5772c98a3a9: Status 404 returned error can't find the container with id 64e7d538ff908f9969540e4745840300f6548358e809405adf66c5772c98a3a9
Jul 06 19:34:33.016776 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:33.016752    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tq9mx\" (UniqueName: \"kubernetes.io/projected/4b4f4528-91cf-4d9f-823c-266283fa1648-kube-api-access-tq9mx\") pod \"4b4f4528-91cf-4d9f-823c-266283fa1648\" (UID: \"4b4f4528-91cf-4d9f-823c-266283fa1648\") "
Jul 06 19:34:33.018666 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:33.018642    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b4f4528-91cf-4d9f-823c-266283fa1648-kube-api-access-tq9mx" (OuterVolumeSpecName: "kube-api-access-tq9mx") pod "4b4f4528-91cf-4d9f-823c-266283fa1648" (UID: "4b4f4528-91cf-4d9f-823c-266283fa1648"). InnerVolumeSpecName "kube-api-access-tq9mx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:34:33.118275 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:33.118186    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tq9mx\" (UniqueName: \"kubernetes.io/projected/4b4f4528-91cf-4d9f-823c-266283fa1648-kube-api-access-tq9mx\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:34:33.416404 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:33.416291    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7wpw2" event={"ID":"60f0a46a-ae42-482f-8997-a292c08c379e","Type":"ContainerStarted","Data":"f84e771fd3f3f501b9517861358efa50d266c2e1f94b439997881388f6d7d08f"}
Jul 06 19:34:33.417474 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:33.417450    2555 generic.go:356] "Generic (PLEG): container finished" podID="4b4f4528-91cf-4d9f-823c-266283fa1648" containerID="eeb7e82bbaa955f45699a7d07a99b2fa63268c0552d47c04fd4b17419e517429" exitCode=0
Jul 06 19:34:33.417598 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:33.417483    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jknk7"
Jul 06 19:34:33.417598 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:33.417543    2555 scope.go:117] "RemoveContainer" containerID="eeb7e82bbaa955f45699a7d07a99b2fa63268c0552d47c04fd4b17419e517429"
Jul 06 19:34:33.419300 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:33.419282    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvjk6" event={"ID":"7bdc1b96-b5ff-4080-a877-61100abc752f","Type":"ContainerStarted","Data":"acb90ad4625babf1ed00ca32769b6b7ea9641ef1317db7fc502cc9aac33cd286"}
Jul 06 19:34:33.419400 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:33.419318    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvjk6" event={"ID":"7bdc1b96-b5ff-4080-a877-61100abc752f","Type":"ContainerStarted","Data":"64e7d538ff908f9969540e4745840300f6548358e809405adf66c5772c98a3a9"}
Jul 06 19:34:33.419455 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:33.419437    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvjk6"
Jul 06 19:34:33.426222 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:33.426205    2555 scope.go:117] "RemoveContainer" containerID="eeb7e82bbaa955f45699a7d07a99b2fa63268c0552d47c04fd4b17419e517429"
Jul 06 19:34:33.426472 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:34:33.426454    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eeb7e82bbaa955f45699a7d07a99b2fa63268c0552d47c04fd4b17419e517429\": container with ID starting with eeb7e82bbaa955f45699a7d07a99b2fa63268c0552d47c04fd4b17419e517429 not found: ID does not exist" containerID="eeb7e82bbaa955f45699a7d07a99b2fa63268c0552d47c04fd4b17419e517429"
Jul 06 19:34:33.426531 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:33.426483    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eeb7e82bbaa955f45699a7d07a99b2fa63268c0552d47c04fd4b17419e517429"} err="failed to get container status \"eeb7e82bbaa955f45699a7d07a99b2fa63268c0552d47c04fd4b17419e517429\": rpc error: code = NotFound desc = could not find container \"eeb7e82bbaa955f45699a7d07a99b2fa63268c0552d47c04fd4b17419e517429\": container with ID starting with eeb7e82bbaa955f45699a7d07a99b2fa63268c0552d47c04fd4b17419e517429 not found: ID does not exist"
Jul 06 19:34:33.438236 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:33.438118    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7wpw2" podStartSLOduration=2.082394887 podStartE2EDuration="23.438102832s" totalImagesPullingTime="21.355707945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:33.437096826 +0000 UTC m=+531.213130246" watchObservedRunningTime="2026-07-06 19:34:33.438102832 +0000 UTC m=+531.214136231"
Jul 06 19:34:33.442028 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:34:33.441995    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jknk7\" is forbidden: User \"system:node:ip-10-0-131-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-150.ec2.internal' and this object" podUID="4b4f4528-91cf-4d9f-823c-266283fa1648" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jknk7"
Jul 06 19:34:33.468377 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:33.468327    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvjk6" podStartSLOduration=12.468309127 podStartE2EDuration="12.468309127s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:33.467325226 +0000 UTC m=+531.243358625" watchObservedRunningTime="2026-07-06 19:34:33.468309127 +0000 UTC m=+531.244342599"
Jul 06 19:34:33.471819 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:34:33.471785    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jknk7\" is forbidden: User \"system:node:ip-10-0-131-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-150.ec2.internal' and this object" podUID="4b4f4528-91cf-4d9f-823c-266283fa1648" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jknk7"
Jul 06 19:34:34.128844 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:34:34.128729    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jknk7\" is forbidden: User \"system:node:ip-10-0-131-150.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-150.ec2.internal' and this object" podUID="4b4f4528-91cf-4d9f-823c-266283fa1648" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jknk7"
Jul 06 19:34:34.130149 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:34.130127    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b4f4528-91cf-4d9f-823c-266283fa1648" path="/var/lib/kubelet/pods/4b4f4528-91cf-4d9f-823c-266283fa1648/volumes"
Jul 06 19:34:34.459357 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:34.459236    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:34.590729 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:34.590694    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:37.943494 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:37.943459    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:38.042184 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:38.042152    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:44.427618 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:44.427542    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvjk6"
Jul 06 19:34:44.637700 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:44.637665    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:44.748102 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:44.748014    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:48.004075 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:48.004047    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:49.983519 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:49.983479    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls"]
Jul 06 19:34:49.998239 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:49.998204    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls"
Jul 06 19:34:50.001738 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:50.001711    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-bkdzg\""
Jul 06 19:34:50.003387 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:50.003363    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls"]
Jul 06 19:34:50.028392 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:50.028363    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:50.039724 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:50.039691    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/681e84da-8c38-4be9-8d5e-6580d45e0a39-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-pddls\" (UID: \"681e84da-8c38-4be9-8d5e-6580d45e0a39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls"
Jul 06 19:34:50.039724 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:50.039723    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/681e84da-8c38-4be9-8d5e-6580d45e0a39-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-pddls\" (UID: \"681e84da-8c38-4be9-8d5e-6580d45e0a39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls"
Jul 06 19:34:50.039963 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:50.039743    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhbpw\" (UniqueName: \"kubernetes.io/projected/681e84da-8c38-4be9-8d5e-6580d45e0a39-kube-api-access-jhbpw\") pod \"maas-default-gateway-openshift-default-56654dcf7-pddls\" (UID: \"681e84da-8c38-4be9-8d5e-6580d45e0a39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls"
Jul 06 19:34:50.039963 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:50.039767    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/681e84da-8c38-4be9-8d5e-6580d45e0a39-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-pddls\" (UID: \"681e84da-8c38-4be9-8d5e-6580d45e0a39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls"
Jul 06 19:34:50.039963 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:50.039869    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/681e84da-8c38-4be9-8d5e-6580d45e0a39-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-pddls\" (UID: \"681e84da-8c38-4be9-8d5e-6580d45e0a39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls"
Jul 06 19:34:50.039963 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:50.039904    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/681e84da-8c38-4be9-8d5e-6580d45e0a39-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-pddls\" (UID: \"681e84da-8c38-4be9-8d5e-6580d45e0a39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls"
Jul 06 19:34:50.040137 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:50.039998    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/681e84da-8c38-4be9-8d5e-6580d45e0a39-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-pddls\" (UID: \"681e84da-8c38-4be9-8d5e-6580d45e0a39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls"
Jul 06 19:34:50.040137 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:50.040036    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/681e84da-8c38-4be9-8d5e-6580d45e0a39-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-pddls\" (UID: \"681e84da-8c38-4be9-8d5e-6580d45e0a39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls"
Jul 06 19:34:50.040137 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:50.040054    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/681e84da-8c38-4be9-8d5e-6580d45e0a39-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-pddls\" (UID: \"681e84da-8c38-4be9-8d5e-6580d45e0a39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls"
Jul 06 19:34:50.141047 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:50.141017    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/681e84da-8c38-4be9-8d5e-6580d45e0a39-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-pddls\" (UID: \"681e84da-8c38-4be9-8d5e-6580d45e0a39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls"
Jul 06 19:34:50.141253 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:50.141071    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/681e84da-8c38-4be9-8d5e-6580d45e0a39-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-pddls\" (UID: \"681e84da-8c38-4be9-8d5e-6580d45e0a39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls"
Jul 06 19:34:50.141253 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:50.141099    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/681e84da-8c38-4be9-8d5e-6580d45e0a39-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-pddls\" (UID: \"681e84da-8c38-4be9-8d5e-6580d45e0a39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls"
Jul 06 19:34:50.141253 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:50.141137    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/681e84da-8c38-4be9-8d5e-6580d45e0a39-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-pddls\" (UID: \"681e84da-8c38-4be9-8d5e-6580d45e0a39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls"
Jul 06 19:34:50.141253 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:50.141160    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/681e84da-8c38-4be9-8d5e-6580d45e0a39-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-pddls\" (UID: \"681e84da-8c38-4be9-8d5e-6580d45e0a39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls"
Jul 06 19:34:50.141253 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:50.141189    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhbpw\" (UniqueName: \"kubernetes.io/projected/681e84da-8c38-4be9-8d5e-6580d45e0a39-kube-api-access-jhbpw\") pod \"maas-default-gateway-openshift-default-56654dcf7-pddls\" (UID: \"681e84da-8c38-4be9-8d5e-6580d45e0a39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls"
Jul 06 19:34:50.141253 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:50.141235    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/681e84da-8c38-4be9-8d5e-6580d45e0a39-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-pddls\" (UID: \"681e84da-8c38-4be9-8d5e-6580d45e0a39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls"
Jul 06 19:34:50.141529 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:50.141275    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/681e84da-8c38-4be9-8d5e-6580d45e0a39-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-pddls\" (UID: \"681e84da-8c38-4be9-8d5e-6580d45e0a39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls"
Jul 06 19:34:50.141529 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:50.141468    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/681e84da-8c38-4be9-8d5e-6580d45e0a39-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-pddls\" (UID: \"681e84da-8c38-4be9-8d5e-6580d45e0a39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls"
Jul 06 19:34:50.141635 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:50.141532    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/681e84da-8c38-4be9-8d5e-6580d45e0a39-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-pddls\" (UID: \"681e84da-8c38-4be9-8d5e-6580d45e0a39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls"
Jul 06 19:34:50.141635 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:50.141598    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/681e84da-8c38-4be9-8d5e-6580d45e0a39-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-pddls\" (UID: \"681e84da-8c38-4be9-8d5e-6580d45e0a39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls"
Jul 06 19:34:50.141743 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:50.141634    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/681e84da-8c38-4be9-8d5e-6580d45e0a39-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-pddls\" (UID: \"681e84da-8c38-4be9-8d5e-6580d45e0a39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls"
Jul 06 19:34:50.141743 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:50.141701    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/681e84da-8c38-4be9-8d5e-6580d45e0a39-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-pddls\" (UID: \"681e84da-8c38-4be9-8d5e-6580d45e0a39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls"
Jul 06 19:34:50.142370 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:50.142350    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/681e84da-8c38-4be9-8d5e-6580d45e0a39-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-pddls\" (UID: \"681e84da-8c38-4be9-8d5e-6580d45e0a39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls"
Jul 06 19:34:50.143630 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:50.143608    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/681e84da-8c38-4be9-8d5e-6580d45e0a39-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-pddls\" (UID: \"681e84da-8c38-4be9-8d5e-6580d45e0a39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls"
Jul 06 19:34:50.143742 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:50.143720    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/681e84da-8c38-4be9-8d5e-6580d45e0a39-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-pddls\" (UID: \"681e84da-8c38-4be9-8d5e-6580d45e0a39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls"
Jul 06 19:34:50.152560 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:50.152539    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/681e84da-8c38-4be9-8d5e-6580d45e0a39-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-pddls\" (UID: \"681e84da-8c38-4be9-8d5e-6580d45e0a39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls"
Jul 06 19:34:50.152641 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:50.152540    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhbpw\" (UniqueName: \"kubernetes.io/projected/681e84da-8c38-4be9-8d5e-6580d45e0a39-kube-api-access-jhbpw\") pod \"maas-default-gateway-openshift-default-56654dcf7-pddls\" (UID: \"681e84da-8c38-4be9-8d5e-6580d45e0a39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls"
Jul 06 19:34:50.184365 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:50.184327    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:50.310027 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:50.309994    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls"
Jul 06 19:34:50.447182 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:50.447155    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls"]
Jul 06 19:34:50.449083 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:34:50.449053    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod681e84da_8c38_4be9_8d5e_6580d45e0a39.slice/crio-af9f3ebd923654f8a0962d4ae386e27308c7bcbf90e803a4e91469c566dbbca6 WatchSource:0}: Error finding container af9f3ebd923654f8a0962d4ae386e27308c7bcbf90e803a4e91469c566dbbca6: Status 404 returned error can't find the container with id af9f3ebd923654f8a0962d4ae386e27308c7bcbf90e803a4e91469c566dbbca6
Jul 06 19:34:50.451204 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:50.451172    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:34:50.451283 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:50.451236    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:34:50.451333 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:50.451284    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:34:50.498075 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:50.498039    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls" event={"ID":"681e84da-8c38-4be9-8d5e-6580d45e0a39","Type":"ContainerStarted","Data":"af9f3ebd923654f8a0962d4ae386e27308c7bcbf90e803a4e91469c566dbbca6"}
Jul 06 19:34:51.504126 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:51.504089    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls" event={"ID":"681e84da-8c38-4be9-8d5e-6580d45e0a39","Type":"ContainerStarted","Data":"2043b224f6f6eadc117a69dfa774d631fd21c9a8983dc98d703b9646a48f33ef"}
Jul 06 19:34:51.528455 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:51.528395    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls" podStartSLOduration=2.528377848 podStartE2EDuration="2.528377848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:51.526033936 +0000 UTC m=+549.302067334" watchObservedRunningTime="2026-07-06 19:34:51.528377848 +0000 UTC m=+549.304411248"
Jul 06 19:34:52.310294 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:52.310258    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls"
Jul 06 19:34:52.315254 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:52.315224    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls"
Jul 06 19:34:52.509056 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:52.509020    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls"
Jul 06 19:34:52.509943 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:52.509924    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls"
Jul 06 19:34:52.635772 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:52.635681    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:52.736625 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:52.736587    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:52.838400 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:52.838364    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:53.017976 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:53.017895    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:34:53.023689 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:53.023666    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-n47tk"
Jul 06 19:34:53.025804 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:53.025786    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 06 19:34:53.032131 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:53.032104    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:34:53.066645 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:53.066610    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:34:53.067506 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:53.067477    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d6a51a8f-5379-4bc1-833d-6d570e4985db-config-file\") pod \"limitador-limitador-54d6d988d5-n47tk\" (UID: \"d6a51a8f-5379-4bc1-833d-6d570e4985db\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n47tk"
Jul 06 19:34:53.067707 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:53.067690    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vmrm\" (UniqueName: \"kubernetes.io/projected/d6a51a8f-5379-4bc1-833d-6d570e4985db-kube-api-access-9vmrm\") pod \"limitador-limitador-54d6d988d5-n47tk\" (UID: \"d6a51a8f-5379-4bc1-833d-6d570e4985db\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n47tk"
Jul 06 19:34:53.168229 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:53.168187    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d6a51a8f-5379-4bc1-833d-6d570e4985db-config-file\") pod \"limitador-limitador-54d6d988d5-n47tk\" (UID: \"d6a51a8f-5379-4bc1-833d-6d570e4985db\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n47tk"
Jul 06 19:34:53.168229 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:53.168235    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vmrm\" (UniqueName: \"kubernetes.io/projected/d6a51a8f-5379-4bc1-833d-6d570e4985db-kube-api-access-9vmrm\") pod \"limitador-limitador-54d6d988d5-n47tk\" (UID: \"d6a51a8f-5379-4bc1-833d-6d570e4985db\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n47tk"
Jul 06 19:34:53.168932 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:53.168886    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d6a51a8f-5379-4bc1-833d-6d570e4985db-config-file\") pod \"limitador-limitador-54d6d988d5-n47tk\" (UID: \"d6a51a8f-5379-4bc1-833d-6d570e4985db\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n47tk"
Jul 06 19:34:53.177367 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:53.177336    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vmrm\" (UniqueName: \"kubernetes.io/projected/d6a51a8f-5379-4bc1-833d-6d570e4985db-kube-api-access-9vmrm\") pod \"limitador-limitador-54d6d988d5-n47tk\" (UID: \"d6a51a8f-5379-4bc1-833d-6d570e4985db\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n47tk"
Jul 06 19:34:53.185097 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:53.185068    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:53.293807 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:53.293771    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:53.334886 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:53.334847    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-n47tk"
Jul 06 19:34:53.508646 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:53.508608    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:34:53.511623 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:34:53.511595    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6a51a8f_5379_4bc1_833d_6d570e4985db.slice/crio-3fa6dd4ad8159bb710090c6ecf712572d6f83d5617f9f7b3008d9188e8ea0f44 WatchSource:0}: Error finding container 3fa6dd4ad8159bb710090c6ecf712572d6f83d5617f9f7b3008d9188e8ea0f44: Status 404 returned error can't find the container with id 3fa6dd4ad8159bb710090c6ecf712572d6f83d5617f9f7b3008d9188e8ea0f44
Jul 06 19:34:53.589361 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:53.589286    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:53.694296 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:53.694263    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:54.003630 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:54.003557    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:54.086983 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:54.086950    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:54.524455 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:54.524416    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-n47tk" event={"ID":"d6a51a8f-5379-4bc1-833d-6d570e4985db","Type":"ContainerStarted","Data":"3fa6dd4ad8159bb710090c6ecf712572d6f83d5617f9f7b3008d9188e8ea0f44"}
Jul 06 19:34:56.260562 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:56.260526    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:56.363166 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:56.363130    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:57.536998 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:57.536965    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-n47tk" event={"ID":"d6a51a8f-5379-4bc1-833d-6d570e4985db","Type":"ContainerStarted","Data":"82bf0cdbfa5a4e33ba654a9281c3fc7f15ccaba2dbf30561767f942510b04381"}
Jul 06 19:34:57.537387 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:57.537130    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-n47tk"
Jul 06 19:34:57.562026 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:34:57.561969    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-n47tk" podStartSLOduration=1.916390905 podStartE2EDuration="5.561952649s" totalImagesPullingTime="3.645561744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:57.560246604 +0000 UTC m=+555.336280035" watchObservedRunningTime="2026-07-06 19:34:57.561952649 +0000 UTC m=+555.337986047"
Jul 06 19:35:01.531112 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:35:01.531079    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:35:01.641815 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:35:01.641783    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:35:04.965682 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:35:04.965643    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:35:08.541954 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:35:08.541895    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-n47tk"
Jul 06 19:35:14.335440 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:35:14.335403    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:35:15.322824 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:35:15.322788    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:35:26.408787 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:35:26.408753    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:35:26.544202 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:35:26.544167    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:35:33.383581 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:35:33.383543    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:35:33.488473 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:35:33.488435    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:35:33.591657 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:35:33.591624    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:35:33.886436 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:35:33.886407    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:35:36.814399 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:35:36.814363    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:35:36.956679 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:35:36.956646    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:35:44.058079 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:35:44.058046    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j9wtk_bb750a78-aa1e-4c55-b771-e06ca00b997a/ovn-acl-logging/0.log"
Jul 06 19:35:44.067146 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:35:44.067124    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j9wtk_bb750a78-aa1e-4c55-b771-e06ca00b997a/ovn-acl-logging/0.log"
Jul 06 19:36:03.092126 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:36:03.092088    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:36:08.330748 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:36:08.330671    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:36:08.800133 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:36:08.800101    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:36:09.145811 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:36:09.145728    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:36:09.363931 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:36:09.363888    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:36:09.468411 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:36:09.468321    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:36:09.646384 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:36:09.646346    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:36:16.770634 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:36:16.770601    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:36:16.853369 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:36:16.853311    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:36:17.899668 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:36:17.899638    2555 generic.go:356] "Generic (PLEG): container finished" podID="681e84da-8c38-4be9-8d5e-6580d45e0a39" containerID="2043b224f6f6eadc117a69dfa774d631fd21c9a8983dc98d703b9646a48f33ef" exitCode=0
Jul 06 19:36:17.900152 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:36:17.899692    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls" event={"ID":"681e84da-8c38-4be9-8d5e-6580d45e0a39","Type":"ContainerDied","Data":"2043b224f6f6eadc117a69dfa774d631fd21c9a8983dc98d703b9646a48f33ef"}
Jul 06 19:36:17.900152 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:36:17.900046    2555 scope.go:117] "RemoveContainer" containerID="2043b224f6f6eadc117a69dfa774d631fd21c9a8983dc98d703b9646a48f33ef"
Jul 06 19:36:17.901032 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:36:17.900999    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:36:17.901133 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:36:17.901075    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:36:17.901133 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:36:17.901117    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:36:18.905405 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:36:18.905373    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls" event={"ID":"681e84da-8c38-4be9-8d5e-6580d45e0a39","Type":"ContainerStarted","Data":"2e73472379ad088ff0c89f600af2b2c679f5b908d6d77718d9179a525447c9c2"}
Jul 06 19:36:19.310511 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:36:19.310482    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls"
Jul 06 19:36:19.311520 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:36:19.311491    2555 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-pddls container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body=
Jul 06 19:36:19.311657 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:36:19.311544    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls" podUID="681e84da-8c38-4be9-8d5e-6580d45e0a39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused"
Jul 06 19:36:20.311031 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:36:20.310997    2555 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-pddls container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body=
Jul 06 19:36:20.311472 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:36:20.311063    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls" podUID="681e84da-8c38-4be9-8d5e-6580d45e0a39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused"
Jul 06 19:36:20.390526 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:36:20.390492    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:36:20.483073 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:36:20.483038    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:36:21.310722 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:36:21.310682    2555 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-pddls container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body=
Jul 06 19:36:21.310903 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:36:21.310780    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls" podUID="681e84da-8c38-4be9-8d5e-6580d45e0a39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused"
Jul 06 19:36:22.311036 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:36:22.310995    2555 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-pddls container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body=
Jul 06 19:36:22.311432 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:36:22.311058    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls" podUID="681e84da-8c38-4be9-8d5e-6580d45e0a39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused"
Jul 06 19:36:22.510007 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:36:22.509965    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls"
Jul 06 19:36:23.317241 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:36:23.317199    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls"
Jul 06 19:36:23.318567 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:36:23.318543    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pddls"
Jul 06 19:36:28.213130 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:36:28.213096    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:36:28.783613 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:36:28.783576    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:36:46.057018 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:36:46.056985    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:36:46.792179 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:36:46.792144    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:36:53.515775 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:36:53.515746    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:36:54.589345 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:36:54.589310    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:37:01.090409 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:37:01.090373    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:37:06.016233 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:37:06.016196    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:37:07.480362 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:37:07.480326    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:37:13.805641 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:37:13.805602    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:37:16.085688 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:37:16.085653    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:37:16.702989 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:37:16.702939    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:37:29.787642 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:37:29.787608    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj"]
Jul 06 19:37:29.791322 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:37:29.791299    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj"
Jul 06 19:37:29.793928 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:37:29.793891    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 06 19:37:29.794623 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:37:29.794591    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 06 19:37:29.794748 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:37:29.794627    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 06 19:37:29.794748 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:37:29.794668    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tbnnk\""
Jul 06 19:37:29.808487 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:37:29.808458    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj"]
Jul 06 19:37:29.849441 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:37:29.849405    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:37:29.898142 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:37:29.898103    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f53f625-9e16-457c-a0ad-1cf12bd16b3d-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj\" (UID: \"3f53f625-9e16-457c-a0ad-1cf12bd16b3d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj"
Jul 06 19:37:29.898142 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:37:29.898144    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzs7r\" (UniqueName: \"kubernetes.io/projected/3f53f625-9e16-457c-a0ad-1cf12bd16b3d-kube-api-access-xzs7r\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj\" (UID: \"3f53f625-9e16-457c-a0ad-1cf12bd16b3d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj"
Jul 06 19:37:29.898387 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:37:29.898184    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f53f625-9e16-457c-a0ad-1cf12bd16b3d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj\" (UID: \"3f53f625-9e16-457c-a0ad-1cf12bd16b3d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj"
Jul 06 19:37:29.898387 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:37:29.898263    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f53f625-9e16-457c-a0ad-1cf12bd16b3d-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj\" (UID: \"3f53f625-9e16-457c-a0ad-1cf12bd16b3d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj"
Jul 06 19:37:29.898387 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:37:29.898331    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f53f625-9e16-457c-a0ad-1cf12bd16b3d-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj\" (UID: \"3f53f625-9e16-457c-a0ad-1cf12bd16b3d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj"
Jul 06 19:37:29.898387 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:37:29.898363    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f53f625-9e16-457c-a0ad-1cf12bd16b3d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj\" (UID: \"3f53f625-9e16-457c-a0ad-1cf12bd16b3d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj"
Jul 06 19:37:29.999448 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:37:29.999409    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f53f625-9e16-457c-a0ad-1cf12bd16b3d-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj\" (UID: \"3f53f625-9e16-457c-a0ad-1cf12bd16b3d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj"
Jul 06 19:37:29.999448 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:37:29.999452    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzs7r\" (UniqueName: \"kubernetes.io/projected/3f53f625-9e16-457c-a0ad-1cf12bd16b3d-kube-api-access-xzs7r\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj\" (UID: \"3f53f625-9e16-457c-a0ad-1cf12bd16b3d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj"
Jul 06 19:37:29.999720 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:37:29.999580    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f53f625-9e16-457c-a0ad-1cf12bd16b3d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj\" (UID: \"3f53f625-9e16-457c-a0ad-1cf12bd16b3d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj"
Jul 06 19:37:29.999720 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:37:29.999623    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f53f625-9e16-457c-a0ad-1cf12bd16b3d-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj\" (UID: \"3f53f625-9e16-457c-a0ad-1cf12bd16b3d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj"
Jul 06 19:37:29.999720 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:37:29.999677    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f53f625-9e16-457c-a0ad-1cf12bd16b3d-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj\" (UID: \"3f53f625-9e16-457c-a0ad-1cf12bd16b3d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj"
Jul 06 19:37:29.999720 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:37:29.999697    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f53f625-9e16-457c-a0ad-1cf12bd16b3d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj\" (UID: \"3f53f625-9e16-457c-a0ad-1cf12bd16b3d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj"
Jul 06 19:37:30.000098 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:37:30.000068    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f53f625-9e16-457c-a0ad-1cf12bd16b3d-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj\" (UID: \"3f53f625-9e16-457c-a0ad-1cf12bd16b3d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj"
Jul 06 19:37:30.000098 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:37:30.000084    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f53f625-9e16-457c-a0ad-1cf12bd16b3d-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj\" (UID: \"3f53f625-9e16-457c-a0ad-1cf12bd16b3d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj"
Jul 06 19:37:30.000249 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:37:30.000141    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f53f625-9e16-457c-a0ad-1cf12bd16b3d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj\" (UID: \"3f53f625-9e16-457c-a0ad-1cf12bd16b3d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj"
Jul 06 19:37:30.001813 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:37:30.001785    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f53f625-9e16-457c-a0ad-1cf12bd16b3d-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj\" (UID: \"3f53f625-9e16-457c-a0ad-1cf12bd16b3d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj"
Jul 06 19:37:30.001992 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:37:30.001973    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f53f625-9e16-457c-a0ad-1cf12bd16b3d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj\" (UID: \"3f53f625-9e16-457c-a0ad-1cf12bd16b3d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj"
Jul 06 19:37:30.010719 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:37:30.010695    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzs7r\" (UniqueName: \"kubernetes.io/projected/3f53f625-9e16-457c-a0ad-1cf12bd16b3d-kube-api-access-xzs7r\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj\" (UID: \"3f53f625-9e16-457c-a0ad-1cf12bd16b3d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj"
Jul 06 19:37:30.101061 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:37:30.100971    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj"
Jul 06 19:37:30.257694 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:37:30.256949    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:37:30.257694 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:37:30.257007    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj"]
Jul 06 19:37:31.234445 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:37:31.234409    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj" event={"ID":"3f53f625-9e16-457c-a0ad-1cf12bd16b3d","Type":"ContainerStarted","Data":"aad14f10a5c2af4c51ca1db24f35a1f479fafafdd139a77832d360d08ab7addb"}
Jul 06 19:37:32.239713 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:37:32.239676    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj" event={"ID":"3f53f625-9e16-457c-a0ad-1cf12bd16b3d","Type":"ContainerStarted","Data":"8b96adc2b032b16ba535d6112c78e1ba67d7dd7dc8b0ae934617ff07faf15af3"}
Jul 06 19:37:32.258972 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:37:32.258936    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:37:32.267245 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:37:32.267195    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj" podStartSLOduration=2.266229987 podStartE2EDuration="3.267179973s" totalImagesPullingTime="1.000949986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:37:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:37:32.264294227 +0000 UTC m=+710.040327638" watchObservedRunningTime="2026-07-06 19:37:32.267179973 +0000 UTC m=+710.043213371"
Jul 06 19:37:34.272780 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:37:34.272672    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:37:40.101445 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:37:40.101406    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj"
Jul 06 19:37:40.101857 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:37:40.101462    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj"
Jul 06 19:37:40.114227 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:37:40.114192    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj"
Jul 06 19:37:40.284958 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:37:40.284929    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj"
Jul 06 19:38:33.394637 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:38:33.394569    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:38:34.672489 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:38:34.672453    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:39:08.505803 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:39:08.505718    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:39:18.093180 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:39:18.093140    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:39:29.482604 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:39:29.482573    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:39:38.778604 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:39:38.778565    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:39:49.090822 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:39:49.090786    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:39:51.735072 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:39:51.735032    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:12.870549 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:12.870502    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w9qgc" podUID="82abcd40-00bb-43f3-8b0d-8753994fb246" containerName="manager" probeResult="failure" output="Get \"http://10.132.0.21:8081/readyz\": dial tcp 10.132.0.21:8081: connect: connection refused"
Jul 06 19:40:12.870970 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:12.870503    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cn4dn" podUID="15f0cac8-027a-43a0-aecb-269352712038" containerName="manager" probeResult="failure" output="Get \"http://10.132.0.22:8081/readyz\": dial tcp 10.132.0.22:8081: connect: connection refused"
Jul 06 19:40:12.964472 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:12.964381    2555 generic.go:356] "Generic (PLEG): container finished" podID="15f0cac8-027a-43a0-aecb-269352712038" containerID="c26a6092243558141aa9d9485edee47658f81b693675073d4d3cb312d862144f" exitCode=1
Jul 06 19:40:12.964472 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:12.964455    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cn4dn" event={"ID":"15f0cac8-027a-43a0-aecb-269352712038","Type":"ContainerDied","Data":"c26a6092243558141aa9d9485edee47658f81b693675073d4d3cb312d862144f"}
Jul 06 19:40:12.964817 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:12.964798    2555 scope.go:117] "RemoveContainer" containerID="c26a6092243558141aa9d9485edee47658f81b693675073d4d3cb312d862144f"
Jul 06 19:40:12.966060 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:12.966042    2555 generic.go:356] "Generic (PLEG): container finished" podID="ca3842fa-ba34-4eea-85a5-cfce35b511f8" containerID="4971fc63d08444bb6a65020f02a92cf6b8a75fe105abdc4a5b4b99fef12edcab" exitCode=1
Jul 06 19:40:12.966141 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:12.966119    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8g2wm" event={"ID":"ca3842fa-ba34-4eea-85a5-cfce35b511f8","Type":"ContainerDied","Data":"4971fc63d08444bb6a65020f02a92cf6b8a75fe105abdc4a5b4b99fef12edcab"}
Jul 06 19:40:12.966411 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:12.966395    2555 scope.go:117] "RemoveContainer" containerID="4971fc63d08444bb6a65020f02a92cf6b8a75fe105abdc4a5b4b99fef12edcab"
Jul 06 19:40:12.967640 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:12.967620    2555 generic.go:356] "Generic (PLEG): container finished" podID="86789700-3004-4ad7-be6d-8484c1d1ae9c" containerID="7813decac1e71fc5fc5703cde45c393fcf03f0fa7e648f91650eabcbf62da057" exitCode=1
Jul 06 19:40:12.967718 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:12.967683    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-s5bxj" event={"ID":"86789700-3004-4ad7-be6d-8484c1d1ae9c","Type":"ContainerDied","Data":"7813decac1e71fc5fc5703cde45c393fcf03f0fa7e648f91650eabcbf62da057"}
Jul 06 19:40:12.968034 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:12.968014    2555 scope.go:117] "RemoveContainer" containerID="7813decac1e71fc5fc5703cde45c393fcf03f0fa7e648f91650eabcbf62da057"
Jul 06 19:40:12.969380 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:12.969362    2555 generic.go:356] "Generic (PLEG): container finished" podID="7bdc1b96-b5ff-4080-a877-61100abc752f" containerID="acb90ad4625babf1ed00ca32769b6b7ea9641ef1317db7fc502cc9aac33cd286" exitCode=1
Jul 06 19:40:12.969480 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:12.969420    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvjk6" event={"ID":"7bdc1b96-b5ff-4080-a877-61100abc752f","Type":"ContainerDied","Data":"acb90ad4625babf1ed00ca32769b6b7ea9641ef1317db7fc502cc9aac33cd286"}
Jul 06 19:40:12.970395 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:12.970232    2555 scope.go:117] "RemoveContainer" containerID="acb90ad4625babf1ed00ca32769b6b7ea9641ef1317db7fc502cc9aac33cd286"
Jul 06 19:40:12.973812 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:12.973566    2555 generic.go:356] "Generic (PLEG): container finished" podID="82abcd40-00bb-43f3-8b0d-8753994fb246" containerID="bd41dc9d8dba3c33efaad6a57eb79b600928a636f7b11af70255c82c996a896c" exitCode=1
Jul 06 19:40:12.973812 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:12.973676    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w9qgc" event={"ID":"82abcd40-00bb-43f3-8b0d-8753994fb246","Type":"ContainerDied","Data":"bd41dc9d8dba3c33efaad6a57eb79b600928a636f7b11af70255c82c996a896c"}
Jul 06 19:40:12.974126 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:12.974106    2555 scope.go:117] "RemoveContainer" containerID="bd41dc9d8dba3c33efaad6a57eb79b600928a636f7b11af70255c82c996a896c"
Jul 06 19:40:12.978629 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:12.978606    2555 generic.go:356] "Generic (PLEG): container finished" podID="046e62b5-715c-458e-b98e-e1a64164578b" containerID="60223b5243dc90cec9e8bf6d69414639d3dac318341025f22603c8425f0de96e" exitCode=1
Jul 06 19:40:12.978747 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:12.978675    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zbsh7" event={"ID":"046e62b5-715c-458e-b98e-e1a64164578b","Type":"ContainerDied","Data":"60223b5243dc90cec9e8bf6d69414639d3dac318341025f22603c8425f0de96e"}
Jul 06 19:40:12.978983 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:12.978966    2555 scope.go:117] "RemoveContainer" containerID="60223b5243dc90cec9e8bf6d69414639d3dac318341025f22603c8425f0de96e"
Jul 06 19:40:12.981181 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:12.981157    2555 generic.go:356] "Generic (PLEG): container finished" podID="c7dee535-a870-4e31-9a68-5aaaaff90be2" containerID="6a4e387f2d8805edb05144a4714c3e10dc67679f1ca494b3555520be4cc522cb" exitCode=1
Jul 06 19:40:12.981271 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:12.981219    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-cx94f" event={"ID":"c7dee535-a870-4e31-9a68-5aaaaff90be2","Type":"ContainerDied","Data":"6a4e387f2d8805edb05144a4714c3e10dc67679f1ca494b3555520be4cc522cb"}
Jul 06 19:40:12.981557 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:12.981541    2555 scope.go:117] "RemoveContainer" containerID="6a4e387f2d8805edb05144a4714c3e10dc67679f1ca494b3555520be4cc522cb"
Jul 06 19:40:13.792184 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:13.792140    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-s5bxj"
Jul 06 19:40:13.963151 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:40:13.963051    2555 controller.go:195] "Failed to update lease" err="Put \"https://ac62e67e410bc444e977b99541dde199-2f2af20a0dc725e5.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-131-150.ec2.internal?timeout=10s\": context deadline exceeded"
Jul 06 19:40:13.968284 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:40:13.968257    2555 kuberuntime_manager.go:1459] "Unhandled Error" err="container manager start failed in pod dns-operator-controller-manager-864dd78c4c-8g2wm_kuadrant-system(ca3842fa-ba34-4eea-85a5-cfce35b511f8): CreateContainerConfigError: failed to sync configmap cache: timed out waiting for the condition" logger="UnhandledError"
Jul 06 19:40:13.968375 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:40:13.968300    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CreateContainerConfigError: \"failed to sync configmap cache: timed out waiting for the condition\"" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8g2wm" podUID="ca3842fa-ba34-4eea-85a5-cfce35b511f8"
Jul 06 19:40:13.987785 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:13.987748    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-cx94f" event={"ID":"c7dee535-a870-4e31-9a68-5aaaaff90be2","Type":"ContainerStarted","Data":"397d40e858786735fd48ad04879a49e6c08de07f619ad2104d2a59f821bc295a"}
Jul 06 19:40:13.988108 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:13.988088    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-cx94f"
Jul 06 19:40:13.989425 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:13.989401    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cn4dn" event={"ID":"15f0cac8-027a-43a0-aecb-269352712038","Type":"ContainerStarted","Data":"c59a9f7728a474bd54f27348c3306cb913706ef7c2f6c5111410dc69e74edd23"}
Jul 06 19:40:13.989585 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:13.989568    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cn4dn"
Jul 06 19:40:13.991077 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:13.991057    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-s5bxj" event={"ID":"86789700-3004-4ad7-be6d-8484c1d1ae9c","Type":"ContainerStarted","Data":"966196c6e9d4e0fcee6633587ce2e7d3e69c6862350f43098aa568a08bc1a5c5"}
Jul 06 19:40:13.991187 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:13.991149    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-s5bxj"
Jul 06 19:40:13.992769 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:13.992751    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvjk6" event={"ID":"7bdc1b96-b5ff-4080-a877-61100abc752f","Type":"ContainerStarted","Data":"f4ec77e2aa4f55f03719111286059489d43edcf6374dd6b9e2df22cef23710d4"}
Jul 06 19:40:13.992969 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:13.992953    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvjk6"
Jul 06 19:40:13.994391 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:13.994373    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w9qgc" event={"ID":"82abcd40-00bb-43f3-8b0d-8753994fb246","Type":"ContainerStarted","Data":"4fd88f6abc62919e4c3b842b53e10d66bde400d8ccb89db35e2be12e1da662a5"}
Jul 06 19:40:13.994572 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:13.994558    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w9qgc"
Jul 06 19:40:13.996008 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:13.995992    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zbsh7" event={"ID":"046e62b5-715c-458e-b98e-e1a64164578b","Type":"ContainerStarted","Data":"70a63eb2a12719ad80550da7659e3d7c4bea66d4573d5f51746c71ae0c78544d"}
Jul 06 19:40:13.996154 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:13.996141    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zbsh7"
Jul 06 19:40:22.208422 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:22.208386    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8g2wm"
Jul 06 19:40:22.208788 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:22.208748    2555 scope.go:117] "RemoveContainer" containerID="4971fc63d08444bb6a65020f02a92cf6b8a75fe105abdc4a5b4b99fef12edcab"
Jul 06 19:40:22.208958 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:40:22.208937    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=dns-operator-controller-manager-864dd78c4c-8g2wm_kuadrant-system(ca3842fa-ba34-4eea-85a5-cfce35b511f8)\"" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8g2wm" podUID="ca3842fa-ba34-4eea-85a5-cfce35b511f8"
Jul 06 19:40:23.058180 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:23.058151    2555 trace.go:236] Trace[2099476688]: "Reflector ListAndWatch" name:object-"kuadrant-system"/"dns-operator-controller-env" (06-Jul-2026 19:40:12.967) (total time: 10089ms):
Jul 06 19:40:23.058180 ip-10-0-131-150 kubenswrapper[2555]: Trace[2099476688]: ---"Objects listed" error:<nil> 10089ms (19:40:23.057)
Jul 06 19:40:23.058180 ip-10-0-131-150 kubenswrapper[2555]: Trace[2099476688]: [10.089959401s] [10.089959401s] END
Jul 06 19:40:23.058180 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:23.058178    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 06 19:40:23.369191 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:23.369105    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:23.760768 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:23.760673    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:25.003340 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:25.003306    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvjk6"
Jul 06 19:40:25.003730 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:25.003404    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zbsh7"
Jul 06 19:40:25.003730 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:25.003452    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-cx94f"
Jul 06 19:40:25.003730 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:25.003486    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-s5bxj"
Jul 06 19:40:28.651292 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:28.651258    2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8g2wm"
Jul 06 19:40:28.651657 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:28.651599    2555 scope.go:117] "RemoveContainer" containerID="4971fc63d08444bb6a65020f02a92cf6b8a75fe105abdc4a5b4b99fef12edcab"
Jul 06 19:40:29.070781 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:29.070745    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8g2wm" event={"ID":"ca3842fa-ba34-4eea-85a5-cfce35b511f8","Type":"ContainerStarted","Data":"c824e995a3625f94fd163d3d3094fbc6025880f87b4c9deeeb56280dc87fe13f"}
Jul 06 19:40:29.070986 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:29.070969    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8g2wm"
Jul 06 19:40:40.077424 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:40.077377    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8g2wm" podUID="ca3842fa-ba34-4eea-85a5-cfce35b511f8" containerName="manager" probeResult="failure" output="Get \"http://10.132.0.25:8081/readyz\": dial tcp 10.132.0.25:8081: connect: connection refused"
Jul 06 19:40:43.324854 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:40:43.324804    2555 controller.go:195] "Failed to update lease" err="Put \"https://ac62e67e410bc444e977b99541dde199-2f2af20a0dc725e5.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-131-150.ec2.internal?timeout=10s\": context deadline exceeded"
Jul 06 19:40:44.088444 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:44.088413    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j9wtk_bb750a78-aa1e-4c55-b771-e06ca00b997a/ovn-acl-logging/0.log"
Jul 06 19:40:44.093562 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:44.093537    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j9wtk_bb750a78-aa1e-4c55-b771-e06ca00b997a/ovn-acl-logging/0.log"
Jul 06 19:40:45.002737 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:45.002700    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cn4dn"
Jul 06 19:40:45.005889 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:45.005865    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w9qgc"
Jul 06 19:40:48.652001 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:48.651960    2555 prober.go:120] "Probe failed" probeType="Liveness" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8g2wm" podUID="ca3842fa-ba34-4eea-85a5-cfce35b511f8" containerName="manager" probeResult="failure" output="Get \"http://10.132.0.25:8081/healthz\": dial tcp 10.132.0.25:8081: connect: connection refused"
Jul 06 19:40:50.076650 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:40:50.076600    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8g2wm" podUID="ca3842fa-ba34-4eea-85a5-cfce35b511f8" containerName="manager" probeResult="failure" output="Get \"http://10.132.0.25:8081/readyz\": dial tcp 10.132.0.25:8081: connect: connection refused"
Jul 06 19:40:53.325780 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:40:53.325742    2555 controller.go:195] "Failed to update lease" err="Put \"https://ac62e67e410bc444e977b99541dde199-2f2af20a0dc725e5.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-131-150.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Jul 06 19:41:00.076233 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:00.076190    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8g2wm" podUID="ca3842fa-ba34-4eea-85a5-cfce35b511f8" containerName="manager" probeResult="failure" output="Get \"http://10.132.0.25:8081/readyz\": dial tcp 10.132.0.25:8081: connect: connection refused"
Jul 06 19:41:03.326111 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:41:03.326069    2555 controller.go:195] "Failed to update lease" err="Put \"https://ac62e67e410bc444e977b99541dde199-2f2af20a0dc725e5.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-131-150.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Jul 06 19:41:08.652216 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:08.652174    2555 prober.go:120] "Probe failed" probeType="Liveness" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8g2wm" podUID="ca3842fa-ba34-4eea-85a5-cfce35b511f8" containerName="manager" probeResult="failure" output="Get \"http://10.132.0.25:8081/healthz\": dial tcp 10.132.0.25:8081: connect: connection refused"
Jul 06 19:41:10.076696 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:10.076655    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8g2wm" podUID="ca3842fa-ba34-4eea-85a5-cfce35b511f8" containerName="manager" probeResult="failure" output="Get \"http://10.132.0.25:8081/readyz\": dial tcp 10.132.0.25:8081: connect: connection refused"
Jul 06 19:41:10.959796 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:41:10.959740    2555 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"046e62b5-715c-458e-b98e-e1a64164578b\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-06T19:40:12Z\\\",\\\"message\\\":\\\"containers with unready status: [manager]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-06T19:40:12Z\\\",\\\"message\\\":\\\"containers with unready status: [manager]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"200m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://70a63eb2a12719ad80550da7659e3d7c4bea66d4573d5f51746c71ae0c78544d\\\",\\\"image\\\":\\\"quay.io/kuadrant/authorino-operator:v0.23.1\\\",\\\"imageID\\\":\\\"quay.io/kuadrant/authorino-operator@sha256:3b728eb98fcd40e2ed8fce6748bd2ffb56c4fa5cc8cbcc7a3736b9818e63a7d2\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://60223b5243dc90cec9e8bf6d69414639d3dac318341025f22603c8425f0de96e\\\",\\\"exitCode\\\":1,\\\"finishedAt\\\":\\\"2026-07-06T19:40:12Z\\\",\\\"reason\\\":\\\"Error\\\",\\\"startedAt\\\":\\\"2026-07-06T19:33:58Z\\\"}},\\\"name\\\":\\\"manager\\\",\\\"ready\\\":false,\\\"resources\\\":{\\\"limits\\\":{\\\"cpu\\\":\\\"200m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"requests\\\":{\\\"cpu\\\":\\\"200m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":1,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-06T19:40:13Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000680000],\\\"uid\\\":1000680000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hbvsd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"kuadrant-system\"/\"authorino-operator-75cc8d5cb7-zbsh7\": Timeout: request did not complete within requested timeout - context deadline exceeded" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zbsh7"
Jul 06 19:41:10.960044 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:41:10.959711    2555 event.go:359] "Server rejected event (will not retry!)" err="Timeout: request did not complete within requested timeout - context deadline exceeded" event="&Event{ObjectMeta:{odh-model-controller-7998c67dc4-s5bxj.18bfcaab06530c28  opendatahub    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:opendatahub,Name:odh-model-controller-7998c67dc4-s5bxj,UID:86789700-3004-4ad7-be6d-8484c1d1ae9c,APIVersion:v1,ResourceVersion:13741,FieldPath:spec.containers{manager},},Reason:Pulled,Message:Successfully pulled image \"quay.io/opendatahub/odh-model-controller:odh-v3.5-EA2\" in 387ms (387ms including waiting). Image size: 238576181 bytes.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-150.ec2.internal,},FirstTimestamp:2026-07-06 19:40:13.356330024 +0000 UTC m=+871.132363400,LastTimestamp:2026-07-06 19:40:13.356330024 +0000 UTC m=+871.132363400,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-150.ec2.internal,}"
Jul 06 19:41:17.817773 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:17.817733    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:41:20.077059 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:20.077026    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8g2wm"
Jul 06 19:41:28.343552 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:28.343522    2555 generic.go:356] "Generic (PLEG): container finished" podID="c7dee535-a870-4e31-9a68-5aaaaff90be2" containerID="397d40e858786735fd48ad04879a49e6c08de07f619ad2104d2a59f821bc295a" exitCode=1
Jul 06 19:41:28.344087 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:28.343600    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-cx94f" event={"ID":"c7dee535-a870-4e31-9a68-5aaaaff90be2","Type":"ContainerDied","Data":"397d40e858786735fd48ad04879a49e6c08de07f619ad2104d2a59f821bc295a"}
Jul 06 19:41:28.344087 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:28.343662    2555 scope.go:117] "RemoveContainer" containerID="6a4e387f2d8805edb05144a4714c3e10dc67679f1ca494b3555520be4cc522cb"
Jul 06 19:41:28.344087 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:28.344071    2555 scope.go:117] "RemoveContainer" containerID="397d40e858786735fd48ad04879a49e6c08de07f619ad2104d2a59f821bc295a"
Jul 06 19:41:28.344339 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:41:28.344318    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=opendatahub-operator-controller-manager-79c9ddb849-cx94f_opendatahub(c7dee535-a870-4e31-9a68-5aaaaff90be2)\"" pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-cx94f" podUID="c7dee535-a870-4e31-9a68-5aaaaff90be2"
Jul 06 19:41:29.349877 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:29.349844    2555 generic.go:356] "Generic (PLEG): container finished" podID="7bdc1b96-b5ff-4080-a877-61100abc752f" containerID="f4ec77e2aa4f55f03719111286059489d43edcf6374dd6b9e2df22cef23710d4" exitCode=1
Jul 06 19:41:29.350344 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:29.349927    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvjk6" event={"ID":"7bdc1b96-b5ff-4080-a877-61100abc752f","Type":"ContainerDied","Data":"f4ec77e2aa4f55f03719111286059489d43edcf6374dd6b9e2df22cef23710d4"}
Jul 06 19:41:29.350344 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:29.349988    2555 scope.go:117] "RemoveContainer" containerID="acb90ad4625babf1ed00ca32769b6b7ea9641ef1317db7fc502cc9aac33cd286"
Jul 06 19:41:29.350344 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:29.350288    2555 scope.go:117] "RemoveContainer" containerID="f4ec77e2aa4f55f03719111286059489d43edcf6374dd6b9e2df22cef23710d4"
Jul 06 19:41:29.350537 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:41:29.350515    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=limitador-operator-controller-manager-859d7b78bd-vvjk6_kuadrant-system(7bdc1b96-b5ff-4080-a877-61100abc752f)\"" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvjk6" podUID="7bdc1b96-b5ff-4080-a877-61100abc752f"
Jul 06 19:41:30.358394 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:30.358363    2555 generic.go:356] "Generic (PLEG): container finished" podID="86789700-3004-4ad7-be6d-8484c1d1ae9c" containerID="966196c6e9d4e0fcee6633587ce2e7d3e69c6862350f43098aa568a08bc1a5c5" exitCode=1
Jul 06 19:41:30.358805 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:30.358440    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-s5bxj" event={"ID":"86789700-3004-4ad7-be6d-8484c1d1ae9c","Type":"ContainerDied","Data":"966196c6e9d4e0fcee6633587ce2e7d3e69c6862350f43098aa568a08bc1a5c5"}
Jul 06 19:41:30.358805 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:30.358505    2555 scope.go:117] "RemoveContainer" containerID="7813decac1e71fc5fc5703cde45c393fcf03f0fa7e648f91650eabcbf62da057"
Jul 06 19:41:30.358930 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:30.358819    2555 scope.go:117] "RemoveContainer" containerID="966196c6e9d4e0fcee6633587ce2e7d3e69c6862350f43098aa568a08bc1a5c5"
Jul 06 19:41:30.359086 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:41:30.359065    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-7998c67dc4-s5bxj_opendatahub(86789700-3004-4ad7-be6d-8484c1d1ae9c)\"" pod="opendatahub/odh-model-controller-7998c67dc4-s5bxj" podUID="86789700-3004-4ad7-be6d-8484c1d1ae9c"
Jul 06 19:41:30.361642 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:30.361622    2555 generic.go:356] "Generic (PLEG): container finished" podID="82abcd40-00bb-43f3-8b0d-8753994fb246" containerID="4fd88f6abc62919e4c3b842b53e10d66bde400d8ccb89db35e2be12e1da662a5" exitCode=1
Jul 06 19:41:30.361734 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:30.361671    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w9qgc" event={"ID":"82abcd40-00bb-43f3-8b0d-8753994fb246","Type":"ContainerDied","Data":"4fd88f6abc62919e4c3b842b53e10d66bde400d8ccb89db35e2be12e1da662a5"}
Jul 06 19:41:30.361959 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:30.361946    2555 scope.go:117] "RemoveContainer" containerID="4fd88f6abc62919e4c3b842b53e10d66bde400d8ccb89db35e2be12e1da662a5"
Jul 06 19:41:30.362122 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:41:30.362107    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kserve-controller-manager-d6f4b65b8-w9qgc_opendatahub(82abcd40-00bb-43f3-8b0d-8753994fb246)\"" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w9qgc" podUID="82abcd40-00bb-43f3-8b0d-8753994fb246"
Jul 06 19:41:30.369004 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:30.368985    2555 scope.go:117] "RemoveContainer" containerID="bd41dc9d8dba3c33efaad6a57eb79b600928a636f7b11af70255c82c996a896c"
Jul 06 19:41:32.622724 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:32.622690    2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w9qgc"
Jul 06 19:41:32.623135 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:32.623063    2555 scope.go:117] "RemoveContainer" containerID="4fd88f6abc62919e4c3b842b53e10d66bde400d8ccb89db35e2be12e1da662a5"
Jul 06 19:41:32.623256 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:41:32.623237    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kserve-controller-manager-d6f4b65b8-w9qgc_opendatahub(82abcd40-00bb-43f3-8b0d-8753994fb246)\"" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w9qgc" podUID="82abcd40-00bb-43f3-8b0d-8753994fb246"
Jul 06 19:41:35.001523 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:35.001472    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvjk6"
Jul 06 19:41:35.002037 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:35.001553    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w9qgc"
Jul 06 19:41:35.002037 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:35.001580    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-s5bxj"
Jul 06 19:41:35.002037 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:35.001629    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-cx94f"
Jul 06 19:41:35.002037 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:35.001981    2555 scope.go:117] "RemoveContainer" containerID="f4ec77e2aa4f55f03719111286059489d43edcf6374dd6b9e2df22cef23710d4"
Jul 06 19:41:35.002226 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:35.002197    2555 scope.go:117] "RemoveContainer" containerID="4fd88f6abc62919e4c3b842b53e10d66bde400d8ccb89db35e2be12e1da662a5"
Jul 06 19:41:35.002295 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:41:35.002197    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=limitador-operator-controller-manager-859d7b78bd-vvjk6_kuadrant-system(7bdc1b96-b5ff-4080-a877-61100abc752f)\"" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvjk6" podUID="7bdc1b96-b5ff-4080-a877-61100abc752f"
Jul 06 19:41:35.002339 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:35.002304    2555 scope.go:117] "RemoveContainer" containerID="966196c6e9d4e0fcee6633587ce2e7d3e69c6862350f43098aa568a08bc1a5c5"
Jul 06 19:41:35.002396 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:41:35.002376    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kserve-controller-manager-d6f4b65b8-w9qgc_opendatahub(82abcd40-00bb-43f3-8b0d-8753994fb246)\"" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w9qgc" podUID="82abcd40-00bb-43f3-8b0d-8753994fb246"
Jul 06 19:41:35.002485 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:35.002470    2555 scope.go:117] "RemoveContainer" containerID="397d40e858786735fd48ad04879a49e6c08de07f619ad2104d2a59f821bc295a"
Jul 06 19:41:35.002485 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:41:35.002474    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-7998c67dc4-s5bxj_opendatahub(86789700-3004-4ad7-be6d-8484c1d1ae9c)\"" pod="opendatahub/odh-model-controller-7998c67dc4-s5bxj" podUID="86789700-3004-4ad7-be6d-8484c1d1ae9c"
Jul 06 19:41:35.002617 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:41:35.002600    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=opendatahub-operator-controller-manager-79c9ddb849-cx94f_opendatahub(c7dee535-a870-4e31-9a68-5aaaaff90be2)\"" pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-cx94f" podUID="c7dee535-a870-4e31-9a68-5aaaaff90be2"
Jul 06 19:41:35.818714 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:35.818682    2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-cx94f"
Jul 06 19:41:35.819127 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:35.819113    2555 scope.go:117] "RemoveContainer" containerID="397d40e858786735fd48ad04879a49e6c08de07f619ad2104d2a59f821bc295a"
Jul 06 19:41:35.819302 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:41:35.819283    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=opendatahub-operator-controller-manager-79c9ddb849-cx94f_opendatahub(c7dee535-a870-4e31-9a68-5aaaaff90be2)\"" pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-cx94f" podUID="c7dee535-a870-4e31-9a68-5aaaaff90be2"
Jul 06 19:41:38.355070 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:38.355035    2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/odh-model-controller-7998c67dc4-s5bxj"
Jul 06 19:41:38.355444 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:38.355393    2555 scope.go:117] "RemoveContainer" containerID="966196c6e9d4e0fcee6633587ce2e7d3e69c6862350f43098aa568a08bc1a5c5"
Jul 06 19:41:38.355572 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:41:38.355553    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-7998c67dc4-s5bxj_opendatahub(86789700-3004-4ad7-be6d-8484c1d1ae9c)\"" pod="opendatahub/odh-model-controller-7998c67dc4-s5bxj" podUID="86789700-3004-4ad7-be6d-8484c1d1ae9c"
Jul 06 19:41:38.876410 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:38.876375    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:41:41.507002 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:41.506968    2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvjk6"
Jul 06 19:41:41.507373 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:41.507290    2555 scope.go:117] "RemoveContainer" containerID="f4ec77e2aa4f55f03719111286059489d43edcf6374dd6b9e2df22cef23710d4"
Jul 06 19:41:42.421178 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:42.421146    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvjk6" event={"ID":"7bdc1b96-b5ff-4080-a877-61100abc752f","Type":"ContainerStarted","Data":"918aa4752c5b61c23f0a622058b1a9baa0e82c9e8190afc65e79748059d90086"}
Jul 06 19:41:42.421385 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:42.421367    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvjk6"
Jul 06 19:41:45.687139 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:45.687102    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:41:46.021903 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:46.021806    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:41:47.124293 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:47.124266    2555 scope.go:117] "RemoveContainer" containerID="4fd88f6abc62919e4c3b842b53e10d66bde400d8ccb89db35e2be12e1da662a5"
Jul 06 19:41:48.451048 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:48.451012    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w9qgc" event={"ID":"82abcd40-00bb-43f3-8b0d-8753994fb246","Type":"ContainerStarted","Data":"17766841f9c6b3523a449fd4a89f012689ed49cb6b7532f395c471e97c961a62"}
Jul 06 19:41:48.451570 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:48.451222    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w9qgc"
Jul 06 19:41:50.124799 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:50.124770    2555 scope.go:117] "RemoveContainer" containerID="397d40e858786735fd48ad04879a49e6c08de07f619ad2104d2a59f821bc295a"
Jul 06 19:41:50.632143 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:50.632107    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:41:51.125120 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:51.125089    2555 scope.go:117] "RemoveContainer" containerID="966196c6e9d4e0fcee6633587ce2e7d3e69c6862350f43098aa568a08bc1a5c5"
Jul 06 19:41:51.466928 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:51.466830    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-cx94f" event={"ID":"c7dee535-a870-4e31-9a68-5aaaaff90be2","Type":"ContainerStarted","Data":"bef236ad9374c67457ba022f7fdd23bf1a41e38921cd8e5b2db03476cdd05d21"}
Jul 06 19:41:51.467145 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:51.467128    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-cx94f"
Jul 06 19:41:52.472761 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:52.472725    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-s5bxj" event={"ID":"86789700-3004-4ad7-be6d-8484c1d1ae9c","Type":"ContainerStarted","Data":"f37cc3e1b150872ea7f5e9cc63bb21347cc0bd8b5867250ea638a74a0d161d33"}
Jul 06 19:41:53.428583 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:53.428547    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vvjk6"
Jul 06 19:41:58.288066 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:58.288033    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:41:58.703465 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:41:58.703379    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:42:00.688696 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:42:00.688663    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:42:02.473318 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:42:02.473275    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-s5bxj"
Jul 06 19:42:02.474588 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:42:02.474565    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-cx94f"
Jul 06 19:42:02.474921 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:42:02.474888    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-s5bxj"
Jul 06 19:42:06.255338 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:42:06.255261    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:42:06.565381 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:42:06.565346    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:42:07.190052 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:42:07.190016    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:42:16.274579 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:42:16.274542    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:42:17.339272 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:42:17.339242    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:42:17.659786 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:42:17.659664    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:42:19.461313 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:42:19.461273    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w9qgc"
Jul 06 19:42:22.172179 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:42:22.172134    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:42:30.107457 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:42:30.107417    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:42:32.298665 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:42:32.298633    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:42:32.733774 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:42:32.733697    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:42:35.321844 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:42:35.321811    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:42:35.614639 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:42:35.614534    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:42:36.016940 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:42:36.016839    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:42:46.953223 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:42:46.953184    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:42:47.167016 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:42:47.166961    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:42:53.218253 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:42:53.218220    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:42:53.309145 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:42:53.309109    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:42:59.887880 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:42:59.887842    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:42:59.948204 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:42:59.948172    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:43:09.690123 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:43:09.690085    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:43:17.078264 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:43:17.078224    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:43:26.782796 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:43:26.782758    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:43:33.592285 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:43:33.592247    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:43:43.798944 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:43:43.798888    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:43:52.683163 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:43:52.683123    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:44:04.678902 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:44:04.678861    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:44:13.983954 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:44:13.983905    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:44:20.427552 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:44:20.427511    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:44:22.098795 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:44:22.098762    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:44:37.084836 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:44:37.084796    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:44:48.681206 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:44:48.681163    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:45:00.166512 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:45:00.166476    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29722785-22w4d"]
Jul 06 19:45:00.169760 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:45:00.169743    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722785-22w4d"
Jul 06 19:45:00.172432 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:45:00.172413    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-ghqtd\""
Jul 06 19:45:00.190674 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:45:00.190649    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722785-22w4d"]
Jul 06 19:45:00.277748 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:45:00.277708    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f92b4\" (UniqueName: \"kubernetes.io/projected/92e9b25c-d31d-4964-96a3-ab9f59619d8c-kube-api-access-f92b4\") pod \"maas-api-key-cleanup-29722785-22w4d\" (UID: \"92e9b25c-d31d-4964-96a3-ab9f59619d8c\") " pod="opendatahub/maas-api-key-cleanup-29722785-22w4d"
Jul 06 19:45:00.378209 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:45:00.378176    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f92b4\" (UniqueName: \"kubernetes.io/projected/92e9b25c-d31d-4964-96a3-ab9f59619d8c-kube-api-access-f92b4\") pod \"maas-api-key-cleanup-29722785-22w4d\" (UID: \"92e9b25c-d31d-4964-96a3-ab9f59619d8c\") " pod="opendatahub/maas-api-key-cleanup-29722785-22w4d"
Jul 06 19:45:00.387407 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:45:00.387379    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f92b4\" (UniqueName: \"kubernetes.io/projected/92e9b25c-d31d-4964-96a3-ab9f59619d8c-kube-api-access-f92b4\") pod \"maas-api-key-cleanup-29722785-22w4d\" (UID: \"92e9b25c-d31d-4964-96a3-ab9f59619d8c\") " pod="opendatahub/maas-api-key-cleanup-29722785-22w4d"
Jul 06 19:45:00.479151 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:45:00.479061    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722785-22w4d"
Jul 06 19:45:00.607214 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:45:00.607187    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722785-22w4d"]
Jul 06 19:45:00.609138 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:45:00.609107    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92e9b25c_d31d_4964_96a3_ab9f59619d8c.slice/crio-25e3ea85f49679e9e4a72396c38c0024544fdedfbbaa9fdda158d8295583b474 WatchSource:0}: Error finding container 25e3ea85f49679e9e4a72396c38c0024544fdedfbbaa9fdda158d8295583b474: Status 404 returned error can't find the container with id 25e3ea85f49679e9e4a72396c38c0024544fdedfbbaa9fdda158d8295583b474
Jul 06 19:45:00.610746 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:45:00.610731    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:45:01.340934 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:45:01.340885    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722785-22w4d" event={"ID":"92e9b25c-d31d-4964-96a3-ab9f59619d8c","Type":"ContainerStarted","Data":"25e3ea85f49679e9e4a72396c38c0024544fdedfbbaa9fdda158d8295583b474"}
Jul 06 19:45:03.351476 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:45:03.351436    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722785-22w4d" event={"ID":"92e9b25c-d31d-4964-96a3-ab9f59619d8c","Type":"ContainerStarted","Data":"d5c2dd8c25f8814295309d314d524e7cf43ad430814b839ae4547bf77a8799e0"}
Jul 06 19:45:03.369761 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:45:03.369697    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29722785-22w4d" podStartSLOduration=1.2488005 podStartE2EDuration="3.369680699s" totalImagesPullingTime="2.120880199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:45:03.368119666 +0000 UTC m=+1161.144153097" watchObservedRunningTime="2026-07-06 19:45:03.369680699 +0000 UTC m=+1161.145714097"
Jul 06 19:45:04.358043 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:45:04.358010    2555 generic.go:356] "Generic (PLEG): container finished" podID="92e9b25c-d31d-4964-96a3-ab9f59619d8c" containerID="d5c2dd8c25f8814295309d314d524e7cf43ad430814b839ae4547bf77a8799e0" exitCode=0
Jul 06 19:45:04.358426 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:45:04.358078    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722785-22w4d" event={"ID":"92e9b25c-d31d-4964-96a3-ab9f59619d8c","Type":"ContainerDied","Data":"d5c2dd8c25f8814295309d314d524e7cf43ad430814b839ae4547bf77a8799e0"}
Jul 06 19:45:05.495208 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:45:05.495181    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722785-22w4d"
Jul 06 19:45:05.624407 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:45:05.624320    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f92b4\" (UniqueName: \"kubernetes.io/projected/92e9b25c-d31d-4964-96a3-ab9f59619d8c-kube-api-access-f92b4\") pod \"92e9b25c-d31d-4964-96a3-ab9f59619d8c\" (UID: \"92e9b25c-d31d-4964-96a3-ab9f59619d8c\") "
Jul 06 19:45:05.626447 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:45:05.626414    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92e9b25c-d31d-4964-96a3-ab9f59619d8c-kube-api-access-f92b4" (OuterVolumeSpecName: "kube-api-access-f92b4") pod "92e9b25c-d31d-4964-96a3-ab9f59619d8c" (UID: "92e9b25c-d31d-4964-96a3-ab9f59619d8c"). InnerVolumeSpecName "kube-api-access-f92b4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:45:05.725185 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:45:05.725129    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f92b4\" (UniqueName: \"kubernetes.io/projected/92e9b25c-d31d-4964-96a3-ab9f59619d8c-kube-api-access-f92b4\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:45:06.368955 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:45:06.368904    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722785-22w4d"
Jul 06 19:45:06.368955 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:45:06.368946    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722785-22w4d" event={"ID":"92e9b25c-d31d-4964-96a3-ab9f59619d8c","Type":"ContainerDied","Data":"25e3ea85f49679e9e4a72396c38c0024544fdedfbbaa9fdda158d8295583b474"}
Jul 06 19:45:06.369159 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:45:06.368995    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="25e3ea85f49679e9e4a72396c38c0024544fdedfbbaa9fdda158d8295583b474"
Jul 06 19:45:13.581405 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:45:13.581367    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:45:23.516213 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:45:23.516177    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:45:39.991277 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:45:39.991242    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:45:44.116640 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:45:44.116614    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j9wtk_bb750a78-aa1e-4c55-b771-e06ca00b997a/ovn-acl-logging/0.log"
Jul 06 19:45:44.119785 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:45:44.119765    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j9wtk_bb750a78-aa1e-4c55-b771-e06ca00b997a/ovn-acl-logging/0.log"
Jul 06 19:45:57.512247 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:45:57.512199    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:46:08.581008 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:46:08.580972    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:46:20.817211 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:46:20.817167    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:23.864639 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:46:23.864593    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:34.084749 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:46:34.084666    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:48:14.754656 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:48:14.754619    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:48:23.589606 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:48:23.589566    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:48:32.387437 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:48:32.387395    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:48:45.081643 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:48:45.081608    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:48:53.694832 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:48:53.694798    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:49:04.293545 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:49:04.293504    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:49:12.787236 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:49:12.787198    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:49:23.375745 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:49:23.375706    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:49:30.381118 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:49:30.381083    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:49:39.579281 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:49:39.579191    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:49:51.181735 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:49:51.181698    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:49:59.380924 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:49:59.380877    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:50:13.085810 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:50:13.085773    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:50:22.710617 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:50:22.710585    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:50:23.851615 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:50:23.851576    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:50:30.769477 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:50:30.769438    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:50:39.479999 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:50:39.479965    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:50:44.146524 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:50:44.146497    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j9wtk_bb750a78-aa1e-4c55-b771-e06ca00b997a/ovn-acl-logging/0.log"
Jul 06 19:50:44.147091 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:50:44.147071    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j9wtk_bb750a78-aa1e-4c55-b771-e06ca00b997a/ovn-acl-logging/0.log"
Jul 06 19:50:50.331672 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:50:50.331639    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:51:02.086080 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:51:02.086036    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:51:25.891440 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:51:25.891406    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:51:27.768402 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:51:27.768374    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:35.382748 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:51:35.382713    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:51:44.130160 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:51:44.130131    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:51:53.901426 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:51:53.901386    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:52:02.488417 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:52:02.488382    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:52:14.003318 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:52:14.003283    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:52:26.783496 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:52:26.783454    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:52:35.675645 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:52:35.675566    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:52:44.588982 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:52:44.588946    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:52:56.183609 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:52:56.183569    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:53:08.279814 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:53:08.279776    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:53:15.689947 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:53:15.689895    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:53:26.485187 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:53:26.485153    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:53:42.675943 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:53:42.675890    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:53:55.679583 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:53:55.679546    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:53:59.852742 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:53:59.852708    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:04.481211 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:04.481119    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:54:08.736142 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:08.736107    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:16.377095 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:16.377060    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:54:17.052752 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:17.052719    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:22.282472 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:22.282437    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:24.189197 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:24.189158    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:54:25.394186 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:25.394141    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:25.517318 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:25.517281    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:26.034066 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:26.034036    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:32.771056 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:32.771021    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:32.869861 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:32.869828    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:32.986601 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:32.986566    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l"]
Jul 06 19:54:32.986919 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:32.986895    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92e9b25c-d31d-4964-96a3-ab9f59619d8c" containerName="cleanup"
Jul 06 19:54:32.986968 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:32.986923    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="92e9b25c-d31d-4964-96a3-ab9f59619d8c" containerName="cleanup"
Jul 06 19:54:32.987002 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:32.986990    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="92e9b25c-d31d-4964-96a3-ab9f59619d8c" containerName="cleanup"
Jul 06 19:54:32.990022 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:32.990002    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l"
Jul 06 19:54:32.992724 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:32.992706    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-5d383ecf-openshift-default-dockercfg-s89tr\""
Jul 06 19:54:33.033851 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:33.033820    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l"]
Jul 06 19:54:33.038032 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:33.037998    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:33.065517 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:33.065491    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54765bd0-7c3d-40fd-9686-1c5791e970dc-istio-podinfo\") pod \"e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l\" (UID: \"54765bd0-7c3d-40fd-9686-1c5791e970dc\") " pod="openshift-ingress/e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l"
Jul 06 19:54:33.065656 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:33.065528    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54765bd0-7c3d-40fd-9686-1c5791e970dc-workload-certs\") pod \"e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l\" (UID: \"54765bd0-7c3d-40fd-9686-1c5791e970dc\") " pod="openshift-ingress/e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l"
Jul 06 19:54:33.065656 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:33.065547    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlwvc\" (UniqueName: \"kubernetes.io/projected/54765bd0-7c3d-40fd-9686-1c5791e970dc-kube-api-access-wlwvc\") pod \"e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l\" (UID: \"54765bd0-7c3d-40fd-9686-1c5791e970dc\") " pod="openshift-ingress/e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l"
Jul 06 19:54:33.065656 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:33.065564    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54765bd0-7c3d-40fd-9686-1c5791e970dc-istio-token\") pod \"e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l\" (UID: \"54765bd0-7c3d-40fd-9686-1c5791e970dc\") " pod="openshift-ingress/e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l"
Jul 06 19:54:33.065656 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:33.065607    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54765bd0-7c3d-40fd-9686-1c5791e970dc-istiod-ca-cert\") pod \"e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l\" (UID: \"54765bd0-7c3d-40fd-9686-1c5791e970dc\") " pod="openshift-ingress/e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l"
Jul 06 19:54:33.065656 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:33.065646    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54765bd0-7c3d-40fd-9686-1c5791e970dc-workload-socket\") pod \"e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l\" (UID: \"54765bd0-7c3d-40fd-9686-1c5791e970dc\") " pod="openshift-ingress/e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l"
Jul 06 19:54:33.065816 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:33.065661    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54765bd0-7c3d-40fd-9686-1c5791e970dc-istio-envoy\") pod \"e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l\" (UID: \"54765bd0-7c3d-40fd-9686-1c5791e970dc\") " pod="openshift-ingress/e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l"
Jul 06 19:54:33.065816 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:33.065677    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54765bd0-7c3d-40fd-9686-1c5791e970dc-istio-data\") pod \"e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l\" (UID: \"54765bd0-7c3d-40fd-9686-1c5791e970dc\") " pod="openshift-ingress/e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l"
Jul 06 19:54:33.065816 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:33.065698    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54765bd0-7c3d-40fd-9686-1c5791e970dc-credential-socket\") pod \"e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l\" (UID: \"54765bd0-7c3d-40fd-9686-1c5791e970dc\") " pod="openshift-ingress/e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l"
Jul 06 19:54:33.130071 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:33.130039    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:33.166336 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:33.166304    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54765bd0-7c3d-40fd-9686-1c5791e970dc-credential-socket\") pod \"e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l\" (UID: \"54765bd0-7c3d-40fd-9686-1c5791e970dc\") " pod="openshift-ingress/e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l"
Jul 06 19:54:33.166492 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:33.166350    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54765bd0-7c3d-40fd-9686-1c5791e970dc-istio-podinfo\") pod \"e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l\" (UID: \"54765bd0-7c3d-40fd-9686-1c5791e970dc\") " pod="openshift-ingress/e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l"
Jul 06 19:54:33.166492 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:33.166469    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54765bd0-7c3d-40fd-9686-1c5791e970dc-workload-certs\") pod \"e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l\" (UID: \"54765bd0-7c3d-40fd-9686-1c5791e970dc\") " pod="openshift-ingress/e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l"
Jul 06 19:54:33.166573 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:33.166513    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlwvc\" (UniqueName: \"kubernetes.io/projected/54765bd0-7c3d-40fd-9686-1c5791e970dc-kube-api-access-wlwvc\") pod \"e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l\" (UID: \"54765bd0-7c3d-40fd-9686-1c5791e970dc\") " pod="openshift-ingress/e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l"
Jul 06 19:54:33.166573 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:33.166534    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54765bd0-7c3d-40fd-9686-1c5791e970dc-istio-token\") pod \"e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l\" (UID: \"54765bd0-7c3d-40fd-9686-1c5791e970dc\") " pod="openshift-ingress/e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l"
Jul 06 19:54:33.166573 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:33.166568    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54765bd0-7c3d-40fd-9686-1c5791e970dc-istiod-ca-cert\") pod \"e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l\" (UID: \"54765bd0-7c3d-40fd-9686-1c5791e970dc\") " pod="openshift-ingress/e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l"
Jul 06 19:54:33.166782 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:33.166624    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54765bd0-7c3d-40fd-9686-1c5791e970dc-workload-socket\") pod \"e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l\" (UID: \"54765bd0-7c3d-40fd-9686-1c5791e970dc\") " pod="openshift-ingress/e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l"
Jul 06 19:54:33.166782 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:33.166648    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54765bd0-7c3d-40fd-9686-1c5791e970dc-istio-envoy\") pod \"e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l\" (UID: \"54765bd0-7c3d-40fd-9686-1c5791e970dc\") " pod="openshift-ingress/e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l"
Jul 06 19:54:33.166782 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:33.166674    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54765bd0-7c3d-40fd-9686-1c5791e970dc-istio-data\") pod \"e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l\" (UID: \"54765bd0-7c3d-40fd-9686-1c5791e970dc\") " pod="openshift-ingress/e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l"
Jul 06 19:54:33.166782 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:33.166734    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54765bd0-7c3d-40fd-9686-1c5791e970dc-credential-socket\") pod \"e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l\" (UID: \"54765bd0-7c3d-40fd-9686-1c5791e970dc\") " pod="openshift-ingress/e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l"
Jul 06 19:54:33.166782 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:33.166772    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54765bd0-7c3d-40fd-9686-1c5791e970dc-workload-certs\") pod \"e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l\" (UID: \"54765bd0-7c3d-40fd-9686-1c5791e970dc\") " pod="openshift-ingress/e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l"
Jul 06 19:54:33.167040 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:33.166984    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54765bd0-7c3d-40fd-9686-1c5791e970dc-workload-socket\") pod \"e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l\" (UID: \"54765bd0-7c3d-40fd-9686-1c5791e970dc\") " pod="openshift-ingress/e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l"
Jul 06 19:54:33.167040 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:33.167030    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54765bd0-7c3d-40fd-9686-1c5791e970dc-istio-data\") pod \"e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l\" (UID: \"54765bd0-7c3d-40fd-9686-1c5791e970dc\") " pod="openshift-ingress/e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l"
Jul 06 19:54:33.167312 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:33.167293    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54765bd0-7c3d-40fd-9686-1c5791e970dc-istiod-ca-cert\") pod \"e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l\" (UID: \"54765bd0-7c3d-40fd-9686-1c5791e970dc\") " pod="openshift-ingress/e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l"
Jul 06 19:54:33.168733 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:33.168717    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54765bd0-7c3d-40fd-9686-1c5791e970dc-istio-envoy\") pod \"e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l\" (UID: \"54765bd0-7c3d-40fd-9686-1c5791e970dc\") " pod="openshift-ingress/e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l"
Jul 06 19:54:33.169137 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:33.169118    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54765bd0-7c3d-40fd-9686-1c5791e970dc-istio-podinfo\") pod \"e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l\" (UID: \"54765bd0-7c3d-40fd-9686-1c5791e970dc\") " pod="openshift-ingress/e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l"
Jul 06 19:54:33.176536 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:33.176514    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54765bd0-7c3d-40fd-9686-1c5791e970dc-istio-token\") pod \"e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l\" (UID: \"54765bd0-7c3d-40fd-9686-1c5791e970dc\") " pod="openshift-ingress/e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l"
Jul 06 19:54:33.176793 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:33.176775    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlwvc\" (UniqueName: \"kubernetes.io/projected/54765bd0-7c3d-40fd-9686-1c5791e970dc-kube-api-access-wlwvc\") pod \"e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l\" (UID: \"54765bd0-7c3d-40fd-9686-1c5791e970dc\") " pod="openshift-ingress/e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l"
Jul 06 19:54:33.300213 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:33.300123    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l"
Jul 06 19:54:33.433113 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:33.433089    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l"]
Jul 06 19:54:33.435180 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:54:33.435152    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54765bd0_7c3d_40fd_9686_1c5791e970dc.slice/crio-3a3344448b61a5880769e629c424c57b19e96b3d5159224ff44927ad17d57dfb WatchSource:0}: Error finding container 3a3344448b61a5880769e629c424c57b19e96b3d5159224ff44927ad17d57dfb: Status 404 returned error can't find the container with id 3a3344448b61a5880769e629c424c57b19e96b3d5159224ff44927ad17d57dfb
Jul 06 19:54:33.437276 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:33.437236    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:54:33.437387 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:33.437324    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:54:33.437387 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:33.437369    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:54:33.949077 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:33.949037    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l" event={"ID":"54765bd0-7c3d-40fd-9686-1c5791e970dc","Type":"ContainerStarted","Data":"b483cac389ff3a6cce1ad70e3b205d4801e96b3ed0a92efd7590756dfc44cad7"}
Jul 06 19:54:33.949077 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:33.949085    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l" event={"ID":"54765bd0-7c3d-40fd-9686-1c5791e970dc","Type":"ContainerStarted","Data":"3a3344448b61a5880769e629c424c57b19e96b3d5159224ff44927ad17d57dfb"}
Jul 06 19:54:33.975342 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:33.975283    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l" podStartSLOduration=1.975267468 podStartE2EDuration="1.975267468s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:54:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:54:33.972523903 +0000 UTC m=+1731.748557301" watchObservedRunningTime="2026-07-06 19:54:33.975267468 +0000 UTC m=+1731.751300865"
Jul 06 19:54:34.265162 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:34.265080    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:34.301151 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:34.301117    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l"
Jul 06 19:54:34.306273 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:34.306246    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l"
Jul 06 19:54:34.367404 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:34.367374    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:34.587437 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:34.587405    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:34.953844 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:34.953761    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l"
Jul 06 19:54:34.955001 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:34.954971    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l"
Jul 06 19:54:35.210368 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:35.210274    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:35.315480 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:35.315447    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:36.967822 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:36.967799    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:37.084740 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:37.084704    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:54:39.266134 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:39.266101    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:39.438842 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:39.438801    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l"]
Jul 06 19:54:39.439092 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:39.439045    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l" podUID="54765bd0-7c3d-40fd-9686-1c5791e970dc" containerName="istio-proxy" containerID="cri-o://b483cac389ff3a6cce1ad70e3b205d4801e96b3ed0a92efd7590756dfc44cad7" gracePeriod=30
Jul 06 19:54:39.487172 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:39.487142    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:39.583679 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:39.583633    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:39.661991 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:39.661944    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:41.353700 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:41.353630    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:44.791426 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:44.791403    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l"
Jul 06 19:54:44.882653 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:44.882563    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54765bd0-7c3d-40fd-9686-1c5791e970dc-istiod-ca-cert\") pod \"54765bd0-7c3d-40fd-9686-1c5791e970dc\" (UID: \"54765bd0-7c3d-40fd-9686-1c5791e970dc\") "
Jul 06 19:54:44.882653 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:44.882605    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54765bd0-7c3d-40fd-9686-1c5791e970dc-istio-data\") pod \"54765bd0-7c3d-40fd-9686-1c5791e970dc\" (UID: \"54765bd0-7c3d-40fd-9686-1c5791e970dc\") "
Jul 06 19:54:44.882653 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:44.882634    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54765bd0-7c3d-40fd-9686-1c5791e970dc-istio-podinfo\") pod \"54765bd0-7c3d-40fd-9686-1c5791e970dc\" (UID: \"54765bd0-7c3d-40fd-9686-1c5791e970dc\") "
Jul 06 19:54:44.882962 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:44.882660    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54765bd0-7c3d-40fd-9686-1c5791e970dc-workload-socket\") pod \"54765bd0-7c3d-40fd-9686-1c5791e970dc\" (UID: \"54765bd0-7c3d-40fd-9686-1c5791e970dc\") "
Jul 06 19:54:44.882962 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:44.882724    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54765bd0-7c3d-40fd-9686-1c5791e970dc-istio-envoy\") pod \"54765bd0-7c3d-40fd-9686-1c5791e970dc\" (UID: \"54765bd0-7c3d-40fd-9686-1c5791e970dc\") "
Jul 06 19:54:44.882962 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:44.882751    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54765bd0-7c3d-40fd-9686-1c5791e970dc-workload-certs\") pod \"54765bd0-7c3d-40fd-9686-1c5791e970dc\" (UID: \"54765bd0-7c3d-40fd-9686-1c5791e970dc\") "
Jul 06 19:54:44.882962 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:44.882773    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54765bd0-7c3d-40fd-9686-1c5791e970dc-credential-socket\") pod \"54765bd0-7c3d-40fd-9686-1c5791e970dc\" (UID: \"54765bd0-7c3d-40fd-9686-1c5791e970dc\") "
Jul 06 19:54:44.882962 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:44.882853    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wlwvc\" (UniqueName: \"kubernetes.io/projected/54765bd0-7c3d-40fd-9686-1c5791e970dc-kube-api-access-wlwvc\") pod \"54765bd0-7c3d-40fd-9686-1c5791e970dc\" (UID: \"54765bd0-7c3d-40fd-9686-1c5791e970dc\") "
Jul 06 19:54:44.882962 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:44.882881    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54765bd0-7c3d-40fd-9686-1c5791e970dc-istio-token\") pod \"54765bd0-7c3d-40fd-9686-1c5791e970dc\" (UID: \"54765bd0-7c3d-40fd-9686-1c5791e970dc\") "
Jul 06 19:54:44.883265 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:44.883059    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54765bd0-7c3d-40fd-9686-1c5791e970dc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "54765bd0-7c3d-40fd-9686-1c5791e970dc" (UID: "54765bd0-7c3d-40fd-9686-1c5791e970dc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:54:44.883265 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:44.883077    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54765bd0-7c3d-40fd-9686-1c5791e970dc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "54765bd0-7c3d-40fd-9686-1c5791e970dc" (UID: "54765bd0-7c3d-40fd-9686-1c5791e970dc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:54:44.883265 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:44.883175    2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54765bd0-7c3d-40fd-9686-1c5791e970dc-istiod-ca-cert\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:54:44.883265 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:44.883200    2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54765bd0-7c3d-40fd-9686-1c5791e970dc-workload-certs\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:54:44.883468 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:44.883333    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54765bd0-7c3d-40fd-9686-1c5791e970dc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "54765bd0-7c3d-40fd-9686-1c5791e970dc" (UID: "54765bd0-7c3d-40fd-9686-1c5791e970dc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:54:44.883468 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:44.883422    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54765bd0-7c3d-40fd-9686-1c5791e970dc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "54765bd0-7c3d-40fd-9686-1c5791e970dc" (UID: "54765bd0-7c3d-40fd-9686-1c5791e970dc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:54:44.883468 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:44.883435    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54765bd0-7c3d-40fd-9686-1c5791e970dc-istio-data" (OuterVolumeSpecName: "istio-data") pod "54765bd0-7c3d-40fd-9686-1c5791e970dc" (UID: "54765bd0-7c3d-40fd-9686-1c5791e970dc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:54:44.884950 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:44.884922    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/54765bd0-7c3d-40fd-9686-1c5791e970dc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "54765bd0-7c3d-40fd-9686-1c5791e970dc" (UID: "54765bd0-7c3d-40fd-9686-1c5791e970dc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 19:54:44.885103 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:44.885086    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54765bd0-7c3d-40fd-9686-1c5791e970dc-kube-api-access-wlwvc" (OuterVolumeSpecName: "kube-api-access-wlwvc") pod "54765bd0-7c3d-40fd-9686-1c5791e970dc" (UID: "54765bd0-7c3d-40fd-9686-1c5791e970dc"). InnerVolumeSpecName "kube-api-access-wlwvc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:54:44.885397 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:44.885370    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54765bd0-7c3d-40fd-9686-1c5791e970dc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "54765bd0-7c3d-40fd-9686-1c5791e970dc" (UID: "54765bd0-7c3d-40fd-9686-1c5791e970dc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:54:44.885500 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:44.885374    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54765bd0-7c3d-40fd-9686-1c5791e970dc-istio-token" (OuterVolumeSpecName: "istio-token") pod "54765bd0-7c3d-40fd-9686-1c5791e970dc" (UID: "54765bd0-7c3d-40fd-9686-1c5791e970dc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:54:44.983749 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:44.983711    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wlwvc\" (UniqueName: \"kubernetes.io/projected/54765bd0-7c3d-40fd-9686-1c5791e970dc-kube-api-access-wlwvc\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:54:44.983749 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:44.983743    2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54765bd0-7c3d-40fd-9686-1c5791e970dc-istio-token\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:54:44.983749 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:44.983753    2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54765bd0-7c3d-40fd-9686-1c5791e970dc-istio-data\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:54:44.983749 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:44.983761    2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54765bd0-7c3d-40fd-9686-1c5791e970dc-istio-podinfo\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:54:44.984053 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:44.983769    2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54765bd0-7c3d-40fd-9686-1c5791e970dc-workload-socket\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:54:44.984053 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:44.983778    2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54765bd0-7c3d-40fd-9686-1c5791e970dc-istio-envoy\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:54:44.984053 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:44.983786    2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54765bd0-7c3d-40fd-9686-1c5791e970dc-credential-socket\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:54:45.000503 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.000471    2555 generic.go:356] "Generic (PLEG): container finished" podID="54765bd0-7c3d-40fd-9686-1c5791e970dc" containerID="b483cac389ff3a6cce1ad70e3b205d4801e96b3ed0a92efd7590756dfc44cad7" exitCode=0
Jul 06 19:54:45.000675 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.000520    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l"
Jul 06 19:54:45.000675 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.000543    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l" event={"ID":"54765bd0-7c3d-40fd-9686-1c5791e970dc","Type":"ContainerDied","Data":"b483cac389ff3a6cce1ad70e3b205d4801e96b3ed0a92efd7590756dfc44cad7"}
Jul 06 19:54:45.000675 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.000598    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l" event={"ID":"54765bd0-7c3d-40fd-9686-1c5791e970dc","Type":"ContainerDied","Data":"3a3344448b61a5880769e629c424c57b19e96b3d5159224ff44927ad17d57dfb"}
Jul 06 19:54:45.000675 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.000620    2555 scope.go:117] "RemoveContainer" containerID="b483cac389ff3a6cce1ad70e3b205d4801e96b3ed0a92efd7590756dfc44cad7"
Jul 06 19:54:45.016257 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.016233    2555 scope.go:117] "RemoveContainer" containerID="b483cac389ff3a6cce1ad70e3b205d4801e96b3ed0a92efd7590756dfc44cad7"
Jul 06 19:54:45.016552 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:54:45.016521    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b483cac389ff3a6cce1ad70e3b205d4801e96b3ed0a92efd7590756dfc44cad7\": container with ID starting with b483cac389ff3a6cce1ad70e3b205d4801e96b3ed0a92efd7590756dfc44cad7 not found: ID does not exist" containerID="b483cac389ff3a6cce1ad70e3b205d4801e96b3ed0a92efd7590756dfc44cad7"
Jul 06 19:54:45.016637 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.016556    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b483cac389ff3a6cce1ad70e3b205d4801e96b3ed0a92efd7590756dfc44cad7"} err="failed to get container status \"b483cac389ff3a6cce1ad70e3b205d4801e96b3ed0a92efd7590756dfc44cad7\": rpc error: code = NotFound desc = could not find container \"b483cac389ff3a6cce1ad70e3b205d4801e96b3ed0a92efd7590756dfc44cad7\": container with ID starting with b483cac389ff3a6cce1ad70e3b205d4801e96b3ed0a92efd7590756dfc44cad7 not found: ID does not exist"
Jul 06 19:54:45.027716 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.027681    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l"]
Jul 06 19:54:45.029394 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.029370    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-5d383ecf-openshift-default-7476b97b89-nb66l"]
Jul 06 19:54:45.192220 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.192140    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:54:45.477127 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.477018    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:45.545259 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.545222    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:45.643969 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.643938    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x"]
Jul 06 19:54:45.644275 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.644264    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54765bd0-7c3d-40fd-9686-1c5791e970dc" containerName="istio-proxy"
Jul 06 19:54:45.644319 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.644277    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="54765bd0-7c3d-40fd-9686-1c5791e970dc" containerName="istio-proxy"
Jul 06 19:54:45.644354 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.644341    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="54765bd0-7c3d-40fd-9686-1c5791e970dc" containerName="istio-proxy"
Jul 06 19:54:45.647319 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.647301    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x"
Jul 06 19:54:45.651320 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.651296    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-86bf468a-openshift-default-dockercfg-lx8s5\""
Jul 06 19:54:45.660936 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.660891    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x"]
Jul 06 19:54:45.698179 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.698143    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:45.775972 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.775941    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:45.791139 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.791110    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f8180a6-5746-42ea-899b-985f4b7bd739-istiod-ca-cert\") pod \"e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x\" (UID: \"8f8180a6-5746-42ea-899b-985f4b7bd739\") " pod="openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x"
Jul 06 19:54:45.791287 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.791146    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bwzj\" (UniqueName: \"kubernetes.io/projected/8f8180a6-5746-42ea-899b-985f4b7bd739-kube-api-access-4bwzj\") pod \"e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x\" (UID: \"8f8180a6-5746-42ea-899b-985f4b7bd739\") " pod="openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x"
Jul 06 19:54:45.791287 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.791182    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f8180a6-5746-42ea-899b-985f4b7bd739-workload-certs\") pod \"e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x\" (UID: \"8f8180a6-5746-42ea-899b-985f4b7bd739\") " pod="openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x"
Jul 06 19:54:45.791287 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.791199    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f8180a6-5746-42ea-899b-985f4b7bd739-istio-envoy\") pod \"e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x\" (UID: \"8f8180a6-5746-42ea-899b-985f4b7bd739\") " pod="openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x"
Jul 06 19:54:45.791287 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.791214    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f8180a6-5746-42ea-899b-985f4b7bd739-istio-data\") pod \"e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x\" (UID: \"8f8180a6-5746-42ea-899b-985f4b7bd739\") " pod="openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x"
Jul 06 19:54:45.791287 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.791232    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f8180a6-5746-42ea-899b-985f4b7bd739-credential-socket\") pod \"e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x\" (UID: \"8f8180a6-5746-42ea-899b-985f4b7bd739\") " pod="openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x"
Jul 06 19:54:45.791287 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.791250    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f8180a6-5746-42ea-899b-985f4b7bd739-workload-socket\") pod \"e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x\" (UID: \"8f8180a6-5746-42ea-899b-985f4b7bd739\") " pod="openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x"
Jul 06 19:54:45.791724 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.791320    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f8180a6-5746-42ea-899b-985f4b7bd739-istio-podinfo\") pod \"e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x\" (UID: \"8f8180a6-5746-42ea-899b-985f4b7bd739\") " pod="openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x"
Jul 06 19:54:45.791724 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.791375    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f8180a6-5746-42ea-899b-985f4b7bd739-istio-token\") pod \"e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x\" (UID: \"8f8180a6-5746-42ea-899b-985f4b7bd739\") " pod="openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x"
Jul 06 19:54:45.892628 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.892587    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f8180a6-5746-42ea-899b-985f4b7bd739-istio-podinfo\") pod \"e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x\" (UID: \"8f8180a6-5746-42ea-899b-985f4b7bd739\") " pod="openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x"
Jul 06 19:54:45.892801 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.892635    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f8180a6-5746-42ea-899b-985f4b7bd739-istio-token\") pod \"e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x\" (UID: \"8f8180a6-5746-42ea-899b-985f4b7bd739\") " pod="openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x"
Jul 06 19:54:45.892801 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.892694    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f8180a6-5746-42ea-899b-985f4b7bd739-istiod-ca-cert\") pod \"e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x\" (UID: \"8f8180a6-5746-42ea-899b-985f4b7bd739\") " pod="openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x"
Jul 06 19:54:45.892801 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.892725    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bwzj\" (UniqueName: \"kubernetes.io/projected/8f8180a6-5746-42ea-899b-985f4b7bd739-kube-api-access-4bwzj\") pod \"e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x\" (UID: \"8f8180a6-5746-42ea-899b-985f4b7bd739\") " pod="openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x"
Jul 06 19:54:45.892801 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.892775    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f8180a6-5746-42ea-899b-985f4b7bd739-workload-certs\") pod \"e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x\" (UID: \"8f8180a6-5746-42ea-899b-985f4b7bd739\") " pod="openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x"
Jul 06 19:54:45.892801 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.892797    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f8180a6-5746-42ea-899b-985f4b7bd739-istio-envoy\") pod \"e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x\" (UID: \"8f8180a6-5746-42ea-899b-985f4b7bd739\") " pod="openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x"
Jul 06 19:54:45.893069 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.892822    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f8180a6-5746-42ea-899b-985f4b7bd739-istio-data\") pod \"e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x\" (UID: \"8f8180a6-5746-42ea-899b-985f4b7bd739\") " pod="openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x"
Jul 06 19:54:45.893069 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.892940    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f8180a6-5746-42ea-899b-985f4b7bd739-credential-socket\") pod \"e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x\" (UID: \"8f8180a6-5746-42ea-899b-985f4b7bd739\") " pod="openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x"
Jul 06 19:54:45.893069 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.892978    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f8180a6-5746-42ea-899b-985f4b7bd739-workload-socket\") pod \"e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x\" (UID: \"8f8180a6-5746-42ea-899b-985f4b7bd739\") " pod="openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x"
Jul 06 19:54:45.893363 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.893334    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f8180a6-5746-42ea-899b-985f4b7bd739-workload-certs\") pod \"e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x\" (UID: \"8f8180a6-5746-42ea-899b-985f4b7bd739\") " pod="openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x"
Jul 06 19:54:45.893486 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.893448    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f8180a6-5746-42ea-899b-985f4b7bd739-workload-socket\") pod \"e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x\" (UID: \"8f8180a6-5746-42ea-899b-985f4b7bd739\") " pod="openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x"
Jul 06 19:54:45.893486 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.893464    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f8180a6-5746-42ea-899b-985f4b7bd739-credential-socket\") pod \"e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x\" (UID: \"8f8180a6-5746-42ea-899b-985f4b7bd739\") " pod="openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x"
Jul 06 19:54:45.893597 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.893561    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f8180a6-5746-42ea-899b-985f4b7bd739-istio-data\") pod \"e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x\" (UID: \"8f8180a6-5746-42ea-899b-985f4b7bd739\") " pod="openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x"
Jul 06 19:54:45.893655 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.893608    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f8180a6-5746-42ea-899b-985f4b7bd739-istiod-ca-cert\") pod \"e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x\" (UID: \"8f8180a6-5746-42ea-899b-985f4b7bd739\") " pod="openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x"
Jul 06 19:54:45.895186 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.895166    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f8180a6-5746-42ea-899b-985f4b7bd739-istio-envoy\") pod \"e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x\" (UID: \"8f8180a6-5746-42ea-899b-985f4b7bd739\") " pod="openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x"
Jul 06 19:54:45.895428 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.895390    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f8180a6-5746-42ea-899b-985f4b7bd739-istio-podinfo\") pod \"e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x\" (UID: \"8f8180a6-5746-42ea-899b-985f4b7bd739\") " pod="openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x"
Jul 06 19:54:45.910321 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.910287    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f8180a6-5746-42ea-899b-985f4b7bd739-istio-token\") pod \"e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x\" (UID: \"8f8180a6-5746-42ea-899b-985f4b7bd739\") " pod="openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x"
Jul 06 19:54:45.910439 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.910346    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bwzj\" (UniqueName: \"kubernetes.io/projected/8f8180a6-5746-42ea-899b-985f4b7bd739-kube-api-access-4bwzj\") pod \"e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x\" (UID: \"8f8180a6-5746-42ea-899b-985f4b7bd739\") " pod="openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x"
Jul 06 19:54:45.959152 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:45.959111    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x"
Jul 06 19:54:46.100326 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:46.100299    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x"]
Jul 06 19:54:46.102474 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:54:46.102445    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f8180a6_5746_42ea_899b_985f4b7bd739.slice/crio-955d7c143f31155cb00ac672f8c7a8532472fe7acc14e5719af8230bcd6446fc WatchSource:0}: Error finding container 955d7c143f31155cb00ac672f8c7a8532472fe7acc14e5719af8230bcd6446fc: Status 404 returned error can't find the container with id 955d7c143f31155cb00ac672f8c7a8532472fe7acc14e5719af8230bcd6446fc
Jul 06 19:54:46.104589 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:46.104559    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:54:46.104652 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:46.104626    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:54:46.104685 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:46.104654    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:54:46.130383 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:46.130350    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54765bd0-7c3d-40fd-9686-1c5791e970dc" path="/var/lib/kubelet/pods/54765bd0-7c3d-40fd-9686-1c5791e970dc/volumes"
Jul 06 19:54:46.806442 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:46.806399    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:46.913181 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:46.913148    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:47.001927 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:47.001865    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:47.012426 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:47.012396    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x" event={"ID":"8f8180a6-5746-42ea-899b-985f4b7bd739","Type":"ContainerStarted","Data":"5695a9da631d63545e75b491dbf788da331e42bfb7635319a25cb548580ec2f9"}
Jul 06 19:54:47.012579 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:47.012451    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x" event={"ID":"8f8180a6-5746-42ea-899b-985f4b7bd739","Type":"ContainerStarted","Data":"955d7c143f31155cb00ac672f8c7a8532472fe7acc14e5719af8230bcd6446fc"}
Jul 06 19:54:47.053563 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:47.053507    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x" podStartSLOduration=2.053488386 podStartE2EDuration="2.053488386s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:54:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:54:47.052115176 +0000 UTC m=+1744.828148589" watchObservedRunningTime="2026-07-06 19:54:47.053488386 +0000 UTC m=+1744.829521763"
Jul 06 19:54:47.447962 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:47.447921    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:47.549604 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:47.549553    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:47.959594 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:47.959558    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x"
Jul 06 19:54:47.964568 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:47.964541    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x"
Jul 06 19:54:48.017515 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:48.017477    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x"
Jul 06 19:54:48.018483 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:48.018462    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x"
Jul 06 19:54:48.796652 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:48.796618    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:51.915328 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:51.915294    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:52.244644 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:52.244519    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:57.072996 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:57.072962    2555 generic.go:356] "Generic (PLEG): container finished" podID="8f8180a6-5746-42ea-899b-985f4b7bd739" containerID="5695a9da631d63545e75b491dbf788da331e42bfb7635319a25cb548580ec2f9" exitCode=0
Jul 06 19:54:57.073431 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:57.073035    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x" event={"ID":"8f8180a6-5746-42ea-899b-985f4b7bd739","Type":"ContainerDied","Data":"5695a9da631d63545e75b491dbf788da331e42bfb7635319a25cb548580ec2f9"}
Jul 06 19:54:57.073431 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:57.073415    2555 scope.go:117] "RemoveContainer" containerID="5695a9da631d63545e75b491dbf788da331e42bfb7635319a25cb548580ec2f9"
Jul 06 19:54:57.075302 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:57.074808    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:54:57.075302 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:57.075008    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:54:57.075302 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:57.075110    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:54:58.080125 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:58.080090    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x" event={"ID":"8f8180a6-5746-42ea-899b-985f4b7bd739","Type":"ContainerStarted","Data":"96a05a184fd414d4fe444cd8ba40badb8f1e62a3b47b2ce8d2954e8650a048b2"}
Jul 06 19:54:58.094828 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:58.094788    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x"]
Jul 06 19:54:58.155075 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:58.155030    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:58.340574 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:58.340468    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:58.960125 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:58.960088    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x"
Jul 06 19:54:58.964721 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:58.964691    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x"
Jul 06 19:54:59.084999 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:59.084954    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x" podUID="8f8180a6-5746-42ea-899b-985f4b7bd739" containerName="istio-proxy" containerID="cri-o://96a05a184fd414d4fe444cd8ba40badb8f1e62a3b47b2ce8d2954e8650a048b2" gracePeriod=30
Jul 06 19:54:59.085517 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:59.085066    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x"
Jul 06 19:54:59.086000 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:59.085983    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x"
Jul 06 19:54:59.783863 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:54:59.783807    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:04.355173 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:04.355107    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x"
Jul 06 19:55:04.363994 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:04.363967    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f8180a6-5746-42ea-899b-985f4b7bd739-istio-podinfo\") pod \"8f8180a6-5746-42ea-899b-985f4b7bd739\" (UID: \"8f8180a6-5746-42ea-899b-985f4b7bd739\") "
Jul 06 19:55:04.364165 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:04.364009    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f8180a6-5746-42ea-899b-985f4b7bd739-istio-token\") pod \"8f8180a6-5746-42ea-899b-985f4b7bd739\" (UID: \"8f8180a6-5746-42ea-899b-985f4b7bd739\") "
Jul 06 19:55:04.364165 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:04.364036    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f8180a6-5746-42ea-899b-985f4b7bd739-istio-envoy\") pod \"8f8180a6-5746-42ea-899b-985f4b7bd739\" (UID: \"8f8180a6-5746-42ea-899b-985f4b7bd739\") "
Jul 06 19:55:04.364165 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:04.364051    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f8180a6-5746-42ea-899b-985f4b7bd739-credential-socket\") pod \"8f8180a6-5746-42ea-899b-985f4b7bd739\" (UID: \"8f8180a6-5746-42ea-899b-985f4b7bd739\") "
Jul 06 19:55:04.364165 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:04.364105    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f8180a6-5746-42ea-899b-985f4b7bd739-istio-data\") pod \"8f8180a6-5746-42ea-899b-985f4b7bd739\" (UID: \"8f8180a6-5746-42ea-899b-985f4b7bd739\") "
Jul 06 19:55:04.364165 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:04.364124    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f8180a6-5746-42ea-899b-985f4b7bd739-workload-certs\") pod \"8f8180a6-5746-42ea-899b-985f4b7bd739\" (UID: \"8f8180a6-5746-42ea-899b-985f4b7bd739\") "
Jul 06 19:55:04.364435 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:04.364167    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bwzj\" (UniqueName: \"kubernetes.io/projected/8f8180a6-5746-42ea-899b-985f4b7bd739-kube-api-access-4bwzj\") pod \"8f8180a6-5746-42ea-899b-985f4b7bd739\" (UID: \"8f8180a6-5746-42ea-899b-985f4b7bd739\") "
Jul 06 19:55:04.364435 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:04.364193    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f8180a6-5746-42ea-899b-985f4b7bd739-istiod-ca-cert\") pod \"8f8180a6-5746-42ea-899b-985f4b7bd739\" (UID: \"8f8180a6-5746-42ea-899b-985f4b7bd739\") "
Jul 06 19:55:04.364435 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:04.364226    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f8180a6-5746-42ea-899b-985f4b7bd739-workload-socket\") pod \"8f8180a6-5746-42ea-899b-985f4b7bd739\" (UID: \"8f8180a6-5746-42ea-899b-985f4b7bd739\") "
Jul 06 19:55:04.364435 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:04.364406    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f8180a6-5746-42ea-899b-985f4b7bd739-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8f8180a6-5746-42ea-899b-985f4b7bd739" (UID: "8f8180a6-5746-42ea-899b-985f4b7bd739"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:55:04.364642 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:04.364486    2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f8180a6-5746-42ea-899b-985f4b7bd739-credential-socket\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:55:04.364700 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:04.364615    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f8180a6-5746-42ea-899b-985f4b7bd739-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8f8180a6-5746-42ea-899b-985f4b7bd739" (UID: "8f8180a6-5746-42ea-899b-985f4b7bd739"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:55:04.364700 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:04.364636    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f8180a6-5746-42ea-899b-985f4b7bd739-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8f8180a6-5746-42ea-899b-985f4b7bd739" (UID: "8f8180a6-5746-42ea-899b-985f4b7bd739"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:55:04.364700 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:04.364685    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f8180a6-5746-42ea-899b-985f4b7bd739-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8f8180a6-5746-42ea-899b-985f4b7bd739" (UID: "8f8180a6-5746-42ea-899b-985f4b7bd739"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:55:04.365054 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:04.365026    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f8180a6-5746-42ea-899b-985f4b7bd739-istio-data" (OuterVolumeSpecName: "istio-data") pod "8f8180a6-5746-42ea-899b-985f4b7bd739" (UID: "8f8180a6-5746-42ea-899b-985f4b7bd739"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:55:04.366333 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:04.366311    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f8180a6-5746-42ea-899b-985f4b7bd739-istio-token" (OuterVolumeSpecName: "istio-token") pod "8f8180a6-5746-42ea-899b-985f4b7bd739" (UID: "8f8180a6-5746-42ea-899b-985f4b7bd739"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:55:04.366333 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:04.366321    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f8180a6-5746-42ea-899b-985f4b7bd739-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8f8180a6-5746-42ea-899b-985f4b7bd739" (UID: "8f8180a6-5746-42ea-899b-985f4b7bd739"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:55:04.366538 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:04.366424    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8f8180a6-5746-42ea-899b-985f4b7bd739-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8f8180a6-5746-42ea-899b-985f4b7bd739" (UID: "8f8180a6-5746-42ea-899b-985f4b7bd739"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 19:55:04.366538 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:04.366463    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f8180a6-5746-42ea-899b-985f4b7bd739-kube-api-access-4bwzj" (OuterVolumeSpecName: "kube-api-access-4bwzj") pod "8f8180a6-5746-42ea-899b-985f4b7bd739" (UID: "8f8180a6-5746-42ea-899b-985f4b7bd739"). InnerVolumeSpecName "kube-api-access-4bwzj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:55:04.465036 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:04.465001    2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f8180a6-5746-42ea-899b-985f4b7bd739-istio-podinfo\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:55:04.465036 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:04.465029    2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f8180a6-5746-42ea-899b-985f4b7bd739-istio-token\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:55:04.465036 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:04.465038    2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f8180a6-5746-42ea-899b-985f4b7bd739-istio-envoy\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:55:04.465036 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:04.465048    2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f8180a6-5746-42ea-899b-985f4b7bd739-istio-data\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:55:04.465315 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:04.465056    2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f8180a6-5746-42ea-899b-985f4b7bd739-workload-certs\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:55:04.465315 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:04.465064    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bwzj\" (UniqueName: \"kubernetes.io/projected/8f8180a6-5746-42ea-899b-985f4b7bd739-kube-api-access-4bwzj\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:55:04.465315 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:04.465072    2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f8180a6-5746-42ea-899b-985f4b7bd739-istiod-ca-cert\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:55:04.465315 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:04.465081    2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f8180a6-5746-42ea-899b-985f4b7bd739-workload-socket\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:55:05.114398 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.114367    2555 generic.go:356] "Generic (PLEG): container finished" podID="8f8180a6-5746-42ea-899b-985f4b7bd739" containerID="96a05a184fd414d4fe444cd8ba40badb8f1e62a3b47b2ce8d2954e8650a048b2" exitCode=0
Jul 06 19:55:05.114577 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.114416    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x"
Jul 06 19:55:05.114577 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.114454    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x" event={"ID":"8f8180a6-5746-42ea-899b-985f4b7bd739","Type":"ContainerDied","Data":"96a05a184fd414d4fe444cd8ba40badb8f1e62a3b47b2ce8d2954e8650a048b2"}
Jul 06 19:55:05.114577 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.114508    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x" event={"ID":"8f8180a6-5746-42ea-899b-985f4b7bd739","Type":"ContainerDied","Data":"955d7c143f31155cb00ac672f8c7a8532472fe7acc14e5719af8230bcd6446fc"}
Jul 06 19:55:05.114577 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.114531    2555 scope.go:117] "RemoveContainer" containerID="96a05a184fd414d4fe444cd8ba40badb8f1e62a3b47b2ce8d2954e8650a048b2"
Jul 06 19:55:05.123310 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.123290    2555 scope.go:117] "RemoveContainer" containerID="5695a9da631d63545e75b491dbf788da331e42bfb7635319a25cb548580ec2f9"
Jul 06 19:55:05.130975 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.130955    2555 scope.go:117] "RemoveContainer" containerID="96a05a184fd414d4fe444cd8ba40badb8f1e62a3b47b2ce8d2954e8650a048b2"
Jul 06 19:55:05.131246 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:55:05.131230    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96a05a184fd414d4fe444cd8ba40badb8f1e62a3b47b2ce8d2954e8650a048b2\": container with ID starting with 96a05a184fd414d4fe444cd8ba40badb8f1e62a3b47b2ce8d2954e8650a048b2 not found: ID does not exist" containerID="96a05a184fd414d4fe444cd8ba40badb8f1e62a3b47b2ce8d2954e8650a048b2"
Jul 06 19:55:05.131292 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.131254    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96a05a184fd414d4fe444cd8ba40badb8f1e62a3b47b2ce8d2954e8650a048b2"} err="failed to get container status \"96a05a184fd414d4fe444cd8ba40badb8f1e62a3b47b2ce8d2954e8650a048b2\": rpc error: code = NotFound desc = could not find container \"96a05a184fd414d4fe444cd8ba40badb8f1e62a3b47b2ce8d2954e8650a048b2\": container with ID starting with 96a05a184fd414d4fe444cd8ba40badb8f1e62a3b47b2ce8d2954e8650a048b2 not found: ID does not exist"
Jul 06 19:55:05.131292 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.131269    2555 scope.go:117] "RemoveContainer" containerID="5695a9da631d63545e75b491dbf788da331e42bfb7635319a25cb548580ec2f9"
Jul 06 19:55:05.131490 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:55:05.131472    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5695a9da631d63545e75b491dbf788da331e42bfb7635319a25cb548580ec2f9\": container with ID starting with 5695a9da631d63545e75b491dbf788da331e42bfb7635319a25cb548580ec2f9 not found: ID does not exist" containerID="5695a9da631d63545e75b491dbf788da331e42bfb7635319a25cb548580ec2f9"
Jul 06 19:55:05.131527 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.131497    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5695a9da631d63545e75b491dbf788da331e42bfb7635319a25cb548580ec2f9"} err="failed to get container status \"5695a9da631d63545e75b491dbf788da331e42bfb7635319a25cb548580ec2f9\": rpc error: code = NotFound desc = could not find container \"5695a9da631d63545e75b491dbf788da331e42bfb7635319a25cb548580ec2f9\": container with ID starting with 5695a9da631d63545e75b491dbf788da331e42bfb7635319a25cb548580ec2f9 not found: ID does not exist"
Jul 06 19:55:05.147677 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.147626    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x"]
Jul 06 19:55:05.159857 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.159832    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-86bf468a-openshift-default-56759f6b97-rd46x"]
Jul 06 19:55:05.254191 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.254161    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:05.474386 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.474299    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:05.531703 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.531667    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6"]
Jul 06 19:55:05.532102 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.532085    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f8180a6-5746-42ea-899b-985f4b7bd739" containerName="istio-proxy"
Jul 06 19:55:05.532200 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.532104    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f8180a6-5746-42ea-899b-985f4b7bd739" containerName="istio-proxy"
Jul 06 19:55:05.532322 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.532222    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f8180a6-5746-42ea-899b-985f4b7bd739" containerName="istio-proxy"
Jul 06 19:55:05.536816 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.536791    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6"
Jul 06 19:55:05.540935 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.540900    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-e3f6a090-openshift-default-dockercfg-s79fq\""
Jul 06 19:55:05.565019 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.564982    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6"]
Jul 06 19:55:05.575182 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.575145    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6daa5cf-d1e8-4820-a655-9989859bab28-istio-data\") pod \"e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6\" (UID: \"a6daa5cf-d1e8-4820-a655-9989859bab28\") " pod="openshift-ingress/e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6"
Jul 06 19:55:05.575347 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.575185    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6daa5cf-d1e8-4820-a655-9989859bab28-istio-podinfo\") pod \"e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6\" (UID: \"a6daa5cf-d1e8-4820-a655-9989859bab28\") " pod="openshift-ingress/e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6"
Jul 06 19:55:05.575347 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.575236    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hlzf\" (UniqueName: \"kubernetes.io/projected/a6daa5cf-d1e8-4820-a655-9989859bab28-kube-api-access-5hlzf\") pod \"e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6\" (UID: \"a6daa5cf-d1e8-4820-a655-9989859bab28\") " pod="openshift-ingress/e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6"
Jul 06 19:55:05.575347 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.575256    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6daa5cf-d1e8-4820-a655-9989859bab28-workload-certs\") pod \"e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6\" (UID: \"a6daa5cf-d1e8-4820-a655-9989859bab28\") " pod="openshift-ingress/e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6"
Jul 06 19:55:05.575347 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.575311    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6daa5cf-d1e8-4820-a655-9989859bab28-workload-socket\") pod \"e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6\" (UID: \"a6daa5cf-d1e8-4820-a655-9989859bab28\") " pod="openshift-ingress/e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6"
Jul 06 19:55:05.575492 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.575363    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6daa5cf-d1e8-4820-a655-9989859bab28-credential-socket\") pod \"e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6\" (UID: \"a6daa5cf-d1e8-4820-a655-9989859bab28\") " pod="openshift-ingress/e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6"
Jul 06 19:55:05.575492 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.575394    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6daa5cf-d1e8-4820-a655-9989859bab28-istio-token\") pod \"e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6\" (UID: \"a6daa5cf-d1e8-4820-a655-9989859bab28\") " pod="openshift-ingress/e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6"
Jul 06 19:55:05.575492 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.575443    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6daa5cf-d1e8-4820-a655-9989859bab28-istio-envoy\") pod \"e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6\" (UID: \"a6daa5cf-d1e8-4820-a655-9989859bab28\") " pod="openshift-ingress/e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6"
Jul 06 19:55:05.575492 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.575457    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6daa5cf-d1e8-4820-a655-9989859bab28-istiod-ca-cert\") pod \"e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6\" (UID: \"a6daa5cf-d1e8-4820-a655-9989859bab28\") " pod="openshift-ingress/e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6"
Jul 06 19:55:05.652962 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.652929    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:05.676416 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.676382    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6daa5cf-d1e8-4820-a655-9989859bab28-istio-envoy\") pod \"e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6\" (UID: \"a6daa5cf-d1e8-4820-a655-9989859bab28\") " pod="openshift-ingress/e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6"
Jul 06 19:55:05.676416 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.676418    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6daa5cf-d1e8-4820-a655-9989859bab28-istiod-ca-cert\") pod \"e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6\" (UID: \"a6daa5cf-d1e8-4820-a655-9989859bab28\") " pod="openshift-ingress/e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6"
Jul 06 19:55:05.676605 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.676466    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6daa5cf-d1e8-4820-a655-9989859bab28-istio-data\") pod \"e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6\" (UID: \"a6daa5cf-d1e8-4820-a655-9989859bab28\") " pod="openshift-ingress/e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6"
Jul 06 19:55:05.676605 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.676484    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6daa5cf-d1e8-4820-a655-9989859bab28-istio-podinfo\") pod \"e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6\" (UID: \"a6daa5cf-d1e8-4820-a655-9989859bab28\") " pod="openshift-ingress/e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6"
Jul 06 19:55:05.676605 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.676513    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hlzf\" (UniqueName: \"kubernetes.io/projected/a6daa5cf-d1e8-4820-a655-9989859bab28-kube-api-access-5hlzf\") pod \"e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6\" (UID: \"a6daa5cf-d1e8-4820-a655-9989859bab28\") " pod="openshift-ingress/e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6"
Jul 06 19:55:05.676605 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.676545    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6daa5cf-d1e8-4820-a655-9989859bab28-workload-certs\") pod \"e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6\" (UID: \"a6daa5cf-d1e8-4820-a655-9989859bab28\") " pod="openshift-ingress/e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6"
Jul 06 19:55:05.676605 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.676580    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6daa5cf-d1e8-4820-a655-9989859bab28-workload-socket\") pod \"e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6\" (UID: \"a6daa5cf-d1e8-4820-a655-9989859bab28\") " pod="openshift-ingress/e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6"
Jul 06 19:55:05.676841 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.676616    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6daa5cf-d1e8-4820-a655-9989859bab28-credential-socket\") pod \"e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6\" (UID: \"a6daa5cf-d1e8-4820-a655-9989859bab28\") " pod="openshift-ingress/e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6"
Jul 06 19:55:05.676841 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.676655    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6daa5cf-d1e8-4820-a655-9989859bab28-istio-token\") pod \"e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6\" (UID: \"a6daa5cf-d1e8-4820-a655-9989859bab28\") " pod="openshift-ingress/e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6"
Jul 06 19:55:05.676985 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.676891    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6daa5cf-d1e8-4820-a655-9989859bab28-istio-data\") pod \"e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6\" (UID: \"a6daa5cf-d1e8-4820-a655-9989859bab28\") " pod="openshift-ingress/e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6"
Jul 06 19:55:05.677034 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.676985    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6daa5cf-d1e8-4820-a655-9989859bab28-workload-certs\") pod \"e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6\" (UID: \"a6daa5cf-d1e8-4820-a655-9989859bab28\") " pod="openshift-ingress/e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6"
Jul 06 19:55:05.677034 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.677011    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6daa5cf-d1e8-4820-a655-9989859bab28-workload-socket\") pod \"e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6\" (UID: \"a6daa5cf-d1e8-4820-a655-9989859bab28\") " pod="openshift-ingress/e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6"
Jul 06 19:55:05.677127 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.677111    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6daa5cf-d1e8-4820-a655-9989859bab28-credential-socket\") pod \"e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6\" (UID: \"a6daa5cf-d1e8-4820-a655-9989859bab28\") " pod="openshift-ingress/e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6"
Jul 06 19:55:05.677458 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.677436    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6daa5cf-d1e8-4820-a655-9989859bab28-istiod-ca-cert\") pod \"e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6\" (UID: \"a6daa5cf-d1e8-4820-a655-9989859bab28\") " pod="openshift-ingress/e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6"
Jul 06 19:55:05.679251 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.679228    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6daa5cf-d1e8-4820-a655-9989859bab28-istio-envoy\") pod \"e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6\" (UID: \"a6daa5cf-d1e8-4820-a655-9989859bab28\") " pod="openshift-ingress/e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6"
Jul 06 19:55:05.679458 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.679442    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6daa5cf-d1e8-4820-a655-9989859bab28-istio-podinfo\") pod \"e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6\" (UID: \"a6daa5cf-d1e8-4820-a655-9989859bab28\") " pod="openshift-ingress/e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6"
Jul 06 19:55:05.698923 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.698880    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6daa5cf-d1e8-4820-a655-9989859bab28-istio-token\") pod \"e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6\" (UID: \"a6daa5cf-d1e8-4820-a655-9989859bab28\") " pod="openshift-ingress/e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6"
Jul 06 19:55:05.699068 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.699044    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hlzf\" (UniqueName: \"kubernetes.io/projected/a6daa5cf-d1e8-4820-a655-9989859bab28-kube-api-access-5hlzf\") pod \"e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6\" (UID: \"a6daa5cf-d1e8-4820-a655-9989859bab28\") " pod="openshift-ingress/e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6"
Jul 06 19:55:05.846881 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.846844    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6"
Jul 06 19:55:05.993653 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.993616    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6"]
Jul 06 19:55:05.996542 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:55:05.996512    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6daa5cf_d1e8_4820_a655_9989859bab28.slice/crio-b1618feae5101864968ddb0442f21327cfb40e50f1cd1586ac6891247404fc77 WatchSource:0}: Error finding container b1618feae5101864968ddb0442f21327cfb40e50f1cd1586ac6891247404fc77: Status 404 returned error can't find the container with id b1618feae5101864968ddb0442f21327cfb40e50f1cd1586ac6891247404fc77
Jul 06 19:55:05.998726 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.998693    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:55:05.998833 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.998758    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:55:05.998833 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:05.998792    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:55:06.123545 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:06.123438    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6" event={"ID":"a6daa5cf-d1e8-4820-a655-9989859bab28","Type":"ContainerStarted","Data":"705dd28a0998ae72692e5cd97f161a49bb7769c226e4ad0d0a0acda53d14dcbd"}
Jul 06 19:55:06.123545 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:06.123504    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6" event={"ID":"a6daa5cf-d1e8-4820-a655-9989859bab28","Type":"ContainerStarted","Data":"b1618feae5101864968ddb0442f21327cfb40e50f1cd1586ac6891247404fc77"}
Jul 06 19:55:06.130856 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:06.130815    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f8180a6-5746-42ea-899b-985f4b7bd739" path="/var/lib/kubelet/pods/8f8180a6-5746-42ea-899b-985f4b7bd739/volumes"
Jul 06 19:55:06.152210 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:06.152156    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6" podStartSLOduration=1.152140785 podStartE2EDuration="1.152140785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:55:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:55:06.150870936 +0000 UTC m=+1763.926904352" watchObservedRunningTime="2026-07-06 19:55:06.152140785 +0000 UTC m=+1763.928174239"
Jul 06 19:55:06.756145 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:06.756110    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:06.847362 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:06.847322    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6"
Jul 06 19:55:06.972401 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:06.972356    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:07.083480 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:07.083447    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:07.259593 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:07.259557    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:07.805406 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:07.805376    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:07.852695 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:07.852659    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6"
Jul 06 19:55:07.974823 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:07.974786    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:08.134352 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:08.134271    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6"
Jul 06 19:55:08.135272 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:08.135256    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6"
Jul 06 19:55:08.968179 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:08.968146    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:11.061566 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:11.061526    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:11.210413 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:11.210376    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6"]
Jul 06 19:55:11.210598 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:11.210562    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6" podUID="a6daa5cf-d1e8-4820-a655-9989859bab28" containerName="istio-proxy" containerID="cri-o://705dd28a0998ae72692e5cd97f161a49bb7769c226e4ad0d0a0acda53d14dcbd" gracePeriod=30
Jul 06 19:55:11.250294 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:11.250257    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:11.361278 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:11.361183    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:11.500633 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:11.500575    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:12.488381 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:12.488340    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:16.465608 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:16.465577    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6"
Jul 06 19:55:16.567577 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:16.567539    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6daa5cf-d1e8-4820-a655-9989859bab28-istio-data\") pod \"a6daa5cf-d1e8-4820-a655-9989859bab28\" (UID: \"a6daa5cf-d1e8-4820-a655-9989859bab28\") "
Jul 06 19:55:16.567577 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:16.567581    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6daa5cf-d1e8-4820-a655-9989859bab28-istio-podinfo\") pod \"a6daa5cf-d1e8-4820-a655-9989859bab28\" (UID: \"a6daa5cf-d1e8-4820-a655-9989859bab28\") "
Jul 06 19:55:16.567819 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:16.567615    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6daa5cf-d1e8-4820-a655-9989859bab28-credential-socket\") pod \"a6daa5cf-d1e8-4820-a655-9989859bab28\" (UID: \"a6daa5cf-d1e8-4820-a655-9989859bab28\") "
Jul 06 19:55:16.567819 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:16.567658    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6daa5cf-d1e8-4820-a655-9989859bab28-istio-envoy\") pod \"a6daa5cf-d1e8-4820-a655-9989859bab28\" (UID: \"a6daa5cf-d1e8-4820-a655-9989859bab28\") "
Jul 06 19:55:16.567819 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:16.567686    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6daa5cf-d1e8-4820-a655-9989859bab28-workload-socket\") pod \"a6daa5cf-d1e8-4820-a655-9989859bab28\" (UID: \"a6daa5cf-d1e8-4820-a655-9989859bab28\") "
Jul 06 19:55:16.567819 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:16.567714    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6daa5cf-d1e8-4820-a655-9989859bab28-istiod-ca-cert\") pod \"a6daa5cf-d1e8-4820-a655-9989859bab28\" (UID: \"a6daa5cf-d1e8-4820-a655-9989859bab28\") "
Jul 06 19:55:16.567819 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:16.567753    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hlzf\" (UniqueName: \"kubernetes.io/projected/a6daa5cf-d1e8-4820-a655-9989859bab28-kube-api-access-5hlzf\") pod \"a6daa5cf-d1e8-4820-a655-9989859bab28\" (UID: \"a6daa5cf-d1e8-4820-a655-9989859bab28\") "
Jul 06 19:55:16.567819 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:16.567787    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6daa5cf-d1e8-4820-a655-9989859bab28-workload-certs\") pod \"a6daa5cf-d1e8-4820-a655-9989859bab28\" (UID: \"a6daa5cf-d1e8-4820-a655-9989859bab28\") "
Jul 06 19:55:16.567819 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:16.567821    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6daa5cf-d1e8-4820-a655-9989859bab28-istio-token\") pod \"a6daa5cf-d1e8-4820-a655-9989859bab28\" (UID: \"a6daa5cf-d1e8-4820-a655-9989859bab28\") "
Jul 06 19:55:16.568214 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:16.567885    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6daa5cf-d1e8-4820-a655-9989859bab28-istio-data" (OuterVolumeSpecName: "istio-data") pod "a6daa5cf-d1e8-4820-a655-9989859bab28" (UID: "a6daa5cf-d1e8-4820-a655-9989859bab28"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:55:16.568214 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:16.568101    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6daa5cf-d1e8-4820-a655-9989859bab28-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a6daa5cf-d1e8-4820-a655-9989859bab28" (UID: "a6daa5cf-d1e8-4820-a655-9989859bab28"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:55:16.568214 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:16.568137    2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6daa5cf-d1e8-4820-a655-9989859bab28-istio-data\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:55:16.568214 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:16.568185    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6daa5cf-d1e8-4820-a655-9989859bab28-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a6daa5cf-d1e8-4820-a655-9989859bab28" (UID: "a6daa5cf-d1e8-4820-a655-9989859bab28"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:55:16.568408 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:16.568333    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6daa5cf-d1e8-4820-a655-9989859bab28-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a6daa5cf-d1e8-4820-a655-9989859bab28" (UID: "a6daa5cf-d1e8-4820-a655-9989859bab28"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:55:16.568408 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:16.568350    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6daa5cf-d1e8-4820-a655-9989859bab28-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a6daa5cf-d1e8-4820-a655-9989859bab28" (UID: "a6daa5cf-d1e8-4820-a655-9989859bab28"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:55:16.570130 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:16.570106    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6daa5cf-d1e8-4820-a655-9989859bab28-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a6daa5cf-d1e8-4820-a655-9989859bab28" (UID: "a6daa5cf-d1e8-4820-a655-9989859bab28"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:55:16.570130 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:16.570114    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6daa5cf-d1e8-4820-a655-9989859bab28-istio-token" (OuterVolumeSpecName: "istio-token") pod "a6daa5cf-d1e8-4820-a655-9989859bab28" (UID: "a6daa5cf-d1e8-4820-a655-9989859bab28"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:55:16.570130 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:16.570121    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6daa5cf-d1e8-4820-a655-9989859bab28-kube-api-access-5hlzf" (OuterVolumeSpecName: "kube-api-access-5hlzf") pod "a6daa5cf-d1e8-4820-a655-9989859bab28" (UID: "a6daa5cf-d1e8-4820-a655-9989859bab28"). InnerVolumeSpecName "kube-api-access-5hlzf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:55:16.570301 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:16.570136    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a6daa5cf-d1e8-4820-a655-9989859bab28-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a6daa5cf-d1e8-4820-a655-9989859bab28" (UID: "a6daa5cf-d1e8-4820-a655-9989859bab28"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 19:55:16.668701 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:16.668666    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hlzf\" (UniqueName: \"kubernetes.io/projected/a6daa5cf-d1e8-4820-a655-9989859bab28-kube-api-access-5hlzf\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:55:16.668701 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:16.668697    2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6daa5cf-d1e8-4820-a655-9989859bab28-workload-certs\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:55:16.668701 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:16.668706    2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6daa5cf-d1e8-4820-a655-9989859bab28-istio-token\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:55:16.668966 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:16.668714    2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6daa5cf-d1e8-4820-a655-9989859bab28-istio-podinfo\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:55:16.668966 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:16.668745    2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6daa5cf-d1e8-4820-a655-9989859bab28-credential-socket\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:55:16.668966 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:16.668754    2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6daa5cf-d1e8-4820-a655-9989859bab28-istio-envoy\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:55:16.668966 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:16.668765    2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6daa5cf-d1e8-4820-a655-9989859bab28-workload-socket\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:55:16.668966 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:16.668773    2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6daa5cf-d1e8-4820-a655-9989859bab28-istiod-ca-cert\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:55:17.179638 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:17.179602    2555 generic.go:356] "Generic (PLEG): container finished" podID="a6daa5cf-d1e8-4820-a655-9989859bab28" containerID="705dd28a0998ae72692e5cd97f161a49bb7769c226e4ad0d0a0acda53d14dcbd" exitCode=0
Jul 06 19:55:17.179638 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:17.179640    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6" event={"ID":"a6daa5cf-d1e8-4820-a655-9989859bab28","Type":"ContainerDied","Data":"705dd28a0998ae72692e5cd97f161a49bb7769c226e4ad0d0a0acda53d14dcbd"}
Jul 06 19:55:17.179895 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:17.179649    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6"
Jul 06 19:55:17.179895 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:17.179686    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6" event={"ID":"a6daa5cf-d1e8-4820-a655-9989859bab28","Type":"ContainerDied","Data":"b1618feae5101864968ddb0442f21327cfb40e50f1cd1586ac6891247404fc77"}
Jul 06 19:55:17.179895 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:17.179711    2555 scope.go:117] "RemoveContainer" containerID="705dd28a0998ae72692e5cd97f161a49bb7769c226e4ad0d0a0acda53d14dcbd"
Jul 06 19:55:17.189441 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:17.189419    2555 scope.go:117] "RemoveContainer" containerID="705dd28a0998ae72692e5cd97f161a49bb7769c226e4ad0d0a0acda53d14dcbd"
Jul 06 19:55:17.189693 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:55:17.189673    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"705dd28a0998ae72692e5cd97f161a49bb7769c226e4ad0d0a0acda53d14dcbd\": container with ID starting with 705dd28a0998ae72692e5cd97f161a49bb7769c226e4ad0d0a0acda53d14dcbd not found: ID does not exist" containerID="705dd28a0998ae72692e5cd97f161a49bb7769c226e4ad0d0a0acda53d14dcbd"
Jul 06 19:55:17.189762 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:17.189699    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"705dd28a0998ae72692e5cd97f161a49bb7769c226e4ad0d0a0acda53d14dcbd"} err="failed to get container status \"705dd28a0998ae72692e5cd97f161a49bb7769c226e4ad0d0a0acda53d14dcbd\": rpc error: code = NotFound desc = could not find container \"705dd28a0998ae72692e5cd97f161a49bb7769c226e4ad0d0a0acda53d14dcbd\": container with ID starting with 705dd28a0998ae72692e5cd97f161a49bb7769c226e4ad0d0a0acda53d14dcbd not found: ID does not exist"
Jul 06 19:55:17.206136 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:17.206104    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6"]
Jul 06 19:55:17.211078 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:17.211053    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-e3f6a090-openshift-default-785d9b5c4c-v76p6"]
Jul 06 19:55:17.549422 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:17.549390    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:17.617973 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:17.617931    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:17.989823 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:17.989734    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:18.089393 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:18.089357    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:18.135373 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:18.135343    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6daa5cf-d1e8-4820-a655-9989859bab28" path="/var/lib/kubelet/pods/a6daa5cf-d1e8-4820-a655-9989859bab28/volumes"
Jul 06 19:55:18.163443 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:18.163407    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:19.677742 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:19.677706    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:25.553481 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:25.553445    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:26.754525 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:26.754486    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:44.175040 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:44.175013    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j9wtk_bb750a78-aa1e-4c55-b771-e06ca00b997a/ovn-acl-logging/0.log"
Jul 06 19:55:44.176580 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:44.176559    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j9wtk_bb750a78-aa1e-4c55-b771-e06ca00b997a/ovn-acl-logging/0.log"
Jul 06 19:55:52.314407 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:52.314370    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:58.498965 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:58.498900    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:58.603291 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:58.603255    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:58.708799 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:55:58.708764    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:14.643814 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:14.643781    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:21.546420 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:21.546372    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:21.688140 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:21.688107    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:32.277935 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:32.277847    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:33.035639 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:33.035577    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:38.891075 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:38.891034    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:38.960433 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:38.960356    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:39.060920 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:39.060857    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:39.156489 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:39.156393    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:39.258582 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:39.258549    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:39.952203 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:39.952173    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:40.055551 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:40.055516    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:40.151055 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:40.151023    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:40.977271 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:40.977230    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:56:41.851082 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:41.851031    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:47.884500 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:47.884461    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:56:47.931839 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:47.931777    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:48.001888 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:48.001826    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:48.621055 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:48.621015    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:54.806014 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:54.805978    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:54.897341 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:54.897294    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:56:54.907828 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:54.902670    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:55.037097 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:55.037051    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:55.335999 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:55.335951    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89"]
Jul 06 19:56:55.336399 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:55.336381    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f8180a6-5746-42ea-899b-985f4b7bd739" containerName="istio-proxy"
Jul 06 19:56:55.336491 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:55.336402    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f8180a6-5746-42ea-899b-985f4b7bd739" containerName="istio-proxy"
Jul 06 19:56:55.336491 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:55.336415    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6daa5cf-d1e8-4820-a655-9989859bab28" containerName="istio-proxy"
Jul 06 19:56:55.336491 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:55.336423    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6daa5cf-d1e8-4820-a655-9989859bab28" containerName="istio-proxy"
Jul 06 19:56:55.336648 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:55.336520    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f8180a6-5746-42ea-899b-985f4b7bd739" containerName="istio-proxy"
Jul 06 19:56:55.336648 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:55.336535    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6daa5cf-d1e8-4820-a655-9989859bab28" containerName="istio-proxy"
Jul 06 19:56:55.339631 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:55.339610    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89"
Jul 06 19:56:55.342158 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:55.342134    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-4e857e76-openshift-default-dockercfg-gpxmg\""
Jul 06 19:56:55.370632 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:55.370599    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89"]
Jul 06 19:56:55.383408 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:55.383373    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:55.395987 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:55.395957    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqw4q\" (UniqueName: \"kubernetes.io/projected/754e084b-1a53-49bd-87da-e76fd19db046-kube-api-access-kqw4q\") pod \"e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89\" (UID: \"754e084b-1a53-49bd-87da-e76fd19db046\") " pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89"
Jul 06 19:56:55.396131 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:55.395992    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/754e084b-1a53-49bd-87da-e76fd19db046-istio-data\") pod \"e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89\" (UID: \"754e084b-1a53-49bd-87da-e76fd19db046\") " pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89"
Jul 06 19:56:55.396131 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:55.396018    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/754e084b-1a53-49bd-87da-e76fd19db046-istiod-ca-cert\") pod \"e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89\" (UID: \"754e084b-1a53-49bd-87da-e76fd19db046\") " pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89"
Jul 06 19:56:55.396131 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:55.396082    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/754e084b-1a53-49bd-87da-e76fd19db046-credential-socket\") pod \"e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89\" (UID: \"754e084b-1a53-49bd-87da-e76fd19db046\") " pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89"
Jul 06 19:56:55.396131 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:55.396108    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/754e084b-1a53-49bd-87da-e76fd19db046-istio-token\") pod \"e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89\" (UID: \"754e084b-1a53-49bd-87da-e76fd19db046\") " pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89"
Jul 06 19:56:55.396277 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:55.396135    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/754e084b-1a53-49bd-87da-e76fd19db046-istio-envoy\") pod \"e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89\" (UID: \"754e084b-1a53-49bd-87da-e76fd19db046\") " pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89"
Jul 06 19:56:55.396277 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:55.396156    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/754e084b-1a53-49bd-87da-e76fd19db046-workload-socket\") pod \"e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89\" (UID: \"754e084b-1a53-49bd-87da-e76fd19db046\") " pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89"
Jul 06 19:56:55.396277 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:55.396201    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/754e084b-1a53-49bd-87da-e76fd19db046-workload-certs\") pod \"e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89\" (UID: \"754e084b-1a53-49bd-87da-e76fd19db046\") " pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89"
Jul 06 19:56:55.396277 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:55.396218    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/754e084b-1a53-49bd-87da-e76fd19db046-istio-podinfo\") pod \"e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89\" (UID: \"754e084b-1a53-49bd-87da-e76fd19db046\") " pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89"
Jul 06 19:56:55.482300 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:55.482260    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:55.496645 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:55.496609    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqw4q\" (UniqueName: \"kubernetes.io/projected/754e084b-1a53-49bd-87da-e76fd19db046-kube-api-access-kqw4q\") pod \"e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89\" (UID: \"754e084b-1a53-49bd-87da-e76fd19db046\") " pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89"
Jul 06 19:56:55.496645 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:55.496648    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/754e084b-1a53-49bd-87da-e76fd19db046-istio-data\") pod \"e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89\" (UID: \"754e084b-1a53-49bd-87da-e76fd19db046\") " pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89"
Jul 06 19:56:55.496849 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:55.496769    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/754e084b-1a53-49bd-87da-e76fd19db046-istiod-ca-cert\") pod \"e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89\" (UID: \"754e084b-1a53-49bd-87da-e76fd19db046\") " pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89"
Jul 06 19:56:55.496849 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:55.496829    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/754e084b-1a53-49bd-87da-e76fd19db046-credential-socket\") pod \"e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89\" (UID: \"754e084b-1a53-49bd-87da-e76fd19db046\") " pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89"
Jul 06 19:56:55.496950 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:55.496861    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/754e084b-1a53-49bd-87da-e76fd19db046-istio-token\") pod \"e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89\" (UID: \"754e084b-1a53-49bd-87da-e76fd19db046\") " pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89"
Jul 06 19:56:55.496950 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:55.496901    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/754e084b-1a53-49bd-87da-e76fd19db046-istio-envoy\") pod \"e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89\" (UID: \"754e084b-1a53-49bd-87da-e76fd19db046\") " pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89"
Jul 06 19:56:55.497251 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:55.497074    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/754e084b-1a53-49bd-87da-e76fd19db046-workload-socket\") pod \"e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89\" (UID: \"754e084b-1a53-49bd-87da-e76fd19db046\") " pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89"
Jul 06 19:56:55.497251 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:55.497085    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/754e084b-1a53-49bd-87da-e76fd19db046-istio-data\") pod \"e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89\" (UID: \"754e084b-1a53-49bd-87da-e76fd19db046\") " pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89"
Jul 06 19:56:55.497251 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:55.497134    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/754e084b-1a53-49bd-87da-e76fd19db046-workload-certs\") pod \"e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89\" (UID: \"754e084b-1a53-49bd-87da-e76fd19db046\") " pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89"
Jul 06 19:56:55.497251 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:55.497154    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/754e084b-1a53-49bd-87da-e76fd19db046-istio-podinfo\") pod \"e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89\" (UID: \"754e084b-1a53-49bd-87da-e76fd19db046\") " pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89"
Jul 06 19:56:55.497251 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:55.497208    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/754e084b-1a53-49bd-87da-e76fd19db046-credential-socket\") pod \"e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89\" (UID: \"754e084b-1a53-49bd-87da-e76fd19db046\") " pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89"
Jul 06 19:56:55.497558 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:55.497410    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/754e084b-1a53-49bd-87da-e76fd19db046-workload-socket\") pod \"e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89\" (UID: \"754e084b-1a53-49bd-87da-e76fd19db046\") " pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89"
Jul 06 19:56:55.497558 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:55.497446    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/754e084b-1a53-49bd-87da-e76fd19db046-workload-certs\") pod \"e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89\" (UID: \"754e084b-1a53-49bd-87da-e76fd19db046\") " pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89"
Jul 06 19:56:55.497558 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:55.497505    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/754e084b-1a53-49bd-87da-e76fd19db046-istiod-ca-cert\") pod \"e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89\" (UID: \"754e084b-1a53-49bd-87da-e76fd19db046\") " pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89"
Jul 06 19:56:55.499080 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:55.499060    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/754e084b-1a53-49bd-87da-e76fd19db046-istio-envoy\") pod \"e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89\" (UID: \"754e084b-1a53-49bd-87da-e76fd19db046\") " pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89"
Jul 06 19:56:55.499390 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:55.499372    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/754e084b-1a53-49bd-87da-e76fd19db046-istio-podinfo\") pod \"e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89\" (UID: \"754e084b-1a53-49bd-87da-e76fd19db046\") " pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89"
Jul 06 19:56:55.505604 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:55.505576    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/754e084b-1a53-49bd-87da-e76fd19db046-istio-token\") pod \"e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89\" (UID: \"754e084b-1a53-49bd-87da-e76fd19db046\") " pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89"
Jul 06 19:56:55.505718 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:55.505701    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqw4q\" (UniqueName: \"kubernetes.io/projected/754e084b-1a53-49bd-87da-e76fd19db046-kube-api-access-kqw4q\") pod \"e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89\" (UID: \"754e084b-1a53-49bd-87da-e76fd19db046\") " pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89"
Jul 06 19:56:55.650520 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:55.650438    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89"
Jul 06 19:56:55.794657 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:55.794626    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89"]
Jul 06 19:56:55.795256 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:56:55.795233    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod754e084b_1a53_49bd_87da_e76fd19db046.slice/crio-da43298ba1901e76633ba76a97af8fcfad279577e09be6e4c97e933f41e49370 WatchSource:0}: Error finding container da43298ba1901e76633ba76a97af8fcfad279577e09be6e4c97e933f41e49370: Status 404 returned error can't find the container with id da43298ba1901e76633ba76a97af8fcfad279577e09be6e4c97e933f41e49370
Jul 06 19:56:55.797415 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:55.797383    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:56:55.797517 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:55.797453    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:56:55.797517 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:55.797481    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:56:56.647140 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:56.647100    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89" event={"ID":"754e084b-1a53-49bd-87da-e76fd19db046","Type":"ContainerStarted","Data":"19f3c998da2aa249c6a611635523ea789943ed0ec74d86edb868a237f4ae1324"}
Jul 06 19:56:56.647535 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:56.647157    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89" event={"ID":"754e084b-1a53-49bd-87da-e76fd19db046","Type":"ContainerStarted","Data":"da43298ba1901e76633ba76a97af8fcfad279577e09be6e4c97e933f41e49370"}
Jul 06 19:56:56.651452 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:56.651434    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89"
Jul 06 19:56:56.656480 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:56.656457    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89"
Jul 06 19:56:56.684282 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:56.684232    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89" podStartSLOduration=1.684217589 podStartE2EDuration="1.684217589s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:56:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:56:56.682357668 +0000 UTC m=+1874.458391067" watchObservedRunningTime="2026-07-06 19:56:56.684217589 +0000 UTC m=+1874.460250987"
Jul 06 19:56:57.651963 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:57.651932    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89"
Jul 06 19:56:57.653028 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:57.653009    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89"
Jul 06 19:56:58.688992 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:58.688960    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:58.864065 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:58.864026    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:58.982642 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:58.982549    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:59.094232 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:59.094183    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:59.399705 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:59.399674    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:59.505703 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:56:59.505673    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:03.192683 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:03.192638    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:03.896395 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:03.896361    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:03.991218 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:03.991131    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:04.420771 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:04.420732    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:04.795817 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:04.795781    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:57:10.482365 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:10.482307    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:10.552083 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:10.552049    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:10.955390 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:10.955359    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:11.405839 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:11.405805    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:11.484982 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:11.484940    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:12.654079 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:12.653973    2555 patch_prober.go:28] interesting pod/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Jul 06 19:57:12.654079 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:12.654047    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89" podUID="754e084b-1a53-49bd-87da-e76fd19db046" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Jul 06 19:57:12.727614 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:12.727581    2555 generic.go:356] "Generic (PLEG): container finished" podID="754e084b-1a53-49bd-87da-e76fd19db046" containerID="19f3c998da2aa249c6a611635523ea789943ed0ec74d86edb868a237f4ae1324" exitCode=0
Jul 06 19:57:12.727773 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:12.727656    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89" event={"ID":"754e084b-1a53-49bd-87da-e76fd19db046","Type":"ContainerDied","Data":"19f3c998da2aa249c6a611635523ea789943ed0ec74d86edb868a237f4ae1324"}
Jul 06 19:57:12.728055 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:12.728041    2555 scope.go:117] "RemoveContainer" containerID="19f3c998da2aa249c6a611635523ea789943ed0ec74d86edb868a237f4ae1324"
Jul 06 19:57:12.729042 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:12.729014    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:57:12.729115 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:12.729097    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:57:12.729187 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:12.729171    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:57:13.738705 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:13.738660    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89" event={"ID":"754e084b-1a53-49bd-87da-e76fd19db046","Type":"ContainerStarted","Data":"ee253d6d4f30fbe569ad128b5bc0c61896a4e76f0ab451db00d6a0cb26e0cfb5"}
Jul 06 19:57:14.651417 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:14.651377    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89"
Jul 06 19:57:14.651650 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:14.651622    2555 patch_prober.go:28] interesting pod/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Jul 06 19:57:14.651694 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:14.651662    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89" podUID="754e084b-1a53-49bd-87da-e76fd19db046" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Jul 06 19:57:15.284704 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:15.284667    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:57:15.385077 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:15.385033    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:15.486287 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:15.486249    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:15.651593 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:15.651504    2555 patch_prober.go:28] interesting pod/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Jul 06 19:57:15.651593 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:15.651557    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89" podUID="754e084b-1a53-49bd-87da-e76fd19db046" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Jul 06 19:57:16.651338 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:16.651300    2555 patch_prober.go:28] interesting pod/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Jul 06 19:57:16.651759 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:16.651359    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89" podUID="754e084b-1a53-49bd-87da-e76fd19db046" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Jul 06 19:57:17.582376 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:17.582337    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:17.657218 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:17.657184    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89"
Jul 06 19:57:17.657683 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:17.657590    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89"
Jul 06 19:57:17.658516 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:17.658495    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89"
Jul 06 19:57:17.684084 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:17.684045    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:17.920484 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:17.920388    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89"]
Jul 06 19:57:17.953877 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:17.953846    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:18.146002 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:18.145964    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:18.272302 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:18.272206    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:18.365191 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:18.365160    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:18.494455 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:18.494411    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:18.770679 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:18.770650    2555 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89" secret="" err="secret \"e2e-mt-4e857e76-openshift-default-dockercfg-gpxmg\" not found"
Jul 06 19:57:19.775350 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:19.775306    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89" podUID="754e084b-1a53-49bd-87da-e76fd19db046" containerName="istio-proxy" containerID="cri-o://ee253d6d4f30fbe569ad128b5bc0c61896a4e76f0ab451db00d6a0cb26e0cfb5" gracePeriod=30
Jul 06 19:57:24.330932 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:24.330861    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:24.441253 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:24.441213    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:24.530883 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:24.530853    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:24.699763 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:24.699677    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:25.039115 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:25.039087    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89"
Jul 06 19:57:25.134048 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:25.134020    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/754e084b-1a53-49bd-87da-e76fd19db046-credential-socket\") pod \"754e084b-1a53-49bd-87da-e76fd19db046\" (UID: \"754e084b-1a53-49bd-87da-e76fd19db046\") "
Jul 06 19:57:25.134233 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:25.134073    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/754e084b-1a53-49bd-87da-e76fd19db046-istio-token\") pod \"754e084b-1a53-49bd-87da-e76fd19db046\" (UID: \"754e084b-1a53-49bd-87da-e76fd19db046\") "
Jul 06 19:57:25.134233 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:25.134129    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/754e084b-1a53-49bd-87da-e76fd19db046-istiod-ca-cert\") pod \"754e084b-1a53-49bd-87da-e76fd19db046\" (UID: \"754e084b-1a53-49bd-87da-e76fd19db046\") "
Jul 06 19:57:25.134233 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:25.134146    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/754e084b-1a53-49bd-87da-e76fd19db046-workload-certs\") pod \"754e084b-1a53-49bd-87da-e76fd19db046\" (UID: \"754e084b-1a53-49bd-87da-e76fd19db046\") "
Jul 06 19:57:25.134233 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:25.134183    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/754e084b-1a53-49bd-87da-e76fd19db046-istio-envoy\") pod \"754e084b-1a53-49bd-87da-e76fd19db046\" (UID: \"754e084b-1a53-49bd-87da-e76fd19db046\") "
Jul 06 19:57:25.134233 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:25.134231    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/754e084b-1a53-49bd-87da-e76fd19db046-istio-data\") pod \"754e084b-1a53-49bd-87da-e76fd19db046\" (UID: \"754e084b-1a53-49bd-87da-e76fd19db046\") "
Jul 06 19:57:25.134508 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:25.134263    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/754e084b-1a53-49bd-87da-e76fd19db046-workload-socket\") pod \"754e084b-1a53-49bd-87da-e76fd19db046\" (UID: \"754e084b-1a53-49bd-87da-e76fd19db046\") "
Jul 06 19:57:25.134508 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:25.134287    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/754e084b-1a53-49bd-87da-e76fd19db046-istio-podinfo\") pod \"754e084b-1a53-49bd-87da-e76fd19db046\" (UID: \"754e084b-1a53-49bd-87da-e76fd19db046\") "
Jul 06 19:57:25.134508 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:25.134313    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kqw4q\" (UniqueName: \"kubernetes.io/projected/754e084b-1a53-49bd-87da-e76fd19db046-kube-api-access-kqw4q\") pod \"754e084b-1a53-49bd-87da-e76fd19db046\" (UID: \"754e084b-1a53-49bd-87da-e76fd19db046\") "
Jul 06 19:57:25.134508 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:25.134326    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/754e084b-1a53-49bd-87da-e76fd19db046-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "754e084b-1a53-49bd-87da-e76fd19db046" (UID: "754e084b-1a53-49bd-87da-e76fd19db046"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:57:25.134508 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:25.134459    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/754e084b-1a53-49bd-87da-e76fd19db046-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "754e084b-1a53-49bd-87da-e76fd19db046" (UID: "754e084b-1a53-49bd-87da-e76fd19db046"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:57:25.134773 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:25.134553    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/754e084b-1a53-49bd-87da-e76fd19db046-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "754e084b-1a53-49bd-87da-e76fd19db046" (UID: "754e084b-1a53-49bd-87da-e76fd19db046"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:57:25.134773 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:25.134564    2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/754e084b-1a53-49bd-87da-e76fd19db046-credential-socket\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:57:25.134773 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:25.134585    2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/754e084b-1a53-49bd-87da-e76fd19db046-workload-certs\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:57:25.134773 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:25.134581    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/754e084b-1a53-49bd-87da-e76fd19db046-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "754e084b-1a53-49bd-87da-e76fd19db046" (UID: "754e084b-1a53-49bd-87da-e76fd19db046"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:57:25.135443 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:25.135412    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/754e084b-1a53-49bd-87da-e76fd19db046-istio-data" (OuterVolumeSpecName: "istio-data") pod "754e084b-1a53-49bd-87da-e76fd19db046" (UID: "754e084b-1a53-49bd-87da-e76fd19db046"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:57:25.136492 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:25.136461    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/754e084b-1a53-49bd-87da-e76fd19db046-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "754e084b-1a53-49bd-87da-e76fd19db046" (UID: "754e084b-1a53-49bd-87da-e76fd19db046"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:57:25.136643 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:25.136620    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/754e084b-1a53-49bd-87da-e76fd19db046-kube-api-access-kqw4q" (OuterVolumeSpecName: "kube-api-access-kqw4q") pod "754e084b-1a53-49bd-87da-e76fd19db046" (UID: "754e084b-1a53-49bd-87da-e76fd19db046"). InnerVolumeSpecName "kube-api-access-kqw4q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:57:25.136749 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:25.136730    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/754e084b-1a53-49bd-87da-e76fd19db046-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "754e084b-1a53-49bd-87da-e76fd19db046" (UID: "754e084b-1a53-49bd-87da-e76fd19db046"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 19:57:25.136817 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:25.136800    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/754e084b-1a53-49bd-87da-e76fd19db046-istio-token" (OuterVolumeSpecName: "istio-token") pod "754e084b-1a53-49bd-87da-e76fd19db046" (UID: "754e084b-1a53-49bd-87da-e76fd19db046"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:57:25.235587 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:25.235542    2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/754e084b-1a53-49bd-87da-e76fd19db046-istio-data\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:57:25.235587 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:25.235580    2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/754e084b-1a53-49bd-87da-e76fd19db046-workload-socket\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:57:25.235587 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:25.235594    2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/754e084b-1a53-49bd-87da-e76fd19db046-istio-podinfo\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:57:25.235845 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:25.235607    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kqw4q\" (UniqueName: \"kubernetes.io/projected/754e084b-1a53-49bd-87da-e76fd19db046-kube-api-access-kqw4q\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:57:25.235845 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:25.235619    2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/754e084b-1a53-49bd-87da-e76fd19db046-istio-token\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:57:25.235845 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:25.235631    2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/754e084b-1a53-49bd-87da-e76fd19db046-istiod-ca-cert\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:57:25.235845 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:25.235642    2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/754e084b-1a53-49bd-87da-e76fd19db046-istio-envoy\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:57:25.807432 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:25.807398    2555 generic.go:356] "Generic (PLEG): container finished" podID="754e084b-1a53-49bd-87da-e76fd19db046" containerID="ee253d6d4f30fbe569ad128b5bc0c61896a4e76f0ab451db00d6a0cb26e0cfb5" exitCode=0
Jul 06 19:57:25.807819 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:25.807442    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89"
Jul 06 19:57:25.807819 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:25.807484    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89" event={"ID":"754e084b-1a53-49bd-87da-e76fd19db046","Type":"ContainerDied","Data":"ee253d6d4f30fbe569ad128b5bc0c61896a4e76f0ab451db00d6a0cb26e0cfb5"}
Jul 06 19:57:25.807819 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:25.807549    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89" event={"ID":"754e084b-1a53-49bd-87da-e76fd19db046","Type":"ContainerDied","Data":"da43298ba1901e76633ba76a97af8fcfad279577e09be6e4c97e933f41e49370"}
Jul 06 19:57:25.807819 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:25.807579    2555 scope.go:117] "RemoveContainer" containerID="ee253d6d4f30fbe569ad128b5bc0c61896a4e76f0ab451db00d6a0cb26e0cfb5"
Jul 06 19:57:25.816710 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:25.816693    2555 scope.go:117] "RemoveContainer" containerID="19f3c998da2aa249c6a611635523ea789943ed0ec74d86edb868a237f4ae1324"
Jul 06 19:57:25.824468 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:25.824451    2555 scope.go:117] "RemoveContainer" containerID="ee253d6d4f30fbe569ad128b5bc0c61896a4e76f0ab451db00d6a0cb26e0cfb5"
Jul 06 19:57:25.824731 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:57:25.824711    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee253d6d4f30fbe569ad128b5bc0c61896a4e76f0ab451db00d6a0cb26e0cfb5\": container with ID starting with ee253d6d4f30fbe569ad128b5bc0c61896a4e76f0ab451db00d6a0cb26e0cfb5 not found: ID does not exist" containerID="ee253d6d4f30fbe569ad128b5bc0c61896a4e76f0ab451db00d6a0cb26e0cfb5"
Jul 06 19:57:25.824774 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:25.824739    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee253d6d4f30fbe569ad128b5bc0c61896a4e76f0ab451db00d6a0cb26e0cfb5"} err="failed to get container status \"ee253d6d4f30fbe569ad128b5bc0c61896a4e76f0ab451db00d6a0cb26e0cfb5\": rpc error: code = NotFound desc = could not find container \"ee253d6d4f30fbe569ad128b5bc0c61896a4e76f0ab451db00d6a0cb26e0cfb5\": container with ID starting with ee253d6d4f30fbe569ad128b5bc0c61896a4e76f0ab451db00d6a0cb26e0cfb5 not found: ID does not exist"
Jul 06 19:57:25.824774 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:25.824760    2555 scope.go:117] "RemoveContainer" containerID="19f3c998da2aa249c6a611635523ea789943ed0ec74d86edb868a237f4ae1324"
Jul 06 19:57:25.825016 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:57:25.824996    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19f3c998da2aa249c6a611635523ea789943ed0ec74d86edb868a237f4ae1324\": container with ID starting with 19f3c998da2aa249c6a611635523ea789943ed0ec74d86edb868a237f4ae1324 not found: ID does not exist" containerID="19f3c998da2aa249c6a611635523ea789943ed0ec74d86edb868a237f4ae1324"
Jul 06 19:57:25.825081 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:25.825026    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19f3c998da2aa249c6a611635523ea789943ed0ec74d86edb868a237f4ae1324"} err="failed to get container status \"19f3c998da2aa249c6a611635523ea789943ed0ec74d86edb868a237f4ae1324\": rpc error: code = NotFound desc = could not find container \"19f3c998da2aa249c6a611635523ea789943ed0ec74d86edb868a237f4ae1324\": container with ID starting with 19f3c998da2aa249c6a611635523ea789943ed0ec74d86edb868a237f4ae1324 not found: ID does not exist"
Jul 06 19:57:25.829211 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:25.829190    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89"]
Jul 06 19:57:25.838181 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:25.838160    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-4e857e76-openshift-default-69b7d648f5-p5z89"]
Jul 06 19:57:26.135521 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:26.132607    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="754e084b-1a53-49bd-87da-e76fd19db046" path="/var/lib/kubelet/pods/754e084b-1a53-49bd-87da-e76fd19db046/volumes"
Jul 06 19:57:30.619162 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:30.619107    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:30.688933 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:30.688849    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:37.529944 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:37.529886    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:37.828116 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:37.828039    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb"]
Jul 06 19:57:37.828365 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:37.828354    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="754e084b-1a53-49bd-87da-e76fd19db046" containerName="istio-proxy"
Jul 06 19:57:37.828420 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:37.828367    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="754e084b-1a53-49bd-87da-e76fd19db046" containerName="istio-proxy"
Jul 06 19:57:37.828420 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:37.828380    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="754e084b-1a53-49bd-87da-e76fd19db046" containerName="istio-proxy"
Jul 06 19:57:37.828420 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:37.828386    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="754e084b-1a53-49bd-87da-e76fd19db046" containerName="istio-proxy"
Jul 06 19:57:37.828529 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:37.828445    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="754e084b-1a53-49bd-87da-e76fd19db046" containerName="istio-proxy"
Jul 06 19:57:37.832720 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:37.832700    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb"
Jul 06 19:57:37.835264 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:37.835238    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-60bec37b-openshift-default-dockercfg-7m94f\""
Jul 06 19:57:37.849623 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:37.849595    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb"]
Jul 06 19:57:37.871169 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:37.871140    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:37.947258 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:37.947221    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7590e37f-a44c-43dd-871a-49fb31151182-istiod-ca-cert\") pod \"e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb\" (UID: \"7590e37f-a44c-43dd-871a-49fb31151182\") " pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb"
Jul 06 19:57:37.947258 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:37.947262    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7590e37f-a44c-43dd-871a-49fb31151182-istio-token\") pod \"e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb\" (UID: \"7590e37f-a44c-43dd-871a-49fb31151182\") " pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb"
Jul 06 19:57:37.947483 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:37.947288    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7590e37f-a44c-43dd-871a-49fb31151182-istio-envoy\") pod \"e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb\" (UID: \"7590e37f-a44c-43dd-871a-49fb31151182\") " pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb"
Jul 06 19:57:37.947483 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:37.947346    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdd8m\" (UniqueName: \"kubernetes.io/projected/7590e37f-a44c-43dd-871a-49fb31151182-kube-api-access-qdd8m\") pod \"e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb\" (UID: \"7590e37f-a44c-43dd-871a-49fb31151182\") " pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb"
Jul 06 19:57:37.947483 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:37.947380    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7590e37f-a44c-43dd-871a-49fb31151182-credential-socket\") pod \"e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb\" (UID: \"7590e37f-a44c-43dd-871a-49fb31151182\") " pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb"
Jul 06 19:57:37.947483 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:37.947402    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7590e37f-a44c-43dd-871a-49fb31151182-istio-podinfo\") pod \"e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb\" (UID: \"7590e37f-a44c-43dd-871a-49fb31151182\") " pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb"
Jul 06 19:57:37.947626 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:37.947493    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7590e37f-a44c-43dd-871a-49fb31151182-workload-socket\") pod \"e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb\" (UID: \"7590e37f-a44c-43dd-871a-49fb31151182\") " pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb"
Jul 06 19:57:37.947626 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:37.947521    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7590e37f-a44c-43dd-871a-49fb31151182-istio-data\") pod \"e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb\" (UID: \"7590e37f-a44c-43dd-871a-49fb31151182\") " pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb"
Jul 06 19:57:37.947626 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:37.947560    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7590e37f-a44c-43dd-871a-49fb31151182-workload-certs\") pod \"e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb\" (UID: \"7590e37f-a44c-43dd-871a-49fb31151182\") " pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb"
Jul 06 19:57:38.048040 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:38.047999    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7590e37f-a44c-43dd-871a-49fb31151182-workload-certs\") pod \"e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb\" (UID: \"7590e37f-a44c-43dd-871a-49fb31151182\") " pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb"
Jul 06 19:57:38.048040 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:38.048047    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7590e37f-a44c-43dd-871a-49fb31151182-istiod-ca-cert\") pod \"e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb\" (UID: \"7590e37f-a44c-43dd-871a-49fb31151182\") " pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb"
Jul 06 19:57:38.048295 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:38.048070    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7590e37f-a44c-43dd-871a-49fb31151182-istio-token\") pod \"e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb\" (UID: \"7590e37f-a44c-43dd-871a-49fb31151182\") " pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb"
Jul 06 19:57:38.048295 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:38.048107    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7590e37f-a44c-43dd-871a-49fb31151182-istio-envoy\") pod \"e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb\" (UID: \"7590e37f-a44c-43dd-871a-49fb31151182\") " pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb"
Jul 06 19:57:38.048295 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:38.048133    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdd8m\" (UniqueName: \"kubernetes.io/projected/7590e37f-a44c-43dd-871a-49fb31151182-kube-api-access-qdd8m\") pod \"e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb\" (UID: \"7590e37f-a44c-43dd-871a-49fb31151182\") " pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb"
Jul 06 19:57:38.048295 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:38.048164    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7590e37f-a44c-43dd-871a-49fb31151182-credential-socket\") pod \"e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb\" (UID: \"7590e37f-a44c-43dd-871a-49fb31151182\") " pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb"
Jul 06 19:57:38.048295 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:38.048195    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7590e37f-a44c-43dd-871a-49fb31151182-istio-podinfo\") pod \"e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb\" (UID: \"7590e37f-a44c-43dd-871a-49fb31151182\") " pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb"
Jul 06 19:57:38.048295 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:38.048244    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7590e37f-a44c-43dd-871a-49fb31151182-workload-socket\") pod \"e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb\" (UID: \"7590e37f-a44c-43dd-871a-49fb31151182\") " pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb"
Jul 06 19:57:38.048295 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:38.048266    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7590e37f-a44c-43dd-871a-49fb31151182-istio-data\") pod \"e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb\" (UID: \"7590e37f-a44c-43dd-871a-49fb31151182\") " pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb"
Jul 06 19:57:38.048668 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:38.048465    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7590e37f-a44c-43dd-871a-49fb31151182-workload-certs\") pod \"e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb\" (UID: \"7590e37f-a44c-43dd-871a-49fb31151182\") " pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb"
Jul 06 19:57:38.048668 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:38.048577    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7590e37f-a44c-43dd-871a-49fb31151182-credential-socket\") pod \"e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb\" (UID: \"7590e37f-a44c-43dd-871a-49fb31151182\") " pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb"
Jul 06 19:57:38.048761 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:38.048668    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7590e37f-a44c-43dd-871a-49fb31151182-workload-socket\") pod \"e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb\" (UID: \"7590e37f-a44c-43dd-871a-49fb31151182\") " pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb"
Jul 06 19:57:38.048761 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:38.048746    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7590e37f-a44c-43dd-871a-49fb31151182-istio-data\") pod \"e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb\" (UID: \"7590e37f-a44c-43dd-871a-49fb31151182\") " pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb"
Jul 06 19:57:38.048871 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:38.048795    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7590e37f-a44c-43dd-871a-49fb31151182-istiod-ca-cert\") pod \"e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb\" (UID: \"7590e37f-a44c-43dd-871a-49fb31151182\") " pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb"
Jul 06 19:57:38.050568 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:38.050544    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7590e37f-a44c-43dd-871a-49fb31151182-istio-envoy\") pod \"e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb\" (UID: \"7590e37f-a44c-43dd-871a-49fb31151182\") " pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb"
Jul 06 19:57:38.050667 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:38.050626    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7590e37f-a44c-43dd-871a-49fb31151182-istio-podinfo\") pod \"e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb\" (UID: \"7590e37f-a44c-43dd-871a-49fb31151182\") " pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb"
Jul 06 19:57:38.059114 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:38.059086    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7590e37f-a44c-43dd-871a-49fb31151182-istio-token\") pod \"e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb\" (UID: \"7590e37f-a44c-43dd-871a-49fb31151182\") " pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb"
Jul 06 19:57:38.059375 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:38.059356    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdd8m\" (UniqueName: \"kubernetes.io/projected/7590e37f-a44c-43dd-871a-49fb31151182-kube-api-access-qdd8m\") pod \"e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb\" (UID: \"7590e37f-a44c-43dd-871a-49fb31151182\") " pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb"
Jul 06 19:57:38.143403 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:38.143313    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb"
Jul 06 19:57:38.286859 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:38.286834    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb"]
Jul 06 19:57:38.288386 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:57:38.288359    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7590e37f_a44c_43dd_871a_49fb31151182.slice/crio-dd285f7c77ddf7e6680f724d57c226c291e3a2912f5c6506bdb5c000b6db586f WatchSource:0}: Error finding container dd285f7c77ddf7e6680f724d57c226c291e3a2912f5c6506bdb5c000b6db586f: Status 404 returned error can't find the container with id dd285f7c77ddf7e6680f724d57c226c291e3a2912f5c6506bdb5c000b6db586f
Jul 06 19:57:38.290422 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:38.290389    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:57:38.290522 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:38.290454    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:57:38.290522 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:38.290485    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:57:38.430252 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:38.430130    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:38.872174 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:38.872132    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb" event={"ID":"7590e37f-a44c-43dd-871a-49fb31151182","Type":"ContainerStarted","Data":"3fce73a5fc01e6c7493af3e13cf364d7e09e65663dc86d05ba9d4afee260067e"}
Jul 06 19:57:38.872586 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:38.872239    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb" event={"ID":"7590e37f-a44c-43dd-871a-49fb31151182","Type":"ContainerStarted","Data":"dd285f7c77ddf7e6680f724d57c226c291e3a2912f5c6506bdb5c000b6db586f"}
Jul 06 19:57:38.901937 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:38.901857    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb" podStartSLOduration=1.9018402079999999 podStartE2EDuration="1.901840208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:57:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:57:38.900341676 +0000 UTC m=+1916.676375092" watchObservedRunningTime="2026-07-06 19:57:38.901840208 +0000 UTC m=+1916.677873600"
Jul 06 19:57:39.144519 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:39.144422    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb"
Jul 06 19:57:39.149087 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:39.149060    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb"
Jul 06 19:57:39.877230 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:39.877201    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb"
Jul 06 19:57:39.878304 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:39.878279    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb"
Jul 06 19:57:40.843229 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:40.843192    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:40.950283 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:40.950238    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:41.069208 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:41.069155    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:41.425664 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:41.425631    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:41.706341 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:41.706227    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:41.805304 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:41.805274    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:43.080607 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:43.080572    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:43.153179 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:43.153138    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:45.463548 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:45.463517    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:47.013234 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:47.013200    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:57:54.162269 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:54.162227    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-60bec37b/e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87"]
Jul 06 19:57:54.162757 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:54.162635    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="754e084b-1a53-49bd-87da-e76fd19db046" containerName="istio-proxy"
Jul 06 19:57:54.165731 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:54.165709    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-60bec37b/e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87"
Jul 06 19:57:54.175592 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:54.175562    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-60bec37b\"/\"e2e-lifecycle-model-60bec37b-kserve-self-signed-certs\""
Jul 06 19:57:54.175592 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:54.175583    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-60bec37b\"/\"default-dockercfg-bpjxm\""
Jul 06 19:57:54.175801 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:54.175582    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-60bec37b\"/\"openshift-service-ca.crt\""
Jul 06 19:57:54.175801 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:54.175582    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-60bec37b\"/\"kube-root-ca.crt\""
Jul 06 19:57:54.182285 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:54.182259    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/190db242-23c6-4f24-9a8a-8ade65b9af33-tls-certs\") pod \"e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87\" (UID: \"190db242-23c6-4f24-9a8a-8ade65b9af33\") " pod="ai-tenant-e2e-mt-60bec37b/e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87"
Jul 06 19:57:54.182426 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:54.182314    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/190db242-23c6-4f24-9a8a-8ade65b9af33-model-cache\") pod \"e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87\" (UID: \"190db242-23c6-4f24-9a8a-8ade65b9af33\") " pod="ai-tenant-e2e-mt-60bec37b/e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87"
Jul 06 19:57:54.182426 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:54.182409    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/190db242-23c6-4f24-9a8a-8ade65b9af33-dshm\") pod \"e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87\" (UID: \"190db242-23c6-4f24-9a8a-8ade65b9af33\") " pod="ai-tenant-e2e-mt-60bec37b/e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87"
Jul 06 19:57:54.182546 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:54.182428    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/190db242-23c6-4f24-9a8a-8ade65b9af33-tmp-dir\") pod \"e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87\" (UID: \"190db242-23c6-4f24-9a8a-8ade65b9af33\") " pod="ai-tenant-e2e-mt-60bec37b/e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87"
Jul 06 19:57:54.182546 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:54.182475    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlwqb\" (UniqueName: \"kubernetes.io/projected/190db242-23c6-4f24-9a8a-8ade65b9af33-kube-api-access-zlwqb\") pod \"e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87\" (UID: \"190db242-23c6-4f24-9a8a-8ade65b9af33\") " pod="ai-tenant-e2e-mt-60bec37b/e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87"
Jul 06 19:57:54.182655 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:54.182596    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/190db242-23c6-4f24-9a8a-8ade65b9af33-home\") pod \"e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87\" (UID: \"190db242-23c6-4f24-9a8a-8ade65b9af33\") " pod="ai-tenant-e2e-mt-60bec37b/e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87"
Jul 06 19:57:54.221754 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:54.221717    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-60bec37b/e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87"]
Jul 06 19:57:54.266100 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:54.266055    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:54.283202 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:54.283170    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/190db242-23c6-4f24-9a8a-8ade65b9af33-tls-certs\") pod \"e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87\" (UID: \"190db242-23c6-4f24-9a8a-8ade65b9af33\") " pod="ai-tenant-e2e-mt-60bec37b/e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87"
Jul 06 19:57:54.283405 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:54.283383    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/190db242-23c6-4f24-9a8a-8ade65b9af33-model-cache\") pod \"e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87\" (UID: \"190db242-23c6-4f24-9a8a-8ade65b9af33\") " pod="ai-tenant-e2e-mt-60bec37b/e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87"
Jul 06 19:57:54.283471 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:54.283437    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/190db242-23c6-4f24-9a8a-8ade65b9af33-dshm\") pod \"e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87\" (UID: \"190db242-23c6-4f24-9a8a-8ade65b9af33\") " pod="ai-tenant-e2e-mt-60bec37b/e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87"
Jul 06 19:57:54.283517 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:54.283477    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/190db242-23c6-4f24-9a8a-8ade65b9af33-tmp-dir\") pod \"e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87\" (UID: \"190db242-23c6-4f24-9a8a-8ade65b9af33\") " pod="ai-tenant-e2e-mt-60bec37b/e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87"
Jul 06 19:57:54.283575 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:54.283535    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlwqb\" (UniqueName: \"kubernetes.io/projected/190db242-23c6-4f24-9a8a-8ade65b9af33-kube-api-access-zlwqb\") pod \"e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87\" (UID: \"190db242-23c6-4f24-9a8a-8ade65b9af33\") " pod="ai-tenant-e2e-mt-60bec37b/e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87"
Jul 06 19:57:54.283630 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:54.283603    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/190db242-23c6-4f24-9a8a-8ade65b9af33-home\") pod \"e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87\" (UID: \"190db242-23c6-4f24-9a8a-8ade65b9af33\") " pod="ai-tenant-e2e-mt-60bec37b/e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87"
Jul 06 19:57:54.283789 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:54.283765    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/190db242-23c6-4f24-9a8a-8ade65b9af33-model-cache\") pod \"e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87\" (UID: \"190db242-23c6-4f24-9a8a-8ade65b9af33\") " pod="ai-tenant-e2e-mt-60bec37b/e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87"
Jul 06 19:57:54.283986 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:54.283959    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/190db242-23c6-4f24-9a8a-8ade65b9af33-home\") pod \"e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87\" (UID: \"190db242-23c6-4f24-9a8a-8ade65b9af33\") " pod="ai-tenant-e2e-mt-60bec37b/e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87"
Jul 06 19:57:54.284102 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:54.284003    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/190db242-23c6-4f24-9a8a-8ade65b9af33-tmp-dir\") pod \"e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87\" (UID: \"190db242-23c6-4f24-9a8a-8ade65b9af33\") " pod="ai-tenant-e2e-mt-60bec37b/e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87"
Jul 06 19:57:54.285666 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:54.285644    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/190db242-23c6-4f24-9a8a-8ade65b9af33-dshm\") pod \"e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87\" (UID: \"190db242-23c6-4f24-9a8a-8ade65b9af33\") " pod="ai-tenant-e2e-mt-60bec37b/e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87"
Jul 06 19:57:54.285825 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:54.285805    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/190db242-23c6-4f24-9a8a-8ade65b9af33-tls-certs\") pod \"e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87\" (UID: \"190db242-23c6-4f24-9a8a-8ade65b9af33\") " pod="ai-tenant-e2e-mt-60bec37b/e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87"
Jul 06 19:57:54.309874 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:54.309839    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlwqb\" (UniqueName: \"kubernetes.io/projected/190db242-23c6-4f24-9a8a-8ade65b9af33-kube-api-access-zlwqb\") pod \"e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87\" (UID: \"190db242-23c6-4f24-9a8a-8ade65b9af33\") " pod="ai-tenant-e2e-mt-60bec37b/e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87"
Jul 06 19:57:54.475867 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:54.475781    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-60bec37b/e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87"
Jul 06 19:57:54.622397 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:54.622292    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-60bec37b/e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87"]
Jul 06 19:57:54.624623 ip-10-0-131-150 kubenswrapper[2555]: W0706 19:57:54.624598    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod190db242_23c6_4f24_9a8a_8ade65b9af33.slice/crio-a02bb5fc99c86189eca6eba823c52415aadbad3781f2a3c9adcef127eb77f2b2 WatchSource:0}: Error finding container a02bb5fc99c86189eca6eba823c52415aadbad3781f2a3c9adcef127eb77f2b2: Status 404 returned error can't find the container with id a02bb5fc99c86189eca6eba823c52415aadbad3781f2a3c9adcef127eb77f2b2
Jul 06 19:57:54.878936 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:54.878876    2555 patch_prober.go:28] interesting pod/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 06 19:57:54.879118 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:54.878967    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb" podUID="7590e37f-a44c-43dd-871a-49fb31151182" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 06 19:57:54.968998 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:54.968961    2555 generic.go:356] "Generic (PLEG): container finished" podID="7590e37f-a44c-43dd-871a-49fb31151182" containerID="3fce73a5fc01e6c7493af3e13cf364d7e09e65663dc86d05ba9d4afee260067e" exitCode=0
Jul 06 19:57:54.969177 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:54.969036    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb" event={"ID":"7590e37f-a44c-43dd-871a-49fb31151182","Type":"ContainerDied","Data":"3fce73a5fc01e6c7493af3e13cf364d7e09e65663dc86d05ba9d4afee260067e"}
Jul 06 19:57:54.969501 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:54.969479    2555 scope.go:117] "RemoveContainer" containerID="3fce73a5fc01e6c7493af3e13cf364d7e09e65663dc86d05ba9d4afee260067e"
Jul 06 19:57:54.970515 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:54.970482    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:57:54.970622 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:54.970562    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:57:54.970622 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:54.970598    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:57:54.970622 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:54.970608    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-60bec37b/e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87" event={"ID":"190db242-23c6-4f24-9a8a-8ade65b9af33","Type":"ContainerStarted","Data":"faac4f9acd5ab1950bb35d770a359979aeedd9bc18a0c206fedd991f72d617e7"}
Jul 06 19:57:54.970748 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:54.970637    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-60bec37b/e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87" event={"ID":"190db242-23c6-4f24-9a8a-8ade65b9af33","Type":"ContainerStarted","Data":"a02bb5fc99c86189eca6eba823c52415aadbad3781f2a3c9adcef127eb77f2b2"}
Jul 06 19:57:55.016651 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:55.016594    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-60bec37b/e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87" podStartSLOduration=1.016572363 podStartE2EDuration="1.016572363s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:57:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:57:55.015645232 +0000 UTC m=+1932.791678631" watchObservedRunningTime="2026-07-06 19:57:55.016572363 +0000 UTC m=+1932.792605763"
Jul 06 19:57:55.981781 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:55.981743    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb" event={"ID":"7590e37f-a44c-43dd-871a-49fb31151182","Type":"ContainerStarted","Data":"d4af5d2cf3d8908698c14ea09bd485ffb3d5e5920d5d2f3357fc88e31095fb8f"}
Jul 06 19:57:56.144585 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:56.144547    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb"
Jul 06 19:57:56.144821 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:56.144797    2555 patch_prober.go:28] interesting pod/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 06 19:57:56.144905 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:56.144855    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb" podUID="7590e37f-a44c-43dd-871a-49fb31151182" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 06 19:57:57.144530 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:57.144489    2555 patch_prober.go:28] interesting pod/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 06 19:57:57.145044 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:57.144550    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb" podUID="7590e37f-a44c-43dd-871a-49fb31151182" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 06 19:57:57.783757 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:57.783717    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:57:58.144056 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:58.143959    2555 patch_prober.go:28] interesting pod/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 06 19:57:58.144056 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:58.144021    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb" podUID="7590e37f-a44c-43dd-871a-49fb31151182" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 06 19:57:59.144286 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:59.144242    2555 patch_prober.go:28] interesting pod/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 06 19:57:59.144803 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:57:59.144326    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb" podUID="7590e37f-a44c-43dd-871a-49fb31151182" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 06 19:58:00.143832 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:58:00.143794    2555 patch_prober.go:28] interesting pod/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 06 19:58:00.144057 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:58:00.143863    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb" podUID="7590e37f-a44c-43dd-871a-49fb31151182" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 06 19:58:01.148144 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:58:01.148115    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb"
Jul 06 19:58:01.148547 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:58:01.148377    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb"
Jul 06 19:58:01.149032 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:58:01.149016    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb"
Jul 06 19:58:03.803966 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:58:03.803935    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:03.904500 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:58:03.904467    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:04.476589 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:58:04.476553    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-60bec37b/e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87"
Jul 06 19:58:04.476767 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:58:04.476603    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-60bec37b/e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87"
Jul 06 19:58:04.488991 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:58:04.488964    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-60bec37b/e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87"
Jul 06 19:58:05.036427 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:58:05.036396    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-60bec37b/e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87"
Jul 06 19:58:15.092469 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:58:15.092437    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:58:17.961652 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:58:17.961615    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:18.430647 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:58:18.430614    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:24.079708 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:58:24.079671    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:27.293811 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:58:27.293771    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:58:29.015261 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:58:29.015223    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-60bec37b/e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87"]
Jul 06 19:58:29.112504 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:58:29.112466    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:44.037108 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:58:44.036997    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-60bec37b/e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87" podUID="190db242-23c6-4f24-9a8a-8ade65b9af33" containerName="main" containerID="cri-o://faac4f9acd5ab1950bb35d770a359979aeedd9bc18a0c206fedd991f72d617e7" gracePeriod=45
Jul 06 19:58:44.217709 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:58:44.217673    2555 generic.go:356] "Generic (PLEG): container finished" podID="190db242-23c6-4f24-9a8a-8ade65b9af33" containerID="faac4f9acd5ab1950bb35d770a359979aeedd9bc18a0c206fedd991f72d617e7" exitCode=0
Jul 06 19:58:44.217862 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:58:44.217747    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-60bec37b/e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87" event={"ID":"190db242-23c6-4f24-9a8a-8ade65b9af33","Type":"ContainerDied","Data":"faac4f9acd5ab1950bb35d770a359979aeedd9bc18a0c206fedd991f72d617e7"}
Jul 06 19:58:44.293710 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:58:44.293648    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-60bec37b/e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87"
Jul 06 19:58:44.318474 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:58:44.318447    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/190db242-23c6-4f24-9a8a-8ade65b9af33-home\") pod \"190db242-23c6-4f24-9a8a-8ade65b9af33\" (UID: \"190db242-23c6-4f24-9a8a-8ade65b9af33\") "
Jul 06 19:58:44.318612 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:58:44.318485    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/190db242-23c6-4f24-9a8a-8ade65b9af33-model-cache\") pod \"190db242-23c6-4f24-9a8a-8ade65b9af33\" (UID: \"190db242-23c6-4f24-9a8a-8ade65b9af33\") "
Jul 06 19:58:44.318612 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:58:44.318512    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/190db242-23c6-4f24-9a8a-8ade65b9af33-tmp-dir\") pod \"190db242-23c6-4f24-9a8a-8ade65b9af33\" (UID: \"190db242-23c6-4f24-9a8a-8ade65b9af33\") "
Jul 06 19:58:44.318612 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:58:44.318586    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/190db242-23c6-4f24-9a8a-8ade65b9af33-dshm\") pod \"190db242-23c6-4f24-9a8a-8ade65b9af33\" (UID: \"190db242-23c6-4f24-9a8a-8ade65b9af33\") "
Jul 06 19:58:44.318784 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:58:44.318614    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/190db242-23c6-4f24-9a8a-8ade65b9af33-tls-certs\") pod \"190db242-23c6-4f24-9a8a-8ade65b9af33\" (UID: \"190db242-23c6-4f24-9a8a-8ade65b9af33\") "
Jul 06 19:58:44.318784 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:58:44.318669    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zlwqb\" (UniqueName: \"kubernetes.io/projected/190db242-23c6-4f24-9a8a-8ade65b9af33-kube-api-access-zlwqb\") pod \"190db242-23c6-4f24-9a8a-8ade65b9af33\" (UID: \"190db242-23c6-4f24-9a8a-8ade65b9af33\") "
Jul 06 19:58:44.318784 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:58:44.318758    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/190db242-23c6-4f24-9a8a-8ade65b9af33-home" (OuterVolumeSpecName: "home") pod "190db242-23c6-4f24-9a8a-8ade65b9af33" (UID: "190db242-23c6-4f24-9a8a-8ade65b9af33"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:58:44.318961 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:58:44.318763    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/190db242-23c6-4f24-9a8a-8ade65b9af33-model-cache" (OuterVolumeSpecName: "model-cache") pod "190db242-23c6-4f24-9a8a-8ade65b9af33" (UID: "190db242-23c6-4f24-9a8a-8ade65b9af33"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:58:44.318961 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:58:44.318838    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/190db242-23c6-4f24-9a8a-8ade65b9af33-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "190db242-23c6-4f24-9a8a-8ade65b9af33" (UID: "190db242-23c6-4f24-9a8a-8ade65b9af33"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:58:44.319062 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:58:44.319044    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/190db242-23c6-4f24-9a8a-8ade65b9af33-home\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:58:44.319116 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:58:44.319064    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/190db242-23c6-4f24-9a8a-8ade65b9af33-model-cache\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:58:44.319116 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:58:44.319107    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/190db242-23c6-4f24-9a8a-8ade65b9af33-tmp-dir\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:58:44.321067 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:58:44.321037    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/190db242-23c6-4f24-9a8a-8ade65b9af33-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "190db242-23c6-4f24-9a8a-8ade65b9af33" (UID: "190db242-23c6-4f24-9a8a-8ade65b9af33"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:58:44.321237 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:58:44.321220    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/190db242-23c6-4f24-9a8a-8ade65b9af33-dshm" (OuterVolumeSpecName: "dshm") pod "190db242-23c6-4f24-9a8a-8ade65b9af33" (UID: "190db242-23c6-4f24-9a8a-8ade65b9af33"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:58:44.321296 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:58:44.321240    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/190db242-23c6-4f24-9a8a-8ade65b9af33-kube-api-access-zlwqb" (OuterVolumeSpecName: "kube-api-access-zlwqb") pod "190db242-23c6-4f24-9a8a-8ade65b9af33" (UID: "190db242-23c6-4f24-9a8a-8ade65b9af33"). InnerVolumeSpecName "kube-api-access-zlwqb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:58:44.419516 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:58:44.419481    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/190db242-23c6-4f24-9a8a-8ade65b9af33-dshm\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:58:44.419516 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:58:44.419511    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/190db242-23c6-4f24-9a8a-8ade65b9af33-tls-certs\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:58:44.419516 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:58:44.419523    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zlwqb\" (UniqueName: \"kubernetes.io/projected/190db242-23c6-4f24-9a8a-8ade65b9af33-kube-api-access-zlwqb\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:58:45.223412 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:58:45.223383    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-60bec37b/e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87"
Jul 06 19:58:45.223412 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:58:45.223392    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-60bec37b/e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87" event={"ID":"190db242-23c6-4f24-9a8a-8ade65b9af33","Type":"ContainerDied","Data":"a02bb5fc99c86189eca6eba823c52415aadbad3781f2a3c9adcef127eb77f2b2"}
Jul 06 19:58:45.223885 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:58:45.223452    2555 scope.go:117] "RemoveContainer" containerID="faac4f9acd5ab1950bb35d770a359979aeedd9bc18a0c206fedd991f72d617e7"
Jul 06 19:58:45.244077 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:58:45.244046    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-60bec37b/e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87"]
Jul 06 19:58:45.249435 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:58:45.249411    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-60bec37b/e2e-lifecycle-model-60bec37b-kserve-8569869675-6fn87"]
Jul 06 19:58:46.130734 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:58:46.130702    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="190db242-23c6-4f24-9a8a-8ade65b9af33" path="/var/lib/kubelet/pods/190db242-23c6-4f24-9a8a-8ade65b9af33/volumes"
Jul 06 19:59:05.358047 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:05.358007    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:06.466419 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:06.466388    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:08.480381 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:08.480347    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:59:12.129888 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:12.129854    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:12.194383 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:12.194346    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:17.512194 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:17.512159    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb"]
Jul 06 19:59:17.512582 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:17.512375    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb" podUID="7590e37f-a44c-43dd-871a-49fb31151182" containerName="istio-proxy" containerID="cri-o://d4af5d2cf3d8908698c14ea09bd485ffb3d5e5920d5d2f3357fc88e31095fb8f" gracePeriod=30
Jul 06 19:59:17.598693 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:17.598657    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:17.822071 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:17.822039    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:18.842893 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:18.842850    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:18.940254 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:18.940224    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:19.044694 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:19.044627    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:19.931056 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:19.931021    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:20.082103 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:20.082073    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:21.561368 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:21.561331    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:21.813945 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:21.813856    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:59:22.770480 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:22.770456    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb"
Jul 06 19:59:22.860857 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:22.860760    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7590e37f-a44c-43dd-871a-49fb31151182-istio-data\") pod \"7590e37f-a44c-43dd-871a-49fb31151182\" (UID: \"7590e37f-a44c-43dd-871a-49fb31151182\") "
Jul 06 19:59:22.860857 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:22.860801    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7590e37f-a44c-43dd-871a-49fb31151182-istio-podinfo\") pod \"7590e37f-a44c-43dd-871a-49fb31151182\" (UID: \"7590e37f-a44c-43dd-871a-49fb31151182\") "
Jul 06 19:59:22.860857 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:22.860819    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7590e37f-a44c-43dd-871a-49fb31151182-workload-socket\") pod \"7590e37f-a44c-43dd-871a-49fb31151182\" (UID: \"7590e37f-a44c-43dd-871a-49fb31151182\") "
Jul 06 19:59:22.860857 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:22.860849    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7590e37f-a44c-43dd-871a-49fb31151182-istiod-ca-cert\") pod \"7590e37f-a44c-43dd-871a-49fb31151182\" (UID: \"7590e37f-a44c-43dd-871a-49fb31151182\") "
Jul 06 19:59:22.861218 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:22.860888    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7590e37f-a44c-43dd-871a-49fb31151182-workload-certs\") pod \"7590e37f-a44c-43dd-871a-49fb31151182\" (UID: \"7590e37f-a44c-43dd-871a-49fb31151182\") "
Jul 06 19:59:22.861218 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:22.860940    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7590e37f-a44c-43dd-871a-49fb31151182-istio-envoy\") pod \"7590e37f-a44c-43dd-871a-49fb31151182\" (UID: \"7590e37f-a44c-43dd-871a-49fb31151182\") "
Jul 06 19:59:22.861218 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:22.860971    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdd8m\" (UniqueName: \"kubernetes.io/projected/7590e37f-a44c-43dd-871a-49fb31151182-kube-api-access-qdd8m\") pod \"7590e37f-a44c-43dd-871a-49fb31151182\" (UID: \"7590e37f-a44c-43dd-871a-49fb31151182\") "
Jul 06 19:59:22.861218 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:22.861020    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7590e37f-a44c-43dd-871a-49fb31151182-credential-socket\") pod \"7590e37f-a44c-43dd-871a-49fb31151182\" (UID: \"7590e37f-a44c-43dd-871a-49fb31151182\") "
Jul 06 19:59:22.861218 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:22.861073    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7590e37f-a44c-43dd-871a-49fb31151182-istio-token\") pod \"7590e37f-a44c-43dd-871a-49fb31151182\" (UID: \"7590e37f-a44c-43dd-871a-49fb31151182\") "
Jul 06 19:59:22.861218 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:22.861168    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7590e37f-a44c-43dd-871a-49fb31151182-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7590e37f-a44c-43dd-871a-49fb31151182" (UID: "7590e37f-a44c-43dd-871a-49fb31151182"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:59:22.861551 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:22.861213    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7590e37f-a44c-43dd-871a-49fb31151182-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7590e37f-a44c-43dd-871a-49fb31151182" (UID: "7590e37f-a44c-43dd-871a-49fb31151182"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:59:22.861551 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:22.861255    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7590e37f-a44c-43dd-871a-49fb31151182-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7590e37f-a44c-43dd-871a-49fb31151182" (UID: "7590e37f-a44c-43dd-871a-49fb31151182"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:59:22.861551 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:22.861343    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7590e37f-a44c-43dd-871a-49fb31151182-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7590e37f-a44c-43dd-871a-49fb31151182" (UID: "7590e37f-a44c-43dd-871a-49fb31151182"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:59:22.861551 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:22.861434    2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7590e37f-a44c-43dd-871a-49fb31151182-workload-socket\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:59:22.861551 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:22.861455    2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7590e37f-a44c-43dd-871a-49fb31151182-istiod-ca-cert\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:59:22.861551 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:22.861469    2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7590e37f-a44c-43dd-871a-49fb31151182-workload-certs\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:59:22.861551 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:22.861483    2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7590e37f-a44c-43dd-871a-49fb31151182-credential-socket\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:59:22.861932 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:22.861713    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7590e37f-a44c-43dd-871a-49fb31151182-istio-data" (OuterVolumeSpecName: "istio-data") pod "7590e37f-a44c-43dd-871a-49fb31151182" (UID: "7590e37f-a44c-43dd-871a-49fb31151182"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:59:22.863022 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:22.862996    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7590e37f-a44c-43dd-871a-49fb31151182-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7590e37f-a44c-43dd-871a-49fb31151182" (UID: "7590e37f-a44c-43dd-871a-49fb31151182"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 19:59:22.863256 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:22.863237    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7590e37f-a44c-43dd-871a-49fb31151182-istio-token" (OuterVolumeSpecName: "istio-token") pod "7590e37f-a44c-43dd-871a-49fb31151182" (UID: "7590e37f-a44c-43dd-871a-49fb31151182"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:59:22.863403 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:22.863381    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7590e37f-a44c-43dd-871a-49fb31151182-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7590e37f-a44c-43dd-871a-49fb31151182" (UID: "7590e37f-a44c-43dd-871a-49fb31151182"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:59:22.863456 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:22.863434    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7590e37f-a44c-43dd-871a-49fb31151182-kube-api-access-qdd8m" (OuterVolumeSpecName: "kube-api-access-qdd8m") pod "7590e37f-a44c-43dd-871a-49fb31151182" (UID: "7590e37f-a44c-43dd-871a-49fb31151182"). InnerVolumeSpecName "kube-api-access-qdd8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:59:22.962904 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:22.962866    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdd8m\" (UniqueName: \"kubernetes.io/projected/7590e37f-a44c-43dd-871a-49fb31151182-kube-api-access-qdd8m\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:59:22.962904 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:22.962898    2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7590e37f-a44c-43dd-871a-49fb31151182-istio-token\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:59:22.962904 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:22.962937    2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7590e37f-a44c-43dd-871a-49fb31151182-istio-data\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:59:22.963163 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:22.962946    2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7590e37f-a44c-43dd-871a-49fb31151182-istio-podinfo\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:59:22.963163 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:22.962954    2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7590e37f-a44c-43dd-871a-49fb31151182-istio-envoy\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 19:59:23.413733 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:23.413697    2555 generic.go:356] "Generic (PLEG): container finished" podID="7590e37f-a44c-43dd-871a-49fb31151182" containerID="d4af5d2cf3d8908698c14ea09bd485ffb3d5e5920d5d2f3357fc88e31095fb8f" exitCode=0
Jul 06 19:59:23.413959 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:23.413749    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb"
Jul 06 19:59:23.413959 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:23.413786    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb" event={"ID":"7590e37f-a44c-43dd-871a-49fb31151182","Type":"ContainerDied","Data":"d4af5d2cf3d8908698c14ea09bd485ffb3d5e5920d5d2f3357fc88e31095fb8f"}
Jul 06 19:59:23.413959 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:23.413842    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb" event={"ID":"7590e37f-a44c-43dd-871a-49fb31151182","Type":"ContainerDied","Data":"dd285f7c77ddf7e6680f724d57c226c291e3a2912f5c6506bdb5c000b6db586f"}
Jul 06 19:59:23.413959 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:23.413870    2555 scope.go:117] "RemoveContainer" containerID="d4af5d2cf3d8908698c14ea09bd485ffb3d5e5920d5d2f3357fc88e31095fb8f"
Jul 06 19:59:23.425854 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:23.425833    2555 scope.go:117] "RemoveContainer" containerID="3fce73a5fc01e6c7493af3e13cf364d7e09e65663dc86d05ba9d4afee260067e"
Jul 06 19:59:23.434525 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:23.434501    2555 scope.go:117] "RemoveContainer" containerID="d4af5d2cf3d8908698c14ea09bd485ffb3d5e5920d5d2f3357fc88e31095fb8f"
Jul 06 19:59:23.434797 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:59:23.434779    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4af5d2cf3d8908698c14ea09bd485ffb3d5e5920d5d2f3357fc88e31095fb8f\": container with ID starting with d4af5d2cf3d8908698c14ea09bd485ffb3d5e5920d5d2f3357fc88e31095fb8f not found: ID does not exist" containerID="d4af5d2cf3d8908698c14ea09bd485ffb3d5e5920d5d2f3357fc88e31095fb8f"
Jul 06 19:59:23.434850 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:23.434806    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4af5d2cf3d8908698c14ea09bd485ffb3d5e5920d5d2f3357fc88e31095fb8f"} err="failed to get container status \"d4af5d2cf3d8908698c14ea09bd485ffb3d5e5920d5d2f3357fc88e31095fb8f\": rpc error: code = NotFound desc = could not find container \"d4af5d2cf3d8908698c14ea09bd485ffb3d5e5920d5d2f3357fc88e31095fb8f\": container with ID starting with d4af5d2cf3d8908698c14ea09bd485ffb3d5e5920d5d2f3357fc88e31095fb8f not found: ID does not exist"
Jul 06 19:59:23.434850 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:23.434823    2555 scope.go:117] "RemoveContainer" containerID="3fce73a5fc01e6c7493af3e13cf364d7e09e65663dc86d05ba9d4afee260067e"
Jul 06 19:59:23.435075 ip-10-0-131-150 kubenswrapper[2555]: E0706 19:59:23.435057    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fce73a5fc01e6c7493af3e13cf364d7e09e65663dc86d05ba9d4afee260067e\": container with ID starting with 3fce73a5fc01e6c7493af3e13cf364d7e09e65663dc86d05ba9d4afee260067e not found: ID does not exist" containerID="3fce73a5fc01e6c7493af3e13cf364d7e09e65663dc86d05ba9d4afee260067e"
Jul 06 19:59:23.435122 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:23.435082    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fce73a5fc01e6c7493af3e13cf364d7e09e65663dc86d05ba9d4afee260067e"} err="failed to get container status \"3fce73a5fc01e6c7493af3e13cf364d7e09e65663dc86d05ba9d4afee260067e\": rpc error: code = NotFound desc = could not find container \"3fce73a5fc01e6c7493af3e13cf364d7e09e65663dc86d05ba9d4afee260067e\": container with ID starting with 3fce73a5fc01e6c7493af3e13cf364d7e09e65663dc86d05ba9d4afee260067e not found: ID does not exist"
Jul 06 19:59:23.451316 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:23.451280    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb"]
Jul 06 19:59:23.465496 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:23.465469    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-60bec37b-openshift-default-7b9c57f4b7-rkrbb"]
Jul 06 19:59:24.129669 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:24.129634    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7590e37f-a44c-43dd-871a-49fb31151182" path="/var/lib/kubelet/pods/7590e37f-a44c-43dd-871a-49fb31151182/volumes"
Jul 06 19:59:27.394438 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:27.394401    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:27.494394 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:27.494362    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:28.197812 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:28.197753    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:32.331659 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:32.331629    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:32.432396 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:32.432360    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:34.220230 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:34.220199    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:34.317342 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:34.317310    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:34.422220 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:34.422186    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:34.889402 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:34.889368    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 19:59:39.953583 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:39.953552    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:45.010645 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:45.010613    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:45.455606 ip-10-0-131-150 kubenswrapper[2555]: I0706 19:59:45.455570    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:00.152657 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:00.152621    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29722800-5pmzb"]
Jul 06 20:00:00.153061 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:00.152983    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7590e37f-a44c-43dd-871a-49fb31151182" containerName="istio-proxy"
Jul 06 20:00:00.153061 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:00.152994    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="7590e37f-a44c-43dd-871a-49fb31151182" containerName="istio-proxy"
Jul 06 20:00:00.153061 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:00.153003    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7590e37f-a44c-43dd-871a-49fb31151182" containerName="istio-proxy"
Jul 06 20:00:00.153061 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:00.153009    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="7590e37f-a44c-43dd-871a-49fb31151182" containerName="istio-proxy"
Jul 06 20:00:00.153061 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:00.153015    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="190db242-23c6-4f24-9a8a-8ade65b9af33" containerName="main"
Jul 06 20:00:00.153061 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:00.153020    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="190db242-23c6-4f24-9a8a-8ade65b9af33" containerName="main"
Jul 06 20:00:00.153304 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:00.153065    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="7590e37f-a44c-43dd-871a-49fb31151182" containerName="istio-proxy"
Jul 06 20:00:00.153304 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:00.153074    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="190db242-23c6-4f24-9a8a-8ade65b9af33" containerName="main"
Jul 06 20:00:00.153304 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:00.153081    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="7590e37f-a44c-43dd-871a-49fb31151182" containerName="istio-proxy"
Jul 06 20:00:00.155860 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:00.155843    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722800-5pmzb"
Jul 06 20:00:00.162237 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:00.162210    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-ghqtd\""
Jul 06 20:00:00.166818 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:00.166792    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722800-5pmzb"]
Jul 06 20:00:00.262869 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:00.262828    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2x7l5\" (UniqueName: \"kubernetes.io/projected/80d08180-e0c1-431b-b1b0-85f7c200269a-kube-api-access-2x7l5\") pod \"maas-api-key-cleanup-29722800-5pmzb\" (UID: \"80d08180-e0c1-431b-b1b0-85f7c200269a\") " pod="opendatahub/maas-api-key-cleanup-29722800-5pmzb"
Jul 06 20:00:00.364575 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:00.364530    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2x7l5\" (UniqueName: \"kubernetes.io/projected/80d08180-e0c1-431b-b1b0-85f7c200269a-kube-api-access-2x7l5\") pod \"maas-api-key-cleanup-29722800-5pmzb\" (UID: \"80d08180-e0c1-431b-b1b0-85f7c200269a\") " pod="opendatahub/maas-api-key-cleanup-29722800-5pmzb"
Jul 06 20:00:00.373145 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:00.373111    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x7l5\" (UniqueName: \"kubernetes.io/projected/80d08180-e0c1-431b-b1b0-85f7c200269a-kube-api-access-2x7l5\") pod \"maas-api-key-cleanup-29722800-5pmzb\" (UID: \"80d08180-e0c1-431b-b1b0-85f7c200269a\") " pod="opendatahub/maas-api-key-cleanup-29722800-5pmzb"
Jul 06 20:00:00.473373 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:00.473284    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722800-5pmzb"
Jul 06 20:00:00.809680 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:00.809656    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722800-5pmzb"]
Jul 06 20:00:00.811746 ip-10-0-131-150 kubenswrapper[2555]: W0706 20:00:00.811710    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80d08180_e0c1_431b_b1b0_85f7c200269a.slice/crio-e442196b8eb213475b04499a0c6656f6b2a2b84730d5d7d602c21cb34430462e WatchSource:0}: Error finding container e442196b8eb213475b04499a0c6656f6b2a2b84730d5d7d602c21cb34430462e: Status 404 returned error can't find the container with id e442196b8eb213475b04499a0c6656f6b2a2b84730d5d7d602c21cb34430462e
Jul 06 20:00:01.601237 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:01.601202    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722800-5pmzb" event={"ID":"80d08180-e0c1-431b-b1b0-85f7c200269a","Type":"ContainerStarted","Data":"b5eccac426409bbaad2552012f8ab685a7531c84bce7ba48bbc980f511d86013"}
Jul 06 20:00:01.601629 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:01.601263    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722800-5pmzb" event={"ID":"80d08180-e0c1-431b-b1b0-85f7c200269a","Type":"ContainerStarted","Data":"e442196b8eb213475b04499a0c6656f6b2a2b84730d5d7d602c21cb34430462e"}
Jul 06 20:00:01.618780 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:01.618726    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29722800-5pmzb" podStartSLOduration=1.618705895 podStartE2EDuration="1.618705895s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:00:01.617112777 +0000 UTC m=+2059.393146176" watchObservedRunningTime="2026-07-06 20:00:01.618705895 +0000 UTC m=+2059.394739294"
Jul 06 20:00:02.607369 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:02.607334    2555 generic.go:356] "Generic (PLEG): container finished" podID="80d08180-e0c1-431b-b1b0-85f7c200269a" containerID="b5eccac426409bbaad2552012f8ab685a7531c84bce7ba48bbc980f511d86013" exitCode=0
Jul 06 20:00:02.607785 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:02.607432    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722800-5pmzb" event={"ID":"80d08180-e0c1-431b-b1b0-85f7c200269a","Type":"ContainerDied","Data":"b5eccac426409bbaad2552012f8ab685a7531c84bce7ba48bbc980f511d86013"}
Jul 06 20:00:03.745430 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:03.745400    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722800-5pmzb"
Jul 06 20:00:03.896631 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:03.896524    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2x7l5\" (UniqueName: \"kubernetes.io/projected/80d08180-e0c1-431b-b1b0-85f7c200269a-kube-api-access-2x7l5\") pod \"80d08180-e0c1-431b-b1b0-85f7c200269a\" (UID: \"80d08180-e0c1-431b-b1b0-85f7c200269a\") "
Jul 06 20:00:03.898625 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:03.898597    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80d08180-e0c1-431b-b1b0-85f7c200269a-kube-api-access-2x7l5" (OuterVolumeSpecName: "kube-api-access-2x7l5") pod "80d08180-e0c1-431b-b1b0-85f7c200269a" (UID: "80d08180-e0c1-431b-b1b0-85f7c200269a"). InnerVolumeSpecName "kube-api-access-2x7l5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:00:03.997553 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:03.997474    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2x7l5\" (UniqueName: \"kubernetes.io/projected/80d08180-e0c1-431b-b1b0-85f7c200269a-kube-api-access-2x7l5\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:00:04.617223 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:04.617190    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722800-5pmzb" event={"ID":"80d08180-e0c1-431b-b1b0-85f7c200269a","Type":"ContainerDied","Data":"e442196b8eb213475b04499a0c6656f6b2a2b84730d5d7d602c21cb34430462e"}
Jul 06 20:00:04.617223 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:04.617218    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722800-5pmzb"
Jul 06 20:00:04.617493 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:04.617239    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e442196b8eb213475b04499a0c6656f6b2a2b84730d5d7d602c21cb34430462e"
Jul 06 20:00:06.818467 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:06.818438    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:12.525520 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:12.525484    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:12.589549 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:12.589512    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:12.888432 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:12.888353    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:13.192507 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:13.192413    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h"]
Jul 06 20:00:13.192892 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:13.192872    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80d08180-e0c1-431b-b1b0-85f7c200269a" containerName="cleanup"
Jul 06 20:00:13.193004 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:13.192895    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="80d08180-e0c1-431b-b1b0-85f7c200269a" containerName="cleanup"
Jul 06 20:00:13.193004 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:13.193001    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="80d08180-e0c1-431b-b1b0-85f7c200269a" containerName="cleanup"
Jul 06 20:00:13.196134 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:13.196113    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h"
Jul 06 20:00:13.198809 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:13.198789    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-b05069-openshift-default-dockercfg-4dg5n\""
Jul 06 20:00:13.208445 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:13.208421    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h"]
Jul 06 20:00:13.216522 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:13.216496    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:13.279902 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:13.279856    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5nj8\" (UniqueName: \"kubernetes.io/projected/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-kube-api-access-p5nj8\") pod \"e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h\" (UID: \"04e13e77-a359-4421-a9a1-6b9b1fbfa47e\") " pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h"
Jul 06 20:00:13.280128 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:13.279950    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-workload-certs\") pod \"e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h\" (UID: \"04e13e77-a359-4421-a9a1-6b9b1fbfa47e\") " pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h"
Jul 06 20:00:13.280128 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:13.279977    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-istio-data\") pod \"e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h\" (UID: \"04e13e77-a359-4421-a9a1-6b9b1fbfa47e\") " pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h"
Jul 06 20:00:13.280128 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:13.280016    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-credential-socket\") pod \"e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h\" (UID: \"04e13e77-a359-4421-a9a1-6b9b1fbfa47e\") " pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h"
Jul 06 20:00:13.280128 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:13.280072    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-workload-socket\") pod \"e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h\" (UID: \"04e13e77-a359-4421-a9a1-6b9b1fbfa47e\") " pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h"
Jul 06 20:00:13.280128 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:13.280105    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-istio-podinfo\") pod \"e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h\" (UID: \"04e13e77-a359-4421-a9a1-6b9b1fbfa47e\") " pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h"
Jul 06 20:00:13.280350 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:13.280145    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-istio-token\") pod \"e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h\" (UID: \"04e13e77-a359-4421-a9a1-6b9b1fbfa47e\") " pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h"
Jul 06 20:00:13.280350 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:13.280170    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-istiod-ca-cert\") pod \"e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h\" (UID: \"04e13e77-a359-4421-a9a1-6b9b1fbfa47e\") " pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h"
Jul 06 20:00:13.280350 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:13.280199    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-istio-envoy\") pod \"e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h\" (UID: \"04e13e77-a359-4421-a9a1-6b9b1fbfa47e\") " pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h"
Jul 06 20:00:13.315895 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:13.315841    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:13.381125 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:13.381093    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5nj8\" (UniqueName: \"kubernetes.io/projected/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-kube-api-access-p5nj8\") pod \"e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h\" (UID: \"04e13e77-a359-4421-a9a1-6b9b1fbfa47e\") " pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h"
Jul 06 20:00:13.381343 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:13.381138    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-workload-certs\") pod \"e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h\" (UID: \"04e13e77-a359-4421-a9a1-6b9b1fbfa47e\") " pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h"
Jul 06 20:00:13.381343 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:13.381159    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-istio-data\") pod \"e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h\" (UID: \"04e13e77-a359-4421-a9a1-6b9b1fbfa47e\") " pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h"
Jul 06 20:00:13.381343 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:13.381198    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-credential-socket\") pod \"e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h\" (UID: \"04e13e77-a359-4421-a9a1-6b9b1fbfa47e\") " pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h"
Jul 06 20:00:13.381343 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:13.381227    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-workload-socket\") pod \"e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h\" (UID: \"04e13e77-a359-4421-a9a1-6b9b1fbfa47e\") " pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h"
Jul 06 20:00:13.381343 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:13.381261    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-istio-podinfo\") pod \"e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h\" (UID: \"04e13e77-a359-4421-a9a1-6b9b1fbfa47e\") " pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h"
Jul 06 20:00:13.381343 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:13.381304    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-istio-token\") pod \"e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h\" (UID: \"04e13e77-a359-4421-a9a1-6b9b1fbfa47e\") " pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h"
Jul 06 20:00:13.381343 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:13.381327    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-istiod-ca-cert\") pod \"e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h\" (UID: \"04e13e77-a359-4421-a9a1-6b9b1fbfa47e\") " pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h"
Jul 06 20:00:13.381744 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:13.381357    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-istio-envoy\") pod \"e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h\" (UID: \"04e13e77-a359-4421-a9a1-6b9b1fbfa47e\") " pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h"
Jul 06 20:00:13.381744 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:13.381623    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-workload-certs\") pod \"e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h\" (UID: \"04e13e77-a359-4421-a9a1-6b9b1fbfa47e\") " pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h"
Jul 06 20:00:13.381744 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:13.381711    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-istio-data\") pod \"e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h\" (UID: \"04e13e77-a359-4421-a9a1-6b9b1fbfa47e\") " pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h"
Jul 06 20:00:13.382220 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:13.382175    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-workload-socket\") pod \"e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h\" (UID: \"04e13e77-a359-4421-a9a1-6b9b1fbfa47e\") " pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h"
Jul 06 20:00:13.382561 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:13.382533    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-istiod-ca-cert\") pod \"e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h\" (UID: \"04e13e77-a359-4421-a9a1-6b9b1fbfa47e\") " pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h"
Jul 06 20:00:13.382742 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:13.382630    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-credential-socket\") pod \"e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h\" (UID: \"04e13e77-a359-4421-a9a1-6b9b1fbfa47e\") " pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h"
Jul 06 20:00:13.384197 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:13.384177    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-istio-envoy\") pod \"e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h\" (UID: \"04e13e77-a359-4421-a9a1-6b9b1fbfa47e\") " pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h"
Jul 06 20:00:13.384308 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:13.384178    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-istio-podinfo\") pod \"e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h\" (UID: \"04e13e77-a359-4421-a9a1-6b9b1fbfa47e\") " pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h"
Jul 06 20:00:13.389691 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:13.389659    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-istio-token\") pod \"e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h\" (UID: \"04e13e77-a359-4421-a9a1-6b9b1fbfa47e\") " pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h"
Jul 06 20:00:13.389868 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:13.389848    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5nj8\" (UniqueName: \"kubernetes.io/projected/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-kube-api-access-p5nj8\") pod \"e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h\" (UID: \"04e13e77-a359-4421-a9a1-6b9b1fbfa47e\") " pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h"
Jul 06 20:00:13.506826 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:13.506721    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h"
Jul 06 20:00:13.641315 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:13.641286    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h"]
Jul 06 20:00:13.643043 ip-10-0-131-150 kubenswrapper[2555]: W0706 20:00:13.643012    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04e13e77_a359_4421_a9a1_6b9b1fbfa47e.slice/crio-3c1caa59ebbd299f03fb789f6bddc7a1d88f7e1b0674c51b82c6792a3a4a3ce1 WatchSource:0}: Error finding container 3c1caa59ebbd299f03fb789f6bddc7a1d88f7e1b0674c51b82c6792a3a4a3ce1: Status 404 returned error can't find the container with id 3c1caa59ebbd299f03fb789f6bddc7a1d88f7e1b0674c51b82c6792a3a4a3ce1
Jul 06 20:00:13.645168 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:13.645130    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:00:13.645274 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:13.645215    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:00:13.645318 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:13.645268    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:00:13.661155 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:13.661125    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h" event={"ID":"04e13e77-a359-4421-a9a1-6b9b1fbfa47e","Type":"ContainerStarted","Data":"3c1caa59ebbd299f03fb789f6bddc7a1d88f7e1b0674c51b82c6792a3a4a3ce1"}
Jul 06 20:00:14.667329 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:14.667294    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h" event={"ID":"04e13e77-a359-4421-a9a1-6b9b1fbfa47e","Type":"ContainerStarted","Data":"c4b15e2bad10cef588a615aac5f0a9c0e9fd8282a22151df7ba676cdaf3c3a5d"}
Jul 06 20:00:14.689388 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:14.689334    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h" podStartSLOduration=1.6893148679999999 podStartE2EDuration="1.689314868s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:00:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:00:14.687481969 +0000 UTC m=+2072.463515368" watchObservedRunningTime="2026-07-06 20:00:14.689314868 +0000 UTC m=+2072.465348244"
Jul 06 20:00:15.507631 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:15.507593    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h"
Jul 06 20:00:15.512464 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:15.512441    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h"
Jul 06 20:00:15.672083 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:15.672056    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h"
Jul 06 20:00:15.672845 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:15.672826    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h"
Jul 06 20:00:16.806218 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:16.806177    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:16.907816 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:16.907775    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:17.004475 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:17.004446    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:17.465854 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:17.465816    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:17.759691 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:17.759606    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:17.861399 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:17.861368    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:21.276157 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:21.276121    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:21.651541 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:21.651449    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:21.967822 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:21.967740    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk"]
Jul 06 20:00:21.971000 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:21.970981    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk"
Jul 06 20:00:21.974580 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:21.974552    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-66d504-openshift-default-dockercfg-vtzdc\""
Jul 06 20:00:21.987782 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:21.987758    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk"]
Jul 06 20:00:22.014180 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:22.014148    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:22.109576 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:22.109533    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:22.157807 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:22.157769    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-istio-token\") pod \"e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk\" (UID: \"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad\") " pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk"
Jul 06 20:00:22.157807 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:22.157809    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-istio-envoy\") pod \"e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk\" (UID: \"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad\") " pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk"
Jul 06 20:00:22.158121 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:22.157841    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-istio-podinfo\") pod \"e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk\" (UID: \"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad\") " pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk"
Jul 06 20:00:22.158121 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:22.157896    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pxgf\" (UniqueName: \"kubernetes.io/projected/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-kube-api-access-9pxgf\") pod \"e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk\" (UID: \"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad\") " pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk"
Jul 06 20:00:22.158121 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:22.158012    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-credential-socket\") pod \"e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk\" (UID: \"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad\") " pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk"
Jul 06 20:00:22.158121 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:22.158047    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-workload-certs\") pod \"e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk\" (UID: \"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad\") " pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk"
Jul 06 20:00:22.158121 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:22.158084    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-istiod-ca-cert\") pod \"e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk\" (UID: \"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad\") " pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk"
Jul 06 20:00:22.158342 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:22.158126    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-workload-socket\") pod \"e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk\" (UID: \"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad\") " pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk"
Jul 06 20:00:22.158342 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:22.158165    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-istio-data\") pod \"e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk\" (UID: \"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad\") " pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk"
Jul 06 20:00:22.259032 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:22.258904    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-workload-certs\") pod \"e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk\" (UID: \"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad\") " pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk"
Jul 06 20:00:22.259032 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:22.258988    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-istiod-ca-cert\") pod \"e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk\" (UID: \"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad\") " pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk"
Jul 06 20:00:22.259032 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:22.259023    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-workload-socket\") pod \"e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk\" (UID: \"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad\") " pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk"
Jul 06 20:00:22.259333 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:22.259060    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-istio-data\") pod \"e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk\" (UID: \"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad\") " pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk"
Jul 06 20:00:22.259333 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:22.259187    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-istio-token\") pod \"e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk\" (UID: \"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad\") " pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk"
Jul 06 20:00:22.259333 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:22.259251    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-istio-envoy\") pod \"e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk\" (UID: \"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad\") " pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk"
Jul 06 20:00:22.259333 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:22.259296    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-istio-podinfo\") pod \"e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk\" (UID: \"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad\") " pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk"
Jul 06 20:00:22.259333 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:22.259320    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-workload-certs\") pod \"e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk\" (UID: \"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad\") " pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk"
Jul 06 20:00:22.259333 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:22.259330    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pxgf\" (UniqueName: \"kubernetes.io/projected/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-kube-api-access-9pxgf\") pod \"e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk\" (UID: \"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad\") " pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk"
Jul 06 20:00:22.259661 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:22.259415    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-workload-socket\") pod \"e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk\" (UID: \"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad\") " pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk"
Jul 06 20:00:22.259712 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:22.259440    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-credential-socket\") pod \"e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk\" (UID: \"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad\") " pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk"
Jul 06 20:00:22.259764 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:22.259562    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-istio-data\") pod \"e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk\" (UID: \"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad\") " pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk"
Jul 06 20:00:22.259871 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:22.259852    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-istiod-ca-cert\") pod \"e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk\" (UID: \"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad\") " pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk"
Jul 06 20:00:22.259991 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:22.259973    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-credential-socket\") pod \"e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk\" (UID: \"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad\") " pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk"
Jul 06 20:00:22.261656 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:22.261632    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-istio-envoy\") pod \"e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk\" (UID: \"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad\") " pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk"
Jul 06 20:00:22.262080 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:22.262062    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-istio-podinfo\") pod \"e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk\" (UID: \"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad\") " pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk"
Jul 06 20:00:22.270747 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:22.270708    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pxgf\" (UniqueName: \"kubernetes.io/projected/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-kube-api-access-9pxgf\") pod \"e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk\" (UID: \"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad\") " pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk"
Jul 06 20:00:22.270979 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:22.270956    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-istio-token\") pod \"e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk\" (UID: \"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad\") " pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk"
Jul 06 20:00:22.281887 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:22.281865    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk"
Jul 06 20:00:22.425888 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:22.425857    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk"]
Jul 06 20:00:22.427353 ip-10-0-131-150 kubenswrapper[2555]: W0706 20:00:22.427313    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbea66ecf_2d35_478a_9ab3_3f1593b4a2ad.slice/crio-89e09f301ef1bb3f62a6fddd42ed29edc648f4cf7bf00cbe69a13f82c8d463f6 WatchSource:0}: Error finding container 89e09f301ef1bb3f62a6fddd42ed29edc648f4cf7bf00cbe69a13f82c8d463f6: Status 404 returned error can't find the container with id 89e09f301ef1bb3f62a6fddd42ed29edc648f4cf7bf00cbe69a13f82c8d463f6
Jul 06 20:00:22.431002 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:22.430101    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:00:22.431002 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:22.430260    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:00:22.431002 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:22.430348    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:00:22.682347 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:22.682306    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 20:00:22.707384 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:22.707350    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk" event={"ID":"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad","Type":"ContainerStarted","Data":"c69d75385c9710d2d5a64029797c0543f80db727dbf1a0d040579c102ff283b5"}
Jul 06 20:00:22.707582 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:22.707409    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk" event={"ID":"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad","Type":"ContainerStarted","Data":"89e09f301ef1bb3f62a6fddd42ed29edc648f4cf7bf00cbe69a13f82c8d463f6"}
Jul 06 20:00:22.731165 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:22.731114    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk" podStartSLOduration=1.731098436 podStartE2EDuration="1.731098436s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:00:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:00:22.728124152 +0000 UTC m=+2080.504157570" watchObservedRunningTime="2026-07-06 20:00:22.731098436 +0000 UTC m=+2080.507131835"
Jul 06 20:00:23.283086 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:23.283046    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk"
Jul 06 20:00:23.284563 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:23.284534    2555 patch_prober.go:28] interesting pod/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 06 20:00:23.284673 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:23.284606    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk" podUID="bea66ecf-2d35-478a-9ab3-3f1593b4a2ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 06 20:00:24.285942 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:24.285899    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk"
Jul 06 20:00:24.719229 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:24.719141    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk"
Jul 06 20:00:24.727156 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:24.727125    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk"
Jul 06 20:00:25.393492 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:25.393447    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:25.542742 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:25.542704    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:25.774486 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:25.774456    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:29.285321 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:29.285287    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:30.673900 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:30.673822    2555 patch_prober.go:28] interesting pod/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 06 20:00:30.673900 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:30.673887    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h" podUID="04e13e77-a359-4421-a9a1-6b9b1fbfa47e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 06 20:00:30.756546 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:30.756513    2555 generic.go:356] "Generic (PLEG): container finished" podID="04e13e77-a359-4421-a9a1-6b9b1fbfa47e" containerID="c4b15e2bad10cef588a615aac5f0a9c0e9fd8282a22151df7ba676cdaf3c3a5d" exitCode=0
Jul 06 20:00:30.756718 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:30.756576    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h" event={"ID":"04e13e77-a359-4421-a9a1-6b9b1fbfa47e","Type":"ContainerDied","Data":"c4b15e2bad10cef588a615aac5f0a9c0e9fd8282a22151df7ba676cdaf3c3a5d"}
Jul 06 20:00:30.756966 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:30.756952    2555 scope.go:117] "RemoveContainer" containerID="c4b15e2bad10cef588a615aac5f0a9c0e9fd8282a22151df7ba676cdaf3c3a5d"
Jul 06 20:00:30.757962 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:30.757935    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:00:30.758020 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:30.758001    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:00:30.758058 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:30.758035    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:00:31.762974 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:31.762936    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h" event={"ID":"04e13e77-a359-4421-a9a1-6b9b1fbfa47e","Type":"ContainerStarted","Data":"6cecd7a234b04e7791b58bdc487a6b4e969f0380fd0cb60f2dd9887d94d3beb7"}
Jul 06 20:00:32.507426 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:32.507392    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h"
Jul 06 20:00:32.507597 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:32.507563    2555 patch_prober.go:28] interesting pod/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 06 20:00:32.507677 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:32.507616    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h" podUID="04e13e77-a359-4421-a9a1-6b9b1fbfa47e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 06 20:00:33.313239 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:33.313196    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 20:00:33.508204 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:33.508164    2555 patch_prober.go:28] interesting pod/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 06 20:00:33.508374 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:33.508228    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h" podUID="04e13e77-a359-4421-a9a1-6b9b1fbfa47e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 06 20:00:34.507370 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:34.507334    2555 patch_prober.go:28] interesting pod/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 06 20:00:34.507760 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:34.507388    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h" podUID="04e13e77-a359-4421-a9a1-6b9b1fbfa47e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 06 20:00:35.508129 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:35.508092    2555 patch_prober.go:28] interesting pod/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 06 20:00:35.508505 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:35.508152    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h" podUID="04e13e77-a359-4421-a9a1-6b9b1fbfa47e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 06 20:00:35.786248 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:35.786213    2555 generic.go:356] "Generic (PLEG): container finished" podID="bea66ecf-2d35-478a-9ab3-3f1593b4a2ad" containerID="c69d75385c9710d2d5a64029797c0543f80db727dbf1a0d040579c102ff283b5" exitCode=0
Jul 06 20:00:35.786490 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:35.786290    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk" event={"ID":"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad","Type":"ContainerDied","Data":"c69d75385c9710d2d5a64029797c0543f80db727dbf1a0d040579c102ff283b5"}
Jul 06 20:00:35.786761 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:35.786745    2555 scope.go:117] "RemoveContainer" containerID="c69d75385c9710d2d5a64029797c0543f80db727dbf1a0d040579c102ff283b5"
Jul 06 20:00:35.787770 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:35.787745    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:00:35.787826 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:35.787818    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:00:35.787862 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:35.787848    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:00:35.888498 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:35.888470    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-b05069/test-model-b05069-kserve-b86856645-q84s5"]
Jul 06 20:00:35.892350 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:35.892327    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-b05069/test-model-b05069-kserve-b86856645-q84s5"
Jul 06 20:00:35.894817 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:35.894788    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-b05069\"/\"test-model-b05069-kserve-self-signed-certs\""
Jul 06 20:00:35.894971 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:35.894851    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-b05069\"/\"default-dockercfg-xfvh4\""
Jul 06 20:00:35.894971 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:35.894851    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-b05069\"/\"openshift-service-ca.crt\""
Jul 06 20:00:35.894971 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:35.894856    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-b05069\"/\"kube-root-ca.crt\""
Jul 06 20:00:35.902846 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:35.902784    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-b05069/test-model-b05069-kserve-b86856645-q84s5"]
Jul 06 20:00:35.923653 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:35.923508    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:35.992224 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:35.992182    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68443e5d-d257-42ab-865c-6682779306bf-tmp-dir\") pod \"test-model-b05069-kserve-b86856645-q84s5\" (UID: \"68443e5d-d257-42ab-865c-6682779306bf\") " pod="ai-tenant-e2e-inf-a-b05069/test-model-b05069-kserve-b86856645-q84s5"
Jul 06 20:00:35.992424 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:35.992275    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68443e5d-d257-42ab-865c-6682779306bf-tls-certs\") pod \"test-model-b05069-kserve-b86856645-q84s5\" (UID: \"68443e5d-d257-42ab-865c-6682779306bf\") " pod="ai-tenant-e2e-inf-a-b05069/test-model-b05069-kserve-b86856645-q84s5"
Jul 06 20:00:35.992424 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:35.992317    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68443e5d-d257-42ab-865c-6682779306bf-home\") pod \"test-model-b05069-kserve-b86856645-q84s5\" (UID: \"68443e5d-d257-42ab-865c-6682779306bf\") " pod="ai-tenant-e2e-inf-a-b05069/test-model-b05069-kserve-b86856645-q84s5"
Jul 06 20:00:35.992424 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:35.992340    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-477ck\" (UniqueName: \"kubernetes.io/projected/68443e5d-d257-42ab-865c-6682779306bf-kube-api-access-477ck\") pod \"test-model-b05069-kserve-b86856645-q84s5\" (UID: \"68443e5d-d257-42ab-865c-6682779306bf\") " pod="ai-tenant-e2e-inf-a-b05069/test-model-b05069-kserve-b86856645-q84s5"
Jul 06 20:00:35.992424 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:35.992397    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68443e5d-d257-42ab-865c-6682779306bf-dshm\") pod \"test-model-b05069-kserve-b86856645-q84s5\" (UID: \"68443e5d-d257-42ab-865c-6682779306bf\") " pod="ai-tenant-e2e-inf-a-b05069/test-model-b05069-kserve-b86856645-q84s5"
Jul 06 20:00:35.992649 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:35.992475    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68443e5d-d257-42ab-865c-6682779306bf-model-cache\") pod \"test-model-b05069-kserve-b86856645-q84s5\" (UID: \"68443e5d-d257-42ab-865c-6682779306bf\") " pod="ai-tenant-e2e-inf-a-b05069/test-model-b05069-kserve-b86856645-q84s5"
Jul 06 20:00:36.093775 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:36.093690    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68443e5d-d257-42ab-865c-6682779306bf-tls-certs\") pod \"test-model-b05069-kserve-b86856645-q84s5\" (UID: \"68443e5d-d257-42ab-865c-6682779306bf\") " pod="ai-tenant-e2e-inf-a-b05069/test-model-b05069-kserve-b86856645-q84s5"
Jul 06 20:00:36.093775 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:36.093738    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68443e5d-d257-42ab-865c-6682779306bf-home\") pod \"test-model-b05069-kserve-b86856645-q84s5\" (UID: \"68443e5d-d257-42ab-865c-6682779306bf\") " pod="ai-tenant-e2e-inf-a-b05069/test-model-b05069-kserve-b86856645-q84s5"
Jul 06 20:00:36.093775 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:36.093755    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-477ck\" (UniqueName: \"kubernetes.io/projected/68443e5d-d257-42ab-865c-6682779306bf-kube-api-access-477ck\") pod \"test-model-b05069-kserve-b86856645-q84s5\" (UID: \"68443e5d-d257-42ab-865c-6682779306bf\") " pod="ai-tenant-e2e-inf-a-b05069/test-model-b05069-kserve-b86856645-q84s5"
Jul 06 20:00:36.093775 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:36.093774    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68443e5d-d257-42ab-865c-6682779306bf-dshm\") pod \"test-model-b05069-kserve-b86856645-q84s5\" (UID: \"68443e5d-d257-42ab-865c-6682779306bf\") " pod="ai-tenant-e2e-inf-a-b05069/test-model-b05069-kserve-b86856645-q84s5"
Jul 06 20:00:36.094150 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:36.093802    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68443e5d-d257-42ab-865c-6682779306bf-model-cache\") pod \"test-model-b05069-kserve-b86856645-q84s5\" (UID: \"68443e5d-d257-42ab-865c-6682779306bf\") " pod="ai-tenant-e2e-inf-a-b05069/test-model-b05069-kserve-b86856645-q84s5"
Jul 06 20:00:36.094150 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:36.093832    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68443e5d-d257-42ab-865c-6682779306bf-tmp-dir\") pod \"test-model-b05069-kserve-b86856645-q84s5\" (UID: \"68443e5d-d257-42ab-865c-6682779306bf\") " pod="ai-tenant-e2e-inf-a-b05069/test-model-b05069-kserve-b86856645-q84s5"
Jul 06 20:00:36.094269 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:36.094189    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68443e5d-d257-42ab-865c-6682779306bf-home\") pod \"test-model-b05069-kserve-b86856645-q84s5\" (UID: \"68443e5d-d257-42ab-865c-6682779306bf\") " pod="ai-tenant-e2e-inf-a-b05069/test-model-b05069-kserve-b86856645-q84s5"
Jul 06 20:00:36.094269 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:36.094231    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68443e5d-d257-42ab-865c-6682779306bf-tmp-dir\") pod \"test-model-b05069-kserve-b86856645-q84s5\" (UID: \"68443e5d-d257-42ab-865c-6682779306bf\") " pod="ai-tenant-e2e-inf-a-b05069/test-model-b05069-kserve-b86856645-q84s5"
Jul 06 20:00:36.094421 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:36.094403    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68443e5d-d257-42ab-865c-6682779306bf-model-cache\") pod \"test-model-b05069-kserve-b86856645-q84s5\" (UID: \"68443e5d-d257-42ab-865c-6682779306bf\") " pod="ai-tenant-e2e-inf-a-b05069/test-model-b05069-kserve-b86856645-q84s5"
Jul 06 20:00:36.096419 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:36.096398    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68443e5d-d257-42ab-865c-6682779306bf-tls-certs\") pod \"test-model-b05069-kserve-b86856645-q84s5\" (UID: \"68443e5d-d257-42ab-865c-6682779306bf\") " pod="ai-tenant-e2e-inf-a-b05069/test-model-b05069-kserve-b86856645-q84s5"
Jul 06 20:00:36.096528 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:36.096500    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68443e5d-d257-42ab-865c-6682779306bf-dshm\") pod \"test-model-b05069-kserve-b86856645-q84s5\" (UID: \"68443e5d-d257-42ab-865c-6682779306bf\") " pod="ai-tenant-e2e-inf-a-b05069/test-model-b05069-kserve-b86856645-q84s5"
Jul 06 20:00:36.102632 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:36.102612    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-477ck\" (UniqueName: \"kubernetes.io/projected/68443e5d-d257-42ab-865c-6682779306bf-kube-api-access-477ck\") pod \"test-model-b05069-kserve-b86856645-q84s5\" (UID: \"68443e5d-d257-42ab-865c-6682779306bf\") " pod="ai-tenant-e2e-inf-a-b05069/test-model-b05069-kserve-b86856645-q84s5"
Jul 06 20:00:36.204150 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:36.204113    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-b05069/test-model-b05069-kserve-b86856645-q84s5"
Jul 06 20:00:36.378024 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:36.377999    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-b05069/test-model-b05069-kserve-b86856645-q84s5"]
Jul 06 20:00:36.380325 ip-10-0-131-150 kubenswrapper[2555]: W0706 20:00:36.380297    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod68443e5d_d257_42ab_865c_6682779306bf.slice/crio-56783164fbc1423d812a23889a1362a481fc0c37e608c703e44e91f7781888a9 WatchSource:0}: Error finding container 56783164fbc1423d812a23889a1362a481fc0c37e608c703e44e91f7781888a9: Status 404 returned error can't find the container with id 56783164fbc1423d812a23889a1362a481fc0c37e608c703e44e91f7781888a9
Jul 06 20:00:36.507932 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:36.507887    2555 patch_prober.go:28] interesting pod/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 06 20:00:36.508065 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:36.507955    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h" podUID="04e13e77-a359-4421-a9a1-6b9b1fbfa47e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 06 20:00:36.798623 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:36.798584    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk" event={"ID":"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad","Type":"ContainerStarted","Data":"b1e9433b1278a754f463dfce849da243fe04f1b50dc3c4096587cfcffd0171fa"}
Jul 06 20:00:36.800224 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:36.800191    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-b05069/test-model-b05069-kserve-b86856645-q84s5" event={"ID":"68443e5d-d257-42ab-865c-6682779306bf","Type":"ContainerStarted","Data":"1e0b0700beee49b92ee8582ae37cf0c5ad9f312ae5363c9a311da991c7fe5532"}
Jul 06 20:00:36.800354 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:36.800229    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-b05069/test-model-b05069-kserve-b86856645-q84s5" event={"ID":"68443e5d-d257-42ab-865c-6682779306bf","Type":"ContainerStarted","Data":"56783164fbc1423d812a23889a1362a481fc0c37e608c703e44e91f7781888a9"}
Jul 06 20:00:36.839407 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:36.839347    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-b05069/test-model-b05069-kserve-b86856645-q84s5" podStartSLOduration=1.839333185 podStartE2EDuration="1.839333185s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:00:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:00:36.837284802 +0000 UTC m=+2094.613318219" watchObservedRunningTime="2026-07-06 20:00:36.839333185 +0000 UTC m=+2094.615366583"
Jul 06 20:00:37.282079 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:37.282052    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk"
Jul 06 20:00:37.283304 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:37.283268    2555 patch_prober.go:28] interesting pod/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 06 20:00:37.283481 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:37.283325    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk" podUID="bea66ecf-2d35-478a-9ab3-3f1593b4a2ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 06 20:00:37.511370 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:37.511338    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h"
Jul 06 20:00:37.511735 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:37.511703    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h"
Jul 06 20:00:37.512306 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:37.512286    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h"
Jul 06 20:00:38.282602 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:38.282561    2555 patch_prober.go:28] interesting pod/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 06 20:00:38.282995 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:38.282617    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk" podUID="bea66ecf-2d35-478a-9ab3-3f1593b4a2ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 06 20:00:39.282852 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:39.282815    2555 patch_prober.go:28] interesting pod/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 06 20:00:39.283267 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:39.282869    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk" podUID="bea66ecf-2d35-478a-9ab3-3f1593b4a2ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 06 20:00:39.531747 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:39.531705    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:39.631597 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:39.631507    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:39.719024 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:39.718989    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk"
Jul 06 20:00:40.282527 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:40.282495    2555 patch_prober.go:28] interesting pod/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 06 20:00:40.282692 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:40.282551    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk" podUID="bea66ecf-2d35-478a-9ab3-3f1593b4a2ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 06 20:00:40.789527 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:40.789496    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 20:00:41.282881 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:41.282842    2555 patch_prober.go:28] interesting pod/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 06 20:00:41.283082 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:41.282902    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk" podUID="bea66ecf-2d35-478a-9ab3-3f1593b4a2ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 06 20:00:42.286711 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:42.286679    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk"
Jul 06 20:00:42.287662 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:42.287644    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk"
Jul 06 20:00:44.203414 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:44.203388    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j9wtk_bb750a78-aa1e-4c55-b771-e06ca00b997a/ovn-acl-logging/0.log"
Jul 06 20:00:44.205021 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:44.205000    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j9wtk_bb750a78-aa1e-4c55-b771-e06ca00b997a/ovn-acl-logging/0.log"
Jul 06 20:00:46.204619 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:46.204578    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-b05069/test-model-b05069-kserve-b86856645-q84s5"
Jul 06 20:00:46.205080 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:46.204641    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-b05069/test-model-b05069-kserve-b86856645-q84s5"
Jul 06 20:00:46.217432 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:46.217406    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-b05069/test-model-b05069-kserve-b86856645-q84s5"
Jul 06 20:00:46.271357 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:46.271318    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:46.429473 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:46.429435    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:46.862712 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:46.862680    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-b05069/test-model-b05069-kserve-b86856645-q84s5"
Jul 06 20:00:50.680192 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:50.680146    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 20:00:58.995410 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:58.995377    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-66d504/test-model-66d504-kserve-549f888df5-jznkt"]
Jul 06 20:00:58.998926 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:58.998886    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-66d504/test-model-66d504-kserve-549f888df5-jznkt"
Jul 06 20:00:59.002252 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:59.002231    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-66d504\"/\"default-dockercfg-krvzb\""
Jul 06 20:00:59.002372 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:59.002254    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-66d504\"/\"test-model-66d504-kserve-self-signed-certs\""
Jul 06 20:00:59.002372 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:59.002234    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-66d504\"/\"openshift-service-ca.crt\""
Jul 06 20:00:59.002372 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:59.002234    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-66d504\"/\"kube-root-ca.crt\""
Jul 06 20:00:59.014301 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:59.014278    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-66d504/test-model-66d504-kserve-549f888df5-jznkt"]
Jul 06 20:00:59.032535 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:59.032507    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:59.107089 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:59.107059    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88dd88f1-dbba-418b-b66f-3571150b8473-tmp-dir\") pod \"test-model-66d504-kserve-549f888df5-jznkt\" (UID: \"88dd88f1-dbba-418b-b66f-3571150b8473\") " pod="ai-tenant-e2e-inf-b-66d504/test-model-66d504-kserve-549f888df5-jznkt"
Jul 06 20:00:59.107253 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:59.107126    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88dd88f1-dbba-418b-b66f-3571150b8473-dshm\") pod \"test-model-66d504-kserve-549f888df5-jznkt\" (UID: \"88dd88f1-dbba-418b-b66f-3571150b8473\") " pod="ai-tenant-e2e-inf-b-66d504/test-model-66d504-kserve-549f888df5-jznkt"
Jul 06 20:00:59.107253 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:59.107205    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88dd88f1-dbba-418b-b66f-3571150b8473-tls-certs\") pod \"test-model-66d504-kserve-549f888df5-jznkt\" (UID: \"88dd88f1-dbba-418b-b66f-3571150b8473\") " pod="ai-tenant-e2e-inf-b-66d504/test-model-66d504-kserve-549f888df5-jznkt"
Jul 06 20:00:59.107253 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:59.107244    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88dd88f1-dbba-418b-b66f-3571150b8473-model-cache\") pod \"test-model-66d504-kserve-549f888df5-jznkt\" (UID: \"88dd88f1-dbba-418b-b66f-3571150b8473\") " pod="ai-tenant-e2e-inf-b-66d504/test-model-66d504-kserve-549f888df5-jznkt"
Jul 06 20:00:59.107381 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:59.107266    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-648lq\" (UniqueName: \"kubernetes.io/projected/88dd88f1-dbba-418b-b66f-3571150b8473-kube-api-access-648lq\") pod \"test-model-66d504-kserve-549f888df5-jznkt\" (UID: \"88dd88f1-dbba-418b-b66f-3571150b8473\") " pod="ai-tenant-e2e-inf-b-66d504/test-model-66d504-kserve-549f888df5-jznkt"
Jul 06 20:00:59.107381 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:59.107291    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88dd88f1-dbba-418b-b66f-3571150b8473-home\") pod \"test-model-66d504-kserve-549f888df5-jznkt\" (UID: \"88dd88f1-dbba-418b-b66f-3571150b8473\") " pod="ai-tenant-e2e-inf-b-66d504/test-model-66d504-kserve-549f888df5-jznkt"
Jul 06 20:00:59.208338 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:59.208305    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88dd88f1-dbba-418b-b66f-3571150b8473-tmp-dir\") pod \"test-model-66d504-kserve-549f888df5-jznkt\" (UID: \"88dd88f1-dbba-418b-b66f-3571150b8473\") " pod="ai-tenant-e2e-inf-b-66d504/test-model-66d504-kserve-549f888df5-jznkt"
Jul 06 20:00:59.208525 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:59.208374    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88dd88f1-dbba-418b-b66f-3571150b8473-dshm\") pod \"test-model-66d504-kserve-549f888df5-jznkt\" (UID: \"88dd88f1-dbba-418b-b66f-3571150b8473\") " pod="ai-tenant-e2e-inf-b-66d504/test-model-66d504-kserve-549f888df5-jznkt"
Jul 06 20:00:59.208525 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:59.208404    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88dd88f1-dbba-418b-b66f-3571150b8473-tls-certs\") pod \"test-model-66d504-kserve-549f888df5-jznkt\" (UID: \"88dd88f1-dbba-418b-b66f-3571150b8473\") " pod="ai-tenant-e2e-inf-b-66d504/test-model-66d504-kserve-549f888df5-jznkt"
Jul 06 20:00:59.208525 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:59.208432    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88dd88f1-dbba-418b-b66f-3571150b8473-model-cache\") pod \"test-model-66d504-kserve-549f888df5-jznkt\" (UID: \"88dd88f1-dbba-418b-b66f-3571150b8473\") " pod="ai-tenant-e2e-inf-b-66d504/test-model-66d504-kserve-549f888df5-jznkt"
Jul 06 20:00:59.208525 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:59.208452    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-648lq\" (UniqueName: \"kubernetes.io/projected/88dd88f1-dbba-418b-b66f-3571150b8473-kube-api-access-648lq\") pod \"test-model-66d504-kserve-549f888df5-jznkt\" (UID: \"88dd88f1-dbba-418b-b66f-3571150b8473\") " pod="ai-tenant-e2e-inf-b-66d504/test-model-66d504-kserve-549f888df5-jznkt"
Jul 06 20:00:59.208525 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:59.208475    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88dd88f1-dbba-418b-b66f-3571150b8473-home\") pod \"test-model-66d504-kserve-549f888df5-jznkt\" (UID: \"88dd88f1-dbba-418b-b66f-3571150b8473\") " pod="ai-tenant-e2e-inf-b-66d504/test-model-66d504-kserve-549f888df5-jznkt"
Jul 06 20:00:59.208795 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:59.208736    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88dd88f1-dbba-418b-b66f-3571150b8473-tmp-dir\") pod \"test-model-66d504-kserve-549f888df5-jznkt\" (UID: \"88dd88f1-dbba-418b-b66f-3571150b8473\") " pod="ai-tenant-e2e-inf-b-66d504/test-model-66d504-kserve-549f888df5-jznkt"
Jul 06 20:00:59.208852 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:59.208821    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88dd88f1-dbba-418b-b66f-3571150b8473-home\") pod \"test-model-66d504-kserve-549f888df5-jznkt\" (UID: \"88dd88f1-dbba-418b-b66f-3571150b8473\") " pod="ai-tenant-e2e-inf-b-66d504/test-model-66d504-kserve-549f888df5-jznkt"
Jul 06 20:00:59.208900 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:59.208855    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88dd88f1-dbba-418b-b66f-3571150b8473-model-cache\") pod \"test-model-66d504-kserve-549f888df5-jznkt\" (UID: \"88dd88f1-dbba-418b-b66f-3571150b8473\") " pod="ai-tenant-e2e-inf-b-66d504/test-model-66d504-kserve-549f888df5-jznkt"
Jul 06 20:00:59.210669 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:59.210648    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88dd88f1-dbba-418b-b66f-3571150b8473-dshm\") pod \"test-model-66d504-kserve-549f888df5-jznkt\" (UID: \"88dd88f1-dbba-418b-b66f-3571150b8473\") " pod="ai-tenant-e2e-inf-b-66d504/test-model-66d504-kserve-549f888df5-jznkt"
Jul 06 20:00:59.211133 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:59.211114    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88dd88f1-dbba-418b-b66f-3571150b8473-tls-certs\") pod \"test-model-66d504-kserve-549f888df5-jznkt\" (UID: \"88dd88f1-dbba-418b-b66f-3571150b8473\") " pod="ai-tenant-e2e-inf-b-66d504/test-model-66d504-kserve-549f888df5-jznkt"
Jul 06 20:00:59.216823 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:59.216800    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-648lq\" (UniqueName: \"kubernetes.io/projected/88dd88f1-dbba-418b-b66f-3571150b8473-kube-api-access-648lq\") pod \"test-model-66d504-kserve-549f888df5-jznkt\" (UID: \"88dd88f1-dbba-418b-b66f-3571150b8473\") " pod="ai-tenant-e2e-inf-b-66d504/test-model-66d504-kserve-549f888df5-jznkt"
Jul 06 20:00:59.308394 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:59.308366    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-66d504/test-model-66d504-kserve-549f888df5-jznkt"
Jul 06 20:00:59.461065 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:59.461034    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-66d504/test-model-66d504-kserve-549f888df5-jznkt"]
Jul 06 20:00:59.462498 ip-10-0-131-150 kubenswrapper[2555]: W0706 20:00:59.462474    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod88dd88f1_dbba_418b_b66f_3571150b8473.slice/crio-475cd88feb0799b75630970426084db3956d3e288823f0703e3fbbde6f46449e WatchSource:0}: Error finding container 475cd88feb0799b75630970426084db3956d3e288823f0703e3fbbde6f46449e: Status 404 returned error can't find the container with id 475cd88feb0799b75630970426084db3956d3e288823f0703e3fbbde6f46449e
Jul 06 20:00:59.916245 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:59.916209    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-66d504/test-model-66d504-kserve-549f888df5-jznkt" event={"ID":"88dd88f1-dbba-418b-b66f-3571150b8473","Type":"ContainerStarted","Data":"ea2b09e5fd04f1cc236f688d5a6bf26f5c56f2a09bbd426d2bd1b4ca78c10191"}
Jul 06 20:00:59.916441 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:59.916255    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-66d504/test-model-66d504-kserve-549f888df5-jznkt" event={"ID":"88dd88f1-dbba-418b-b66f-3571150b8473","Type":"ContainerStarted","Data":"475cd88feb0799b75630970426084db3956d3e288823f0703e3fbbde6f46449e"}
Jul 06 20:00:59.937167 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:00:59.937105    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-66d504/test-model-66d504-kserve-549f888df5-jznkt" podStartSLOduration=1.937087471 podStartE2EDuration="1.937087471s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:00:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:00:59.936208349 +0000 UTC m=+2117.712241752" watchObservedRunningTime="2026-07-06 20:00:59.937087471 +0000 UTC m=+2117.713120871"
Jul 06 20:01:05.580886 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:05.580800    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 20:01:09.309221 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:09.309190    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-66d504/test-model-66d504-kserve-549f888df5-jznkt"
Jul 06 20:01:09.309619 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:09.309239    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-66d504/test-model-66d504-kserve-549f888df5-jznkt"
Jul 06 20:01:09.321553 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:09.321524    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-66d504/test-model-66d504-kserve-549f888df5-jznkt"
Jul 06 20:01:09.981115 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:09.981082    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-66d504/test-model-66d504-kserve-549f888df5-jznkt"
Jul 06 20:01:18.320092 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:18.320052    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-b05069/test-model-b05069-kserve-b86856645-q84s5"]
Jul 06 20:01:18.342089 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:18.342054    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:19.465949 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:19.465896    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-66d504/test-model-66d504-kserve-549f888df5-jznkt"]
Jul 06 20:01:19.502030 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:19.501995    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:19.715090 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:19.715058    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:20.252538 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:20.252498    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:20.867596 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:20.867546    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:20.995119 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:20.995089    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:22.886788 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:22.886750    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 20:01:25.311684 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:25.311651    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:33.340397 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:33.340329    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-b05069/test-model-b05069-kserve-b86856645-q84s5" podUID="68443e5d-d257-42ab-865c-6682779306bf" containerName="main" containerID="cri-o://1e0b0700beee49b92ee8582ae37cf0c5ad9f312ae5363c9a311da991c7fe5532" gracePeriod=45
Jul 06 20:01:33.600020 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:33.599961    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-b05069/test-model-b05069-kserve-b86856645-q84s5"
Jul 06 20:01:33.719263 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:33.719227    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68443e5d-d257-42ab-865c-6682779306bf-model-cache\") pod \"68443e5d-d257-42ab-865c-6682779306bf\" (UID: \"68443e5d-d257-42ab-865c-6682779306bf\") "
Jul 06 20:01:33.719454 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:33.719275    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68443e5d-d257-42ab-865c-6682779306bf-tls-certs\") pod \"68443e5d-d257-42ab-865c-6682779306bf\" (UID: \"68443e5d-d257-42ab-865c-6682779306bf\") "
Jul 06 20:01:33.719454 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:33.719301    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68443e5d-d257-42ab-865c-6682779306bf-tmp-dir\") pod \"68443e5d-d257-42ab-865c-6682779306bf\" (UID: \"68443e5d-d257-42ab-865c-6682779306bf\") "
Jul 06 20:01:33.719454 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:33.719325    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68443e5d-d257-42ab-865c-6682779306bf-dshm\") pod \"68443e5d-d257-42ab-865c-6682779306bf\" (UID: \"68443e5d-d257-42ab-865c-6682779306bf\") "
Jul 06 20:01:33.719454 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:33.719374    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68443e5d-d257-42ab-865c-6682779306bf-home\") pod \"68443e5d-d257-42ab-865c-6682779306bf\" (UID: \"68443e5d-d257-42ab-865c-6682779306bf\") "
Jul 06 20:01:33.719454 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:33.719404    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-477ck\" (UniqueName: \"kubernetes.io/projected/68443e5d-d257-42ab-865c-6682779306bf-kube-api-access-477ck\") pod \"68443e5d-d257-42ab-865c-6682779306bf\" (UID: \"68443e5d-d257-42ab-865c-6682779306bf\") "
Jul 06 20:01:33.719723 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:33.719570    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68443e5d-d257-42ab-865c-6682779306bf-model-cache" (OuterVolumeSpecName: "model-cache") pod "68443e5d-d257-42ab-865c-6682779306bf" (UID: "68443e5d-d257-42ab-865c-6682779306bf"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:01:33.719723 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:33.719607    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68443e5d-d257-42ab-865c-6682779306bf-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "68443e5d-d257-42ab-865c-6682779306bf" (UID: "68443e5d-d257-42ab-865c-6682779306bf"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:01:33.719723 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:33.719645    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68443e5d-d257-42ab-865c-6682779306bf-home" (OuterVolumeSpecName: "home") pod "68443e5d-d257-42ab-865c-6682779306bf" (UID: "68443e5d-d257-42ab-865c-6682779306bf"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:01:33.719873 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:33.719726    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68443e5d-d257-42ab-865c-6682779306bf-model-cache\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:01:33.719873 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:33.719744    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68443e5d-d257-42ab-865c-6682779306bf-tmp-dir\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:01:33.719873 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:33.719757    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68443e5d-d257-42ab-865c-6682779306bf-home\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:01:33.721617 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:33.721588    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68443e5d-d257-42ab-865c-6682779306bf-kube-api-access-477ck" (OuterVolumeSpecName: "kube-api-access-477ck") pod "68443e5d-d257-42ab-865c-6682779306bf" (UID: "68443e5d-d257-42ab-865c-6682779306bf"). InnerVolumeSpecName "kube-api-access-477ck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:01:33.721617 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:33.721604    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68443e5d-d257-42ab-865c-6682779306bf-dshm" (OuterVolumeSpecName: "dshm") pod "68443e5d-d257-42ab-865c-6682779306bf" (UID: "68443e5d-d257-42ab-865c-6682779306bf"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:01:33.721743 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:33.721653    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68443e5d-d257-42ab-865c-6682779306bf-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "68443e5d-d257-42ab-865c-6682779306bf" (UID: "68443e5d-d257-42ab-865c-6682779306bf"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:01:33.820485 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:33.820450    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68443e5d-d257-42ab-865c-6682779306bf-tls-certs\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:01:33.820485 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:33.820480    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68443e5d-d257-42ab-865c-6682779306bf-dshm\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:01:33.820485 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:33.820489    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-477ck\" (UniqueName: \"kubernetes.io/projected/68443e5d-d257-42ab-865c-6682779306bf-kube-api-access-477ck\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:01:34.091760 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:34.091723    2555 generic.go:356] "Generic (PLEG): container finished" podID="68443e5d-d257-42ab-865c-6682779306bf" containerID="1e0b0700beee49b92ee8582ae37cf0c5ad9f312ae5363c9a311da991c7fe5532" exitCode=0
Jul 06 20:01:34.091981 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:34.091769    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-b05069/test-model-b05069-kserve-b86856645-q84s5"
Jul 06 20:01:34.091981 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:34.091805    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-b05069/test-model-b05069-kserve-b86856645-q84s5" event={"ID":"68443e5d-d257-42ab-865c-6682779306bf","Type":"ContainerDied","Data":"1e0b0700beee49b92ee8582ae37cf0c5ad9f312ae5363c9a311da991c7fe5532"}
Jul 06 20:01:34.091981 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:34.091849    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-b05069/test-model-b05069-kserve-b86856645-q84s5" event={"ID":"68443e5d-d257-42ab-865c-6682779306bf","Type":"ContainerDied","Data":"56783164fbc1423d812a23889a1362a481fc0c37e608c703e44e91f7781888a9"}
Jul 06 20:01:34.091981 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:34.091866    2555 scope.go:117] "RemoveContainer" containerID="1e0b0700beee49b92ee8582ae37cf0c5ad9f312ae5363c9a311da991c7fe5532"
Jul 06 20:01:34.100818 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:34.100800    2555 scope.go:117] "RemoveContainer" containerID="1e0b0700beee49b92ee8582ae37cf0c5ad9f312ae5363c9a311da991c7fe5532"
Jul 06 20:01:34.101097 ip-10-0-131-150 kubenswrapper[2555]: E0706 20:01:34.101077    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e0b0700beee49b92ee8582ae37cf0c5ad9f312ae5363c9a311da991c7fe5532\": container with ID starting with 1e0b0700beee49b92ee8582ae37cf0c5ad9f312ae5363c9a311da991c7fe5532 not found: ID does not exist" containerID="1e0b0700beee49b92ee8582ae37cf0c5ad9f312ae5363c9a311da991c7fe5532"
Jul 06 20:01:34.101146 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:34.101106    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e0b0700beee49b92ee8582ae37cf0c5ad9f312ae5363c9a311da991c7fe5532"} err="failed to get container status \"1e0b0700beee49b92ee8582ae37cf0c5ad9f312ae5363c9a311da991c7fe5532\": rpc error: code = NotFound desc = could not find container \"1e0b0700beee49b92ee8582ae37cf0c5ad9f312ae5363c9a311da991c7fe5532\": container with ID starting with 1e0b0700beee49b92ee8582ae37cf0c5ad9f312ae5363c9a311da991c7fe5532 not found: ID does not exist"
Jul 06 20:01:34.113881 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:34.113854    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-b05069/test-model-b05069-kserve-b86856645-q84s5"]
Jul 06 20:01:34.115536 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:34.115517    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-b05069/test-model-b05069-kserve-b86856645-q84s5"]
Jul 06 20:01:34.129702 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:34.129669    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68443e5d-d257-42ab-865c-6682779306bf" path="/var/lib/kubelet/pods/68443e5d-d257-42ab-865c-6682779306bf/volumes"
Jul 06 20:01:34.486168 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:34.486072    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-66d504/test-model-66d504-kserve-549f888df5-jznkt" podUID="88dd88f1-dbba-418b-b66f-3571150b8473" containerName="main" containerID="cri-o://ea2b09e5fd04f1cc236f688d5a6bf26f5c56f2a09bbd426d2bd1b4ca78c10191" gracePeriod=45
Jul 06 20:01:34.738114 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:34.738059    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-66d504/test-model-66d504-kserve-549f888df5-jznkt"
Jul 06 20:01:34.830367 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:34.830336    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88dd88f1-dbba-418b-b66f-3571150b8473-dshm\") pod \"88dd88f1-dbba-418b-b66f-3571150b8473\" (UID: \"88dd88f1-dbba-418b-b66f-3571150b8473\") "
Jul 06 20:01:34.830549 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:34.830395    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88dd88f1-dbba-418b-b66f-3571150b8473-tmp-dir\") pod \"88dd88f1-dbba-418b-b66f-3571150b8473\" (UID: \"88dd88f1-dbba-418b-b66f-3571150b8473\") "
Jul 06 20:01:34.830549 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:34.830420    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88dd88f1-dbba-418b-b66f-3571150b8473-tls-certs\") pod \"88dd88f1-dbba-418b-b66f-3571150b8473\" (UID: \"88dd88f1-dbba-418b-b66f-3571150b8473\") "
Jul 06 20:01:34.830549 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:34.830440    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-648lq\" (UniqueName: \"kubernetes.io/projected/88dd88f1-dbba-418b-b66f-3571150b8473-kube-api-access-648lq\") pod \"88dd88f1-dbba-418b-b66f-3571150b8473\" (UID: \"88dd88f1-dbba-418b-b66f-3571150b8473\") "
Jul 06 20:01:34.830549 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:34.830489    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88dd88f1-dbba-418b-b66f-3571150b8473-model-cache\") pod \"88dd88f1-dbba-418b-b66f-3571150b8473\" (UID: \"88dd88f1-dbba-418b-b66f-3571150b8473\") "
Jul 06 20:01:34.830549 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:34.830508    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88dd88f1-dbba-418b-b66f-3571150b8473-home\") pod \"88dd88f1-dbba-418b-b66f-3571150b8473\" (UID: \"88dd88f1-dbba-418b-b66f-3571150b8473\") "
Jul 06 20:01:34.830811 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:34.830780    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88dd88f1-dbba-418b-b66f-3571150b8473-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "88dd88f1-dbba-418b-b66f-3571150b8473" (UID: "88dd88f1-dbba-418b-b66f-3571150b8473"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:01:34.830811 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:34.830794    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88dd88f1-dbba-418b-b66f-3571150b8473-model-cache" (OuterVolumeSpecName: "model-cache") pod "88dd88f1-dbba-418b-b66f-3571150b8473" (UID: "88dd88f1-dbba-418b-b66f-3571150b8473"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:01:34.830952 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:34.830892    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88dd88f1-dbba-418b-b66f-3571150b8473-home" (OuterVolumeSpecName: "home") pod "88dd88f1-dbba-418b-b66f-3571150b8473" (UID: "88dd88f1-dbba-418b-b66f-3571150b8473"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:01:34.832767 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:34.832734    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88dd88f1-dbba-418b-b66f-3571150b8473-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "88dd88f1-dbba-418b-b66f-3571150b8473" (UID: "88dd88f1-dbba-418b-b66f-3571150b8473"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:01:34.832767 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:34.832734    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88dd88f1-dbba-418b-b66f-3571150b8473-kube-api-access-648lq" (OuterVolumeSpecName: "kube-api-access-648lq") pod "88dd88f1-dbba-418b-b66f-3571150b8473" (UID: "88dd88f1-dbba-418b-b66f-3571150b8473"). InnerVolumeSpecName "kube-api-access-648lq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:01:34.832767 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:34.832739    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88dd88f1-dbba-418b-b66f-3571150b8473-dshm" (OuterVolumeSpecName: "dshm") pod "88dd88f1-dbba-418b-b66f-3571150b8473" (UID: "88dd88f1-dbba-418b-b66f-3571150b8473"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:01:34.931290 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:34.931251    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-648lq\" (UniqueName: \"kubernetes.io/projected/88dd88f1-dbba-418b-b66f-3571150b8473-kube-api-access-648lq\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:01:34.931290 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:34.931284    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88dd88f1-dbba-418b-b66f-3571150b8473-model-cache\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:01:34.931290 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:34.931296    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88dd88f1-dbba-418b-b66f-3571150b8473-home\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:01:34.931516 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:34.931304    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88dd88f1-dbba-418b-b66f-3571150b8473-dshm\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:01:34.931516 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:34.931334    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88dd88f1-dbba-418b-b66f-3571150b8473-tmp-dir\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:01:34.931516 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:34.931343    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88dd88f1-dbba-418b-b66f-3571150b8473-tls-certs\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:01:35.098560 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:35.098529    2555 generic.go:356] "Generic (PLEG): container finished" podID="88dd88f1-dbba-418b-b66f-3571150b8473" containerID="ea2b09e5fd04f1cc236f688d5a6bf26f5c56f2a09bbd426d2bd1b4ca78c10191" exitCode=0
Jul 06 20:01:35.098773 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:35.098569    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-66d504/test-model-66d504-kserve-549f888df5-jznkt"
Jul 06 20:01:35.098773 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:35.098616    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-66d504/test-model-66d504-kserve-549f888df5-jznkt" event={"ID":"88dd88f1-dbba-418b-b66f-3571150b8473","Type":"ContainerDied","Data":"ea2b09e5fd04f1cc236f688d5a6bf26f5c56f2a09bbd426d2bd1b4ca78c10191"}
Jul 06 20:01:35.098773 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:35.098653    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-66d504/test-model-66d504-kserve-549f888df5-jznkt" event={"ID":"88dd88f1-dbba-418b-b66f-3571150b8473","Type":"ContainerDied","Data":"475cd88feb0799b75630970426084db3956d3e288823f0703e3fbbde6f46449e"}
Jul 06 20:01:35.098773 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:35.098675    2555 scope.go:117] "RemoveContainer" containerID="ea2b09e5fd04f1cc236f688d5a6bf26f5c56f2a09bbd426d2bd1b4ca78c10191"
Jul 06 20:01:35.108334 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:35.108317    2555 scope.go:117] "RemoveContainer" containerID="ea2b09e5fd04f1cc236f688d5a6bf26f5c56f2a09bbd426d2bd1b4ca78c10191"
Jul 06 20:01:35.108568 ip-10-0-131-150 kubenswrapper[2555]: E0706 20:01:35.108550    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea2b09e5fd04f1cc236f688d5a6bf26f5c56f2a09bbd426d2bd1b4ca78c10191\": container with ID starting with ea2b09e5fd04f1cc236f688d5a6bf26f5c56f2a09bbd426d2bd1b4ca78c10191 not found: ID does not exist" containerID="ea2b09e5fd04f1cc236f688d5a6bf26f5c56f2a09bbd426d2bd1b4ca78c10191"
Jul 06 20:01:35.108618 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:35.108574    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea2b09e5fd04f1cc236f688d5a6bf26f5c56f2a09bbd426d2bd1b4ca78c10191"} err="failed to get container status \"ea2b09e5fd04f1cc236f688d5a6bf26f5c56f2a09bbd426d2bd1b4ca78c10191\": rpc error: code = NotFound desc = could not find container \"ea2b09e5fd04f1cc236f688d5a6bf26f5c56f2a09bbd426d2bd1b4ca78c10191\": container with ID starting with ea2b09e5fd04f1cc236f688d5a6bf26f5c56f2a09bbd426d2bd1b4ca78c10191 not found: ID does not exist"
Jul 06 20:01:35.121109 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:35.121085    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-66d504/test-model-66d504-kserve-549f888df5-jznkt"]
Jul 06 20:01:35.124973 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:35.124954    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-66d504/test-model-66d504-kserve-549f888df5-jznkt"]
Jul 06 20:01:36.129813 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:36.129781    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88dd88f1-dbba-418b-b66f-3571150b8473" path="/var/lib/kubelet/pods/88dd88f1-dbba-418b-b66f-3571150b8473/volumes"
Jul 06 20:01:52.799073 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:52.799036    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:53.076994 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:53.076889    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h"]
Jul 06 20:01:53.077155 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:53.077125    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h" podUID="04e13e77-a359-4421-a9a1-6b9b1fbfa47e" containerName="istio-proxy" containerID="cri-o://6cecd7a234b04e7791b58bdc487a6b4e969f0380fd0cb60f2dd9887d94d3beb7" gracePeriod=30
Jul 06 20:01:53.097353 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:53.097313    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:53.334656 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:53.334572    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:53.643328 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:53.643223    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:54.094369 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:54.094328    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:54.184684 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:54.184633    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:54.443126 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:54.443028    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:56.102652 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:56.102615    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 20:01:58.216806 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:58.216759    2555 generic.go:356] "Generic (PLEG): container finished" podID="04e13e77-a359-4421-a9a1-6b9b1fbfa47e" containerID="6cecd7a234b04e7791b58bdc487a6b4e969f0380fd0cb60f2dd9887d94d3beb7" exitCode=0
Jul 06 20:01:58.217203 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:58.216817    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h" event={"ID":"04e13e77-a359-4421-a9a1-6b9b1fbfa47e","Type":"ContainerDied","Data":"6cecd7a234b04e7791b58bdc487a6b4e969f0380fd0cb60f2dd9887d94d3beb7"}
Jul 06 20:01:58.217203 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:58.216892    2555 scope.go:117] "RemoveContainer" containerID="c4b15e2bad10cef588a615aac5f0a9c0e9fd8282a22151df7ba676cdaf3c3a5d"
Jul 06 20:01:58.335904 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:58.335840    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h"
Jul 06 20:01:58.354804 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:58.354779    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-istiod-ca-cert\") pod \"04e13e77-a359-4421-a9a1-6b9b1fbfa47e\" (UID: \"04e13e77-a359-4421-a9a1-6b9b1fbfa47e\") "
Jul 06 20:01:58.355362 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:58.354813    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-istio-envoy\") pod \"04e13e77-a359-4421-a9a1-6b9b1fbfa47e\" (UID: \"04e13e77-a359-4421-a9a1-6b9b1fbfa47e\") "
Jul 06 20:01:58.355362 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:58.354834    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-istio-podinfo\") pod \"04e13e77-a359-4421-a9a1-6b9b1fbfa47e\" (UID: \"04e13e77-a359-4421-a9a1-6b9b1fbfa47e\") "
Jul 06 20:01:58.355362 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:58.354894    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p5nj8\" (UniqueName: \"kubernetes.io/projected/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-kube-api-access-p5nj8\") pod \"04e13e77-a359-4421-a9a1-6b9b1fbfa47e\" (UID: \"04e13e77-a359-4421-a9a1-6b9b1fbfa47e\") "
Jul 06 20:01:58.355362 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:58.354932    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-workload-socket\") pod \"04e13e77-a359-4421-a9a1-6b9b1fbfa47e\" (UID: \"04e13e77-a359-4421-a9a1-6b9b1fbfa47e\") "
Jul 06 20:01:58.355362 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:58.354987    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-istio-token\") pod \"04e13e77-a359-4421-a9a1-6b9b1fbfa47e\" (UID: \"04e13e77-a359-4421-a9a1-6b9b1fbfa47e\") "
Jul 06 20:01:58.355362 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:58.355012    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-istio-data\") pod \"04e13e77-a359-4421-a9a1-6b9b1fbfa47e\" (UID: \"04e13e77-a359-4421-a9a1-6b9b1fbfa47e\") "
Jul 06 20:01:58.355362 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:58.355175    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-credential-socket\") pod \"04e13e77-a359-4421-a9a1-6b9b1fbfa47e\" (UID: \"04e13e77-a359-4421-a9a1-6b9b1fbfa47e\") "
Jul 06 20:01:58.355362 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:58.355228    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-workload-certs\") pod \"04e13e77-a359-4421-a9a1-6b9b1fbfa47e\" (UID: \"04e13e77-a359-4421-a9a1-6b9b1fbfa47e\") "
Jul 06 20:01:58.355840 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:58.355392    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "04e13e77-a359-4421-a9a1-6b9b1fbfa47e" (UID: "04e13e77-a359-4421-a9a1-6b9b1fbfa47e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:01:58.355840 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:58.355692    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "04e13e77-a359-4421-a9a1-6b9b1fbfa47e" (UID: "04e13e77-a359-4421-a9a1-6b9b1fbfa47e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:01:58.355996 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:58.355969    2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-workload-socket\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:01:58.356073 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:58.355997    2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-istiod-ca-cert\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:01:58.356073 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:58.356004    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "04e13e77-a359-4421-a9a1-6b9b1fbfa47e" (UID: "04e13e77-a359-4421-a9a1-6b9b1fbfa47e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:01:58.356193 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:58.356172    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "04e13e77-a359-4421-a9a1-6b9b1fbfa47e" (UID: "04e13e77-a359-4421-a9a1-6b9b1fbfa47e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:01:58.356990 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:58.356946    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-istio-data" (OuterVolumeSpecName: "istio-data") pod "04e13e77-a359-4421-a9a1-6b9b1fbfa47e" (UID: "04e13e77-a359-4421-a9a1-6b9b1fbfa47e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:01:58.358522 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:58.358491    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-istio-token" (OuterVolumeSpecName: "istio-token") pod "04e13e77-a359-4421-a9a1-6b9b1fbfa47e" (UID: "04e13e77-a359-4421-a9a1-6b9b1fbfa47e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:01:58.359218 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:58.359192    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "04e13e77-a359-4421-a9a1-6b9b1fbfa47e" (UID: "04e13e77-a359-4421-a9a1-6b9b1fbfa47e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 20:01:58.359218 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:58.359209    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-kube-api-access-p5nj8" (OuterVolumeSpecName: "kube-api-access-p5nj8") pod "04e13e77-a359-4421-a9a1-6b9b1fbfa47e" (UID: "04e13e77-a359-4421-a9a1-6b9b1fbfa47e"). InnerVolumeSpecName "kube-api-access-p5nj8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:01:58.359348 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:58.359218    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "04e13e77-a359-4421-a9a1-6b9b1fbfa47e" (UID: "04e13e77-a359-4421-a9a1-6b9b1fbfa47e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:01:58.457138 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:58.457101    2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-istio-data\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:01:58.457138 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:58.457134    2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-credential-socket\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:01:58.457138 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:58.457144    2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-workload-certs\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:01:58.457390 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:58.457152    2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-istio-envoy\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:01:58.457390 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:58.457161    2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-istio-podinfo\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:01:58.457390 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:58.457168    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5nj8\" (UniqueName: \"kubernetes.io/projected/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-kube-api-access-p5nj8\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:01:58.457390 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:58.457177    2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04e13e77-a359-4421-a9a1-6b9b1fbfa47e-istio-token\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:01:59.223180 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:59.223140    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h" event={"ID":"04e13e77-a359-4421-a9a1-6b9b1fbfa47e","Type":"ContainerDied","Data":"3c1caa59ebbd299f03fb789f6bddc7a1d88f7e1b0674c51b82c6792a3a4a3ce1"}
Jul 06 20:01:59.223612 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:59.223191    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h"
Jul 06 20:01:59.223612 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:59.223214    2555 scope.go:117] "RemoveContainer" containerID="6cecd7a234b04e7791b58bdc487a6b4e969f0380fd0cb60f2dd9887d94d3beb7"
Jul 06 20:01:59.253533 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:59.253504    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h"]
Jul 06 20:01:59.255089 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:01:59.255066    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-b05069-openshift-default-5746f44b7c-b4p9h"]
Jul 06 20:02:00.130556 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:00.130520    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04e13e77-a359-4421-a9a1-6b9b1fbfa47e" path="/var/lib/kubelet/pods/04e13e77-a359-4421-a9a1-6b9b1fbfa47e/volumes"
Jul 06 20:02:00.307885 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:00.307849    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:00.374474 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:00.374439    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:00.565437 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:00.565401    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk"]
Jul 06 20:02:00.565706 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:00.565675    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk" podUID="bea66ecf-2d35-478a-9ab3-3f1593b4a2ad" containerName="istio-proxy" containerID="cri-o://b1e9433b1278a754f463dfce849da243fe04f1b50dc3c4096587cfcffd0171fa" gracePeriod=30
Jul 06 20:02:00.580008 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:00.579981    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:00.816562 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:00.816453    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:01.173887 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.173807    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:01.479866 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.479786    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5"]
Jul 06 20:02:01.480254 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.480137    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88dd88f1-dbba-418b-b66f-3571150b8473" containerName="main"
Jul 06 20:02:01.480254 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.480150    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="88dd88f1-dbba-418b-b66f-3571150b8473" containerName="main"
Jul 06 20:02:01.480254 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.480162    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04e13e77-a359-4421-a9a1-6b9b1fbfa47e" containerName="istio-proxy"
Jul 06 20:02:01.480254 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.480167    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="04e13e77-a359-4421-a9a1-6b9b1fbfa47e" containerName="istio-proxy"
Jul 06 20:02:01.480254 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.480176    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68443e5d-d257-42ab-865c-6682779306bf" containerName="main"
Jul 06 20:02:01.480254 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.480182    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="68443e5d-d257-42ab-865c-6682779306bf" containerName="main"
Jul 06 20:02:01.480254 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.480190    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04e13e77-a359-4421-a9a1-6b9b1fbfa47e" containerName="istio-proxy"
Jul 06 20:02:01.480254 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.480196    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="04e13e77-a359-4421-a9a1-6b9b1fbfa47e" containerName="istio-proxy"
Jul 06 20:02:01.480254 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.480249    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="68443e5d-d257-42ab-865c-6682779306bf" containerName="main"
Jul 06 20:02:01.480254 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.480257    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="04e13e77-a359-4421-a9a1-6b9b1fbfa47e" containerName="istio-proxy"
Jul 06 20:02:01.480584 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.480264    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="04e13e77-a359-4421-a9a1-6b9b1fbfa47e" containerName="istio-proxy"
Jul 06 20:02:01.480584 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.480270    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="88dd88f1-dbba-418b-b66f-3571150b8473" containerName="main"
Jul 06 20:02:01.484711 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.484693    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5"
Jul 06 20:02:01.487248 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.487225    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-d1d6a7-openshift-default-dockercfg-vt5fw\""
Jul 06 20:02:01.497011 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.496986    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5"]
Jul 06 20:02:01.588768 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.588732    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/361d5570-19ca-4323-ad6b-ffe9eec455b7-istio-envoy\") pod \"e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5\" (UID: \"361d5570-19ca-4323-ad6b-ffe9eec455b7\") " pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5"
Jul 06 20:02:01.588768 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.588769    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/361d5570-19ca-4323-ad6b-ffe9eec455b7-istio-token\") pod \"e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5\" (UID: \"361d5570-19ca-4323-ad6b-ffe9eec455b7\") " pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5"
Jul 06 20:02:01.589013 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.588879    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/361d5570-19ca-4323-ad6b-ffe9eec455b7-istio-data\") pod \"e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5\" (UID: \"361d5570-19ca-4323-ad6b-ffe9eec455b7\") " pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5"
Jul 06 20:02:01.589013 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.588933    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/361d5570-19ca-4323-ad6b-ffe9eec455b7-istio-podinfo\") pod \"e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5\" (UID: \"361d5570-19ca-4323-ad6b-ffe9eec455b7\") " pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5"
Jul 06 20:02:01.589013 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.588961    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/361d5570-19ca-4323-ad6b-ffe9eec455b7-credential-socket\") pod \"e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5\" (UID: \"361d5570-19ca-4323-ad6b-ffe9eec455b7\") " pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5"
Jul 06 20:02:01.589013 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.588989    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/361d5570-19ca-4323-ad6b-ffe9eec455b7-workload-socket\") pod \"e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5\" (UID: \"361d5570-19ca-4323-ad6b-ffe9eec455b7\") " pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5"
Jul 06 20:02:01.589157 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.589038    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/361d5570-19ca-4323-ad6b-ffe9eec455b7-istiod-ca-cert\") pod \"e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5\" (UID: \"361d5570-19ca-4323-ad6b-ffe9eec455b7\") " pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5"
Jul 06 20:02:01.589157 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.589068    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88zcm\" (UniqueName: \"kubernetes.io/projected/361d5570-19ca-4323-ad6b-ffe9eec455b7-kube-api-access-88zcm\") pod \"e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5\" (UID: \"361d5570-19ca-4323-ad6b-ffe9eec455b7\") " pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5"
Jul 06 20:02:01.589157 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.589091    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/361d5570-19ca-4323-ad6b-ffe9eec455b7-workload-certs\") pod \"e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5\" (UID: \"361d5570-19ca-4323-ad6b-ffe9eec455b7\") " pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5"
Jul 06 20:02:01.689641 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.689595    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/361d5570-19ca-4323-ad6b-ffe9eec455b7-istio-data\") pod \"e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5\" (UID: \"361d5570-19ca-4323-ad6b-ffe9eec455b7\") " pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5"
Jul 06 20:02:01.689641 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.689645    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/361d5570-19ca-4323-ad6b-ffe9eec455b7-istio-podinfo\") pod \"e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5\" (UID: \"361d5570-19ca-4323-ad6b-ffe9eec455b7\") " pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5"
Jul 06 20:02:01.689896 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.689668    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/361d5570-19ca-4323-ad6b-ffe9eec455b7-credential-socket\") pod \"e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5\" (UID: \"361d5570-19ca-4323-ad6b-ffe9eec455b7\") " pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5"
Jul 06 20:02:01.689896 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.689695    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/361d5570-19ca-4323-ad6b-ffe9eec455b7-workload-socket\") pod \"e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5\" (UID: \"361d5570-19ca-4323-ad6b-ffe9eec455b7\") " pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5"
Jul 06 20:02:01.689896 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.689717    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/361d5570-19ca-4323-ad6b-ffe9eec455b7-istiod-ca-cert\") pod \"e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5\" (UID: \"361d5570-19ca-4323-ad6b-ffe9eec455b7\") " pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5"
Jul 06 20:02:01.689896 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.689736    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88zcm\" (UniqueName: \"kubernetes.io/projected/361d5570-19ca-4323-ad6b-ffe9eec455b7-kube-api-access-88zcm\") pod \"e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5\" (UID: \"361d5570-19ca-4323-ad6b-ffe9eec455b7\") " pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5"
Jul 06 20:02:01.689896 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.689763    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/361d5570-19ca-4323-ad6b-ffe9eec455b7-workload-certs\") pod \"e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5\" (UID: \"361d5570-19ca-4323-ad6b-ffe9eec455b7\") " pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5"
Jul 06 20:02:01.689896 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.689803    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/361d5570-19ca-4323-ad6b-ffe9eec455b7-istio-envoy\") pod \"e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5\" (UID: \"361d5570-19ca-4323-ad6b-ffe9eec455b7\") " pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5"
Jul 06 20:02:01.689896 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.689828    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/361d5570-19ca-4323-ad6b-ffe9eec455b7-istio-token\") pod \"e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5\" (UID: \"361d5570-19ca-4323-ad6b-ffe9eec455b7\") " pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5"
Jul 06 20:02:01.690368 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.690087    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/361d5570-19ca-4323-ad6b-ffe9eec455b7-istio-data\") pod \"e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5\" (UID: \"361d5570-19ca-4323-ad6b-ffe9eec455b7\") " pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5"
Jul 06 20:02:01.690368 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.690288    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/361d5570-19ca-4323-ad6b-ffe9eec455b7-credential-socket\") pod \"e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5\" (UID: \"361d5570-19ca-4323-ad6b-ffe9eec455b7\") " pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5"
Jul 06 20:02:01.690368 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.690353    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/361d5570-19ca-4323-ad6b-ffe9eec455b7-workload-socket\") pod \"e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5\" (UID: \"361d5570-19ca-4323-ad6b-ffe9eec455b7\") " pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5"
Jul 06 20:02:01.690470 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.690377    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/361d5570-19ca-4323-ad6b-ffe9eec455b7-workload-certs\") pod \"e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5\" (UID: \"361d5570-19ca-4323-ad6b-ffe9eec455b7\") " pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5"
Jul 06 20:02:01.690559 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.690541    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/361d5570-19ca-4323-ad6b-ffe9eec455b7-istiod-ca-cert\") pod \"e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5\" (UID: \"361d5570-19ca-4323-ad6b-ffe9eec455b7\") " pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5"
Jul 06 20:02:01.692194 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.692174    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/361d5570-19ca-4323-ad6b-ffe9eec455b7-istio-envoy\") pod \"e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5\" (UID: \"361d5570-19ca-4323-ad6b-ffe9eec455b7\") " pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5"
Jul 06 20:02:01.692435 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.692414    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/361d5570-19ca-4323-ad6b-ffe9eec455b7-istio-podinfo\") pod \"e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5\" (UID: \"361d5570-19ca-4323-ad6b-ffe9eec455b7\") " pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5"
Jul 06 20:02:01.698243 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.698216    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/361d5570-19ca-4323-ad6b-ffe9eec455b7-istio-token\") pod \"e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5\" (UID: \"361d5570-19ca-4323-ad6b-ffe9eec455b7\") " pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5"
Jul 06 20:02:01.698854 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.698835    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88zcm\" (UniqueName: \"kubernetes.io/projected/361d5570-19ca-4323-ad6b-ffe9eec455b7-kube-api-access-88zcm\") pod \"e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5\" (UID: \"361d5570-19ca-4323-ad6b-ffe9eec455b7\") " pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5"
Jul 06 20:02:01.794811 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.794766    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5"
Jul 06 20:02:01.877806 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.877774    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:01.938680 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.938650    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5"]
Jul 06 20:02:01.940105 ip-10-0-131-150 kubenswrapper[2555]: W0706 20:02:01.940080    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod361d5570_19ca_4323_ad6b_ffe9eec455b7.slice/crio-28000bd803e23da2a069ac70675a73fa50678849ab82365608a4a892d992d1f5 WatchSource:0}: Error finding container 28000bd803e23da2a069ac70675a73fa50678849ab82365608a4a892d992d1f5: Status 404 returned error can't find the container with id 28000bd803e23da2a069ac70675a73fa50678849ab82365608a4a892d992d1f5
Jul 06 20:02:01.942145 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.942114    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:02:01.942213 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.942184    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:02:01.942253 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.942212    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:02:01.978449 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:01.978419    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:02.239565 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:02.239447    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5" event={"ID":"361d5570-19ca-4323-ad6b-ffe9eec455b7","Type":"ContainerStarted","Data":"a1f425074c5c6a992f9aed4bc8db1be77772560cf8121ad6d9e6881387f34f2f"}
Jul 06 20:02:02.239565 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:02.239515    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5" event={"ID":"361d5570-19ca-4323-ad6b-ffe9eec455b7","Type":"ContainerStarted","Data":"28000bd803e23da2a069ac70675a73fa50678849ab82365608a4a892d992d1f5"}
Jul 06 20:02:02.259510 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:02.259453    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5" podStartSLOduration=1.259432678 podStartE2EDuration="1.259432678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:02:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:02:02.258876649 +0000 UTC m=+2180.034910050" watchObservedRunningTime="2026-07-06 20:02:02.259432678 +0000 UTC m=+2180.035466076"
Jul 06 20:02:02.795482 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:02.795441    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5"
Jul 06 20:02:02.800513 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:02.800486    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5"
Jul 06 20:02:03.245363 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:03.245279    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5"
Jul 06 20:02:03.246342 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:03.246326    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5"
Jul 06 20:02:04.196671 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:04.196577    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:04.322966 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:04.322932    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:04.423274 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:04.423240    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:04.527117 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:04.527086    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:04.848972 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:04.848847    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:04.944017 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:04.943982    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:05.822379 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:05.822352    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk"
Jul 06 20:02:05.927939 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:05.927821    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-istio-podinfo\") pod \"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad\" (UID: \"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad\") "
Jul 06 20:02:05.927939 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:05.927874    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-workload-socket\") pod \"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad\" (UID: \"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad\") "
Jul 06 20:02:05.927939 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:05.927937    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9pxgf\" (UniqueName: \"kubernetes.io/projected/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-kube-api-access-9pxgf\") pod \"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad\" (UID: \"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad\") "
Jul 06 20:02:05.928210 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:05.927963    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-credential-socket\") pod \"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad\" (UID: \"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad\") "
Jul 06 20:02:05.928210 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:05.927981    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-istio-data\") pod \"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad\" (UID: \"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad\") "
Jul 06 20:02:05.928210 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:05.928127    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-istio-token\") pod \"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad\" (UID: \"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad\") "
Jul 06 20:02:05.928210 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:05.928170    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-istiod-ca-cert\") pod \"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad\" (UID: \"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad\") "
Jul 06 20:02:05.928434 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:05.928247    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-istio-envoy\") pod \"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad\" (UID: \"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad\") "
Jul 06 20:02:05.928434 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:05.928256    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bea66ecf-2d35-478a-9ab3-3f1593b4a2ad" (UID: "bea66ecf-2d35-478a-9ab3-3f1593b4a2ad"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:02:05.928434 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:05.928286    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bea66ecf-2d35-478a-9ab3-3f1593b4a2ad" (UID: "bea66ecf-2d35-478a-9ab3-3f1593b4a2ad"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:02:05.928434 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:05.928319    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-workload-certs\") pod \"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad\" (UID: \"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad\") "
Jul 06 20:02:05.928636 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:05.928564    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bea66ecf-2d35-478a-9ab3-3f1593b4a2ad" (UID: "bea66ecf-2d35-478a-9ab3-3f1593b4a2ad"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:02:05.928636 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:05.928616    2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-workload-socket\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:02:05.928741 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:05.928639    2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-credential-socket\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:02:05.928741 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:05.928678    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bea66ecf-2d35-478a-9ab3-3f1593b4a2ad" (UID: "bea66ecf-2d35-478a-9ab3-3f1593b4a2ad"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:02:05.929083 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:05.929053    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-istio-data" (OuterVolumeSpecName: "istio-data") pod "bea66ecf-2d35-478a-9ab3-3f1593b4a2ad" (UID: "bea66ecf-2d35-478a-9ab3-3f1593b4a2ad"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:02:05.930213 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:05.930192    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bea66ecf-2d35-478a-9ab3-3f1593b4a2ad" (UID: "bea66ecf-2d35-478a-9ab3-3f1593b4a2ad"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 20:02:05.930319 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:05.930305    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bea66ecf-2d35-478a-9ab3-3f1593b4a2ad" (UID: "bea66ecf-2d35-478a-9ab3-3f1593b4a2ad"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:02:05.930384 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:05.930360    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-kube-api-access-9pxgf" (OuterVolumeSpecName: "kube-api-access-9pxgf") pod "bea66ecf-2d35-478a-9ab3-3f1593b4a2ad" (UID: "bea66ecf-2d35-478a-9ab3-3f1593b4a2ad"). InnerVolumeSpecName "kube-api-access-9pxgf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:02:05.930384 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:05.930371    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-istio-token" (OuterVolumeSpecName: "istio-token") pod "bea66ecf-2d35-478a-9ab3-3f1593b4a2ad" (UID: "bea66ecf-2d35-478a-9ab3-3f1593b4a2ad"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:02:06.029584 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:06.029545    2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-istio-podinfo\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:02:06.029584 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:06.029577    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9pxgf\" (UniqueName: \"kubernetes.io/projected/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-kube-api-access-9pxgf\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:02:06.029584 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:06.029592    2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-istio-data\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:02:06.029828 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:06.029604    2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-istio-token\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:02:06.029828 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:06.029616    2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-istiod-ca-cert\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:02:06.029828 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:06.029626    2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-istio-envoy\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:02:06.029828 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:06.029636    2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad-workload-certs\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:02:06.261275 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:06.261166    2555 generic.go:356] "Generic (PLEG): container finished" podID="bea66ecf-2d35-478a-9ab3-3f1593b4a2ad" containerID="b1e9433b1278a754f463dfce849da243fe04f1b50dc3c4096587cfcffd0171fa" exitCode=0
Jul 06 20:02:06.261275 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:06.261212    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk"
Jul 06 20:02:06.261275 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:06.261242    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk" event={"ID":"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad","Type":"ContainerDied","Data":"b1e9433b1278a754f463dfce849da243fe04f1b50dc3c4096587cfcffd0171fa"}
Jul 06 20:02:06.261515 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:06.261307    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk" event={"ID":"bea66ecf-2d35-478a-9ab3-3f1593b4a2ad","Type":"ContainerDied","Data":"89e09f301ef1bb3f62a6fddd42ed29edc648f4cf7bf00cbe69a13f82c8d463f6"}
Jul 06 20:02:06.261515 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:06.261329    2555 scope.go:117] "RemoveContainer" containerID="b1e9433b1278a754f463dfce849da243fe04f1b50dc3c4096587cfcffd0171fa"
Jul 06 20:02:06.270039 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:06.270017    2555 scope.go:117] "RemoveContainer" containerID="c69d75385c9710d2d5a64029797c0543f80db727dbf1a0d040579c102ff283b5"
Jul 06 20:02:06.277949 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:06.277924    2555 scope.go:117] "RemoveContainer" containerID="b1e9433b1278a754f463dfce849da243fe04f1b50dc3c4096587cfcffd0171fa"
Jul 06 20:02:06.278238 ip-10-0-131-150 kubenswrapper[2555]: E0706 20:02:06.278216    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1e9433b1278a754f463dfce849da243fe04f1b50dc3c4096587cfcffd0171fa\": container with ID starting with b1e9433b1278a754f463dfce849da243fe04f1b50dc3c4096587cfcffd0171fa not found: ID does not exist" containerID="b1e9433b1278a754f463dfce849da243fe04f1b50dc3c4096587cfcffd0171fa"
Jul 06 20:02:06.278321 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:06.278245    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1e9433b1278a754f463dfce849da243fe04f1b50dc3c4096587cfcffd0171fa"} err="failed to get container status \"b1e9433b1278a754f463dfce849da243fe04f1b50dc3c4096587cfcffd0171fa\": rpc error: code = NotFound desc = could not find container \"b1e9433b1278a754f463dfce849da243fe04f1b50dc3c4096587cfcffd0171fa\": container with ID starting with b1e9433b1278a754f463dfce849da243fe04f1b50dc3c4096587cfcffd0171fa not found: ID does not exist"
Jul 06 20:02:06.278321 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:06.278264    2555 scope.go:117] "RemoveContainer" containerID="c69d75385c9710d2d5a64029797c0543f80db727dbf1a0d040579c102ff283b5"
Jul 06 20:02:06.278534 ip-10-0-131-150 kubenswrapper[2555]: E0706 20:02:06.278514    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c69d75385c9710d2d5a64029797c0543f80db727dbf1a0d040579c102ff283b5\": container with ID starting with c69d75385c9710d2d5a64029797c0543f80db727dbf1a0d040579c102ff283b5 not found: ID does not exist" containerID="c69d75385c9710d2d5a64029797c0543f80db727dbf1a0d040579c102ff283b5"
Jul 06 20:02:06.278584 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:06.278532    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c69d75385c9710d2d5a64029797c0543f80db727dbf1a0d040579c102ff283b5"} err="failed to get container status \"c69d75385c9710d2d5a64029797c0543f80db727dbf1a0d040579c102ff283b5\": rpc error: code = NotFound desc = could not find container \"c69d75385c9710d2d5a64029797c0543f80db727dbf1a0d040579c102ff283b5\": container with ID starting with c69d75385c9710d2d5a64029797c0543f80db727dbf1a0d040579c102ff283b5 not found: ID does not exist"
Jul 06 20:02:06.279443 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:06.279420    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk"]
Jul 06 20:02:06.286404 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:06.284564    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-66d504-openshift-default-5b74456577-rqqlk"]
Jul 06 20:02:08.130509 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:08.130473    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bea66ecf-2d35-478a-9ab3-3f1593b4a2ad" path="/var/lib/kubelet/pods/bea66ecf-2d35-478a-9ab3-3f1593b4a2ad/volumes"
Jul 06 20:02:08.747735 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:08.747704    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:08.779741 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:08.779705    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 20:02:09.225865 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:09.225832    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:09.542765 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:09.542733    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f"]
Jul 06 20:02:09.543092 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:09.543079    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bea66ecf-2d35-478a-9ab3-3f1593b4a2ad" containerName="istio-proxy"
Jul 06 20:02:09.543139 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:09.543093    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="bea66ecf-2d35-478a-9ab3-3f1593b4a2ad" containerName="istio-proxy"
Jul 06 20:02:09.543139 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:09.543113    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bea66ecf-2d35-478a-9ab3-3f1593b4a2ad" containerName="istio-proxy"
Jul 06 20:02:09.543139 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:09.543118    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="bea66ecf-2d35-478a-9ab3-3f1593b4a2ad" containerName="istio-proxy"
Jul 06 20:02:09.543230 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:09.543172    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="bea66ecf-2d35-478a-9ab3-3f1593b4a2ad" containerName="istio-proxy"
Jul 06 20:02:09.547511 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:09.547491    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f"
Jul 06 20:02:09.549890 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:09.549865    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-47ea5d-openshift-default-dockercfg-j8dd7\""
Jul 06 20:02:09.561465 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:09.561440    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f"]
Jul 06 20:02:09.584181 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:09.584149    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:09.662362 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:09.662325    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-workload-certs\") pod \"e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f\" (UID: \"e5e609df-ec7c-4d25-ae44-e77d0d2d4279\") " pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f"
Jul 06 20:02:09.662362 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:09.662364    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlm4l\" (UniqueName: \"kubernetes.io/projected/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-kube-api-access-rlm4l\") pod \"e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f\" (UID: \"e5e609df-ec7c-4d25-ae44-e77d0d2d4279\") " pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f"
Jul 06 20:02:09.662632 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:09.662390    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-istio-podinfo\") pod \"e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f\" (UID: \"e5e609df-ec7c-4d25-ae44-e77d0d2d4279\") " pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f"
Jul 06 20:02:09.662632 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:09.662406    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-istiod-ca-cert\") pod \"e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f\" (UID: \"e5e609df-ec7c-4d25-ae44-e77d0d2d4279\") " pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f"
Jul 06 20:02:09.662632 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:09.662494    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-istio-data\") pod \"e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f\" (UID: \"e5e609df-ec7c-4d25-ae44-e77d0d2d4279\") " pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f"
Jul 06 20:02:09.662632 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:09.662552    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-credential-socket\") pod \"e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f\" (UID: \"e5e609df-ec7c-4d25-ae44-e77d0d2d4279\") " pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f"
Jul 06 20:02:09.662632 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:09.662578    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-istio-envoy\") pod \"e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f\" (UID: \"e5e609df-ec7c-4d25-ae44-e77d0d2d4279\") " pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f"
Jul 06 20:02:09.662632 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:09.662622    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-workload-socket\") pod \"e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f\" (UID: \"e5e609df-ec7c-4d25-ae44-e77d0d2d4279\") " pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f"
Jul 06 20:02:09.662857 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:09.662644    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-istio-token\") pod \"e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f\" (UID: \"e5e609df-ec7c-4d25-ae44-e77d0d2d4279\") " pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f"
Jul 06 20:02:09.679182 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:09.679145    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:09.764013 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:09.763971    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-credential-socket\") pod \"e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f\" (UID: \"e5e609df-ec7c-4d25-ae44-e77d0d2d4279\") " pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f"
Jul 06 20:02:09.764212 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:09.764022    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-istio-envoy\") pod \"e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f\" (UID: \"e5e609df-ec7c-4d25-ae44-e77d0d2d4279\") " pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f"
Jul 06 20:02:09.764212 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:09.764076    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-workload-socket\") pod \"e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f\" (UID: \"e5e609df-ec7c-4d25-ae44-e77d0d2d4279\") " pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f"
Jul 06 20:02:09.764212 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:09.764103    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-istio-token\") pod \"e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f\" (UID: \"e5e609df-ec7c-4d25-ae44-e77d0d2d4279\") " pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f"
Jul 06 20:02:09.764212 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:09.764170    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-workload-certs\") pod \"e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f\" (UID: \"e5e609df-ec7c-4d25-ae44-e77d0d2d4279\") " pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f"
Jul 06 20:02:09.764212 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:09.764204    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlm4l\" (UniqueName: \"kubernetes.io/projected/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-kube-api-access-rlm4l\") pod \"e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f\" (UID: \"e5e609df-ec7c-4d25-ae44-e77d0d2d4279\") " pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f"
Jul 06 20:02:09.764537 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:09.764244    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-istio-podinfo\") pod \"e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f\" (UID: \"e5e609df-ec7c-4d25-ae44-e77d0d2d4279\") " pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f"
Jul 06 20:02:09.764537 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:09.764268    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-istiod-ca-cert\") pod \"e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f\" (UID: \"e5e609df-ec7c-4d25-ae44-e77d0d2d4279\") " pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f"
Jul 06 20:02:09.764537 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:09.764323    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-istio-data\") pod \"e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f\" (UID: \"e5e609df-ec7c-4d25-ae44-e77d0d2d4279\") " pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f"
Jul 06 20:02:09.764537 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:09.764498    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-credential-socket\") pod \"e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f\" (UID: \"e5e609df-ec7c-4d25-ae44-e77d0d2d4279\") " pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f"
Jul 06 20:02:09.764753 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:09.764672    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-istio-data\") pod \"e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f\" (UID: \"e5e609df-ec7c-4d25-ae44-e77d0d2d4279\") " pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f"
Jul 06 20:02:09.764850 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:09.764824    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-workload-certs\") pod \"e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f\" (UID: \"e5e609df-ec7c-4d25-ae44-e77d0d2d4279\") " pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f"
Jul 06 20:02:09.765536 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:09.765511    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-workload-socket\") pod \"e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f\" (UID: \"e5e609df-ec7c-4d25-ae44-e77d0d2d4279\") " pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f"
Jul 06 20:02:09.765897 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:09.765872    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-istiod-ca-cert\") pod \"e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f\" (UID: \"e5e609df-ec7c-4d25-ae44-e77d0d2d4279\") " pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f"
Jul 06 20:02:09.768040 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:09.768018    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-istio-envoy\") pod \"e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f\" (UID: \"e5e609df-ec7c-4d25-ae44-e77d0d2d4279\") " pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f"
Jul 06 20:02:09.768155 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:09.768066    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-istio-podinfo\") pod \"e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f\" (UID: \"e5e609df-ec7c-4d25-ae44-e77d0d2d4279\") " pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f"
Jul 06 20:02:09.774194 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:09.774157    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-istio-token\") pod \"e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f\" (UID: \"e5e609df-ec7c-4d25-ae44-e77d0d2d4279\") " pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f"
Jul 06 20:02:09.774511 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:09.774490    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlm4l\" (UniqueName: \"kubernetes.io/projected/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-kube-api-access-rlm4l\") pod \"e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f\" (UID: \"e5e609df-ec7c-4d25-ae44-e77d0d2d4279\") " pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f"
Jul 06 20:02:09.857876 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:09.857773    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f"
Jul 06 20:02:10.041986 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:10.030367    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f"]
Jul 06 20:02:10.046901 ip-10-0-131-150 kubenswrapper[2555]: W0706 20:02:10.046864    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5e609df_ec7c_4d25_ae44_e77d0d2d4279.slice/crio-ecace70094bc2020e6db4ce3c6e19d14a3e9c0f0be6a68f527b6f6fd640ffd06 WatchSource:0}: Error finding container ecace70094bc2020e6db4ce3c6e19d14a3e9c0f0be6a68f527b6f6fd640ffd06: Status 404 returned error can't find the container with id ecace70094bc2020e6db4ce3c6e19d14a3e9c0f0be6a68f527b6f6fd640ffd06
Jul 06 20:02:10.049397 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:10.049361    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:02:10.049492 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:10.049451    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:02:10.049492 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:10.049482    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:02:10.288117 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:10.288074    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f" event={"ID":"e5e609df-ec7c-4d25-ae44-e77d0d2d4279","Type":"ContainerStarted","Data":"3c324dc8c2df7ef3e83cdece389011a0724ed64ea4fd176e380df5642073242a"}
Jul 06 20:02:10.288534 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:10.288144    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f" event={"ID":"e5e609df-ec7c-4d25-ae44-e77d0d2d4279","Type":"ContainerStarted","Data":"ecace70094bc2020e6db4ce3c6e19d14a3e9c0f0be6a68f527b6f6fd640ffd06"}
Jul 06 20:02:10.311575 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:10.311522    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f" podStartSLOduration=1.311506431 podStartE2EDuration="1.311506431s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:02:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:02:10.309756272 +0000 UTC m=+2188.085789694" watchObservedRunningTime="2026-07-06 20:02:10.311506431 +0000 UTC m=+2188.087539832"
Jul 06 20:02:10.857956 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:10.857895    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f"
Jul 06 20:02:11.864162 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:11.864130    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f"
Jul 06 20:02:12.244508 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:12.244405    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:12.303776 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:12.303742    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f"
Jul 06 20:02:12.304642 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:12.304621    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f"
Jul 06 20:02:12.351780 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:12.351735    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:12.429971 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:12.429938    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:12.785764 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:12.785722    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:12.942618 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:12.942579    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:13.138259 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:13.138167    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:16.166384 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:16.166347    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:16.270219 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:16.270178    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:16.815980 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:16.815947    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:17.328847 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:17.328816    2555 generic.go:356] "Generic (PLEG): container finished" podID="361d5570-19ca-4323-ad6b-ffe9eec455b7" containerID="a1f425074c5c6a992f9aed4bc8db1be77772560cf8121ad6d9e6881387f34f2f" exitCode=0
Jul 06 20:02:17.329281 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:17.328876    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5" event={"ID":"361d5570-19ca-4323-ad6b-ffe9eec455b7","Type":"ContainerDied","Data":"a1f425074c5c6a992f9aed4bc8db1be77772560cf8121ad6d9e6881387f34f2f"}
Jul 06 20:02:17.329331 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:17.329296    2555 scope.go:117] "RemoveContainer" containerID="a1f425074c5c6a992f9aed4bc8db1be77772560cf8121ad6d9e6881387f34f2f"
Jul 06 20:02:17.330272 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:17.330243    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:02:17.330371 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:17.330328    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:02:17.330434 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:17.330388    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:02:18.245430 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:18.245386    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5"
Jul 06 20:02:18.339115 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:18.339064    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5" event={"ID":"361d5570-19ca-4323-ad6b-ffe9eec455b7","Type":"ContainerStarted","Data":"63c1686014e6d188ae6577fc306a893782c143a16046667e35650fe08bd0e556"}
Jul 06 20:02:18.794993 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:18.794956    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5"
Jul 06 20:02:18.796151 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:18.796126    2555 patch_prober.go:28] interesting pod/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 06 20:02:18.796255 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:18.796184    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5" podUID="361d5570-19ca-4323-ad6b-ffe9eec455b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 06 20:02:19.795999 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:19.795960    2555 patch_prober.go:28] interesting pod/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 06 20:02:19.796389 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:19.796028    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5" podUID="361d5570-19ca-4323-ad6b-ffe9eec455b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 06 20:02:20.303957 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:20.303924    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 20:02:20.795735 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:20.795701    2555 patch_prober.go:28] interesting pod/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 06 20:02:20.795903 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:20.795759    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5" podUID="361d5570-19ca-4323-ad6b-ffe9eec455b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 06 20:02:21.795524 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:21.795481    2555 patch_prober.go:28] interesting pod/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 06 20:02:21.795975 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:21.795554    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5" podUID="361d5570-19ca-4323-ad6b-ffe9eec455b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 06 20:02:22.799660 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:22.799626    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5"
Jul 06 20:02:22.800162 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:22.799948    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5"
Jul 06 20:02:22.800680 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:22.800663    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5"
Jul 06 20:02:25.240960 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:25.240923    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:25.700185 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:25.700149    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:25.941239 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:25.941183    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:26.068081 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:26.068044    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:26.334048 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:26.333936    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:28.345099 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:28.345055    2555 patch_prober.go:28] interesting pod/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 06 20:02:28.345521 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:28.345123    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f" podUID="e5e609df-ec7c-4d25-ae44-e77d0d2d4279" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 20:02:29.398001 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:29.397968    2555 generic.go:356] "Generic (PLEG): container finished" podID="e5e609df-ec7c-4d25-ae44-e77d0d2d4279" containerID="3c324dc8c2df7ef3e83cdece389011a0724ed64ea4fd176e380df5642073242a" exitCode=0
Jul 06 20:02:29.398458 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:29.398013    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f" event={"ID":"e5e609df-ec7c-4d25-ae44-e77d0d2d4279","Type":"ContainerDied","Data":"3c324dc8c2df7ef3e83cdece389011a0724ed64ea4fd176e380df5642073242a"}
Jul 06 20:02:29.398458 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:29.398372    2555 scope.go:117] "RemoveContainer" containerID="3c324dc8c2df7ef3e83cdece389011a0724ed64ea4fd176e380df5642073242a"
Jul 06 20:02:29.399372 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:29.399339    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:02:29.399496 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:29.399423    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:02:29.399496 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:29.399471    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:02:30.404571 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:30.404529    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f" event={"ID":"e5e609df-ec7c-4d25-ae44-e77d0d2d4279","Type":"ContainerStarted","Data":"e24baa6dd0dc3129a6c6b5a1353129489d730beb1d16f444f7f6b70b99aaa394"}
Jul 06 20:02:30.858945 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:30.858890    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f"
Jul 06 20:02:30.859153 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:30.859129    2555 patch_prober.go:28] interesting pod/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 06 20:02:30.859204 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:30.859182    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f" podUID="e5e609df-ec7c-4d25-ae44-e77d0d2d4279" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 06 20:02:31.858747 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:31.858703    2555 patch_prober.go:28] interesting pod/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 06 20:02:31.859178 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:31.858774    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f" podUID="e5e609df-ec7c-4d25-ae44-e77d0d2d4279" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 06 20:02:32.002462 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:32.002426    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:32.083014 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:32.082982    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:32.284870 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:32.284840    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5"]
Jul 06 20:02:32.285099 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:32.285074    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5" podUID="361d5570-19ca-4323-ad6b-ffe9eec455b7" containerName="istio-proxy" containerID="cri-o://63c1686014e6d188ae6577fc306a893782c143a16046667e35650fe08bd0e556" gracePeriod=30
Jul 06 20:02:32.304739 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:32.304709    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:32.427493 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:32.427438    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 20:02:32.549823 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:32.549734    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:32.729029 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:32.728998    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:32.858309 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:32.858222    2555 patch_prober.go:28] interesting pod/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 06 20:02:32.858309 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:32.858275    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f" podUID="e5e609df-ec7c-4d25-ae44-e77d0d2d4279" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 06 20:02:33.163635 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:33.163546    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:33.260399 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:33.260358    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:33.360733 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:33.360698    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:33.650694 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:33.650662    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:33.858503 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:33.858462    2555 patch_prober.go:28] interesting pod/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 06 20:02:33.858682 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:33.858520    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f" podUID="e5e609df-ec7c-4d25-ae44-e77d0d2d4279" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 06 20:02:34.861805 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:34.861774    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f"
Jul 06 20:02:34.862186 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:34.862134    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f"
Jul 06 20:02:34.862747 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:34.862729    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f"
Jul 06 20:02:37.443830 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:37.443797    2555 generic.go:356] "Generic (PLEG): container finished" podID="361d5570-19ca-4323-ad6b-ffe9eec455b7" containerID="63c1686014e6d188ae6577fc306a893782c143a16046667e35650fe08bd0e556" exitCode=0
Jul 06 20:02:37.444300 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:37.443871    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5" event={"ID":"361d5570-19ca-4323-ad6b-ffe9eec455b7","Type":"ContainerDied","Data":"63c1686014e6d188ae6577fc306a893782c143a16046667e35650fe08bd0e556"}
Jul 06 20:02:37.444300 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:37.443956    2555 scope.go:117] "RemoveContainer" containerID="a1f425074c5c6a992f9aed4bc8db1be77772560cf8121ad6d9e6881387f34f2f"
Jul 06 20:02:37.548869 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:37.548809    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5"
Jul 06 20:02:37.624501 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:37.624462    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/361d5570-19ca-4323-ad6b-ffe9eec455b7-istiod-ca-cert\") pod \"361d5570-19ca-4323-ad6b-ffe9eec455b7\" (UID: \"361d5570-19ca-4323-ad6b-ffe9eec455b7\") "
Jul 06 20:02:37.624501 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:37.624501    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88zcm\" (UniqueName: \"kubernetes.io/projected/361d5570-19ca-4323-ad6b-ffe9eec455b7-kube-api-access-88zcm\") pod \"361d5570-19ca-4323-ad6b-ffe9eec455b7\" (UID: \"361d5570-19ca-4323-ad6b-ffe9eec455b7\") "
Jul 06 20:02:37.624820 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:37.624533    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/361d5570-19ca-4323-ad6b-ffe9eec455b7-istio-token\") pod \"361d5570-19ca-4323-ad6b-ffe9eec455b7\" (UID: \"361d5570-19ca-4323-ad6b-ffe9eec455b7\") "
Jul 06 20:02:37.624820 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:37.624567    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/361d5570-19ca-4323-ad6b-ffe9eec455b7-istio-envoy\") pod \"361d5570-19ca-4323-ad6b-ffe9eec455b7\" (UID: \"361d5570-19ca-4323-ad6b-ffe9eec455b7\") "
Jul 06 20:02:37.624820 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:37.624701    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/361d5570-19ca-4323-ad6b-ffe9eec455b7-credential-socket\") pod \"361d5570-19ca-4323-ad6b-ffe9eec455b7\" (UID: \"361d5570-19ca-4323-ad6b-ffe9eec455b7\") "
Jul 06 20:02:37.624820 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:37.624739    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/361d5570-19ca-4323-ad6b-ffe9eec455b7-workload-socket\") pod \"361d5570-19ca-4323-ad6b-ffe9eec455b7\" (UID: \"361d5570-19ca-4323-ad6b-ffe9eec455b7\") "
Jul 06 20:02:37.624820 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:37.624796    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/361d5570-19ca-4323-ad6b-ffe9eec455b7-workload-certs\") pod \"361d5570-19ca-4323-ad6b-ffe9eec455b7\" (UID: \"361d5570-19ca-4323-ad6b-ffe9eec455b7\") "
Jul 06 20:02:37.624820 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:37.624823    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/361d5570-19ca-4323-ad6b-ffe9eec455b7-istio-podinfo\") pod \"361d5570-19ca-4323-ad6b-ffe9eec455b7\" (UID: \"361d5570-19ca-4323-ad6b-ffe9eec455b7\") "
Jul 06 20:02:37.625173 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:37.624868    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/361d5570-19ca-4323-ad6b-ffe9eec455b7-istio-data\") pod \"361d5570-19ca-4323-ad6b-ffe9eec455b7\" (UID: \"361d5570-19ca-4323-ad6b-ffe9eec455b7\") "
Jul 06 20:02:37.625173 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:37.625009    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/361d5570-19ca-4323-ad6b-ffe9eec455b7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "361d5570-19ca-4323-ad6b-ffe9eec455b7" (UID: "361d5570-19ca-4323-ad6b-ffe9eec455b7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:02:37.625173 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:37.625057    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/361d5570-19ca-4323-ad6b-ffe9eec455b7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "361d5570-19ca-4323-ad6b-ffe9eec455b7" (UID: "361d5570-19ca-4323-ad6b-ffe9eec455b7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:02:37.625353 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:37.625216    2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/361d5570-19ca-4323-ad6b-ffe9eec455b7-istiod-ca-cert\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:02:37.625353 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:37.625237    2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/361d5570-19ca-4323-ad6b-ffe9eec455b7-credential-socket\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:02:37.625353 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:37.625236    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/361d5570-19ca-4323-ad6b-ffe9eec455b7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "361d5570-19ca-4323-ad6b-ffe9eec455b7" (UID: "361d5570-19ca-4323-ad6b-ffe9eec455b7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:02:37.625353 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:37.625332    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/361d5570-19ca-4323-ad6b-ffe9eec455b7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "361d5570-19ca-4323-ad6b-ffe9eec455b7" (UID: "361d5570-19ca-4323-ad6b-ffe9eec455b7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:02:37.625796 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:37.625775    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/361d5570-19ca-4323-ad6b-ffe9eec455b7-istio-data" (OuterVolumeSpecName: "istio-data") pod "361d5570-19ca-4323-ad6b-ffe9eec455b7" (UID: "361d5570-19ca-4323-ad6b-ffe9eec455b7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:02:37.626888 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:37.626870    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/361d5570-19ca-4323-ad6b-ffe9eec455b7-kube-api-access-88zcm" (OuterVolumeSpecName: "kube-api-access-88zcm") pod "361d5570-19ca-4323-ad6b-ffe9eec455b7" (UID: "361d5570-19ca-4323-ad6b-ffe9eec455b7"). InnerVolumeSpecName "kube-api-access-88zcm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:02:37.627158 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:37.627140    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/361d5570-19ca-4323-ad6b-ffe9eec455b7-istio-token" (OuterVolumeSpecName: "istio-token") pod "361d5570-19ca-4323-ad6b-ffe9eec455b7" (UID: "361d5570-19ca-4323-ad6b-ffe9eec455b7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:02:37.627268 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:37.627249    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/361d5570-19ca-4323-ad6b-ffe9eec455b7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "361d5570-19ca-4323-ad6b-ffe9eec455b7" (UID: "361d5570-19ca-4323-ad6b-ffe9eec455b7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:02:37.627320 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:37.627283    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/361d5570-19ca-4323-ad6b-ffe9eec455b7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "361d5570-19ca-4323-ad6b-ffe9eec455b7" (UID: "361d5570-19ca-4323-ad6b-ffe9eec455b7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 20:02:37.726659 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:37.726611    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88zcm\" (UniqueName: \"kubernetes.io/projected/361d5570-19ca-4323-ad6b-ffe9eec455b7-kube-api-access-88zcm\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:02:37.726659 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:37.726653    2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/361d5570-19ca-4323-ad6b-ffe9eec455b7-istio-token\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:02:37.726659 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:37.726667    2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/361d5570-19ca-4323-ad6b-ffe9eec455b7-istio-envoy\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:02:37.726905 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:37.726678    2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/361d5570-19ca-4323-ad6b-ffe9eec455b7-workload-socket\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:02:37.726905 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:37.726690    2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/361d5570-19ca-4323-ad6b-ffe9eec455b7-workload-certs\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:02:37.726905 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:37.726700    2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/361d5570-19ca-4323-ad6b-ffe9eec455b7-istio-podinfo\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:02:37.726905 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:37.726712    2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/361d5570-19ca-4323-ad6b-ffe9eec455b7-istio-data\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:02:38.449791 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:38.449709    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5"
Jul 06 20:02:38.449791 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:38.449737    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5" event={"ID":"361d5570-19ca-4323-ad6b-ffe9eec455b7","Type":"ContainerDied","Data":"28000bd803e23da2a069ac70675a73fa50678849ab82365608a4a892d992d1f5"}
Jul 06 20:02:38.450285 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:38.449795    2555 scope.go:117] "RemoveContainer" containerID="63c1686014e6d188ae6577fc306a893782c143a16046667e35650fe08bd0e556"
Jul 06 20:02:38.474532 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:38.474497    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5"]
Jul 06 20:02:38.482171 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:38.482145    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-d1d6a7-openshift-default-89b4c8997-ps6v5"]
Jul 06 20:02:39.403873 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:39.403841    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:39.503673 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:39.503627    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:39.668940 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:39.668817    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f"]
Jul 06 20:02:39.669099 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:39.669046    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f" podUID="e5e609df-ec7c-4d25-ae44-e77d0d2d4279" containerName="istio-proxy" containerID="cri-o://e24baa6dd0dc3129a6c6b5a1353129489d730beb1d16f444f7f6b70b99aaa394" gracePeriod=30
Jul 06 20:02:39.711019 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:39.710966    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:39.962473 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:39.962384    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:40.130002 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:40.129967    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="361d5570-19ca-4323-ad6b-ffe9eec455b7" path="/var/lib/kubelet/pods/361d5570-19ca-4323-ad6b-ffe9eec455b7/volumes"
Jul 06 20:02:40.273010 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:40.272984    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 20:02:40.464289 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:40.464259    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:40.688418 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:40.688337    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4"]
Jul 06 20:02:40.688780 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:40.688731    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="361d5570-19ca-4323-ad6b-ffe9eec455b7" containerName="istio-proxy"
Jul 06 20:02:40.688780 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:40.688743    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="361d5570-19ca-4323-ad6b-ffe9eec455b7" containerName="istio-proxy"
Jul 06 20:02:40.688780 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:40.688760    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="361d5570-19ca-4323-ad6b-ffe9eec455b7" containerName="istio-proxy"
Jul 06 20:02:40.688780 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:40.688769    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="361d5570-19ca-4323-ad6b-ffe9eec455b7" containerName="istio-proxy"
Jul 06 20:02:40.688981 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:40.688828    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="bea66ecf-2d35-478a-9ab3-3f1593b4a2ad" containerName="istio-proxy"
Jul 06 20:02:40.688981 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:40.688839    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="361d5570-19ca-4323-ad6b-ffe9eec455b7" containerName="istio-proxy"
Jul 06 20:02:40.688981 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:40.688850    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="361d5570-19ca-4323-ad6b-ffe9eec455b7" containerName="istio-proxy"
Jul 06 20:02:40.691758 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:40.691740    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4"
Jul 06 20:02:40.696121 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:40.696097    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-96f4cb-openshift-default-dockercfg-s59sq\""
Jul 06 20:02:40.714014 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:40.713985    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4"]
Jul 06 20:02:40.741823 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:40.741779    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:40.851726 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:40.851692    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0cc16ed7-2e39-4e18-9fcb-343ab3392297-istio-data\") pod \"e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4\" (UID: \"0cc16ed7-2e39-4e18-9fcb-343ab3392297\") " pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4"
Jul 06 20:02:40.851931 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:40.851731    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cc16ed7-2e39-4e18-9fcb-343ab3392297-workload-socket\") pod \"e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4\" (UID: \"0cc16ed7-2e39-4e18-9fcb-343ab3392297\") " pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4"
Jul 06 20:02:40.851931 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:40.851752    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0cc16ed7-2e39-4e18-9fcb-343ab3392297-istiod-ca-cert\") pod \"e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4\" (UID: \"0cc16ed7-2e39-4e18-9fcb-343ab3392297\") " pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4"
Jul 06 20:02:40.851931 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:40.851831    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0cc16ed7-2e39-4e18-9fcb-343ab3392297-istio-envoy\") pod \"e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4\" (UID: \"0cc16ed7-2e39-4e18-9fcb-343ab3392297\") " pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4"
Jul 06 20:02:40.851931 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:40.851867    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cc16ed7-2e39-4e18-9fcb-343ab3392297-credential-socket\") pod \"e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4\" (UID: \"0cc16ed7-2e39-4e18-9fcb-343ab3392297\") " pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4"
Jul 06 20:02:40.852085 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:40.851902    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0cc16ed7-2e39-4e18-9fcb-343ab3392297-workload-certs\") pod \"e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4\" (UID: \"0cc16ed7-2e39-4e18-9fcb-343ab3392297\") " pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4"
Jul 06 20:02:40.852085 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:40.851989    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbwsx\" (UniqueName: \"kubernetes.io/projected/0cc16ed7-2e39-4e18-9fcb-343ab3392297-kube-api-access-fbwsx\") pod \"e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4\" (UID: \"0cc16ed7-2e39-4e18-9fcb-343ab3392297\") " pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4"
Jul 06 20:02:40.852085 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:40.852037    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0cc16ed7-2e39-4e18-9fcb-343ab3392297-istio-podinfo\") pod \"e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4\" (UID: \"0cc16ed7-2e39-4e18-9fcb-343ab3392297\") " pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4"
Jul 06 20:02:40.852085 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:40.852059    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0cc16ed7-2e39-4e18-9fcb-343ab3392297-istio-token\") pod \"e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4\" (UID: \"0cc16ed7-2e39-4e18-9fcb-343ab3392297\") " pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4"
Jul 06 20:02:40.953338 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:40.953254    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0cc16ed7-2e39-4e18-9fcb-343ab3392297-istio-token\") pod \"e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4\" (UID: \"0cc16ed7-2e39-4e18-9fcb-343ab3392297\") " pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4"
Jul 06 20:02:40.953338 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:40.953298    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0cc16ed7-2e39-4e18-9fcb-343ab3392297-istio-data\") pod \"e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4\" (UID: \"0cc16ed7-2e39-4e18-9fcb-343ab3392297\") " pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4"
Jul 06 20:02:40.953338 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:40.953325    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cc16ed7-2e39-4e18-9fcb-343ab3392297-workload-socket\") pod \"e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4\" (UID: \"0cc16ed7-2e39-4e18-9fcb-343ab3392297\") " pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4"
Jul 06 20:02:40.953612 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:40.953341    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0cc16ed7-2e39-4e18-9fcb-343ab3392297-istiod-ca-cert\") pod \"e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4\" (UID: \"0cc16ed7-2e39-4e18-9fcb-343ab3392297\") " pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4"
Jul 06 20:02:40.953612 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:40.953366    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0cc16ed7-2e39-4e18-9fcb-343ab3392297-istio-envoy\") pod \"e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4\" (UID: \"0cc16ed7-2e39-4e18-9fcb-343ab3392297\") " pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4"
Jul 06 20:02:40.953612 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:40.953393    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cc16ed7-2e39-4e18-9fcb-343ab3392297-credential-socket\") pod \"e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4\" (UID: \"0cc16ed7-2e39-4e18-9fcb-343ab3392297\") " pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4"
Jul 06 20:02:40.953612 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:40.953434    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0cc16ed7-2e39-4e18-9fcb-343ab3392297-workload-certs\") pod \"e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4\" (UID: \"0cc16ed7-2e39-4e18-9fcb-343ab3392297\") " pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4"
Jul 06 20:02:40.953612 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:40.953458    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbwsx\" (UniqueName: \"kubernetes.io/projected/0cc16ed7-2e39-4e18-9fcb-343ab3392297-kube-api-access-fbwsx\") pod \"e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4\" (UID: \"0cc16ed7-2e39-4e18-9fcb-343ab3392297\") " pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4"
Jul 06 20:02:40.953612 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:40.953530    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0cc16ed7-2e39-4e18-9fcb-343ab3392297-istio-podinfo\") pod \"e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4\" (UID: \"0cc16ed7-2e39-4e18-9fcb-343ab3392297\") " pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4"
Jul 06 20:02:40.953926 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:40.953788    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cc16ed7-2e39-4e18-9fcb-343ab3392297-workload-socket\") pod \"e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4\" (UID: \"0cc16ed7-2e39-4e18-9fcb-343ab3392297\") " pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4"
Jul 06 20:02:40.953926 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:40.953853    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cc16ed7-2e39-4e18-9fcb-343ab3392297-credential-socket\") pod \"e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4\" (UID: \"0cc16ed7-2e39-4e18-9fcb-343ab3392297\") " pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4"
Jul 06 20:02:40.954056 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:40.953944    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0cc16ed7-2e39-4e18-9fcb-343ab3392297-workload-certs\") pod \"e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4\" (UID: \"0cc16ed7-2e39-4e18-9fcb-343ab3392297\") " pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4"
Jul 06 20:02:40.954109 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:40.954050    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0cc16ed7-2e39-4e18-9fcb-343ab3392297-istio-data\") pod \"e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4\" (UID: \"0cc16ed7-2e39-4e18-9fcb-343ab3392297\") " pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4"
Jul 06 20:02:40.954176 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:40.954157    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0cc16ed7-2e39-4e18-9fcb-343ab3392297-istiod-ca-cert\") pod \"e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4\" (UID: \"0cc16ed7-2e39-4e18-9fcb-343ab3392297\") " pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4"
Jul 06 20:02:40.955771 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:40.955748    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0cc16ed7-2e39-4e18-9fcb-343ab3392297-istio-envoy\") pod \"e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4\" (UID: \"0cc16ed7-2e39-4e18-9fcb-343ab3392297\") " pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4"
Jul 06 20:02:40.956000 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:40.955982    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0cc16ed7-2e39-4e18-9fcb-343ab3392297-istio-podinfo\") pod \"e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4\" (UID: \"0cc16ed7-2e39-4e18-9fcb-343ab3392297\") " pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4"
Jul 06 20:02:40.965269 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:40.965234    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0cc16ed7-2e39-4e18-9fcb-343ab3392297-istio-token\") pod \"e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4\" (UID: \"0cc16ed7-2e39-4e18-9fcb-343ab3392297\") " pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4"
Jul 06 20:02:40.965405 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:40.965348    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbwsx\" (UniqueName: \"kubernetes.io/projected/0cc16ed7-2e39-4e18-9fcb-343ab3392297-kube-api-access-fbwsx\") pod \"e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4\" (UID: \"0cc16ed7-2e39-4e18-9fcb-343ab3392297\") " pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4"
Jul 06 20:02:40.986848 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:40.986817    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:41.001970 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:41.001940    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4"
Jul 06 20:02:41.149677 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:41.149651    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4"]
Jul 06 20:02:41.151212 ip-10-0-131-150 kubenswrapper[2555]: W0706 20:02:41.151188    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cc16ed7_2e39_4e18_9fcb_343ab3392297.slice/crio-0f0dbb591418b32c494f56b82981039c52935414c0e7b31532215b76ed5c25de WatchSource:0}: Error finding container 0f0dbb591418b32c494f56b82981039c52935414c0e7b31532215b76ed5c25de: Status 404 returned error can't find the container with id 0f0dbb591418b32c494f56b82981039c52935414c0e7b31532215b76ed5c25de
Jul 06 20:02:41.153326 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:41.153293    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:02:41.153413 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:41.153369    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:02:41.153413 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:41.153403    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:02:41.468043 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:41.468010    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4" event={"ID":"0cc16ed7-2e39-4e18-9fcb-343ab3392297","Type":"ContainerStarted","Data":"3193283fcd0d18dad7ac98fd6edeeea57a35b4ef3f370ef2cea8a10eab1aa675"}
Jul 06 20:02:41.468215 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:41.468069    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4" event={"ID":"0cc16ed7-2e39-4e18-9fcb-343ab3392297","Type":"ContainerStarted","Data":"0f0dbb591418b32c494f56b82981039c52935414c0e7b31532215b76ed5c25de"}
Jul 06 20:02:42.002073 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:42.002034    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4"
Jul 06 20:02:42.006899 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:42.006873    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4"
Jul 06 20:02:42.029955 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:42.029885    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4" podStartSLOduration=2.029871223 podStartE2EDuration="2.029871223s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:02:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:02:41.489568441 +0000 UTC m=+2219.265601840" watchObservedRunningTime="2026-07-06 20:02:42.029871223 +0000 UTC m=+2219.805904716"
Jul 06 20:02:42.473268 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:42.473218    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4"
Jul 06 20:02:42.474051 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:42.474029    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4"
Jul 06 20:02:42.684449 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:42.684397    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:43.448207 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:43.448179    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:43.554035 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:43.553989    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:43.642267 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:43.642225    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:43.743201 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:43.743108    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:44.050990 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:44.050954    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:44.149067 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:44.149028    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:44.926767 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:44.926735    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f"
Jul 06 20:02:45.091786 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:45.091752    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-istio-envoy\") pod \"e5e609df-ec7c-4d25-ae44-e77d0d2d4279\" (UID: \"e5e609df-ec7c-4d25-ae44-e77d0d2d4279\") "
Jul 06 20:02:45.092097 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:45.091793    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-istio-data\") pod \"e5e609df-ec7c-4d25-ae44-e77d0d2d4279\" (UID: \"e5e609df-ec7c-4d25-ae44-e77d0d2d4279\") "
Jul 06 20:02:45.092097 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:45.091841    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-istio-podinfo\") pod \"e5e609df-ec7c-4d25-ae44-e77d0d2d4279\" (UID: \"e5e609df-ec7c-4d25-ae44-e77d0d2d4279\") "
Jul 06 20:02:45.092097 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:45.091875    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-credential-socket\") pod \"e5e609df-ec7c-4d25-ae44-e77d0d2d4279\" (UID: \"e5e609df-ec7c-4d25-ae44-e77d0d2d4279\") "
Jul 06 20:02:45.092097 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:45.091942    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-workload-certs\") pod \"e5e609df-ec7c-4d25-ae44-e77d0d2d4279\" (UID: \"e5e609df-ec7c-4d25-ae44-e77d0d2d4279\") "
Jul 06 20:02:45.092097 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:45.092007    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-istiod-ca-cert\") pod \"e5e609df-ec7c-4d25-ae44-e77d0d2d4279\" (UID: \"e5e609df-ec7c-4d25-ae44-e77d0d2d4279\") "
Jul 06 20:02:45.092097 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:45.092047    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rlm4l\" (UniqueName: \"kubernetes.io/projected/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-kube-api-access-rlm4l\") pod \"e5e609df-ec7c-4d25-ae44-e77d0d2d4279\" (UID: \"e5e609df-ec7c-4d25-ae44-e77d0d2d4279\") "
Jul 06 20:02:45.092097 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:45.092065    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-workload-socket\") pod \"e5e609df-ec7c-4d25-ae44-e77d0d2d4279\" (UID: \"e5e609df-ec7c-4d25-ae44-e77d0d2d4279\") "
Jul 06 20:02:45.092097 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:45.092092    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-istio-token\") pod \"e5e609df-ec7c-4d25-ae44-e77d0d2d4279\" (UID: \"e5e609df-ec7c-4d25-ae44-e77d0d2d4279\") "
Jul 06 20:02:45.092558 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:45.092200    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e5e609df-ec7c-4d25-ae44-e77d0d2d4279" (UID: "e5e609df-ec7c-4d25-ae44-e77d0d2d4279"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:02:45.092558 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:45.092216    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e5e609df-ec7c-4d25-ae44-e77d0d2d4279" (UID: "e5e609df-ec7c-4d25-ae44-e77d0d2d4279"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:02:45.092558 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:45.092376    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e5e609df-ec7c-4d25-ae44-e77d0d2d4279" (UID: "e5e609df-ec7c-4d25-ae44-e77d0d2d4279"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:02:45.092558 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:45.092408    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e5e609df-ec7c-4d25-ae44-e77d0d2d4279" (UID: "e5e609df-ec7c-4d25-ae44-e77d0d2d4279"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:02:45.092558 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:45.092426    2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-credential-socket\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:02:45.092558 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:45.092445    2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-workload-certs\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:02:45.092860 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:45.092834    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-istio-data" (OuterVolumeSpecName: "istio-data") pod "e5e609df-ec7c-4d25-ae44-e77d0d2d4279" (UID: "e5e609df-ec7c-4d25-ae44-e77d0d2d4279"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:02:45.094539 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:45.094505    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e5e609df-ec7c-4d25-ae44-e77d0d2d4279" (UID: "e5e609df-ec7c-4d25-ae44-e77d0d2d4279"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:02:45.094635 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:45.094597    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-istio-token" (OuterVolumeSpecName: "istio-token") pod "e5e609df-ec7c-4d25-ae44-e77d0d2d4279" (UID: "e5e609df-ec7c-4d25-ae44-e77d0d2d4279"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:02:45.094723 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:45.094706    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e5e609df-ec7c-4d25-ae44-e77d0d2d4279" (UID: "e5e609df-ec7c-4d25-ae44-e77d0d2d4279"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 20:02:45.094772 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:45.094727    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-kube-api-access-rlm4l" (OuterVolumeSpecName: "kube-api-access-rlm4l") pod "e5e609df-ec7c-4d25-ae44-e77d0d2d4279" (UID: "e5e609df-ec7c-4d25-ae44-e77d0d2d4279"). InnerVolumeSpecName "kube-api-access-rlm4l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:02:45.192880 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:45.192840    2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-istio-podinfo\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:02:45.192880 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:45.192873    2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-istiod-ca-cert\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:02:45.192880 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:45.192882    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rlm4l\" (UniqueName: \"kubernetes.io/projected/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-kube-api-access-rlm4l\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:02:45.193151 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:45.192892    2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-workload-socket\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:02:45.193151 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:45.192902    2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-istio-token\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:02:45.193151 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:45.192941    2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-istio-envoy\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:02:45.193151 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:45.192952    2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5e609df-ec7c-4d25-ae44-e77d0d2d4279-istio-data\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:02:45.489459 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:45.489375    2555 generic.go:356] "Generic (PLEG): container finished" podID="e5e609df-ec7c-4d25-ae44-e77d0d2d4279" containerID="e24baa6dd0dc3129a6c6b5a1353129489d730beb1d16f444f7f6b70b99aaa394" exitCode=0
Jul 06 20:02:45.489459 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:45.489426    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f"
Jul 06 20:02:45.489459 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:45.489447    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f" event={"ID":"e5e609df-ec7c-4d25-ae44-e77d0d2d4279","Type":"ContainerDied","Data":"e24baa6dd0dc3129a6c6b5a1353129489d730beb1d16f444f7f6b70b99aaa394"}
Jul 06 20:02:45.489710 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:45.489491    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f" event={"ID":"e5e609df-ec7c-4d25-ae44-e77d0d2d4279","Type":"ContainerDied","Data":"ecace70094bc2020e6db4ce3c6e19d14a3e9c0f0be6a68f527b6f6fd640ffd06"}
Jul 06 20:02:45.489710 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:45.489512    2555 scope.go:117] "RemoveContainer" containerID="e24baa6dd0dc3129a6c6b5a1353129489d730beb1d16f444f7f6b70b99aaa394"
Jul 06 20:02:45.498686 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:45.498667    2555 scope.go:117] "RemoveContainer" containerID="3c324dc8c2df7ef3e83cdece389011a0724ed64ea4fd176e380df5642073242a"
Jul 06 20:02:45.506599 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:45.506579    2555 scope.go:117] "RemoveContainer" containerID="e24baa6dd0dc3129a6c6b5a1353129489d730beb1d16f444f7f6b70b99aaa394"
Jul 06 20:02:45.506878 ip-10-0-131-150 kubenswrapper[2555]: E0706 20:02:45.506859    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e24baa6dd0dc3129a6c6b5a1353129489d730beb1d16f444f7f6b70b99aaa394\": container with ID starting with e24baa6dd0dc3129a6c6b5a1353129489d730beb1d16f444f7f6b70b99aaa394 not found: ID does not exist" containerID="e24baa6dd0dc3129a6c6b5a1353129489d730beb1d16f444f7f6b70b99aaa394"
Jul 06 20:02:45.506943 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:45.506887    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e24baa6dd0dc3129a6c6b5a1353129489d730beb1d16f444f7f6b70b99aaa394"} err="failed to get container status \"e24baa6dd0dc3129a6c6b5a1353129489d730beb1d16f444f7f6b70b99aaa394\": rpc error: code = NotFound desc = could not find container \"e24baa6dd0dc3129a6c6b5a1353129489d730beb1d16f444f7f6b70b99aaa394\": container with ID starting with e24baa6dd0dc3129a6c6b5a1353129489d730beb1d16f444f7f6b70b99aaa394 not found: ID does not exist"
Jul 06 20:02:45.506943 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:45.506919    2555 scope.go:117] "RemoveContainer" containerID="3c324dc8c2df7ef3e83cdece389011a0724ed64ea4fd176e380df5642073242a"
Jul 06 20:02:45.507123 ip-10-0-131-150 kubenswrapper[2555]: E0706 20:02:45.507109    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c324dc8c2df7ef3e83cdece389011a0724ed64ea4fd176e380df5642073242a\": container with ID starting with 3c324dc8c2df7ef3e83cdece389011a0724ed64ea4fd176e380df5642073242a not found: ID does not exist" containerID="3c324dc8c2df7ef3e83cdece389011a0724ed64ea4fd176e380df5642073242a"
Jul 06 20:02:45.507165 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:45.507126    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c324dc8c2df7ef3e83cdece389011a0724ed64ea4fd176e380df5642073242a"} err="failed to get container status \"3c324dc8c2df7ef3e83cdece389011a0724ed64ea4fd176e380df5642073242a\": rpc error: code = NotFound desc = could not find container \"3c324dc8c2df7ef3e83cdece389011a0724ed64ea4fd176e380df5642073242a\": container with ID starting with 3c324dc8c2df7ef3e83cdece389011a0724ed64ea4fd176e380df5642073242a not found: ID does not exist"
Jul 06 20:02:45.512386 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:45.512363    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f"]
Jul 06 20:02:45.515840 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:45.515812    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-47ea5d-openshift-default-fbc754cc-zn99f"]
Jul 06 20:02:46.130895 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:46.130857    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5e609df-ec7c-4d25-ae44-e77d0d2d4279" path="/var/lib/kubelet/pods/e5e609df-ec7c-4d25-ae44-e77d0d2d4279/volumes"
Jul 06 20:02:47.968296 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:47.968256    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:48.316287 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:48.316253    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:48.606533 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:48.606458    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb"]
Jul 06 20:02:48.606789 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:48.606776    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5e609df-ec7c-4d25-ae44-e77d0d2d4279" containerName="istio-proxy"
Jul 06 20:02:48.606833 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:48.606791    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5e609df-ec7c-4d25-ae44-e77d0d2d4279" containerName="istio-proxy"
Jul 06 20:02:48.606833 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:48.606821    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5e609df-ec7c-4d25-ae44-e77d0d2d4279" containerName="istio-proxy"
Jul 06 20:02:48.606833 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:48.606827    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5e609df-ec7c-4d25-ae44-e77d0d2d4279" containerName="istio-proxy"
Jul 06 20:02:48.606945 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:48.606889    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5e609df-ec7c-4d25-ae44-e77d0d2d4279" containerName="istio-proxy"
Jul 06 20:02:48.606945 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:48.606897    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5e609df-ec7c-4d25-ae44-e77d0d2d4279" containerName="istio-proxy"
Jul 06 20:02:48.609758 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:48.609742    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb"
Jul 06 20:02:48.613281 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:48.613262    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-fd49c7-openshift-default-dockercfg-fh7bf\""
Jul 06 20:02:48.634512 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:48.634482    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb"]
Jul 06 20:02:48.662688 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:48.662650    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:48.724046 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:48.724009    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/074daf76-2b93-4bad-ab21-c009188e4ffa-workload-certs\") pod \"e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb\" (UID: \"074daf76-2b93-4bad-ab21-c009188e4ffa\") " pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb"
Jul 06 20:02:48.724213 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:48.724052    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/074daf76-2b93-4bad-ab21-c009188e4ffa-istio-data\") pod \"e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb\" (UID: \"074daf76-2b93-4bad-ab21-c009188e4ffa\") " pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb"
Jul 06 20:02:48.724213 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:48.724086    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d98j8\" (UniqueName: \"kubernetes.io/projected/074daf76-2b93-4bad-ab21-c009188e4ffa-kube-api-access-d98j8\") pod \"e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb\" (UID: \"074daf76-2b93-4bad-ab21-c009188e4ffa\") " pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb"
Jul 06 20:02:48.724213 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:48.724110    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/074daf76-2b93-4bad-ab21-c009188e4ffa-istio-envoy\") pod \"e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb\" (UID: \"074daf76-2b93-4bad-ab21-c009188e4ffa\") " pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb"
Jul 06 20:02:48.724213 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:48.724189    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/074daf76-2b93-4bad-ab21-c009188e4ffa-credential-socket\") pod \"e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb\" (UID: \"074daf76-2b93-4bad-ab21-c009188e4ffa\") " pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb"
Jul 06 20:02:48.724352 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:48.724234    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/074daf76-2b93-4bad-ab21-c009188e4ffa-istio-token\") pod \"e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb\" (UID: \"074daf76-2b93-4bad-ab21-c009188e4ffa\") " pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb"
Jul 06 20:02:48.724352 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:48.724269    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/074daf76-2b93-4bad-ab21-c009188e4ffa-istiod-ca-cert\") pod \"e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb\" (UID: \"074daf76-2b93-4bad-ab21-c009188e4ffa\") " pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb"
Jul 06 20:02:48.724352 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:48.724323    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/074daf76-2b93-4bad-ab21-c009188e4ffa-istio-podinfo\") pod \"e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb\" (UID: \"074daf76-2b93-4bad-ab21-c009188e4ffa\") " pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb"
Jul 06 20:02:48.724457 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:48.724351    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/074daf76-2b93-4bad-ab21-c009188e4ffa-workload-socket\") pod \"e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb\" (UID: \"074daf76-2b93-4bad-ab21-c009188e4ffa\") " pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb"
Jul 06 20:02:48.825583 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:48.825544    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/074daf76-2b93-4bad-ab21-c009188e4ffa-credential-socket\") pod \"e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb\" (UID: \"074daf76-2b93-4bad-ab21-c009188e4ffa\") " pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb"
Jul 06 20:02:48.825583 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:48.825587    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/074daf76-2b93-4bad-ab21-c009188e4ffa-istio-token\") pod \"e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb\" (UID: \"074daf76-2b93-4bad-ab21-c009188e4ffa\") " pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb"
Jul 06 20:02:48.825811 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:48.825614    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/074daf76-2b93-4bad-ab21-c009188e4ffa-istiod-ca-cert\") pod \"e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb\" (UID: \"074daf76-2b93-4bad-ab21-c009188e4ffa\") " pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb"
Jul 06 20:02:48.825811 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:48.825645    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/074daf76-2b93-4bad-ab21-c009188e4ffa-istio-podinfo\") pod \"e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb\" (UID: \"074daf76-2b93-4bad-ab21-c009188e4ffa\") " pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb"
Jul 06 20:02:48.825811 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:48.825668    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/074daf76-2b93-4bad-ab21-c009188e4ffa-workload-socket\") pod \"e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb\" (UID: \"074daf76-2b93-4bad-ab21-c009188e4ffa\") " pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb"
Jul 06 20:02:48.825811 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:48.825719    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/074daf76-2b93-4bad-ab21-c009188e4ffa-workload-certs\") pod \"e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb\" (UID: \"074daf76-2b93-4bad-ab21-c009188e4ffa\") " pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb"
Jul 06 20:02:48.825811 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:48.825746    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/074daf76-2b93-4bad-ab21-c009188e4ffa-istio-data\") pod \"e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb\" (UID: \"074daf76-2b93-4bad-ab21-c009188e4ffa\") " pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb"
Jul 06 20:02:48.826108 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:48.825829    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d98j8\" (UniqueName: \"kubernetes.io/projected/074daf76-2b93-4bad-ab21-c009188e4ffa-kube-api-access-d98j8\") pod \"e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb\" (UID: \"074daf76-2b93-4bad-ab21-c009188e4ffa\") " pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb"
Jul 06 20:02:48.826108 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:48.825888    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/074daf76-2b93-4bad-ab21-c009188e4ffa-istio-envoy\") pod \"e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb\" (UID: \"074daf76-2b93-4bad-ab21-c009188e4ffa\") " pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb"
Jul 06 20:02:48.826108 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:48.826027    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/074daf76-2b93-4bad-ab21-c009188e4ffa-credential-socket\") pod \"e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb\" (UID: \"074daf76-2b93-4bad-ab21-c009188e4ffa\") " pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb"
Jul 06 20:02:48.826279 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:48.826160    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/074daf76-2b93-4bad-ab21-c009188e4ffa-workload-socket\") pod \"e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb\" (UID: \"074daf76-2b93-4bad-ab21-c009188e4ffa\") " pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb"
Jul 06 20:02:48.826336 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:48.826299    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/074daf76-2b93-4bad-ab21-c009188e4ffa-workload-certs\") pod \"e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb\" (UID: \"074daf76-2b93-4bad-ab21-c009188e4ffa\") " pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb"
Jul 06 20:02:48.826376 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:48.826337    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/074daf76-2b93-4bad-ab21-c009188e4ffa-istio-data\") pod \"e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb\" (UID: \"074daf76-2b93-4bad-ab21-c009188e4ffa\") " pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb"
Jul 06 20:02:48.826426 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:48.826404    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/074daf76-2b93-4bad-ab21-c009188e4ffa-istiod-ca-cert\") pod \"e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb\" (UID: \"074daf76-2b93-4bad-ab21-c009188e4ffa\") " pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb"
Jul 06 20:02:48.828212 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:48.828192    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/074daf76-2b93-4bad-ab21-c009188e4ffa-istio-envoy\") pod \"e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb\" (UID: \"074daf76-2b93-4bad-ab21-c009188e4ffa\") " pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb"
Jul 06 20:02:48.828496 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:48.828473    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/074daf76-2b93-4bad-ab21-c009188e4ffa-istio-podinfo\") pod \"e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb\" (UID: \"074daf76-2b93-4bad-ab21-c009188e4ffa\") " pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb"
Jul 06 20:02:48.834465 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:48.834436    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/074daf76-2b93-4bad-ab21-c009188e4ffa-istio-token\") pod \"e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb\" (UID: \"074daf76-2b93-4bad-ab21-c009188e4ffa\") " pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb"
Jul 06 20:02:48.834549 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:48.834522    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d98j8\" (UniqueName: \"kubernetes.io/projected/074daf76-2b93-4bad-ab21-c009188e4ffa-kube-api-access-d98j8\") pod \"e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb\" (UID: \"074daf76-2b93-4bad-ab21-c009188e4ffa\") " pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb"
Jul 06 20:02:48.920456 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:48.920373    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb"
Jul 06 20:02:49.052450 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:49.052423    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb"]
Jul 06 20:02:49.053965 ip-10-0-131-150 kubenswrapper[2555]: W0706 20:02:49.053904    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod074daf76_2b93_4bad_ab21_c009188e4ffa.slice/crio-d38eea35c9c1e1008d2ad2c7668ab0b760c85d7295b43729b06b98fd618db791 WatchSource:0}: Error finding container d38eea35c9c1e1008d2ad2c7668ab0b760c85d7295b43729b06b98fd618db791: Status 404 returned error can't find the container with id d38eea35c9c1e1008d2ad2c7668ab0b760c85d7295b43729b06b98fd618db791
Jul 06 20:02:49.056193 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:49.056158    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:02:49.056254 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:49.056240    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:02:49.056291 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:49.056281    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:02:49.258300 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:49.258215    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:49.510642 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:49.510546    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb" event={"ID":"074daf76-2b93-4bad-ab21-c009188e4ffa","Type":"ContainerStarted","Data":"547d4b5d30302733cd535b5b0a3d72602bac6dca3b3e20cfb2b78dc04839afc7"}
Jul 06 20:02:49.510642 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:49.510600    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb" event={"ID":"074daf76-2b93-4bad-ab21-c009188e4ffa","Type":"ContainerStarted","Data":"d38eea35c9c1e1008d2ad2c7668ab0b760c85d7295b43729b06b98fd618db791"}
Jul 06 20:02:49.921313 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:49.921281    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb"
Jul 06 20:02:50.725267 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:50.725222    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:50.925635 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:50.925604    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb"
Jul 06 20:02:50.959508 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:50.959455    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb" podStartSLOduration=2.959438796 podStartE2EDuration="2.959438796s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:02:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:02:49.54166191 +0000 UTC m=+2227.317695310" watchObservedRunningTime="2026-07-06 20:02:50.959438796 +0000 UTC m=+2228.735472195"
Jul 06 20:02:51.190493 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:51.190459    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 20:02:51.521817 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:51.521740    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb"
Jul 06 20:02:51.522799 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:51.522777    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb"
Jul 06 20:02:51.593745 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:51.593710    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:51.776280 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:51.776250    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:51.883986 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:51.883947    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:52.046668 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:52.046572    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:52.357522 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:52.357435    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:52.482036 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:52.481998    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:56.016075 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:56.016039    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:58.516134 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:58.516087    2555 patch_prober.go:28] interesting pod/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 06 20:02:58.516532 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:58.516162    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4" podUID="0cc16ed7-2e39-4e18-9fcb-343ab3392297" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 20:02:59.579706 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:59.579673    2555 generic.go:356] "Generic (PLEG): container finished" podID="0cc16ed7-2e39-4e18-9fcb-343ab3392297" containerID="3193283fcd0d18dad7ac98fd6edeeea57a35b4ef3f370ef2cea8a10eab1aa675" exitCode=0
Jul 06 20:02:59.580157 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:59.579754    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4" event={"ID":"0cc16ed7-2e39-4e18-9fcb-343ab3392297","Type":"ContainerDied","Data":"3193283fcd0d18dad7ac98fd6edeeea57a35b4ef3f370ef2cea8a10eab1aa675"}
Jul 06 20:02:59.580202 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:59.580163    2555 scope.go:117] "RemoveContainer" containerID="3193283fcd0d18dad7ac98fd6edeeea57a35b4ef3f370ef2cea8a10eab1aa675"
Jul 06 20:02:59.581186 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:59.581157    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:02:59.581262 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:59.581241    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:02:59.581303 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:02:59.581285    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:03:00.586638 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:00.586604    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4" event={"ID":"0cc16ed7-2e39-4e18-9fcb-343ab3392297","Type":"ContainerStarted","Data":"362e3577154522aec7662f109d5b61a7a6c6dcf27e291f51a3d747182c80de29"}
Jul 06 20:03:01.002742 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:01.002648    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4"
Jul 06 20:03:01.002902 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:01.002881    2555 patch_prober.go:28] interesting pod/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 06 20:03:01.002993 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:01.002972    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4" podUID="0cc16ed7-2e39-4e18-9fcb-343ab3392297" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 06 20:03:01.518314 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:01.518274    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 20:03:02.003094 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:02.003056    2555 patch_prober.go:28] interesting pod/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 06 20:03:02.003471 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:02.003130    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4" podUID="0cc16ed7-2e39-4e18-9fcb-343ab3392297" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 06 20:03:03.002690 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:03.002651    2555 patch_prober.go:28] interesting pod/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 06 20:03:03.002928 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:03.002716    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4" podUID="0cc16ed7-2e39-4e18-9fcb-343ab3392297" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 06 20:03:04.002456 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:04.002371    2555 patch_prober.go:28] interesting pod/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 06 20:03:04.002456 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:04.002419    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4" podUID="0cc16ed7-2e39-4e18-9fcb-343ab3392297" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 06 20:03:04.778216 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:04.778173    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:03:04.879382 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:04.879326    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:03:05.006271 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:05.006236    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4"
Jul 06 20:03:05.006719 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:05.006610    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4"
Jul 06 20:03:05.007199 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:05.007179    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4"
Jul 06 20:03:05.612800 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:05.612770    2555 generic.go:356] "Generic (PLEG): container finished" podID="074daf76-2b93-4bad-ab21-c009188e4ffa" containerID="547d4b5d30302733cd535b5b0a3d72602bac6dca3b3e20cfb2b78dc04839afc7" exitCode=0
Jul 06 20:03:05.613009 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:05.612840    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb" event={"ID":"074daf76-2b93-4bad-ab21-c009188e4ffa","Type":"ContainerDied","Data":"547d4b5d30302733cd535b5b0a3d72602bac6dca3b3e20cfb2b78dc04839afc7"}
Jul 06 20:03:05.613376 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:05.613358    2555 scope.go:117] "RemoveContainer" containerID="547d4b5d30302733cd535b5b0a3d72602bac6dca3b3e20cfb2b78dc04839afc7"
Jul 06 20:03:05.614326 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:05.614301    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:03:05.614395 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:05.614374    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:03:05.614443 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:05.614406    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:03:06.521884 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:06.521827    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb"
Jul 06 20:03:06.623282 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:06.623238    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb" event={"ID":"074daf76-2b93-4bad-ab21-c009188e4ffa","Type":"ContainerStarted","Data":"6352448c70d09ab08cbefb3c96674b0ec765e10d1119528aa33c84a2e0d84e16"}
Jul 06 20:03:06.920843 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:06.920800    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb"
Jul 06 20:03:06.922208 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:06.922174    2555 patch_prober.go:28] interesting pod/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 06 20:03:06.922360 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:06.922256    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb" podUID="074daf76-2b93-4bad-ab21-c009188e4ffa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 06 20:03:07.921580 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:07.921533    2555 patch_prober.go:28] interesting pod/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 06 20:03:07.922119 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:07.921609    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb" podUID="074daf76-2b93-4bad-ab21-c009188e4ffa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 06 20:03:08.921667 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:08.921613    2555 patch_prober.go:28] interesting pod/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 06 20:03:08.922214 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:08.921704    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb" podUID="074daf76-2b93-4bad-ab21-c009188e4ffa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 06 20:03:09.248684 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:09.248608    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-96f4cb/auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl"]
Jul 06 20:03:09.250989 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:09.250974    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-96f4cb/auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl"
Jul 06 20:03:09.256514 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:09.256493    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-96f4cb\"/\"default-dockercfg-mmxl9\""
Jul 06 20:03:09.256903 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:09.256889    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-96f4cb\"/\"openshift-service-ca.crt\""
Jul 06 20:03:09.258103 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:09.258077    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-96f4cb\"/\"kube-root-ca.crt\""
Jul 06 20:03:09.259270 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:09.259250    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-96f4cb\"/\"auth-test-model-96f4cb-kserve-self-signed-certs\""
Jul 06 20:03:09.270865 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:09.270831    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-96f4cb/auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl"]
Jul 06 20:03:09.346707 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:09.346667    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6fmx\" (UniqueName: \"kubernetes.io/projected/6cd08032-82a0-4c8d-8359-fb54ff42d01f-kube-api-access-d6fmx\") pod \"auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl\" (UID: \"6cd08032-82a0-4c8d-8359-fb54ff42d01f\") " pod="ai-tenant-e2e-shared-a-96f4cb/auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl"
Jul 06 20:03:09.346897 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:09.346733    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6cd08032-82a0-4c8d-8359-fb54ff42d01f-home\") pod \"auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl\" (UID: \"6cd08032-82a0-4c8d-8359-fb54ff42d01f\") " pod="ai-tenant-e2e-shared-a-96f4cb/auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl"
Jul 06 20:03:09.346897 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:09.346788    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6cd08032-82a0-4c8d-8359-fb54ff42d01f-tls-certs\") pod \"auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl\" (UID: \"6cd08032-82a0-4c8d-8359-fb54ff42d01f\") " pod="ai-tenant-e2e-shared-a-96f4cb/auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl"
Jul 06 20:03:09.346897 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:09.346828    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6cd08032-82a0-4c8d-8359-fb54ff42d01f-model-cache\") pod \"auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl\" (UID: \"6cd08032-82a0-4c8d-8359-fb54ff42d01f\") " pod="ai-tenant-e2e-shared-a-96f4cb/auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl"
Jul 06 20:03:09.346897 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:09.346851    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6cd08032-82a0-4c8d-8359-fb54ff42d01f-dshm\") pod \"auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl\" (UID: \"6cd08032-82a0-4c8d-8359-fb54ff42d01f\") " pod="ai-tenant-e2e-shared-a-96f4cb/auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl"
Jul 06 20:03:09.346897 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:09.346874    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6cd08032-82a0-4c8d-8359-fb54ff42d01f-tmp-dir\") pod \"auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl\" (UID: \"6cd08032-82a0-4c8d-8359-fb54ff42d01f\") " pod="ai-tenant-e2e-shared-a-96f4cb/auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl"
Jul 06 20:03:09.430449 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:09.430400    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:03:09.448142 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:09.448098    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6cd08032-82a0-4c8d-8359-fb54ff42d01f-home\") pod \"auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl\" (UID: \"6cd08032-82a0-4c8d-8359-fb54ff42d01f\") " pod="ai-tenant-e2e-shared-a-96f4cb/auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl"
Jul 06 20:03:09.448345 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:09.448147    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6cd08032-82a0-4c8d-8359-fb54ff42d01f-tls-certs\") pod \"auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl\" (UID: \"6cd08032-82a0-4c8d-8359-fb54ff42d01f\") " pod="ai-tenant-e2e-shared-a-96f4cb/auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl"
Jul 06 20:03:09.448345 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:09.448194    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6cd08032-82a0-4c8d-8359-fb54ff42d01f-model-cache\") pod \"auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl\" (UID: \"6cd08032-82a0-4c8d-8359-fb54ff42d01f\") " pod="ai-tenant-e2e-shared-a-96f4cb/auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl"
Jul 06 20:03:09.448345 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:09.448222    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6cd08032-82a0-4c8d-8359-fb54ff42d01f-dshm\") pod \"auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl\" (UID: \"6cd08032-82a0-4c8d-8359-fb54ff42d01f\") " pod="ai-tenant-e2e-shared-a-96f4cb/auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl"
Jul 06 20:03:09.448345 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:09.448257    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6cd08032-82a0-4c8d-8359-fb54ff42d01f-tmp-dir\") pod \"auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl\" (UID: \"6cd08032-82a0-4c8d-8359-fb54ff42d01f\") " pod="ai-tenant-e2e-shared-a-96f4cb/auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl"
Jul 06 20:03:09.448345 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:09.448293    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6fmx\" (UniqueName: \"kubernetes.io/projected/6cd08032-82a0-4c8d-8359-fb54ff42d01f-kube-api-access-d6fmx\") pod \"auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl\" (UID: \"6cd08032-82a0-4c8d-8359-fb54ff42d01f\") " pod="ai-tenant-e2e-shared-a-96f4cb/auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl"
Jul 06 20:03:09.448606 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:09.448558    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6cd08032-82a0-4c8d-8359-fb54ff42d01f-home\") pod \"auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl\" (UID: \"6cd08032-82a0-4c8d-8359-fb54ff42d01f\") " pod="ai-tenant-e2e-shared-a-96f4cb/auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl"
Jul 06 20:03:09.448606 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:09.448586    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6cd08032-82a0-4c8d-8359-fb54ff42d01f-model-cache\") pod \"auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl\" (UID: \"6cd08032-82a0-4c8d-8359-fb54ff42d01f\") " pod="ai-tenant-e2e-shared-a-96f4cb/auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl"
Jul 06 20:03:09.448698 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:09.448680    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6cd08032-82a0-4c8d-8359-fb54ff42d01f-tmp-dir\") pod \"auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl\" (UID: \"6cd08032-82a0-4c8d-8359-fb54ff42d01f\") " pod="ai-tenant-e2e-shared-a-96f4cb/auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl"
Jul 06 20:03:09.450617 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:09.450594    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6cd08032-82a0-4c8d-8359-fb54ff42d01f-dshm\") pod \"auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl\" (UID: \"6cd08032-82a0-4c8d-8359-fb54ff42d01f\") " pod="ai-tenant-e2e-shared-a-96f4cb/auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl"
Jul 06 20:03:09.450780 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:09.450763    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6cd08032-82a0-4c8d-8359-fb54ff42d01f-tls-certs\") pod \"auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl\" (UID: \"6cd08032-82a0-4c8d-8359-fb54ff42d01f\") " pod="ai-tenant-e2e-shared-a-96f4cb/auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl"
Jul 06 20:03:09.467231 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:09.467194    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6fmx\" (UniqueName: \"kubernetes.io/projected/6cd08032-82a0-4c8d-8359-fb54ff42d01f-kube-api-access-d6fmx\") pod \"auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl\" (UID: \"6cd08032-82a0-4c8d-8359-fb54ff42d01f\") " pod="ai-tenant-e2e-shared-a-96f4cb/auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl"
Jul 06 20:03:09.560997 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:09.560949    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-96f4cb/auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl"
Jul 06 20:03:09.739521 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:09.739441    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-96f4cb/auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl"]
Jul 06 20:03:09.747187 ip-10-0-131-150 kubenswrapper[2555]: W0706 20:03:09.747130    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6cd08032_82a0_4c8d_8359_fb54ff42d01f.slice/crio-b0cf1876a4c6b27fb02bc17e1bf252d9eca6a6fb3ae7ea9ff74216c5b641ab1e WatchSource:0}: Error finding container b0cf1876a4c6b27fb02bc17e1bf252d9eca6a6fb3ae7ea9ff74216c5b641ab1e: Status 404 returned error can't find the container with id b0cf1876a4c6b27fb02bc17e1bf252d9eca6a6fb3ae7ea9ff74216c5b641ab1e
Jul 06 20:03:09.920997 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:09.920893    2555 patch_prober.go:28] interesting pod/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 06 20:03:09.921262 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:09.921224    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb" podUID="074daf76-2b93-4bad-ab21-c009188e4ffa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 06 20:03:10.661452 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:10.661414    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-96f4cb/auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl" event={"ID":"6cd08032-82a0-4c8d-8359-fb54ff42d01f","Type":"ContainerStarted","Data":"d83b1fc1ce1bfa8851836e718d3822fe55b64ed1fdbfed00067b41db35771bb6"}
Jul 06 20:03:10.661452 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:10.661458    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-96f4cb/auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl" event={"ID":"6cd08032-82a0-4c8d-8359-fb54ff42d01f","Type":"ContainerStarted","Data":"b0cf1876a4c6b27fb02bc17e1bf252d9eca6a6fb3ae7ea9ff74216c5b641ab1e"}
Jul 06 20:03:10.692324 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:10.692260    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-96f4cb/auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl" podStartSLOduration=1.692239528 podStartE2EDuration="1.692239528s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:03:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:03:10.692139958 +0000 UTC m=+2248.468173376" watchObservedRunningTime="2026-07-06 20:03:10.692239528 +0000 UTC m=+2248.468272924"
Jul 06 20:03:10.925122 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:10.925036    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb"
Jul 06 20:03:10.925424 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:10.925404    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb"
Jul 06 20:03:10.926000 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:10.925982    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb"
Jul 06 20:03:12.796863 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:12.796825    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 20:03:13.306348 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:13.306309    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:03:13.490364 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:13.490326    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:03:19.561842 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:19.561804    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-96f4cb/auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl"
Jul 06 20:03:19.562368 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:19.561858    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-96f4cb/auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl"
Jul 06 20:03:19.574343 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:19.574311    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-96f4cb/auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl"
Jul 06 20:03:19.717705 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:03:19.717678    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-96f4cb/auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl"
Jul 06 20:04:04.303114 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:04:04.303076    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-fd49c7/auth-test-model-fd49c7-kserve-5d668998dc-9lv9z"]
Jul 06 20:04:04.306582 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:04:04.306565    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fd49c7/auth-test-model-fd49c7-kserve-5d668998dc-9lv9z"
Jul 06 20:04:04.310020 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:04:04.309998    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-fd49c7\"/\"default-dockercfg-zpm2p\""
Jul 06 20:04:04.310158 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:04:04.310000    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-fd49c7\"/\"auth-test-model-fd49c7-kserve-self-signed-certs\""
Jul 06 20:04:04.310158 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:04:04.310053    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-fd49c7\"/\"kube-root-ca.crt\""
Jul 06 20:04:04.310158 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:04:04.310102    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-fd49c7\"/\"openshift-service-ca.crt\""
Jul 06 20:04:04.317077 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:04:04.317054    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-fd49c7/auth-test-model-fd49c7-kserve-5d668998dc-9lv9z"]
Jul 06 20:04:04.342535 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:04:04.342495    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:04:04.459400 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:04:04.459365    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/381959cb-b151-41a5-860d-ec8d91bfd7ed-model-cache\") pod \"auth-test-model-fd49c7-kserve-5d668998dc-9lv9z\" (UID: \"381959cb-b151-41a5-860d-ec8d91bfd7ed\") " pod="ai-tenant-e2e-shared-b-fd49c7/auth-test-model-fd49c7-kserve-5d668998dc-9lv9z"
Jul 06 20:04:04.459706 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:04:04.459678    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/381959cb-b151-41a5-860d-ec8d91bfd7ed-tmp-dir\") pod \"auth-test-model-fd49c7-kserve-5d668998dc-9lv9z\" (UID: \"381959cb-b151-41a5-860d-ec8d91bfd7ed\") " pod="ai-tenant-e2e-shared-b-fd49c7/auth-test-model-fd49c7-kserve-5d668998dc-9lv9z"
Jul 06 20:04:04.459838 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:04:04.459783    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/381959cb-b151-41a5-860d-ec8d91bfd7ed-tls-certs\") pod \"auth-test-model-fd49c7-kserve-5d668998dc-9lv9z\" (UID: \"381959cb-b151-41a5-860d-ec8d91bfd7ed\") " pod="ai-tenant-e2e-shared-b-fd49c7/auth-test-model-fd49c7-kserve-5d668998dc-9lv9z"
Jul 06 20:04:04.459838 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:04:04.459814    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/381959cb-b151-41a5-860d-ec8d91bfd7ed-home\") pod \"auth-test-model-fd49c7-kserve-5d668998dc-9lv9z\" (UID: \"381959cb-b151-41a5-860d-ec8d91bfd7ed\") " pod="ai-tenant-e2e-shared-b-fd49c7/auth-test-model-fd49c7-kserve-5d668998dc-9lv9z"
Jul 06 20:04:04.459972 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:04:04.459837    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/381959cb-b151-41a5-860d-ec8d91bfd7ed-dshm\") pod \"auth-test-model-fd49c7-kserve-5d668998dc-9lv9z\" (UID: \"381959cb-b151-41a5-860d-ec8d91bfd7ed\") " pod="ai-tenant-e2e-shared-b-fd49c7/auth-test-model-fd49c7-kserve-5d668998dc-9lv9z"
Jul 06 20:04:04.459972 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:04:04.459874    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzvxq\" (UniqueName: \"kubernetes.io/projected/381959cb-b151-41a5-860d-ec8d91bfd7ed-kube-api-access-vzvxq\") pod \"auth-test-model-fd49c7-kserve-5d668998dc-9lv9z\" (UID: \"381959cb-b151-41a5-860d-ec8d91bfd7ed\") " pod="ai-tenant-e2e-shared-b-fd49c7/auth-test-model-fd49c7-kserve-5d668998dc-9lv9z"
Jul 06 20:04:04.561366 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:04:04.561269    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzvxq\" (UniqueName: \"kubernetes.io/projected/381959cb-b151-41a5-860d-ec8d91bfd7ed-kube-api-access-vzvxq\") pod \"auth-test-model-fd49c7-kserve-5d668998dc-9lv9z\" (UID: \"381959cb-b151-41a5-860d-ec8d91bfd7ed\") " pod="ai-tenant-e2e-shared-b-fd49c7/auth-test-model-fd49c7-kserve-5d668998dc-9lv9z"
Jul 06 20:04:04.561366 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:04:04.561311    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/381959cb-b151-41a5-860d-ec8d91bfd7ed-model-cache\") pod \"auth-test-model-fd49c7-kserve-5d668998dc-9lv9z\" (UID: \"381959cb-b151-41a5-860d-ec8d91bfd7ed\") " pod="ai-tenant-e2e-shared-b-fd49c7/auth-test-model-fd49c7-kserve-5d668998dc-9lv9z"
Jul 06 20:04:04.561366 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:04:04.561360    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/381959cb-b151-41a5-860d-ec8d91bfd7ed-tmp-dir\") pod \"auth-test-model-fd49c7-kserve-5d668998dc-9lv9z\" (UID: \"381959cb-b151-41a5-860d-ec8d91bfd7ed\") " pod="ai-tenant-e2e-shared-b-fd49c7/auth-test-model-fd49c7-kserve-5d668998dc-9lv9z"
Jul 06 20:04:04.561661 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:04:04.561410    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/381959cb-b151-41a5-860d-ec8d91bfd7ed-tls-certs\") pod \"auth-test-model-fd49c7-kserve-5d668998dc-9lv9z\" (UID: \"381959cb-b151-41a5-860d-ec8d91bfd7ed\") " pod="ai-tenant-e2e-shared-b-fd49c7/auth-test-model-fd49c7-kserve-5d668998dc-9lv9z"
Jul 06 20:04:04.561661 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:04:04.561481    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/381959cb-b151-41a5-860d-ec8d91bfd7ed-home\") pod \"auth-test-model-fd49c7-kserve-5d668998dc-9lv9z\" (UID: \"381959cb-b151-41a5-860d-ec8d91bfd7ed\") " pod="ai-tenant-e2e-shared-b-fd49c7/auth-test-model-fd49c7-kserve-5d668998dc-9lv9z"
Jul 06 20:04:04.561661 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:04:04.561511    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/381959cb-b151-41a5-860d-ec8d91bfd7ed-dshm\") pod \"auth-test-model-fd49c7-kserve-5d668998dc-9lv9z\" (UID: \"381959cb-b151-41a5-860d-ec8d91bfd7ed\") " pod="ai-tenant-e2e-shared-b-fd49c7/auth-test-model-fd49c7-kserve-5d668998dc-9lv9z"
Jul 06 20:04:04.561825 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:04:04.561800    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/381959cb-b151-41a5-860d-ec8d91bfd7ed-model-cache\") pod \"auth-test-model-fd49c7-kserve-5d668998dc-9lv9z\" (UID: \"381959cb-b151-41a5-860d-ec8d91bfd7ed\") " pod="ai-tenant-e2e-shared-b-fd49c7/auth-test-model-fd49c7-kserve-5d668998dc-9lv9z"
Jul 06 20:04:04.561883 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:04:04.561835    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/381959cb-b151-41a5-860d-ec8d91bfd7ed-tmp-dir\") pod \"auth-test-model-fd49c7-kserve-5d668998dc-9lv9z\" (UID: \"381959cb-b151-41a5-860d-ec8d91bfd7ed\") " pod="ai-tenant-e2e-shared-b-fd49c7/auth-test-model-fd49c7-kserve-5d668998dc-9lv9z"
Jul 06 20:04:04.561883 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:04:04.561856    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/381959cb-b151-41a5-860d-ec8d91bfd7ed-home\") pod \"auth-test-model-fd49c7-kserve-5d668998dc-9lv9z\" (UID: \"381959cb-b151-41a5-860d-ec8d91bfd7ed\") " pod="ai-tenant-e2e-shared-b-fd49c7/auth-test-model-fd49c7-kserve-5d668998dc-9lv9z"
Jul 06 20:04:04.563765 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:04:04.563740    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/381959cb-b151-41a5-860d-ec8d91bfd7ed-dshm\") pod \"auth-test-model-fd49c7-kserve-5d668998dc-9lv9z\" (UID: \"381959cb-b151-41a5-860d-ec8d91bfd7ed\") " pod="ai-tenant-e2e-shared-b-fd49c7/auth-test-model-fd49c7-kserve-5d668998dc-9lv9z"
Jul 06 20:04:04.563970 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:04:04.563952    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/381959cb-b151-41a5-860d-ec8d91bfd7ed-tls-certs\") pod \"auth-test-model-fd49c7-kserve-5d668998dc-9lv9z\" (UID: \"381959cb-b151-41a5-860d-ec8d91bfd7ed\") " pod="ai-tenant-e2e-shared-b-fd49c7/auth-test-model-fd49c7-kserve-5d668998dc-9lv9z"
Jul 06 20:04:04.570107 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:04:04.570082    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzvxq\" (UniqueName: \"kubernetes.io/projected/381959cb-b151-41a5-860d-ec8d91bfd7ed-kube-api-access-vzvxq\") pod \"auth-test-model-fd49c7-kserve-5d668998dc-9lv9z\" (UID: \"381959cb-b151-41a5-860d-ec8d91bfd7ed\") " pod="ai-tenant-e2e-shared-b-fd49c7/auth-test-model-fd49c7-kserve-5d668998dc-9lv9z"
Jul 06 20:04:04.615778 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:04:04.615742    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fd49c7/auth-test-model-fd49c7-kserve-5d668998dc-9lv9z"
Jul 06 20:04:04.751341 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:04:04.751309    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-fd49c7/auth-test-model-fd49c7-kserve-5d668998dc-9lv9z"]
Jul 06 20:04:04.753484 ip-10-0-131-150 kubenswrapper[2555]: W0706 20:04:04.753448    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod381959cb_b151_41a5_860d_ec8d91bfd7ed.slice/crio-954e4b29c74a58825f9aeb2d6fc78ec4a017de8e9c999d239c21abaec54fa620 WatchSource:0}: Error finding container 954e4b29c74a58825f9aeb2d6fc78ec4a017de8e9c999d239c21abaec54fa620: Status 404 returned error can't find the container with id 954e4b29c74a58825f9aeb2d6fc78ec4a017de8e9c999d239c21abaec54fa620
Jul 06 20:04:04.934653 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:04:04.934554    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fd49c7/auth-test-model-fd49c7-kserve-5d668998dc-9lv9z" event={"ID":"381959cb-b151-41a5-860d-ec8d91bfd7ed","Type":"ContainerStarted","Data":"1f2abec4e059dbd179ef58a41a714456fc861335197c6641c2da20ebb4ed255f"}
Jul 06 20:04:04.934653 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:04:04.934596    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fd49c7/auth-test-model-fd49c7-kserve-5d668998dc-9lv9z" event={"ID":"381959cb-b151-41a5-860d-ec8d91bfd7ed","Type":"ContainerStarted","Data":"954e4b29c74a58825f9aeb2d6fc78ec4a017de8e9c999d239c21abaec54fa620"}
Jul 06 20:04:04.954217 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:04:04.954161    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-fd49c7/auth-test-model-fd49c7-kserve-5d668998dc-9lv9z" podStartSLOduration=0.954145951 podStartE2EDuration="954.145951ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:04:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:04:04.952098952 +0000 UTC m=+2302.728132365" watchObservedRunningTime="2026-07-06 20:04:04.954145951 +0000 UTC m=+2302.730179360"
Jul 06 20:04:07.582357 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:04:07.582324    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 20:04:14.616832 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:04:14.616795    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-fd49c7/auth-test-model-fd49c7-kserve-5d668998dc-9lv9z"
Jul 06 20:04:14.617419 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:04:14.616888    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-fd49c7/auth-test-model-fd49c7-kserve-5d668998dc-9lv9z"
Jul 06 20:04:14.629150 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:04:14.629129    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-fd49c7/auth-test-model-fd49c7-kserve-5d668998dc-9lv9z"
Jul 06 20:04:15.010978 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:04:15.010891    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-fd49c7/auth-test-model-fd49c7-kserve-5d668998dc-9lv9z"
Jul 06 20:04:23.786229 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:04:23.786190    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 20:04:40.888305 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:04:40.888224    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 20:04:42.916872 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:04:42.916838    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:04:55.613835 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:04:55.613794    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 20:05:13.182235 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:05:13.182199    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 20:05:29.005599 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:05:29.005567    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 20:05:43.384297 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:05:43.384260    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 20:05:44.233296 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:05:44.233266    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j9wtk_bb750a78-aa1e-4c55-b771-e06ca00b997a/ovn-acl-logging/0.log"
Jul 06 20:05:44.234779 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:05:44.234757    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j9wtk_bb750a78-aa1e-4c55-b771-e06ca00b997a/ovn-acl-logging/0.log"
Jul 06 20:05:55.854177 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:05:55.854137    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-96f4cb/auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl"]
Jul 06 20:05:55.863279 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:05:55.863234    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:05:56.727425 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:05:56.727388    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-fd49c7/auth-test-model-fd49c7-kserve-5d668998dc-9lv9z"]
Jul 06 20:05:57.345702 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:05:57.345659    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:06:00.028775 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:00.028738    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 20:06:06.763609 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:06.763570    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:06:10.874428 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:10.874357    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-96f4cb/auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl" podUID="6cd08032-82a0-4c8d-8359-fb54ff42d01f" containerName="main" containerID="cri-o://d83b1fc1ce1bfa8851836e718d3822fe55b64ed1fdbfed00067b41db35771bb6" gracePeriod=45
Jul 06 20:06:11.136683 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:11.136610    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-96f4cb/auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl"
Jul 06 20:06:11.159627 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:11.159592    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6cd08032-82a0-4c8d-8359-fb54ff42d01f-dshm\") pod \"6cd08032-82a0-4c8d-8359-fb54ff42d01f\" (UID: \"6cd08032-82a0-4c8d-8359-fb54ff42d01f\") "
Jul 06 20:06:11.159819 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:11.159660    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6cd08032-82a0-4c8d-8359-fb54ff42d01f-model-cache\") pod \"6cd08032-82a0-4c8d-8359-fb54ff42d01f\" (UID: \"6cd08032-82a0-4c8d-8359-fb54ff42d01f\") "
Jul 06 20:06:11.159819 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:11.159700    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6cd08032-82a0-4c8d-8359-fb54ff42d01f-tls-certs\") pod \"6cd08032-82a0-4c8d-8359-fb54ff42d01f\" (UID: \"6cd08032-82a0-4c8d-8359-fb54ff42d01f\") "
Jul 06 20:06:11.159819 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:11.159747    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6cd08032-82a0-4c8d-8359-fb54ff42d01f-home\") pod \"6cd08032-82a0-4c8d-8359-fb54ff42d01f\" (UID: \"6cd08032-82a0-4c8d-8359-fb54ff42d01f\") "
Jul 06 20:06:11.159819 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:11.159785    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6fmx\" (UniqueName: \"kubernetes.io/projected/6cd08032-82a0-4c8d-8359-fb54ff42d01f-kube-api-access-d6fmx\") pod \"6cd08032-82a0-4c8d-8359-fb54ff42d01f\" (UID: \"6cd08032-82a0-4c8d-8359-fb54ff42d01f\") "
Jul 06 20:06:11.160057 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:11.159822    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6cd08032-82a0-4c8d-8359-fb54ff42d01f-tmp-dir\") pod \"6cd08032-82a0-4c8d-8359-fb54ff42d01f\" (UID: \"6cd08032-82a0-4c8d-8359-fb54ff42d01f\") "
Jul 06 20:06:11.160057 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:11.160004    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cd08032-82a0-4c8d-8359-fb54ff42d01f-model-cache" (OuterVolumeSpecName: "model-cache") pod "6cd08032-82a0-4c8d-8359-fb54ff42d01f" (UID: "6cd08032-82a0-4c8d-8359-fb54ff42d01f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:06:11.160151 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:11.160061    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cd08032-82a0-4c8d-8359-fb54ff42d01f-home" (OuterVolumeSpecName: "home") pod "6cd08032-82a0-4c8d-8359-fb54ff42d01f" (UID: "6cd08032-82a0-4c8d-8359-fb54ff42d01f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:06:11.160216 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:11.160138    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cd08032-82a0-4c8d-8359-fb54ff42d01f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6cd08032-82a0-4c8d-8359-fb54ff42d01f" (UID: "6cd08032-82a0-4c8d-8359-fb54ff42d01f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:06:11.160216 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:11.160160    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6cd08032-82a0-4c8d-8359-fb54ff42d01f-model-cache\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:06:11.160216 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:11.160175    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6cd08032-82a0-4c8d-8359-fb54ff42d01f-home\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:06:11.161943 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:11.161895    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6cd08032-82a0-4c8d-8359-fb54ff42d01f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6cd08032-82a0-4c8d-8359-fb54ff42d01f" (UID: "6cd08032-82a0-4c8d-8359-fb54ff42d01f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:06:11.161943 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:11.161935    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cd08032-82a0-4c8d-8359-fb54ff42d01f-dshm" (OuterVolumeSpecName: "dshm") pod "6cd08032-82a0-4c8d-8359-fb54ff42d01f" (UID: "6cd08032-82a0-4c8d-8359-fb54ff42d01f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:06:11.162121 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:11.161957    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cd08032-82a0-4c8d-8359-fb54ff42d01f-kube-api-access-d6fmx" (OuterVolumeSpecName: "kube-api-access-d6fmx") pod "6cd08032-82a0-4c8d-8359-fb54ff42d01f" (UID: "6cd08032-82a0-4c8d-8359-fb54ff42d01f"). InnerVolumeSpecName "kube-api-access-d6fmx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:06:11.260621 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:11.260577    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6cd08032-82a0-4c8d-8359-fb54ff42d01f-tls-certs\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:06:11.260621 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:11.260615    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6fmx\" (UniqueName: \"kubernetes.io/projected/6cd08032-82a0-4c8d-8359-fb54ff42d01f-kube-api-access-d6fmx\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:06:11.260621 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:11.260625    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6cd08032-82a0-4c8d-8359-fb54ff42d01f-tmp-dir\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:06:11.260871 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:11.260635    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6cd08032-82a0-4c8d-8359-fb54ff42d01f-dshm\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:06:11.586182 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:11.586147    2555 generic.go:356] "Generic (PLEG): container finished" podID="6cd08032-82a0-4c8d-8359-fb54ff42d01f" containerID="d83b1fc1ce1bfa8851836e718d3822fe55b64ed1fdbfed00067b41db35771bb6" exitCode=0
Jul 06 20:06:11.586182 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:11.586187    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-96f4cb/auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl"
Jul 06 20:06:11.586398 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:11.586231    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-96f4cb/auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl" event={"ID":"6cd08032-82a0-4c8d-8359-fb54ff42d01f","Type":"ContainerDied","Data":"d83b1fc1ce1bfa8851836e718d3822fe55b64ed1fdbfed00067b41db35771bb6"}
Jul 06 20:06:11.586398 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:11.586274    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-96f4cb/auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl" event={"ID":"6cd08032-82a0-4c8d-8359-fb54ff42d01f","Type":"ContainerDied","Data":"b0cf1876a4c6b27fb02bc17e1bf252d9eca6a6fb3ae7ea9ff74216c5b641ab1e"}
Jul 06 20:06:11.586398 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:11.586292    2555 scope.go:117] "RemoveContainer" containerID="d83b1fc1ce1bfa8851836e718d3822fe55b64ed1fdbfed00067b41db35771bb6"
Jul 06 20:06:11.595216 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:11.595199    2555 scope.go:117] "RemoveContainer" containerID="d83b1fc1ce1bfa8851836e718d3822fe55b64ed1fdbfed00067b41db35771bb6"
Jul 06 20:06:11.595487 ip-10-0-131-150 kubenswrapper[2555]: E0706 20:06:11.595458    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d83b1fc1ce1bfa8851836e718d3822fe55b64ed1fdbfed00067b41db35771bb6\": container with ID starting with d83b1fc1ce1bfa8851836e718d3822fe55b64ed1fdbfed00067b41db35771bb6 not found: ID does not exist" containerID="d83b1fc1ce1bfa8851836e718d3822fe55b64ed1fdbfed00067b41db35771bb6"
Jul 06 20:06:11.595542 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:11.595497    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d83b1fc1ce1bfa8851836e718d3822fe55b64ed1fdbfed00067b41db35771bb6"} err="failed to get container status \"d83b1fc1ce1bfa8851836e718d3822fe55b64ed1fdbfed00067b41db35771bb6\": rpc error: code = NotFound desc = could not find container \"d83b1fc1ce1bfa8851836e718d3822fe55b64ed1fdbfed00067b41db35771bb6\": container with ID starting with d83b1fc1ce1bfa8851836e718d3822fe55b64ed1fdbfed00067b41db35771bb6 not found: ID does not exist"
Jul 06 20:06:11.747422 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:11.747376    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-fd49c7/auth-test-model-fd49c7-kserve-5d668998dc-9lv9z" podUID="381959cb-b151-41a5-860d-ec8d91bfd7ed" containerName="main" containerID="cri-o://1f2abec4e059dbd179ef58a41a714456fc861335197c6641c2da20ebb4ed255f" gracePeriod=45
Jul 06 20:06:12.009854 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:12.009830    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fd49c7/auth-test-model-fd49c7-kserve-5d668998dc-9lv9z"
Jul 06 20:06:12.065680 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:12.065646    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzvxq\" (UniqueName: \"kubernetes.io/projected/381959cb-b151-41a5-860d-ec8d91bfd7ed-kube-api-access-vzvxq\") pod \"381959cb-b151-41a5-860d-ec8d91bfd7ed\" (UID: \"381959cb-b151-41a5-860d-ec8d91bfd7ed\") "
Jul 06 20:06:12.065680 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:12.065684    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/381959cb-b151-41a5-860d-ec8d91bfd7ed-home\") pod \"381959cb-b151-41a5-860d-ec8d91bfd7ed\" (UID: \"381959cb-b151-41a5-860d-ec8d91bfd7ed\") "
Jul 06 20:06:12.065904 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:12.065743    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/381959cb-b151-41a5-860d-ec8d91bfd7ed-tls-certs\") pod \"381959cb-b151-41a5-860d-ec8d91bfd7ed\" (UID: \"381959cb-b151-41a5-860d-ec8d91bfd7ed\") "
Jul 06 20:06:12.065904 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:12.065769    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/381959cb-b151-41a5-860d-ec8d91bfd7ed-dshm\") pod \"381959cb-b151-41a5-860d-ec8d91bfd7ed\" (UID: \"381959cb-b151-41a5-860d-ec8d91bfd7ed\") "
Jul 06 20:06:12.065904 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:12.065821    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/381959cb-b151-41a5-860d-ec8d91bfd7ed-tmp-dir\") pod \"381959cb-b151-41a5-860d-ec8d91bfd7ed\" (UID: \"381959cb-b151-41a5-860d-ec8d91bfd7ed\") "
Jul 06 20:06:12.066093 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:12.065977    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/381959cb-b151-41a5-860d-ec8d91bfd7ed-model-cache\") pod \"381959cb-b151-41a5-860d-ec8d91bfd7ed\" (UID: \"381959cb-b151-41a5-860d-ec8d91bfd7ed\") "
Jul 06 20:06:12.066093 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:12.066036    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/381959cb-b151-41a5-860d-ec8d91bfd7ed-home" (OuterVolumeSpecName: "home") pod "381959cb-b151-41a5-860d-ec8d91bfd7ed" (UID: "381959cb-b151-41a5-860d-ec8d91bfd7ed"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:06:12.066240 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:12.066216    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/381959cb-b151-41a5-860d-ec8d91bfd7ed-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "381959cb-b151-41a5-860d-ec8d91bfd7ed" (UID: "381959cb-b151-41a5-860d-ec8d91bfd7ed"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:06:12.066240 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:12.066229    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/381959cb-b151-41a5-860d-ec8d91bfd7ed-model-cache" (OuterVolumeSpecName: "model-cache") pod "381959cb-b151-41a5-860d-ec8d91bfd7ed" (UID: "381959cb-b151-41a5-860d-ec8d91bfd7ed"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:06:12.066350 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:12.066279    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/381959cb-b151-41a5-860d-ec8d91bfd7ed-home\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:06:12.068175 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:12.068148    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/381959cb-b151-41a5-860d-ec8d91bfd7ed-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "381959cb-b151-41a5-860d-ec8d91bfd7ed" (UID: "381959cb-b151-41a5-860d-ec8d91bfd7ed"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:06:12.068332 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:12.068314    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/381959cb-b151-41a5-860d-ec8d91bfd7ed-dshm" (OuterVolumeSpecName: "dshm") pod "381959cb-b151-41a5-860d-ec8d91bfd7ed" (UID: "381959cb-b151-41a5-860d-ec8d91bfd7ed"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:06:12.068386 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:12.068317    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/381959cb-b151-41a5-860d-ec8d91bfd7ed-kube-api-access-vzvxq" (OuterVolumeSpecName: "kube-api-access-vzvxq") pod "381959cb-b151-41a5-860d-ec8d91bfd7ed" (UID: "381959cb-b151-41a5-860d-ec8d91bfd7ed"). InnerVolumeSpecName "kube-api-access-vzvxq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:06:12.167578 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:12.167537    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzvxq\" (UniqueName: \"kubernetes.io/projected/381959cb-b151-41a5-860d-ec8d91bfd7ed-kube-api-access-vzvxq\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:06:12.167578 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:12.167574    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/381959cb-b151-41a5-860d-ec8d91bfd7ed-tls-certs\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:06:12.167578 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:12.167585    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/381959cb-b151-41a5-860d-ec8d91bfd7ed-dshm\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:06:12.167807 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:12.167593    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/381959cb-b151-41a5-860d-ec8d91bfd7ed-tmp-dir\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:06:12.167807 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:12.167602    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/381959cb-b151-41a5-860d-ec8d91bfd7ed-model-cache\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:06:12.592460 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:12.592422    2555 generic.go:356] "Generic (PLEG): container finished" podID="381959cb-b151-41a5-860d-ec8d91bfd7ed" containerID="1f2abec4e059dbd179ef58a41a714456fc861335197c6641c2da20ebb4ed255f" exitCode=0
Jul 06 20:06:12.592663 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:12.592478    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fd49c7/auth-test-model-fd49c7-kserve-5d668998dc-9lv9z"
Jul 06 20:06:12.592663 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:12.592503    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fd49c7/auth-test-model-fd49c7-kserve-5d668998dc-9lv9z" event={"ID":"381959cb-b151-41a5-860d-ec8d91bfd7ed","Type":"ContainerDied","Data":"1f2abec4e059dbd179ef58a41a714456fc861335197c6641c2da20ebb4ed255f"}
Jul 06 20:06:12.592663 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:12.592547    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fd49c7/auth-test-model-fd49c7-kserve-5d668998dc-9lv9z" event={"ID":"381959cb-b151-41a5-860d-ec8d91bfd7ed","Type":"ContainerDied","Data":"954e4b29c74a58825f9aeb2d6fc78ec4a017de8e9c999d239c21abaec54fa620"}
Jul 06 20:06:12.592663 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:12.592568    2555 scope.go:117] "RemoveContainer" containerID="1f2abec4e059dbd179ef58a41a714456fc861335197c6641c2da20ebb4ed255f"
Jul 06 20:06:12.601118 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:12.601099    2555 scope.go:117] "RemoveContainer" containerID="1f2abec4e059dbd179ef58a41a714456fc861335197c6641c2da20ebb4ed255f"
Jul 06 20:06:12.601409 ip-10-0-131-150 kubenswrapper[2555]: E0706 20:06:12.601390    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f2abec4e059dbd179ef58a41a714456fc861335197c6641c2da20ebb4ed255f\": container with ID starting with 1f2abec4e059dbd179ef58a41a714456fc861335197c6641c2da20ebb4ed255f not found: ID does not exist" containerID="1f2abec4e059dbd179ef58a41a714456fc861335197c6641c2da20ebb4ed255f"
Jul 06 20:06:12.601462 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:12.601418    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f2abec4e059dbd179ef58a41a714456fc861335197c6641c2da20ebb4ed255f"} err="failed to get container status \"1f2abec4e059dbd179ef58a41a714456fc861335197c6641c2da20ebb4ed255f\": rpc error: code = NotFound desc = could not find container \"1f2abec4e059dbd179ef58a41a714456fc861335197c6641c2da20ebb4ed255f\": container with ID starting with 1f2abec4e059dbd179ef58a41a714456fc861335197c6641c2da20ebb4ed255f not found: ID does not exist"
Jul 06 20:06:14.905218 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:14.905182    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-96f4cb/auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl"]
Jul 06 20:06:19.468978 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:19.468941    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-96f4cb/auth-test-model-96f4cb-kserve-6bf865d7f5-h7ssl"]
Jul 06 20:06:20.132839 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:20.132804    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cd08032-82a0-4c8d-8359-fb54ff42d01f" path="/var/lib/kubelet/pods/6cd08032-82a0-4c8d-8359-fb54ff42d01f/volumes"
Jul 06 20:06:24.945096 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:24.945058    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-fd49c7/auth-test-model-fd49c7-kserve-5d668998dc-9lv9z"]
Jul 06 20:06:27.159804 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:27.159769    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-fd49c7/auth-test-model-fd49c7-kserve-5d668998dc-9lv9z"]
Jul 06 20:06:28.130095 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:28.130062    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="381959cb-b151-41a5-860d-ec8d91bfd7ed" path="/var/lib/kubelet/pods/381959cb-b151-41a5-860d-ec8d91bfd7ed/volumes"
Jul 06 20:06:34.302163 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:34.302121    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 20:06:58.296800 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:58.296761    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-fd49c7/sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg"]
Jul 06 20:06:58.297595 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:58.297568    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cd08032-82a0-4c8d-8359-fb54ff42d01f" containerName="main"
Jul 06 20:06:58.297595 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:58.297596    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cd08032-82a0-4c8d-8359-fb54ff42d01f" containerName="main"
Jul 06 20:06:58.297820 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:58.297610    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="381959cb-b151-41a5-860d-ec8d91bfd7ed" containerName="main"
Jul 06 20:06:58.297820 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:58.297619    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="381959cb-b151-41a5-860d-ec8d91bfd7ed" containerName="main"
Jul 06 20:06:58.297820 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:58.297738    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cd08032-82a0-4c8d-8359-fb54ff42d01f" containerName="main"
Jul 06 20:06:58.297820 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:58.297748    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="381959cb-b151-41a5-860d-ec8d91bfd7ed" containerName="main"
Jul 06 20:06:58.300544 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:58.300521    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fd49c7/sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg"
Jul 06 20:06:58.305321 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:58.305298    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-fd49c7\"/\"default-dockercfg-zpm2p\""
Jul 06 20:06:58.305571 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:58.305311    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-fd49c7\"/\"openshift-service-ca.crt\""
Jul 06 20:06:58.305571 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:58.305360    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-fd49c7\"/\"kube-root-ca.crt\""
Jul 06 20:06:58.310374 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:58.310352    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-fd49c7\"/\"sub-test-model-fd49c7-kserve-self-signed-certs\""
Jul 06 20:06:58.325108 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:58.325081    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-fd49c7/sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg"]
Jul 06 20:06:58.373055 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:58.373023    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:06:58.380270 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:58.380247    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8c71b1d-36aa-432c-a8a6-ab8b88d20abc-tmp-dir\") pod \"sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg\" (UID: \"b8c71b1d-36aa-432c-a8a6-ab8b88d20abc\") " pod="ai-tenant-e2e-shared-b-fd49c7/sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg"
Jul 06 20:06:58.380418 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:58.380285    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8c71b1d-36aa-432c-a8a6-ab8b88d20abc-home\") pod \"sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg\" (UID: \"b8c71b1d-36aa-432c-a8a6-ab8b88d20abc\") " pod="ai-tenant-e2e-shared-b-fd49c7/sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg"
Jul 06 20:06:58.380418 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:58.380313    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8c71b1d-36aa-432c-a8a6-ab8b88d20abc-model-cache\") pod \"sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg\" (UID: \"b8c71b1d-36aa-432c-a8a6-ab8b88d20abc\") " pod="ai-tenant-e2e-shared-b-fd49c7/sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg"
Jul 06 20:06:58.380418 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:58.380388    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mgrd\" (UniqueName: \"kubernetes.io/projected/b8c71b1d-36aa-432c-a8a6-ab8b88d20abc-kube-api-access-6mgrd\") pod \"sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg\" (UID: \"b8c71b1d-36aa-432c-a8a6-ab8b88d20abc\") " pod="ai-tenant-e2e-shared-b-fd49c7/sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg"
Jul 06 20:06:58.380571 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:58.380445    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8c71b1d-36aa-432c-a8a6-ab8b88d20abc-dshm\") pod \"sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg\" (UID: \"b8c71b1d-36aa-432c-a8a6-ab8b88d20abc\") " pod="ai-tenant-e2e-shared-b-fd49c7/sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg"
Jul 06 20:06:58.380571 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:58.380479    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8c71b1d-36aa-432c-a8a6-ab8b88d20abc-tls-certs\") pod \"sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg\" (UID: \"b8c71b1d-36aa-432c-a8a6-ab8b88d20abc\") " pod="ai-tenant-e2e-shared-b-fd49c7/sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg"
Jul 06 20:06:58.481406 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:58.481370    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mgrd\" (UniqueName: \"kubernetes.io/projected/b8c71b1d-36aa-432c-a8a6-ab8b88d20abc-kube-api-access-6mgrd\") pod \"sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg\" (UID: \"b8c71b1d-36aa-432c-a8a6-ab8b88d20abc\") " pod="ai-tenant-e2e-shared-b-fd49c7/sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg"
Jul 06 20:06:58.481587 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:58.481419    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8c71b1d-36aa-432c-a8a6-ab8b88d20abc-dshm\") pod \"sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg\" (UID: \"b8c71b1d-36aa-432c-a8a6-ab8b88d20abc\") " pod="ai-tenant-e2e-shared-b-fd49c7/sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg"
Jul 06 20:06:58.481587 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:58.481441    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8c71b1d-36aa-432c-a8a6-ab8b88d20abc-tls-certs\") pod \"sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg\" (UID: \"b8c71b1d-36aa-432c-a8a6-ab8b88d20abc\") " pod="ai-tenant-e2e-shared-b-fd49c7/sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg"
Jul 06 20:06:58.481587 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:58.481480    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8c71b1d-36aa-432c-a8a6-ab8b88d20abc-tmp-dir\") pod \"sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg\" (UID: \"b8c71b1d-36aa-432c-a8a6-ab8b88d20abc\") " pod="ai-tenant-e2e-shared-b-fd49c7/sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg"
Jul 06 20:06:58.481587 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:58.481506    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8c71b1d-36aa-432c-a8a6-ab8b88d20abc-home\") pod \"sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg\" (UID: \"b8c71b1d-36aa-432c-a8a6-ab8b88d20abc\") " pod="ai-tenant-e2e-shared-b-fd49c7/sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg"
Jul 06 20:06:58.481772 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:58.481646    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8c71b1d-36aa-432c-a8a6-ab8b88d20abc-model-cache\") pod \"sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg\" (UID: \"b8c71b1d-36aa-432c-a8a6-ab8b88d20abc\") " pod="ai-tenant-e2e-shared-b-fd49c7/sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg"
Jul 06 20:06:58.481855 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:58.481840    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8c71b1d-36aa-432c-a8a6-ab8b88d20abc-home\") pod \"sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg\" (UID: \"b8c71b1d-36aa-432c-a8a6-ab8b88d20abc\") " pod="ai-tenant-e2e-shared-b-fd49c7/sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg"
Jul 06 20:06:58.482003 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:58.481979    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8c71b1d-36aa-432c-a8a6-ab8b88d20abc-tmp-dir\") pod \"sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg\" (UID: \"b8c71b1d-36aa-432c-a8a6-ab8b88d20abc\") " pod="ai-tenant-e2e-shared-b-fd49c7/sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg"
Jul 06 20:06:58.482091 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:58.482055    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8c71b1d-36aa-432c-a8a6-ab8b88d20abc-model-cache\") pod \"sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg\" (UID: \"b8c71b1d-36aa-432c-a8a6-ab8b88d20abc\") " pod="ai-tenant-e2e-shared-b-fd49c7/sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg"
Jul 06 20:06:58.483783 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:58.483762    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8c71b1d-36aa-432c-a8a6-ab8b88d20abc-dshm\") pod \"sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg\" (UID: \"b8c71b1d-36aa-432c-a8a6-ab8b88d20abc\") " pod="ai-tenant-e2e-shared-b-fd49c7/sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg"
Jul 06 20:06:58.484068 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:58.484051    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8c71b1d-36aa-432c-a8a6-ab8b88d20abc-tls-certs\") pod \"sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg\" (UID: \"b8c71b1d-36aa-432c-a8a6-ab8b88d20abc\") " pod="ai-tenant-e2e-shared-b-fd49c7/sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg"
Jul 06 20:06:58.492057 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:58.492034    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mgrd\" (UniqueName: \"kubernetes.io/projected/b8c71b1d-36aa-432c-a8a6-ab8b88d20abc-kube-api-access-6mgrd\") pod \"sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg\" (UID: \"b8c71b1d-36aa-432c-a8a6-ab8b88d20abc\") " pod="ai-tenant-e2e-shared-b-fd49c7/sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg"
Jul 06 20:06:58.610996 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:58.610905    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fd49c7/sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg"
Jul 06 20:06:58.756950 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:58.756924    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-fd49c7/sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg"]
Jul 06 20:06:58.758706 ip-10-0-131-150 kubenswrapper[2555]: W0706 20:06:58.758675    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb8c71b1d_36aa_432c_a8a6_ab8b88d20abc.slice/crio-9b941c0934d1eaa1055ab91f631eaaa6e06821369d683f42eb752ab3e2da1a20 WatchSource:0}: Error finding container 9b941c0934d1eaa1055ab91f631eaaa6e06821369d683f42eb752ab3e2da1a20: Status 404 returned error can't find the container with id 9b941c0934d1eaa1055ab91f631eaaa6e06821369d683f42eb752ab3e2da1a20
Jul 06 20:06:58.817667 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:58.817636    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fd49c7/sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg" event={"ID":"b8c71b1d-36aa-432c-a8a6-ab8b88d20abc","Type":"ContainerStarted","Data":"9b941c0934d1eaa1055ab91f631eaaa6e06821369d683f42eb752ab3e2da1a20"}
Jul 06 20:06:59.823804 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:06:59.823769    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fd49c7/sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg" event={"ID":"b8c71b1d-36aa-432c-a8a6-ab8b88d20abc","Type":"ContainerStarted","Data":"5c88cabe894347582cadb10ddcf446449c872a4e5c60abf9d5711ed8ae040d85"}
Jul 06 20:07:00.380416 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:00.380370    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:07:00.516894 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:00.516828    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:07:02.847099 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:02.847036    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-fd49c7/sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg" podStartSLOduration=4.847020008 podStartE2EDuration="4.847020008s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:06:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:06:59.864118441 +0000 UTC m=+2477.640151850" watchObservedRunningTime="2026-07-06 20:07:02.847020008 +0000 UTC m=+2480.623053453"
Jul 06 20:07:02.847829 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:02.847803    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 20:07:08.329418 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:08.329381    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:07:08.611899 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:08.611782    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-fd49c7/sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg"
Jul 06 20:07:08.611899 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:08.611864    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-fd49c7/sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg"
Jul 06 20:07:08.624648 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:08.624620    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-fd49c7/sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg"
Jul 06 20:07:08.877614 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:08.877532    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-fd49c7/sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg"
Jul 06 20:07:13.027648 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:13.027610    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:07:17.213559 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:17.213516    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:07:17.357078 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:17.357039    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:07:19.771720 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:19.771683    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 20:07:38.201834 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:38.201753    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 20:07:44.707924 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:44.707884    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:07:45.328040 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:45.327987    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-fd49c7/sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg"]
Jul 06 20:07:45.361377 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:45.361343    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:07:53.528355 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:53.528309    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-96f4cb/rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv"]
Jul 06 20:07:53.531691 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:53.531673    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-96f4cb/rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv"
Jul 06 20:07:53.534977 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:53.534955    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-96f4cb\"/\"default-dockercfg-mmxl9\""
Jul 06 20:07:53.538464 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:53.538448    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-96f4cb\"/\"rate-test-model-96f4cb-kserve-self-signed-certs\""
Jul 06 20:07:53.540335 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:53.540315    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-96f4cb\"/\"kube-root-ca.crt\""
Jul 06 20:07:53.541507 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:53.541492    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-96f4cb\"/\"openshift-service-ca.crt\""
Jul 06 20:07:53.559141 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:53.559107    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-96f4cb/rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv"]
Jul 06 20:07:53.576472 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:53.576436    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0d348f5-bd8f-4b1b-8046-3039c6881e44-tls-certs\") pod \"rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv\" (UID: \"d0d348f5-bd8f-4b1b-8046-3039c6881e44\") " pod="ai-tenant-e2e-shared-a-96f4cb/rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv"
Jul 06 20:07:53.576658 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:53.576485    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0d348f5-bd8f-4b1b-8046-3039c6881e44-model-cache\") pod \"rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv\" (UID: \"d0d348f5-bd8f-4b1b-8046-3039c6881e44\") " pod="ai-tenant-e2e-shared-a-96f4cb/rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv"
Jul 06 20:07:53.576658 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:53.576579    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2rf9\" (UniqueName: \"kubernetes.io/projected/d0d348f5-bd8f-4b1b-8046-3039c6881e44-kube-api-access-n2rf9\") pod \"rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv\" (UID: \"d0d348f5-bd8f-4b1b-8046-3039c6881e44\") " pod="ai-tenant-e2e-shared-a-96f4cb/rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv"
Jul 06 20:07:53.576658 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:53.576607    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0d348f5-bd8f-4b1b-8046-3039c6881e44-dshm\") pod \"rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv\" (UID: \"d0d348f5-bd8f-4b1b-8046-3039c6881e44\") " pod="ai-tenant-e2e-shared-a-96f4cb/rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv"
Jul 06 20:07:53.576658 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:53.576652    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0d348f5-bd8f-4b1b-8046-3039c6881e44-home\") pod \"rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv\" (UID: \"d0d348f5-bd8f-4b1b-8046-3039c6881e44\") " pod="ai-tenant-e2e-shared-a-96f4cb/rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv"
Jul 06 20:07:53.576828 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:53.576707    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0d348f5-bd8f-4b1b-8046-3039c6881e44-tmp-dir\") pod \"rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv\" (UID: \"d0d348f5-bd8f-4b1b-8046-3039c6881e44\") " pod="ai-tenant-e2e-shared-a-96f4cb/rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv"
Jul 06 20:07:53.592602 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:53.592569    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:07:53.677494 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:53.677453    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2rf9\" (UniqueName: \"kubernetes.io/projected/d0d348f5-bd8f-4b1b-8046-3039c6881e44-kube-api-access-n2rf9\") pod \"rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv\" (UID: \"d0d348f5-bd8f-4b1b-8046-3039c6881e44\") " pod="ai-tenant-e2e-shared-a-96f4cb/rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv"
Jul 06 20:07:53.677494 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:53.677498    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0d348f5-bd8f-4b1b-8046-3039c6881e44-dshm\") pod \"rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv\" (UID: \"d0d348f5-bd8f-4b1b-8046-3039c6881e44\") " pod="ai-tenant-e2e-shared-a-96f4cb/rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv"
Jul 06 20:07:53.677750 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:53.677541    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0d348f5-bd8f-4b1b-8046-3039c6881e44-home\") pod \"rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv\" (UID: \"d0d348f5-bd8f-4b1b-8046-3039c6881e44\") " pod="ai-tenant-e2e-shared-a-96f4cb/rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv"
Jul 06 20:07:53.677750 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:53.677563    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0d348f5-bd8f-4b1b-8046-3039c6881e44-tmp-dir\") pod \"rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv\" (UID: \"d0d348f5-bd8f-4b1b-8046-3039c6881e44\") " pod="ai-tenant-e2e-shared-a-96f4cb/rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv"
Jul 06 20:07:53.677750 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:53.677595    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0d348f5-bd8f-4b1b-8046-3039c6881e44-tls-certs\") pod \"rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv\" (UID: \"d0d348f5-bd8f-4b1b-8046-3039c6881e44\") " pod="ai-tenant-e2e-shared-a-96f4cb/rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv"
Jul 06 20:07:53.677750 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:53.677628    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0d348f5-bd8f-4b1b-8046-3039c6881e44-model-cache\") pod \"rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv\" (UID: \"d0d348f5-bd8f-4b1b-8046-3039c6881e44\") " pod="ai-tenant-e2e-shared-a-96f4cb/rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv"
Jul 06 20:07:53.678094 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:53.678067    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0d348f5-bd8f-4b1b-8046-3039c6881e44-tmp-dir\") pod \"rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv\" (UID: \"d0d348f5-bd8f-4b1b-8046-3039c6881e44\") " pod="ai-tenant-e2e-shared-a-96f4cb/rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv"
Jul 06 20:07:53.678229 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:53.678096    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0d348f5-bd8f-4b1b-8046-3039c6881e44-home\") pod \"rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv\" (UID: \"d0d348f5-bd8f-4b1b-8046-3039c6881e44\") " pod="ai-tenant-e2e-shared-a-96f4cb/rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv"
Jul 06 20:07:53.678229 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:53.678123    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0d348f5-bd8f-4b1b-8046-3039c6881e44-model-cache\") pod \"rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv\" (UID: \"d0d348f5-bd8f-4b1b-8046-3039c6881e44\") " pod="ai-tenant-e2e-shared-a-96f4cb/rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv"
Jul 06 20:07:53.679855 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:53.679827    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0d348f5-bd8f-4b1b-8046-3039c6881e44-dshm\") pod \"rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv\" (UID: \"d0d348f5-bd8f-4b1b-8046-3039c6881e44\") " pod="ai-tenant-e2e-shared-a-96f4cb/rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv"
Jul 06 20:07:53.680086 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:53.680068    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0d348f5-bd8f-4b1b-8046-3039c6881e44-tls-certs\") pod \"rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv\" (UID: \"d0d348f5-bd8f-4b1b-8046-3039c6881e44\") " pod="ai-tenant-e2e-shared-a-96f4cb/rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv"
Jul 06 20:07:53.686752 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:53.686726    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2rf9\" (UniqueName: \"kubernetes.io/projected/d0d348f5-bd8f-4b1b-8046-3039c6881e44-kube-api-access-n2rf9\") pod \"rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv\" (UID: \"d0d348f5-bd8f-4b1b-8046-3039c6881e44\") " pod="ai-tenant-e2e-shared-a-96f4cb/rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv"
Jul 06 20:07:53.840975 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:53.840847    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-96f4cb/rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv"
Jul 06 20:07:54.000114 ip-10-0-131-150 kubenswrapper[2555]: W0706 20:07:54.000081    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd0d348f5_bd8f_4b1b_8046_3039c6881e44.slice/crio-0dcb6e807afe5ef864c7590d2bf325e92feba11b2990c4c61345d332f9a93d14 WatchSource:0}: Error finding container 0dcb6e807afe5ef864c7590d2bf325e92feba11b2990c4c61345d332f9a93d14: Status 404 returned error can't find the container with id 0dcb6e807afe5ef864c7590d2bf325e92feba11b2990c4c61345d332f9a93d14
Jul 06 20:07:54.000638 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:54.000615    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-96f4cb/rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv"]
Jul 06 20:07:54.091177 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:54.091086    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-96f4cb/rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv" event={"ID":"d0d348f5-bd8f-4b1b-8046-3039c6881e44","Type":"ContainerStarted","Data":"0d6ae6d1067153f0e3ae55b8cf23abb391d381ba7661386239c5668753415c04"}
Jul 06 20:07:54.091177 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:54.091132    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-96f4cb/rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv" event={"ID":"d0d348f5-bd8f-4b1b-8046-3039c6881e44","Type":"ContainerStarted","Data":"0dcb6e807afe5ef864c7590d2bf325e92feba11b2990c4c61345d332f9a93d14"}
Jul 06 20:07:54.112644 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:54.112562    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-96f4cb/rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv" podStartSLOduration=1.112540573 podStartE2EDuration="1.112540573s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:07:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:07:54.111843788 +0000 UTC m=+2531.887877205" watchObservedRunningTime="2026-07-06 20:07:54.112540573 +0000 UTC m=+2531.888573973"
Jul 06 20:07:55.103466 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:07:55.103431    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 20:08:00.352717 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:00.352669    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-fd49c7/sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg" podUID="b8c71b1d-36aa-432c-a8a6-ab8b88d20abc" containerName="main" containerID="cri-o://5c88cabe894347582cadb10ddcf446449c872a4e5c60abf9d5711ed8ae040d85" gracePeriod=45
Jul 06 20:08:00.611080 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:00.611013    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fd49c7/sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg"
Jul 06 20:08:00.643130 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:00.643095    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8c71b1d-36aa-432c-a8a6-ab8b88d20abc-tls-certs\") pod \"b8c71b1d-36aa-432c-a8a6-ab8b88d20abc\" (UID: \"b8c71b1d-36aa-432c-a8a6-ab8b88d20abc\") "
Jul 06 20:08:00.643336 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:00.643209    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8c71b1d-36aa-432c-a8a6-ab8b88d20abc-home\") pod \"b8c71b1d-36aa-432c-a8a6-ab8b88d20abc\" (UID: \"b8c71b1d-36aa-432c-a8a6-ab8b88d20abc\") "
Jul 06 20:08:00.643336 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:00.643230    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mgrd\" (UniqueName: \"kubernetes.io/projected/b8c71b1d-36aa-432c-a8a6-ab8b88d20abc-kube-api-access-6mgrd\") pod \"b8c71b1d-36aa-432c-a8a6-ab8b88d20abc\" (UID: \"b8c71b1d-36aa-432c-a8a6-ab8b88d20abc\") "
Jul 06 20:08:00.643336 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:00.643258    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8c71b1d-36aa-432c-a8a6-ab8b88d20abc-tmp-dir\") pod \"b8c71b1d-36aa-432c-a8a6-ab8b88d20abc\" (UID: \"b8c71b1d-36aa-432c-a8a6-ab8b88d20abc\") "
Jul 06 20:08:00.643336 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:00.643292    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8c71b1d-36aa-432c-a8a6-ab8b88d20abc-model-cache\") pod \"b8c71b1d-36aa-432c-a8a6-ab8b88d20abc\" (UID: \"b8c71b1d-36aa-432c-a8a6-ab8b88d20abc\") "
Jul 06 20:08:00.643336 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:00.643316    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8c71b1d-36aa-432c-a8a6-ab8b88d20abc-dshm\") pod \"b8c71b1d-36aa-432c-a8a6-ab8b88d20abc\" (UID: \"b8c71b1d-36aa-432c-a8a6-ab8b88d20abc\") "
Jul 06 20:08:00.643600 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:00.643542    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8c71b1d-36aa-432c-a8a6-ab8b88d20abc-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b8c71b1d-36aa-432c-a8a6-ab8b88d20abc" (UID: "b8c71b1d-36aa-432c-a8a6-ab8b88d20abc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:08:00.643600 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:00.643557    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8c71b1d-36aa-432c-a8a6-ab8b88d20abc-home" (OuterVolumeSpecName: "home") pod "b8c71b1d-36aa-432c-a8a6-ab8b88d20abc" (UID: "b8c71b1d-36aa-432c-a8a6-ab8b88d20abc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:08:00.643600 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:00.643580    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8c71b1d-36aa-432c-a8a6-ab8b88d20abc-model-cache" (OuterVolumeSpecName: "model-cache") pod "b8c71b1d-36aa-432c-a8a6-ab8b88d20abc" (UID: "b8c71b1d-36aa-432c-a8a6-ab8b88d20abc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:08:00.645440 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:00.645414    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8c71b1d-36aa-432c-a8a6-ab8b88d20abc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b8c71b1d-36aa-432c-a8a6-ab8b88d20abc" (UID: "b8c71b1d-36aa-432c-a8a6-ab8b88d20abc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:08:00.645554 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:00.645471    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8c71b1d-36aa-432c-a8a6-ab8b88d20abc-dshm" (OuterVolumeSpecName: "dshm") pod "b8c71b1d-36aa-432c-a8a6-ab8b88d20abc" (UID: "b8c71b1d-36aa-432c-a8a6-ab8b88d20abc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:08:00.645554 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:00.645504    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8c71b1d-36aa-432c-a8a6-ab8b88d20abc-kube-api-access-6mgrd" (OuterVolumeSpecName: "kube-api-access-6mgrd") pod "b8c71b1d-36aa-432c-a8a6-ab8b88d20abc" (UID: "b8c71b1d-36aa-432c-a8a6-ab8b88d20abc"). InnerVolumeSpecName "kube-api-access-6mgrd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:08:00.744351 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:00.744305    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8c71b1d-36aa-432c-a8a6-ab8b88d20abc-home\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:08:00.744351 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:00.744346    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mgrd\" (UniqueName: \"kubernetes.io/projected/b8c71b1d-36aa-432c-a8a6-ab8b88d20abc-kube-api-access-6mgrd\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:08:00.744351 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:00.744358    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8c71b1d-36aa-432c-a8a6-ab8b88d20abc-tmp-dir\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:08:00.744609 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:00.744367    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8c71b1d-36aa-432c-a8a6-ab8b88d20abc-model-cache\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:08:00.744609 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:00.744377    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8c71b1d-36aa-432c-a8a6-ab8b88d20abc-dshm\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:08:00.744609 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:00.744386    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8c71b1d-36aa-432c-a8a6-ab8b88d20abc-tls-certs\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:08:01.132010 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:01.131974    2555 generic.go:356] "Generic (PLEG): container finished" podID="b8c71b1d-36aa-432c-a8a6-ab8b88d20abc" containerID="5c88cabe894347582cadb10ddcf446449c872a4e5c60abf9d5711ed8ae040d85" exitCode=0
Jul 06 20:08:01.132224 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:01.132018    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fd49c7/sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg"
Jul 06 20:08:01.132224 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:01.132039    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fd49c7/sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg" event={"ID":"b8c71b1d-36aa-432c-a8a6-ab8b88d20abc","Type":"ContainerDied","Data":"5c88cabe894347582cadb10ddcf446449c872a4e5c60abf9d5711ed8ae040d85"}
Jul 06 20:08:01.132224 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:01.132081    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fd49c7/sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg" event={"ID":"b8c71b1d-36aa-432c-a8a6-ab8b88d20abc","Type":"ContainerDied","Data":"9b941c0934d1eaa1055ab91f631eaaa6e06821369d683f42eb752ab3e2da1a20"}
Jul 06 20:08:01.132224 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:01.132104    2555 scope.go:117] "RemoveContainer" containerID="5c88cabe894347582cadb10ddcf446449c872a4e5c60abf9d5711ed8ae040d85"
Jul 06 20:08:01.141030 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:01.141003    2555 scope.go:117] "RemoveContainer" containerID="5c88cabe894347582cadb10ddcf446449c872a4e5c60abf9d5711ed8ae040d85"
Jul 06 20:08:01.141312 ip-10-0-131-150 kubenswrapper[2555]: E0706 20:08:01.141294    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c88cabe894347582cadb10ddcf446449c872a4e5c60abf9d5711ed8ae040d85\": container with ID starting with 5c88cabe894347582cadb10ddcf446449c872a4e5c60abf9d5711ed8ae040d85 not found: ID does not exist" containerID="5c88cabe894347582cadb10ddcf446449c872a4e5c60abf9d5711ed8ae040d85"
Jul 06 20:08:01.141356 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:01.141318    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c88cabe894347582cadb10ddcf446449c872a4e5c60abf9d5711ed8ae040d85"} err="failed to get container status \"5c88cabe894347582cadb10ddcf446449c872a4e5c60abf9d5711ed8ae040d85\": rpc error: code = NotFound desc = could not find container \"5c88cabe894347582cadb10ddcf446449c872a4e5c60abf9d5711ed8ae040d85\": container with ID starting with 5c88cabe894347582cadb10ddcf446449c872a4e5c60abf9d5711ed8ae040d85 not found: ID does not exist"
Jul 06 20:08:01.166295 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:01.166263    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-fd49c7/sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg"]
Jul 06 20:08:01.170439 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:01.170411    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-fd49c7/sub-test-model-fd49c7-kserve-779dfb4cc-tb9bg"]
Jul 06 20:08:02.130388 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:02.130353    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8c71b1d-36aa-432c-a8a6-ab8b88d20abc" path="/var/lib/kubelet/pods/b8c71b1d-36aa-432c-a8a6-ab8b88d20abc/volumes"
Jul 06 20:08:03.841898 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:03.841855    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-96f4cb/rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv"
Jul 06 20:08:03.842356 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:03.841951    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-96f4cb/rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv"
Jul 06 20:08:03.854885 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:03.854855    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-96f4cb/rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv"
Jul 06 20:08:04.158222 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:04.158130    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-96f4cb/rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv"
Jul 06 20:08:05.603979 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:05.603775    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:08:05.730604 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:05.730544    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:08:06.715368 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:06.715331    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 20:08:14.282370 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:14.282334    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:08:14.410640 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:14.410571    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:08:32.982637 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:32.982599    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-fd49c7/rate-test-model-fd49c7-kserve-69b99d87-dcpgw"]
Jul 06 20:08:32.983260 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:32.983159    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8c71b1d-36aa-432c-a8a6-ab8b88d20abc" containerName="main"
Jul 06 20:08:32.983260 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:32.983182    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8c71b1d-36aa-432c-a8a6-ab8b88d20abc" containerName="main"
Jul 06 20:08:32.983382 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:32.983268    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8c71b1d-36aa-432c-a8a6-ab8b88d20abc" containerName="main"
Jul 06 20:08:32.986275 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:32.986255    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fd49c7/rate-test-model-fd49c7-kserve-69b99d87-dcpgw"
Jul 06 20:08:32.989995 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:32.989977    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-fd49c7\"/\"openshift-service-ca.crt\""
Jul 06 20:08:32.990725 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:32.990707    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-fd49c7\"/\"default-dockercfg-zpm2p\""
Jul 06 20:08:32.990804 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:32.990777    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-fd49c7\"/\"rate-test-model-fd49c7-kserve-self-signed-certs\""
Jul 06 20:08:32.991106 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:32.991090    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-fd49c7\"/\"kube-root-ca.crt\""
Jul 06 20:08:33.011946 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:33.011901    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-fd49c7/rate-test-model-fd49c7-kserve-69b99d87-dcpgw"]
Jul 06 20:08:33.057855 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:33.057821    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:08:33.141221 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:33.141184    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c79d280-dcc6-422b-ae3a-2e559b29b00f-model-cache\") pod \"rate-test-model-fd49c7-kserve-69b99d87-dcpgw\" (UID: \"8c79d280-dcc6-422b-ae3a-2e559b29b00f\") " pod="ai-tenant-e2e-shared-b-fd49c7/rate-test-model-fd49c7-kserve-69b99d87-dcpgw"
Jul 06 20:08:33.141221 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:33.141223    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c79d280-dcc6-422b-ae3a-2e559b29b00f-tls-certs\") pod \"rate-test-model-fd49c7-kserve-69b99d87-dcpgw\" (UID: \"8c79d280-dcc6-422b-ae3a-2e559b29b00f\") " pod="ai-tenant-e2e-shared-b-fd49c7/rate-test-model-fd49c7-kserve-69b99d87-dcpgw"
Jul 06 20:08:33.141476 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:33.141317    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c79d280-dcc6-422b-ae3a-2e559b29b00f-dshm\") pod \"rate-test-model-fd49c7-kserve-69b99d87-dcpgw\" (UID: \"8c79d280-dcc6-422b-ae3a-2e559b29b00f\") " pod="ai-tenant-e2e-shared-b-fd49c7/rate-test-model-fd49c7-kserve-69b99d87-dcpgw"
Jul 06 20:08:33.141476 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:33.141340    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sv5f\" (UniqueName: \"kubernetes.io/projected/8c79d280-dcc6-422b-ae3a-2e559b29b00f-kube-api-access-4sv5f\") pod \"rate-test-model-fd49c7-kserve-69b99d87-dcpgw\" (UID: \"8c79d280-dcc6-422b-ae3a-2e559b29b00f\") " pod="ai-tenant-e2e-shared-b-fd49c7/rate-test-model-fd49c7-kserve-69b99d87-dcpgw"
Jul 06 20:08:33.141476 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:33.141367    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c79d280-dcc6-422b-ae3a-2e559b29b00f-home\") pod \"rate-test-model-fd49c7-kserve-69b99d87-dcpgw\" (UID: \"8c79d280-dcc6-422b-ae3a-2e559b29b00f\") " pod="ai-tenant-e2e-shared-b-fd49c7/rate-test-model-fd49c7-kserve-69b99d87-dcpgw"
Jul 06 20:08:33.141618 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:33.141496    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c79d280-dcc6-422b-ae3a-2e559b29b00f-tmp-dir\") pod \"rate-test-model-fd49c7-kserve-69b99d87-dcpgw\" (UID: \"8c79d280-dcc6-422b-ae3a-2e559b29b00f\") " pod="ai-tenant-e2e-shared-b-fd49c7/rate-test-model-fd49c7-kserve-69b99d87-dcpgw"
Jul 06 20:08:33.242571 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:33.242468    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c79d280-dcc6-422b-ae3a-2e559b29b00f-tmp-dir\") pod \"rate-test-model-fd49c7-kserve-69b99d87-dcpgw\" (UID: \"8c79d280-dcc6-422b-ae3a-2e559b29b00f\") " pod="ai-tenant-e2e-shared-b-fd49c7/rate-test-model-fd49c7-kserve-69b99d87-dcpgw"
Jul 06 20:08:33.242571 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:33.242534    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c79d280-dcc6-422b-ae3a-2e559b29b00f-model-cache\") pod \"rate-test-model-fd49c7-kserve-69b99d87-dcpgw\" (UID: \"8c79d280-dcc6-422b-ae3a-2e559b29b00f\") " pod="ai-tenant-e2e-shared-b-fd49c7/rate-test-model-fd49c7-kserve-69b99d87-dcpgw"
Jul 06 20:08:33.242571 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:33.242557    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c79d280-dcc6-422b-ae3a-2e559b29b00f-tls-certs\") pod \"rate-test-model-fd49c7-kserve-69b99d87-dcpgw\" (UID: \"8c79d280-dcc6-422b-ae3a-2e559b29b00f\") " pod="ai-tenant-e2e-shared-b-fd49c7/rate-test-model-fd49c7-kserve-69b99d87-dcpgw"
Jul 06 20:08:33.242849 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:33.242614    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c79d280-dcc6-422b-ae3a-2e559b29b00f-dshm\") pod \"rate-test-model-fd49c7-kserve-69b99d87-dcpgw\" (UID: \"8c79d280-dcc6-422b-ae3a-2e559b29b00f\") " pod="ai-tenant-e2e-shared-b-fd49c7/rate-test-model-fd49c7-kserve-69b99d87-dcpgw"
Jul 06 20:08:33.242849 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:33.242636    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sv5f\" (UniqueName: \"kubernetes.io/projected/8c79d280-dcc6-422b-ae3a-2e559b29b00f-kube-api-access-4sv5f\") pod \"rate-test-model-fd49c7-kserve-69b99d87-dcpgw\" (UID: \"8c79d280-dcc6-422b-ae3a-2e559b29b00f\") " pod="ai-tenant-e2e-shared-b-fd49c7/rate-test-model-fd49c7-kserve-69b99d87-dcpgw"
Jul 06 20:08:33.242849 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:33.242661    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c79d280-dcc6-422b-ae3a-2e559b29b00f-home\") pod \"rate-test-model-fd49c7-kserve-69b99d87-dcpgw\" (UID: \"8c79d280-dcc6-422b-ae3a-2e559b29b00f\") " pod="ai-tenant-e2e-shared-b-fd49c7/rate-test-model-fd49c7-kserve-69b99d87-dcpgw"
Jul 06 20:08:33.243015 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:33.242898    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c79d280-dcc6-422b-ae3a-2e559b29b00f-model-cache\") pod \"rate-test-model-fd49c7-kserve-69b99d87-dcpgw\" (UID: \"8c79d280-dcc6-422b-ae3a-2e559b29b00f\") " pod="ai-tenant-e2e-shared-b-fd49c7/rate-test-model-fd49c7-kserve-69b99d87-dcpgw"
Jul 06 20:08:33.243086 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:33.243068    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c79d280-dcc6-422b-ae3a-2e559b29b00f-home\") pod \"rate-test-model-fd49c7-kserve-69b99d87-dcpgw\" (UID: \"8c79d280-dcc6-422b-ae3a-2e559b29b00f\") " pod="ai-tenant-e2e-shared-b-fd49c7/rate-test-model-fd49c7-kserve-69b99d87-dcpgw"
Jul 06 20:08:33.243143 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:33.243112    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c79d280-dcc6-422b-ae3a-2e559b29b00f-tmp-dir\") pod \"rate-test-model-fd49c7-kserve-69b99d87-dcpgw\" (UID: \"8c79d280-dcc6-422b-ae3a-2e559b29b00f\") " pod="ai-tenant-e2e-shared-b-fd49c7/rate-test-model-fd49c7-kserve-69b99d87-dcpgw"
Jul 06 20:08:33.245469 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:33.245443    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c79d280-dcc6-422b-ae3a-2e559b29b00f-dshm\") pod \"rate-test-model-fd49c7-kserve-69b99d87-dcpgw\" (UID: \"8c79d280-dcc6-422b-ae3a-2e559b29b00f\") " pod="ai-tenant-e2e-shared-b-fd49c7/rate-test-model-fd49c7-kserve-69b99d87-dcpgw"
Jul 06 20:08:33.245634 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:33.245620    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c79d280-dcc6-422b-ae3a-2e559b29b00f-tls-certs\") pod \"rate-test-model-fd49c7-kserve-69b99d87-dcpgw\" (UID: \"8c79d280-dcc6-422b-ae3a-2e559b29b00f\") " pod="ai-tenant-e2e-shared-b-fd49c7/rate-test-model-fd49c7-kserve-69b99d87-dcpgw"
Jul 06 20:08:33.251120 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:33.251097    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sv5f\" (UniqueName: \"kubernetes.io/projected/8c79d280-dcc6-422b-ae3a-2e559b29b00f-kube-api-access-4sv5f\") pod \"rate-test-model-fd49c7-kserve-69b99d87-dcpgw\" (UID: \"8c79d280-dcc6-422b-ae3a-2e559b29b00f\") " pod="ai-tenant-e2e-shared-b-fd49c7/rate-test-model-fd49c7-kserve-69b99d87-dcpgw"
Jul 06 20:08:33.294995 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:33.294964    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fd49c7/rate-test-model-fd49c7-kserve-69b99d87-dcpgw"
Jul 06 20:08:33.434080 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:33.434056    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-fd49c7/rate-test-model-fd49c7-kserve-69b99d87-dcpgw"]
Jul 06 20:08:33.435668 ip-10-0-131-150 kubenswrapper[2555]: W0706 20:08:33.435635    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8c79d280_dcc6_422b_ae3a_2e559b29b00f.slice/crio-32fd29ffe42b28ce2e3e0b1b1b498c6749a4db705e9577d42c6992223a3ee986 WatchSource:0}: Error finding container 32fd29ffe42b28ce2e3e0b1b1b498c6749a4db705e9577d42c6992223a3ee986: Status 404 returned error can't find the container with id 32fd29ffe42b28ce2e3e0b1b1b498c6749a4db705e9577d42c6992223a3ee986
Jul 06 20:08:34.301029 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:34.300993    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fd49c7/rate-test-model-fd49c7-kserve-69b99d87-dcpgw" event={"ID":"8c79d280-dcc6-422b-ae3a-2e559b29b00f","Type":"ContainerStarted","Data":"361fbea5d307cbefc846c95f7809f0b94c66cf7cf4ebfc0d0ef4f0277f0b5b45"}
Jul 06 20:08:34.301029 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:34.301034    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fd49c7/rate-test-model-fd49c7-kserve-69b99d87-dcpgw" event={"ID":"8c79d280-dcc6-422b-ae3a-2e559b29b00f","Type":"ContainerStarted","Data":"32fd29ffe42b28ce2e3e0b1b1b498c6749a4db705e9577d42c6992223a3ee986"}
Jul 06 20:08:34.326046 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:34.325994    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-fd49c7/rate-test-model-fd49c7-kserve-69b99d87-dcpgw" podStartSLOduration=2.325978419 podStartE2EDuration="2.325978419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:08:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:08:34.324614099 +0000 UTC m=+2572.100647498" watchObservedRunningTime="2026-07-06 20:08:34.325978419 +0000 UTC m=+2572.102011809"
Jul 06 20:08:36.656303 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:36.656266    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 20:08:37.815655 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:37.815617    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:08:43.295272 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:43.295236    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-fd49c7/rate-test-model-fd49c7-kserve-69b99d87-dcpgw"
Jul 06 20:08:43.295748 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:43.295288    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-fd49c7/rate-test-model-fd49c7-kserve-69b99d87-dcpgw"
Jul 06 20:08:43.307636 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:43.307612    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-fd49c7/rate-test-model-fd49c7-kserve-69b99d87-dcpgw"
Jul 06 20:08:43.356485 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:08:43.356454    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-fd49c7/rate-test-model-fd49c7-kserve-69b99d87-dcpgw"
Jul 06 20:09:08.195721 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:08.195677    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 20:09:27.802104 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:27.802062    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 20:09:31.772358 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:31.772326    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-96f4cb/rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv"]
Jul 06 20:09:31.801583 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:31.801552    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:09:32.697247 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:32.697211    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-fd49c7/rate-test-model-fd49c7-kserve-69b99d87-dcpgw"]
Jul 06 20:09:32.708077 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:32.708043    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:09:33.843382 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:33.843347    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:09:34.371244 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:34.371203    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:09:34.521174 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:34.521138    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:09:34.630603 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:34.630512    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:09:34.915563 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:34.915474    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:09:39.347114 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:39.347078    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:09:41.683103 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:41.683068    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 20:09:46.791891 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:46.791850    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-96f4cb/rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv" podUID="d0d348f5-bd8f-4b1b-8046-3039c6881e44" containerName="main" containerID="cri-o://0d6ae6d1067153f0e3ae55b8cf23abb391d381ba7661386239c5668753415c04" gracePeriod=45
Jul 06 20:09:47.050994 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:47.050930    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-96f4cb/rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv"
Jul 06 20:09:47.098697 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:47.098666    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0d348f5-bd8f-4b1b-8046-3039c6881e44-tmp-dir\") pod \"d0d348f5-bd8f-4b1b-8046-3039c6881e44\" (UID: \"d0d348f5-bd8f-4b1b-8046-3039c6881e44\") "
Jul 06 20:09:47.098852 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:47.098732    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0d348f5-bd8f-4b1b-8046-3039c6881e44-home\") pod \"d0d348f5-bd8f-4b1b-8046-3039c6881e44\" (UID: \"d0d348f5-bd8f-4b1b-8046-3039c6881e44\") "
Jul 06 20:09:47.098852 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:47.098756    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0d348f5-bd8f-4b1b-8046-3039c6881e44-model-cache\") pod \"d0d348f5-bd8f-4b1b-8046-3039c6881e44\" (UID: \"d0d348f5-bd8f-4b1b-8046-3039c6881e44\") "
Jul 06 20:09:47.098852 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:47.098773    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0d348f5-bd8f-4b1b-8046-3039c6881e44-dshm\") pod \"d0d348f5-bd8f-4b1b-8046-3039c6881e44\" (UID: \"d0d348f5-bd8f-4b1b-8046-3039c6881e44\") "
Jul 06 20:09:47.098998 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:47.098854    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2rf9\" (UniqueName: \"kubernetes.io/projected/d0d348f5-bd8f-4b1b-8046-3039c6881e44-kube-api-access-n2rf9\") pod \"d0d348f5-bd8f-4b1b-8046-3039c6881e44\" (UID: \"d0d348f5-bd8f-4b1b-8046-3039c6881e44\") "
Jul 06 20:09:47.098998 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:47.098897    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0d348f5-bd8f-4b1b-8046-3039c6881e44-tls-certs\") pod \"d0d348f5-bd8f-4b1b-8046-3039c6881e44\" (UID: \"d0d348f5-bd8f-4b1b-8046-3039c6881e44\") "
Jul 06 20:09:47.099128 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:47.099017    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0d348f5-bd8f-4b1b-8046-3039c6881e44-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d0d348f5-bd8f-4b1b-8046-3039c6881e44" (UID: "d0d348f5-bd8f-4b1b-8046-3039c6881e44"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:09:47.099128 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:47.099050    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0d348f5-bd8f-4b1b-8046-3039c6881e44-model-cache" (OuterVolumeSpecName: "model-cache") pod "d0d348f5-bd8f-4b1b-8046-3039c6881e44" (UID: "d0d348f5-bd8f-4b1b-8046-3039c6881e44"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:09:47.099128 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:47.099089    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0d348f5-bd8f-4b1b-8046-3039c6881e44-home" (OuterVolumeSpecName: "home") pod "d0d348f5-bd8f-4b1b-8046-3039c6881e44" (UID: "d0d348f5-bd8f-4b1b-8046-3039c6881e44"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:09:47.099285 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:47.099176    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0d348f5-bd8f-4b1b-8046-3039c6881e44-tmp-dir\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:09:47.099285 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:47.099190    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0d348f5-bd8f-4b1b-8046-3039c6881e44-home\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:09:47.099285 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:47.099199    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0d348f5-bd8f-4b1b-8046-3039c6881e44-model-cache\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:09:47.101084 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:47.101049    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0d348f5-bd8f-4b1b-8046-3039c6881e44-kube-api-access-n2rf9" (OuterVolumeSpecName: "kube-api-access-n2rf9") pod "d0d348f5-bd8f-4b1b-8046-3039c6881e44" (UID: "d0d348f5-bd8f-4b1b-8046-3039c6881e44"). InnerVolumeSpecName "kube-api-access-n2rf9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:09:47.101194 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:47.101103    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0d348f5-bd8f-4b1b-8046-3039c6881e44-dshm" (OuterVolumeSpecName: "dshm") pod "d0d348f5-bd8f-4b1b-8046-3039c6881e44" (UID: "d0d348f5-bd8f-4b1b-8046-3039c6881e44"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:09:47.101194 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:47.101127    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0d348f5-bd8f-4b1b-8046-3039c6881e44-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d0d348f5-bd8f-4b1b-8046-3039c6881e44" (UID: "d0d348f5-bd8f-4b1b-8046-3039c6881e44"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:09:47.200278 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:47.200240    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2rf9\" (UniqueName: \"kubernetes.io/projected/d0d348f5-bd8f-4b1b-8046-3039c6881e44-kube-api-access-n2rf9\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:09:47.200278 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:47.200273    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0d348f5-bd8f-4b1b-8046-3039c6881e44-tls-certs\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:09:47.200278 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:47.200282    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0d348f5-bd8f-4b1b-8046-3039c6881e44-dshm\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:09:47.668600 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:47.668569    2555 generic.go:356] "Generic (PLEG): container finished" podID="d0d348f5-bd8f-4b1b-8046-3039c6881e44" containerID="0d6ae6d1067153f0e3ae55b8cf23abb391d381ba7661386239c5668753415c04" exitCode=0
Jul 06 20:09:47.668796 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:47.668612    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-96f4cb/rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv"
Jul 06 20:09:47.668796 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:47.668646    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-96f4cb/rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv" event={"ID":"d0d348f5-bd8f-4b1b-8046-3039c6881e44","Type":"ContainerDied","Data":"0d6ae6d1067153f0e3ae55b8cf23abb391d381ba7661386239c5668753415c04"}
Jul 06 20:09:47.668796 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:47.668695    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-96f4cb/rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv" event={"ID":"d0d348f5-bd8f-4b1b-8046-3039c6881e44","Type":"ContainerDied","Data":"0dcb6e807afe5ef864c7590d2bf325e92feba11b2990c4c61345d332f9a93d14"}
Jul 06 20:09:47.668796 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:47.668716    2555 scope.go:117] "RemoveContainer" containerID="0d6ae6d1067153f0e3ae55b8cf23abb391d381ba7661386239c5668753415c04"
Jul 06 20:09:47.677545 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:47.677527    2555 scope.go:117] "RemoveContainer" containerID="0d6ae6d1067153f0e3ae55b8cf23abb391d381ba7661386239c5668753415c04"
Jul 06 20:09:47.677809 ip-10-0-131-150 kubenswrapper[2555]: E0706 20:09:47.677790    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d6ae6d1067153f0e3ae55b8cf23abb391d381ba7661386239c5668753415c04\": container with ID starting with 0d6ae6d1067153f0e3ae55b8cf23abb391d381ba7661386239c5668753415c04 not found: ID does not exist" containerID="0d6ae6d1067153f0e3ae55b8cf23abb391d381ba7661386239c5668753415c04"
Jul 06 20:09:47.677870 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:47.677821    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d6ae6d1067153f0e3ae55b8cf23abb391d381ba7661386239c5668753415c04"} err="failed to get container status \"0d6ae6d1067153f0e3ae55b8cf23abb391d381ba7661386239c5668753415c04\": rpc error: code = NotFound desc = could not find container \"0d6ae6d1067153f0e3ae55b8cf23abb391d381ba7661386239c5668753415c04\": container with ID starting with 0d6ae6d1067153f0e3ae55b8cf23abb391d381ba7661386239c5668753415c04 not found: ID does not exist"
Jul 06 20:09:47.693678 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:47.693651    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-96f4cb/rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv"]
Jul 06 20:09:47.701673 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:47.701648    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-96f4cb/rate-test-model-96f4cb-kserve-8bb6c4d87-xdzqv"]
Jul 06 20:09:47.716764 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:47.716735    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-fd49c7/rate-test-model-fd49c7-kserve-69b99d87-dcpgw" podUID="8c79d280-dcc6-422b-ae3a-2e559b29b00f" containerName="main" containerID="cri-o://361fbea5d307cbefc846c95f7809f0b94c66cf7cf4ebfc0d0ef4f0277f0b5b45" gracePeriod=45
Jul 06 20:09:47.971801 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:47.971774    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fd49c7/rate-test-model-fd49c7-kserve-69b99d87-dcpgw"
Jul 06 20:09:48.008124 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:48.008087    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c79d280-dcc6-422b-ae3a-2e559b29b00f-model-cache\") pod \"8c79d280-dcc6-422b-ae3a-2e559b29b00f\" (UID: \"8c79d280-dcc6-422b-ae3a-2e559b29b00f\") "
Jul 06 20:09:48.008124 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:48.008132    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4sv5f\" (UniqueName: \"kubernetes.io/projected/8c79d280-dcc6-422b-ae3a-2e559b29b00f-kube-api-access-4sv5f\") pod \"8c79d280-dcc6-422b-ae3a-2e559b29b00f\" (UID: \"8c79d280-dcc6-422b-ae3a-2e559b29b00f\") "
Jul 06 20:09:48.008432 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:48.008174    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c79d280-dcc6-422b-ae3a-2e559b29b00f-dshm\") pod \"8c79d280-dcc6-422b-ae3a-2e559b29b00f\" (UID: \"8c79d280-dcc6-422b-ae3a-2e559b29b00f\") "
Jul 06 20:09:48.008432 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:48.008243    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c79d280-dcc6-422b-ae3a-2e559b29b00f-home\") pod \"8c79d280-dcc6-422b-ae3a-2e559b29b00f\" (UID: \"8c79d280-dcc6-422b-ae3a-2e559b29b00f\") "
Jul 06 20:09:48.008432 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:48.008271    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c79d280-dcc6-422b-ae3a-2e559b29b00f-tls-certs\") pod \"8c79d280-dcc6-422b-ae3a-2e559b29b00f\" (UID: \"8c79d280-dcc6-422b-ae3a-2e559b29b00f\") "
Jul 06 20:09:48.008432 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:48.008296    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c79d280-dcc6-422b-ae3a-2e559b29b00f-tmp-dir\") pod \"8c79d280-dcc6-422b-ae3a-2e559b29b00f\" (UID: \"8c79d280-dcc6-422b-ae3a-2e559b29b00f\") "
Jul 06 20:09:48.008653 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:48.008631    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c79d280-dcc6-422b-ae3a-2e559b29b00f-home" (OuterVolumeSpecName: "home") pod "8c79d280-dcc6-422b-ae3a-2e559b29b00f" (UID: "8c79d280-dcc6-422b-ae3a-2e559b29b00f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:09:48.008747 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:48.008649    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c79d280-dcc6-422b-ae3a-2e559b29b00f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8c79d280-dcc6-422b-ae3a-2e559b29b00f" (UID: "8c79d280-dcc6-422b-ae3a-2e559b29b00f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:09:48.008747 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:48.008436    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c79d280-dcc6-422b-ae3a-2e559b29b00f-model-cache" (OuterVolumeSpecName: "model-cache") pod "8c79d280-dcc6-422b-ae3a-2e559b29b00f" (UID: "8c79d280-dcc6-422b-ae3a-2e559b29b00f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:09:48.010796 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:48.010769    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c79d280-dcc6-422b-ae3a-2e559b29b00f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8c79d280-dcc6-422b-ae3a-2e559b29b00f" (UID: "8c79d280-dcc6-422b-ae3a-2e559b29b00f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:09:48.010935 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:48.010833    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c79d280-dcc6-422b-ae3a-2e559b29b00f-kube-api-access-4sv5f" (OuterVolumeSpecName: "kube-api-access-4sv5f") pod "8c79d280-dcc6-422b-ae3a-2e559b29b00f" (UID: "8c79d280-dcc6-422b-ae3a-2e559b29b00f"). InnerVolumeSpecName "kube-api-access-4sv5f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:09:48.010935 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:48.010900    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c79d280-dcc6-422b-ae3a-2e559b29b00f-dshm" (OuterVolumeSpecName: "dshm") pod "8c79d280-dcc6-422b-ae3a-2e559b29b00f" (UID: "8c79d280-dcc6-422b-ae3a-2e559b29b00f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:09:48.109833 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:48.109797    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c79d280-dcc6-422b-ae3a-2e559b29b00f-model-cache\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:09:48.109833 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:48.109832    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4sv5f\" (UniqueName: \"kubernetes.io/projected/8c79d280-dcc6-422b-ae3a-2e559b29b00f-kube-api-access-4sv5f\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:09:48.110069 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:48.109846    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c79d280-dcc6-422b-ae3a-2e559b29b00f-dshm\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:09:48.110069 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:48.109857    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c79d280-dcc6-422b-ae3a-2e559b29b00f-home\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:09:48.110069 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:48.109869    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c79d280-dcc6-422b-ae3a-2e559b29b00f-tls-certs\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:09:48.110069 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:48.109879    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c79d280-dcc6-422b-ae3a-2e559b29b00f-tmp-dir\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:09:48.131131 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:48.131097    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0d348f5-bd8f-4b1b-8046-3039c6881e44" path="/var/lib/kubelet/pods/d0d348f5-bd8f-4b1b-8046-3039c6881e44/volumes"
Jul 06 20:09:48.675088 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:48.675052    2555 generic.go:356] "Generic (PLEG): container finished" podID="8c79d280-dcc6-422b-ae3a-2e559b29b00f" containerID="361fbea5d307cbefc846c95f7809f0b94c66cf7cf4ebfc0d0ef4f0277f0b5b45" exitCode=0
Jul 06 20:09:48.675246 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:48.675095    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fd49c7/rate-test-model-fd49c7-kserve-69b99d87-dcpgw"
Jul 06 20:09:48.675246 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:48.675142    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fd49c7/rate-test-model-fd49c7-kserve-69b99d87-dcpgw" event={"ID":"8c79d280-dcc6-422b-ae3a-2e559b29b00f","Type":"ContainerDied","Data":"361fbea5d307cbefc846c95f7809f0b94c66cf7cf4ebfc0d0ef4f0277f0b5b45"}
Jul 06 20:09:48.675246 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:48.675181    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fd49c7/rate-test-model-fd49c7-kserve-69b99d87-dcpgw" event={"ID":"8c79d280-dcc6-422b-ae3a-2e559b29b00f","Type":"ContainerDied","Data":"32fd29ffe42b28ce2e3e0b1b1b498c6749a4db705e9577d42c6992223a3ee986"}
Jul 06 20:09:48.675246 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:48.675200    2555 scope.go:117] "RemoveContainer" containerID="361fbea5d307cbefc846c95f7809f0b94c66cf7cf4ebfc0d0ef4f0277f0b5b45"
Jul 06 20:09:48.683651 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:48.683625    2555 scope.go:117] "RemoveContainer" containerID="361fbea5d307cbefc846c95f7809f0b94c66cf7cf4ebfc0d0ef4f0277f0b5b45"
Jul 06 20:09:48.683935 ip-10-0-131-150 kubenswrapper[2555]: E0706 20:09:48.683900    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"361fbea5d307cbefc846c95f7809f0b94c66cf7cf4ebfc0d0ef4f0277f0b5b45\": container with ID starting with 361fbea5d307cbefc846c95f7809f0b94c66cf7cf4ebfc0d0ef4f0277f0b5b45 not found: ID does not exist" containerID="361fbea5d307cbefc846c95f7809f0b94c66cf7cf4ebfc0d0ef4f0277f0b5b45"
Jul 06 20:09:48.683999 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:48.683948    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"361fbea5d307cbefc846c95f7809f0b94c66cf7cf4ebfc0d0ef4f0277f0b5b45"} err="failed to get container status \"361fbea5d307cbefc846c95f7809f0b94c66cf7cf4ebfc0d0ef4f0277f0b5b45\": rpc error: code = NotFound desc = could not find container \"361fbea5d307cbefc846c95f7809f0b94c66cf7cf4ebfc0d0ef4f0277f0b5b45\": container with ID starting with 361fbea5d307cbefc846c95f7809f0b94c66cf7cf4ebfc0d0ef4f0277f0b5b45 not found: ID does not exist"
Jul 06 20:09:48.697138 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:48.697111    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-fd49c7/rate-test-model-fd49c7-kserve-69b99d87-dcpgw"]
Jul 06 20:09:48.702175 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:48.702148    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-fd49c7/rate-test-model-fd49c7-kserve-69b99d87-dcpgw"]
Jul 06 20:09:50.130341 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:09:50.130312    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c79d280-dcc6-422b-ae3a-2e559b29b00f" path="/var/lib/kubelet/pods/8c79d280-dcc6-422b-ae3a-2e559b29b00f/volumes"
Jul 06 20:10:17.431342 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:17.431298    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:10:17.634224 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:17.634190    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4"]
Jul 06 20:10:17.634464 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:17.634432    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4" podUID="0cc16ed7-2e39-4e18-9fcb-343ab3392297" containerName="istio-proxy" containerID="cri-o://362e3577154522aec7662f109d5b61a7a6c6dcf27e291f51a3d747182c80de29" gracePeriod=30
Jul 06 20:10:17.845152 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:17.845111    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:10:17.979036 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:17.978993    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:10:18.130327 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:18.130210    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:10:18.531145 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:18.531117    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:10:18.916405 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:18.916314    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:10:19.047477 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:19.047437    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:10:19.317313 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:19.317276    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:10:20.009289 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:20.009244    2555 patch_prober.go:28] interesting pod/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 20:10:20.009669 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:20.009314    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4" podUID="0cc16ed7-2e39-4e18-9fcb-343ab3392297" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 20:10:22.009418 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:22.009383    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n47tk"]
Jul 06 20:10:22.845374 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:22.845343    2555 generic.go:356] "Generic (PLEG): container finished" podID="0cc16ed7-2e39-4e18-9fcb-343ab3392297" containerID="362e3577154522aec7662f109d5b61a7a6c6dcf27e291f51a3d747182c80de29" exitCode=0
Jul 06 20:10:22.845558 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:22.845417    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4" event={"ID":"0cc16ed7-2e39-4e18-9fcb-343ab3392297","Type":"ContainerDied","Data":"362e3577154522aec7662f109d5b61a7a6c6dcf27e291f51a3d747182c80de29"}
Jul 06 20:10:22.845558 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:22.845495    2555 scope.go:117] "RemoveContainer" containerID="3193283fcd0d18dad7ac98fd6edeeea57a35b4ef3f370ef2cea8a10eab1aa675"
Jul 06 20:10:22.895408 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:22.895344    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4"
Jul 06 20:10:22.910142 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:22.910111    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0cc16ed7-2e39-4e18-9fcb-343ab3392297-istio-token\") pod \"0cc16ed7-2e39-4e18-9fcb-343ab3392297\" (UID: \"0cc16ed7-2e39-4e18-9fcb-343ab3392297\") "
Jul 06 20:10:22.910142 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:22.910146    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cc16ed7-2e39-4e18-9fcb-343ab3392297-workload-socket\") pod \"0cc16ed7-2e39-4e18-9fcb-343ab3392297\" (UID: \"0cc16ed7-2e39-4e18-9fcb-343ab3392297\") "
Jul 06 20:10:22.910358 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:22.910204    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cc16ed7-2e39-4e18-9fcb-343ab3392297-credential-socket\") pod \"0cc16ed7-2e39-4e18-9fcb-343ab3392297\" (UID: \"0cc16ed7-2e39-4e18-9fcb-343ab3392297\") "
Jul 06 20:10:22.910358 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:22.910227    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0cc16ed7-2e39-4e18-9fcb-343ab3392297-istio-data\") pod \"0cc16ed7-2e39-4e18-9fcb-343ab3392297\" (UID: \"0cc16ed7-2e39-4e18-9fcb-343ab3392297\") "
Jul 06 20:10:22.910358 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:22.910249    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0cc16ed7-2e39-4e18-9fcb-343ab3392297-istio-podinfo\") pod \"0cc16ed7-2e39-4e18-9fcb-343ab3392297\" (UID: \"0cc16ed7-2e39-4e18-9fcb-343ab3392297\") "
Jul 06 20:10:22.910358 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:22.910291    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0cc16ed7-2e39-4e18-9fcb-343ab3392297-istio-envoy\") pod \"0cc16ed7-2e39-4e18-9fcb-343ab3392297\" (UID: \"0cc16ed7-2e39-4e18-9fcb-343ab3392297\") "
Jul 06 20:10:22.910358 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:22.910317    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbwsx\" (UniqueName: \"kubernetes.io/projected/0cc16ed7-2e39-4e18-9fcb-343ab3392297-kube-api-access-fbwsx\") pod \"0cc16ed7-2e39-4e18-9fcb-343ab3392297\" (UID: \"0cc16ed7-2e39-4e18-9fcb-343ab3392297\") "
Jul 06 20:10:22.910358 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:22.910354    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0cc16ed7-2e39-4e18-9fcb-343ab3392297-workload-certs\") pod \"0cc16ed7-2e39-4e18-9fcb-343ab3392297\" (UID: \"0cc16ed7-2e39-4e18-9fcb-343ab3392297\") "
Jul 06 20:10:22.910671 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:22.910382    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0cc16ed7-2e39-4e18-9fcb-343ab3392297-istiod-ca-cert\") pod \"0cc16ed7-2e39-4e18-9fcb-343ab3392297\" (UID: \"0cc16ed7-2e39-4e18-9fcb-343ab3392297\") "
Jul 06 20:10:22.910671 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:22.910517    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cc16ed7-2e39-4e18-9fcb-343ab3392297-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0cc16ed7-2e39-4e18-9fcb-343ab3392297" (UID: "0cc16ed7-2e39-4e18-9fcb-343ab3392297"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:10:22.910671 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:22.910573    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cc16ed7-2e39-4e18-9fcb-343ab3392297-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0cc16ed7-2e39-4e18-9fcb-343ab3392297" (UID: "0cc16ed7-2e39-4e18-9fcb-343ab3392297"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:10:22.910836 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:22.910663    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cc16ed7-2e39-4e18-9fcb-343ab3392297-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0cc16ed7-2e39-4e18-9fcb-343ab3392297" (UID: "0cc16ed7-2e39-4e18-9fcb-343ab3392297"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:10:22.910836 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:22.910673    2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cc16ed7-2e39-4e18-9fcb-343ab3392297-workload-socket\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:10:22.910836 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:22.910692    2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cc16ed7-2e39-4e18-9fcb-343ab3392297-credential-socket\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:10:22.911022 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:22.910829    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cc16ed7-2e39-4e18-9fcb-343ab3392297-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0cc16ed7-2e39-4e18-9fcb-343ab3392297" (UID: "0cc16ed7-2e39-4e18-9fcb-343ab3392297"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:10:22.911237 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:22.911211    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cc16ed7-2e39-4e18-9fcb-343ab3392297-istio-data" (OuterVolumeSpecName: "istio-data") pod "0cc16ed7-2e39-4e18-9fcb-343ab3392297" (UID: "0cc16ed7-2e39-4e18-9fcb-343ab3392297"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:10:22.912504 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:22.912474    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cc16ed7-2e39-4e18-9fcb-343ab3392297-istio-token" (OuterVolumeSpecName: "istio-token") pod "0cc16ed7-2e39-4e18-9fcb-343ab3392297" (UID: "0cc16ed7-2e39-4e18-9fcb-343ab3392297"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:10:22.912806 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:22.912781    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cc16ed7-2e39-4e18-9fcb-343ab3392297-kube-api-access-fbwsx" (OuterVolumeSpecName: "kube-api-access-fbwsx") pod "0cc16ed7-2e39-4e18-9fcb-343ab3392297" (UID: "0cc16ed7-2e39-4e18-9fcb-343ab3392297"). InnerVolumeSpecName "kube-api-access-fbwsx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:10:22.913005 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:22.912980    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cc16ed7-2e39-4e18-9fcb-343ab3392297-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0cc16ed7-2e39-4e18-9fcb-343ab3392297" (UID: "0cc16ed7-2e39-4e18-9fcb-343ab3392297"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:10:22.913099 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:22.913004    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0cc16ed7-2e39-4e18-9fcb-343ab3392297-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0cc16ed7-2e39-4e18-9fcb-343ab3392297" (UID: "0cc16ed7-2e39-4e18-9fcb-343ab3392297"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 20:10:23.011390 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:23.011348    2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0cc16ed7-2e39-4e18-9fcb-343ab3392297-istio-envoy\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:10:23.011390 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:23.011383    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbwsx\" (UniqueName: \"kubernetes.io/projected/0cc16ed7-2e39-4e18-9fcb-343ab3392297-kube-api-access-fbwsx\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:10:23.011390 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:23.011394    2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0cc16ed7-2e39-4e18-9fcb-343ab3392297-workload-certs\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:10:23.011390 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:23.011402    2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0cc16ed7-2e39-4e18-9fcb-343ab3392297-istiod-ca-cert\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:10:23.011877 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:23.011411    2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0cc16ed7-2e39-4e18-9fcb-343ab3392297-istio-token\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:10:23.011877 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:23.011418    2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0cc16ed7-2e39-4e18-9fcb-343ab3392297-istio-data\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:10:23.011877 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:23.011426    2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0cc16ed7-2e39-4e18-9fcb-343ab3392297-istio-podinfo\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:10:23.852112 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:23.852070    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4" event={"ID":"0cc16ed7-2e39-4e18-9fcb-343ab3392297","Type":"ContainerDied","Data":"0f0dbb591418b32c494f56b82981039c52935414c0e7b31532215b76ed5c25de"}
Jul 06 20:10:23.852307 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:23.852124    2555 scope.go:117] "RemoveContainer" containerID="362e3577154522aec7662f109d5b61a7a6c6dcf27e291f51a3d747182c80de29"
Jul 06 20:10:23.852307 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:23.852081    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4"
Jul 06 20:10:23.879328 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:23.879291    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4"]
Jul 06 20:10:23.888462 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:23.888430    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-96f4cb-openshift-default-77df7887ff-c78v4"]
Jul 06 20:10:24.130483 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:24.130406    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cc16ed7-2e39-4e18-9fcb-343ab3392297" path="/var/lib/kubelet/pods/0cc16ed7-2e39-4e18-9fcb-343ab3392297/volumes"
Jul 06 20:10:25.306697 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:25.306653    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:10:25.437023 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:25.436987    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:10:25.567846 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:25.567760    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb"]
Jul 06 20:10:25.568022 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:25.567983    2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb" podUID="074daf76-2b93-4bad-ab21-c009188e4ffa" containerName="istio-proxy" containerID="cri-o://6352448c70d09ab08cbefb3c96674b0ec765e10d1119528aa33c84a2e0d84e16" gracePeriod=30
Jul 06 20:10:25.622400 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:25.622328    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:10:25.857671 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:25.857559    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:10:25.927776 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:25.927741    2555 patch_prober.go:28] interesting pod/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 20:10:25.927968 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:25.927804    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb" podUID="074daf76-2b93-4bad-ab21-c009188e4ffa" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 20:10:30.831577 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:30.831518    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb"
Jul 06 20:10:30.879207 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:30.879169    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/074daf76-2b93-4bad-ab21-c009188e4ffa-istio-envoy\") pod \"074daf76-2b93-4bad-ab21-c009188e4ffa\" (UID: \"074daf76-2b93-4bad-ab21-c009188e4ffa\") "
Jul 06 20:10:30.879397 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:30.879237    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/074daf76-2b93-4bad-ab21-c009188e4ffa-istio-token\") pod \"074daf76-2b93-4bad-ab21-c009188e4ffa\" (UID: \"074daf76-2b93-4bad-ab21-c009188e4ffa\") "
Jul 06 20:10:30.879397 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:30.879275    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/074daf76-2b93-4bad-ab21-c009188e4ffa-istio-podinfo\") pod \"074daf76-2b93-4bad-ab21-c009188e4ffa\" (UID: \"074daf76-2b93-4bad-ab21-c009188e4ffa\") "
Jul 06 20:10:30.879397 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:30.879299    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/074daf76-2b93-4bad-ab21-c009188e4ffa-workload-socket\") pod \"074daf76-2b93-4bad-ab21-c009188e4ffa\" (UID: \"074daf76-2b93-4bad-ab21-c009188e4ffa\") "
Jul 06 20:10:30.879397 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:30.879331    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/074daf76-2b93-4bad-ab21-c009188e4ffa-workload-certs\") pod \"074daf76-2b93-4bad-ab21-c009188e4ffa\" (UID: \"074daf76-2b93-4bad-ab21-c009188e4ffa\") "
Jul 06 20:10:30.879397 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:30.879376    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/074daf76-2b93-4bad-ab21-c009188e4ffa-istio-data\") pod \"074daf76-2b93-4bad-ab21-c009188e4ffa\" (UID: \"074daf76-2b93-4bad-ab21-c009188e4ffa\") "
Jul 06 20:10:30.879677 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:30.879469    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/074daf76-2b93-4bad-ab21-c009188e4ffa-credential-socket\") pod \"074daf76-2b93-4bad-ab21-c009188e4ffa\" (UID: \"074daf76-2b93-4bad-ab21-c009188e4ffa\") "
Jul 06 20:10:30.879677 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:30.879502    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d98j8\" (UniqueName: \"kubernetes.io/projected/074daf76-2b93-4bad-ab21-c009188e4ffa-kube-api-access-d98j8\") pod \"074daf76-2b93-4bad-ab21-c009188e4ffa\" (UID: \"074daf76-2b93-4bad-ab21-c009188e4ffa\") "
Jul 06 20:10:30.879677 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:30.879526    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/074daf76-2b93-4bad-ab21-c009188e4ffa-istiod-ca-cert\") pod \"074daf76-2b93-4bad-ab21-c009188e4ffa\" (UID: \"074daf76-2b93-4bad-ab21-c009188e4ffa\") "
Jul 06 20:10:30.879829 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:30.879666    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/074daf76-2b93-4bad-ab21-c009188e4ffa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "074daf76-2b93-4bad-ab21-c009188e4ffa" (UID: "074daf76-2b93-4bad-ab21-c009188e4ffa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:10:30.879829 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:30.879815    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/074daf76-2b93-4bad-ab21-c009188e4ffa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "074daf76-2b93-4bad-ab21-c009188e4ffa" (UID: "074daf76-2b93-4bad-ab21-c009188e4ffa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:10:30.879956 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:30.879841    2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/074daf76-2b93-4bad-ab21-c009188e4ffa-workload-socket\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:10:30.880023 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:30.879971    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/074daf76-2b93-4bad-ab21-c009188e4ffa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "074daf76-2b93-4bad-ab21-c009188e4ffa" (UID: "074daf76-2b93-4bad-ab21-c009188e4ffa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:10:30.880110 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:30.880085    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/074daf76-2b93-4bad-ab21-c009188e4ffa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "074daf76-2b93-4bad-ab21-c009188e4ffa" (UID: "074daf76-2b93-4bad-ab21-c009188e4ffa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:10:30.880673 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:30.880648    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/074daf76-2b93-4bad-ab21-c009188e4ffa-istio-data" (OuterVolumeSpecName: "istio-data") pod "074daf76-2b93-4bad-ab21-c009188e4ffa" (UID: "074daf76-2b93-4bad-ab21-c009188e4ffa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:10:30.881647 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:30.881624    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/074daf76-2b93-4bad-ab21-c009188e4ffa-istio-token" (OuterVolumeSpecName: "istio-token") pod "074daf76-2b93-4bad-ab21-c009188e4ffa" (UID: "074daf76-2b93-4bad-ab21-c009188e4ffa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:10:30.881782 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:30.881758    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/074daf76-2b93-4bad-ab21-c009188e4ffa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "074daf76-2b93-4bad-ab21-c009188e4ffa" (UID: "074daf76-2b93-4bad-ab21-c009188e4ffa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:10:30.881973 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:30.881942    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/074daf76-2b93-4bad-ab21-c009188e4ffa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "074daf76-2b93-4bad-ab21-c009188e4ffa" (UID: "074daf76-2b93-4bad-ab21-c009188e4ffa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 20:10:30.882082 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:30.882003    2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/074daf76-2b93-4bad-ab21-c009188e4ffa-kube-api-access-d98j8" (OuterVolumeSpecName: "kube-api-access-d98j8") pod "074daf76-2b93-4bad-ab21-c009188e4ffa" (UID: "074daf76-2b93-4bad-ab21-c009188e4ffa"). InnerVolumeSpecName "kube-api-access-d98j8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:10:30.890968 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:30.890939    2555 generic.go:356] "Generic (PLEG): container finished" podID="074daf76-2b93-4bad-ab21-c009188e4ffa" containerID="6352448c70d09ab08cbefb3c96674b0ec765e10d1119528aa33c84a2e0d84e16" exitCode=0
Jul 06 20:10:30.891105 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:30.891004    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb"
Jul 06 20:10:30.891171 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:30.891001    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb" event={"ID":"074daf76-2b93-4bad-ab21-c009188e4ffa","Type":"ContainerDied","Data":"6352448c70d09ab08cbefb3c96674b0ec765e10d1119528aa33c84a2e0d84e16"}
Jul 06 20:10:30.891224 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:30.891185    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb" event={"ID":"074daf76-2b93-4bad-ab21-c009188e4ffa","Type":"ContainerDied","Data":"d38eea35c9c1e1008d2ad2c7668ab0b760c85d7295b43729b06b98fd618db791"}
Jul 06 20:10:30.891281 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:30.891254    2555 scope.go:117] "RemoveContainer" containerID="6352448c70d09ab08cbefb3c96674b0ec765e10d1119528aa33c84a2e0d84e16"
Jul 06 20:10:30.903331 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:30.903305    2555 scope.go:117] "RemoveContainer" containerID="547d4b5d30302733cd535b5b0a3d72602bac6dca3b3e20cfb2b78dc04839afc7"
Jul 06 20:10:30.911891 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:30.911872    2555 scope.go:117] "RemoveContainer" containerID="6352448c70d09ab08cbefb3c96674b0ec765e10d1119528aa33c84a2e0d84e16"
Jul 06 20:10:30.912194 ip-10-0-131-150 kubenswrapper[2555]: E0706 20:10:30.912173    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6352448c70d09ab08cbefb3c96674b0ec765e10d1119528aa33c84a2e0d84e16\": container with ID starting with 6352448c70d09ab08cbefb3c96674b0ec765e10d1119528aa33c84a2e0d84e16 not found: ID does not exist" containerID="6352448c70d09ab08cbefb3c96674b0ec765e10d1119528aa33c84a2e0d84e16"
Jul 06 20:10:30.912251 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:30.912203    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6352448c70d09ab08cbefb3c96674b0ec765e10d1119528aa33c84a2e0d84e16"} err="failed to get container status \"6352448c70d09ab08cbefb3c96674b0ec765e10d1119528aa33c84a2e0d84e16\": rpc error: code = NotFound desc = could not find container \"6352448c70d09ab08cbefb3c96674b0ec765e10d1119528aa33c84a2e0d84e16\": container with ID starting with 6352448c70d09ab08cbefb3c96674b0ec765e10d1119528aa33c84a2e0d84e16 not found: ID does not exist"
Jul 06 20:10:30.912251 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:30.912220    2555 scope.go:117] "RemoveContainer" containerID="547d4b5d30302733cd535b5b0a3d72602bac6dca3b3e20cfb2b78dc04839afc7"
Jul 06 20:10:30.912439 ip-10-0-131-150 kubenswrapper[2555]: E0706 20:10:30.912424    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"547d4b5d30302733cd535b5b0a3d72602bac6dca3b3e20cfb2b78dc04839afc7\": container with ID starting with 547d4b5d30302733cd535b5b0a3d72602bac6dca3b3e20cfb2b78dc04839afc7 not found: ID does not exist" containerID="547d4b5d30302733cd535b5b0a3d72602bac6dca3b3e20cfb2b78dc04839afc7"
Jul 06 20:10:30.912477 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:30.912445    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"547d4b5d30302733cd535b5b0a3d72602bac6dca3b3e20cfb2b78dc04839afc7"} err="failed to get container status \"547d4b5d30302733cd535b5b0a3d72602bac6dca3b3e20cfb2b78dc04839afc7\": rpc error: code = NotFound desc = could not find container \"547d4b5d30302733cd535b5b0a3d72602bac6dca3b3e20cfb2b78dc04839afc7\": container with ID starting with 547d4b5d30302733cd535b5b0a3d72602bac6dca3b3e20cfb2b78dc04839afc7 not found: ID does not exist"
Jul 06 20:10:30.920490 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:30.920459    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb"]
Jul 06 20:10:30.926395 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:30.926365    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-fd49c7-openshift-default-6c5fdf5dd7-777vb"]
Jul 06 20:10:30.980443 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:30.980417    2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/074daf76-2b93-4bad-ab21-c009188e4ffa-credential-socket\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:10:30.980443 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:30.980441    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d98j8\" (UniqueName: \"kubernetes.io/projected/074daf76-2b93-4bad-ab21-c009188e4ffa-kube-api-access-d98j8\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:10:30.980627 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:30.980454    2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/074daf76-2b93-4bad-ab21-c009188e4ffa-istiod-ca-cert\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:10:30.980627 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:30.980463    2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/074daf76-2b93-4bad-ab21-c009188e4ffa-istio-envoy\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:10:30.980627 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:30.980471    2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/074daf76-2b93-4bad-ab21-c009188e4ffa-istio-token\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:10:30.980627 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:30.980478    2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/074daf76-2b93-4bad-ab21-c009188e4ffa-istio-podinfo\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:10:30.980627 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:30.980485    2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/074daf76-2b93-4bad-ab21-c009188e4ffa-workload-certs\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:10:30.980627 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:30.980494    2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/074daf76-2b93-4bad-ab21-c009188e4ffa-istio-data\") on node \"ip-10-0-131-150.ec2.internal\" DevicePath \"\""
Jul 06 20:10:31.579841 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:31.579803    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-w9qgc_82abcd40-00bb-43f3-8b0d-8753994fb246/manager/2.log"
Jul 06 20:10:31.729471 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:31.729441    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-cn4dn_15f0cac8-027a-43a0-aecb-269352712038/manager/1.log"
Jul 06 20:10:32.057527 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:32.057502    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722785-22w4d_92e9b25c-d31d-4964-96a3-ab9f59619d8c/cleanup/0.log"
Jul 06 20:10:32.130591 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:32.130560    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="074daf76-2b93-4bad-ab21-c009188e4ffa" path="/var/lib/kubelet/pods/074daf76-2b93-4bad-ab21-c009188e4ffa/volumes"
Jul 06 20:10:32.199325 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:32.199297    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722800-5pmzb_80d08180-e0c1-431b-b1b0-85f7c200269a/cleanup/0.log"
Jul 06 20:10:32.479927 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:32.479835    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-bxj9s_9b16bf4a-9f95-4ae2-af21-a3cbfbafa00c/server/0.log"
Jul 06 20:10:32.615695 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:32.615662    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-s5bxj_86789700-3004-4ad7-be6d-8484c1d1ae9c/manager/2.log"
Jul 06 20:10:32.746674 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:32.746584    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79c9ddb849-cx94f_c7dee535-a870-4e31-9a68-5aaaaff90be2/copy-manifests/0.log"
Jul 06 20:10:32.760396 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:32.760367    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79c9ddb849-cx94f_c7dee535-a870-4e31-9a68-5aaaaff90be2/manager/2.log"
Jul 06 20:10:34.825205 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:34.825124    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-zbsh7_046e62b5-715c-458e-b98e-e1a64164578b/manager/1.log"
Jul 06 20:10:34.980493 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:34.980465    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-8g2wm_ca3842fa-ba34-4eea-85a5-cfce35b511f8/manager/1.log"
Jul 06 20:10:35.112803 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:35.112719    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-7wpw2_60f0a46a-ae42-482f-8997-a292c08c379e/kuadrant-console-plugin/0.log"
Jul 06 20:10:35.245852 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:35.245823    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-dtrsp_eb895176-dd4d-419e-b20d-163e769fa24e/registry-server/0.log"
Jul 06 20:10:35.512209 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:35.512131    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-n47tk_d6a51a8f-5379-4bc1-833d-6d570e4985db/limitador/0.log"
Jul 06 20:10:35.646598 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:35.646565    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-vvjk6_7bdc1b96-b5ff-4080-a877-61100abc752f/manager/2.log"
Jul 06 20:10:36.073748 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:36.073717    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf496pgf_01a9fe94-8e63-47fc-a801-6b333efea455/istio-proxy/0.log"
Jul 06 20:10:36.351356 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:36.351279    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-68c9f86fd7-c2cxh_3735bed5-1e21-47cb-9288-d6a433b3126a/kube-auth-proxy/0.log"
Jul 06 20:10:36.608112 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:36.608033    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pddls_681e84da-8c38-4be9-8d5e-6580d45e0a39/istio-proxy/1.log"
Jul 06 20:10:38.046657 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:38.046625    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-ks6qj_3f53f625-9e16-457c-a0ad-1cf12bd16b3d/main/0.log"
Jul 06 20:10:42.376074 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:42.376038    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:10:42.486951 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:42.486893    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log" limit=1024
Jul 06 20:10:44.266018 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:44.265985    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j9wtk_bb750a78-aa1e-4c55-b771-e06ca00b997a/ovn-acl-logging/0.log"
Jul 06 20:10:44.267229 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:44.267204    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j9wtk_bb750a78-aa1e-4c55-b771-e06ca00b997a/ovn-acl-logging/0.log"
Jul 06 20:10:45.744169 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:45.744130    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-btzb4_0acb06f4-a973-4679-99e1-d7a44e7286ae/global-pull-secret-syncer/0.log"
Jul 06 20:10:45.928995 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:45.928965    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7tzh4_7eff5404-593b-4ff6-b2f8-3ef6d8c2db53/konnectivity-agent/0.log"
Jul 06 20:10:46.085289 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:46.085245    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-150.ec2.internal_eb580d2521422f06e4ec1bc19d959bbf/haproxy/0.log"
Jul 06 20:10:51.441904 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:51.441863    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-zbsh7_046e62b5-715c-458e-b98e-e1a64164578b/manager/1.log"
Jul 06 20:10:51.444399 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:51.444375    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-zbsh7_046e62b5-715c-458e-b98e-e1a64164578b/manager/0.log"
Jul 06 20:10:51.492985 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:51.492954    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-8g2wm_ca3842fa-ba34-4eea-85a5-cfce35b511f8/manager/1.log"
Jul 06 20:10:51.493157 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:51.493036    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-8g2wm_ca3842fa-ba34-4eea-85a5-cfce35b511f8/manager/0.log"
Jul 06 20:10:51.537198 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:51.537174    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-7wpw2_60f0a46a-ae42-482f-8997-a292c08c379e/kuadrant-console-plugin/0.log"
Jul 06 20:10:51.601025 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:51.600994    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-dtrsp_eb895176-dd4d-419e-b20d-163e769fa24e/registry-server/0.log"
Jul 06 20:10:51.947133 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:51.947102    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-n47tk_d6a51a8f-5379-4bc1-833d-6d570e4985db/limitador/0.log"
Jul 06 20:10:52.016823 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:52.016793    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-vvjk6_7bdc1b96-b5ff-4080-a877-61100abc752f/manager/1.log"
Jul 06 20:10:52.043846 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:52.043813    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-vvjk6_7bdc1b96-b5ff-4080-a877-61100abc752f/manager/2.log"
Jul 06 20:10:54.456839 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:54.456807    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ml8rq_ea0949d5-75de-4ba1-aeff-f44de9e9db27/node-exporter/0.log"
Jul 06 20:10:54.490204 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:54.490175    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ml8rq_ea0949d5-75de-4ba1-aeff-f44de9e9db27/kube-rbac-proxy/0.log"
Jul 06 20:10:54.535259 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:54.535235    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ml8rq_ea0949d5-75de-4ba1-aeff-f44de9e9db27/init-textfile/0.log"
Jul 06 20:10:55.403395 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:55.403361    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n7wvf/perf-node-gather-daemonset-gk8w9"]
Jul 06 20:10:55.403688 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:55.403677    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cc16ed7-2e39-4e18-9fcb-343ab3392297" containerName="istio-proxy"
Jul 06 20:10:55.403732 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:55.403690    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cc16ed7-2e39-4e18-9fcb-343ab3392297" containerName="istio-proxy"
Jul 06 20:10:55.403732 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:55.403701    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="074daf76-2b93-4bad-ab21-c009188e4ffa" containerName="istio-proxy"
Jul 06 20:10:55.403732 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:55.403707    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="074daf76-2b93-4bad-ab21-c009188e4ffa" containerName="istio-proxy"
Jul 06 20:10:55.403732 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:55.403715    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0d348f5-bd8f-4b1b-8046-3039c6881e44" containerName="main"
Jul 06 20:10:55.403732 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:55.403721    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0d348f5-bd8f-4b1b-8046-3039c6881e44" containerName="main"
Jul 06 20:10:55.403732 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:55.403728    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c79d280-dcc6-422b-ae3a-2e559b29b00f" containerName="main"
Jul 06 20:10:55.403732 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:55.403733    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c79d280-dcc6-422b-ae3a-2e559b29b00f" containerName="main"
Jul 06 20:10:55.403975 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:55.403749    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cc16ed7-2e39-4e18-9fcb-343ab3392297" containerName="istio-proxy"
Jul 06 20:10:55.403975 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:55.403755    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cc16ed7-2e39-4e18-9fcb-343ab3392297" containerName="istio-proxy"
Jul 06 20:10:55.403975 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:55.403806    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0d348f5-bd8f-4b1b-8046-3039c6881e44" containerName="main"
Jul 06 20:10:55.403975 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:55.403814    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cc16ed7-2e39-4e18-9fcb-343ab3392297" containerName="istio-proxy"
Jul 06 20:10:55.403975 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:55.403820    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="074daf76-2b93-4bad-ab21-c009188e4ffa" containerName="istio-proxy"
Jul 06 20:10:55.403975 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:55.403824    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="074daf76-2b93-4bad-ab21-c009188e4ffa" containerName="istio-proxy"
Jul 06 20:10:55.403975 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:55.403830    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c79d280-dcc6-422b-ae3a-2e559b29b00f" containerName="main"
Jul 06 20:10:55.403975 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:55.403836    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cc16ed7-2e39-4e18-9fcb-343ab3392297" containerName="istio-proxy"
Jul 06 20:10:55.406832 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:55.406813    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-gk8w9"
Jul 06 20:10:55.409677 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:55.409657    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n7wvf\"/\"kube-root-ca.crt\""
Jul 06 20:10:55.410325 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:55.410305    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-n7wvf\"/\"default-dockercfg-v9qnr\""
Jul 06 20:10:55.410428 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:55.410389    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n7wvf\"/\"openshift-service-ca.crt\""
Jul 06 20:10:55.489211 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:55.489173    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n7wvf/perf-node-gather-daemonset-gk8w9"]
Jul 06 20:10:55.492240 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:55.492215    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9fdfd089-fbb1-48a7-b0b5-206046bf664c-sys\") pod \"perf-node-gather-daemonset-gk8w9\" (UID: \"9fdfd089-fbb1-48a7-b0b5-206046bf664c\") " pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-gk8w9"
Jul 06 20:10:55.492402 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:55.492243    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9fdfd089-fbb1-48a7-b0b5-206046bf664c-podres\") pod \"perf-node-gather-daemonset-gk8w9\" (UID: \"9fdfd089-fbb1-48a7-b0b5-206046bf664c\") " pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-gk8w9"
Jul 06 20:10:55.492402 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:55.492272    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9fdfd089-fbb1-48a7-b0b5-206046bf664c-lib-modules\") pod \"perf-node-gather-daemonset-gk8w9\" (UID: \"9fdfd089-fbb1-48a7-b0b5-206046bf664c\") " pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-gk8w9"
Jul 06 20:10:55.492402 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:55.492380    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9fdfd089-fbb1-48a7-b0b5-206046bf664c-proc\") pod \"perf-node-gather-daemonset-gk8w9\" (UID: \"9fdfd089-fbb1-48a7-b0b5-206046bf664c\") " pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-gk8w9"
Jul 06 20:10:55.492552 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:55.492412    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwbdd\" (UniqueName: \"kubernetes.io/projected/9fdfd089-fbb1-48a7-b0b5-206046bf664c-kube-api-access-fwbdd\") pod \"perf-node-gather-daemonset-gk8w9\" (UID: \"9fdfd089-fbb1-48a7-b0b5-206046bf664c\") " pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-gk8w9"
Jul 06 20:10:55.593070 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:55.593028    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9fdfd089-fbb1-48a7-b0b5-206046bf664c-lib-modules\") pod \"perf-node-gather-daemonset-gk8w9\" (UID: \"9fdfd089-fbb1-48a7-b0b5-206046bf664c\") " pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-gk8w9"
Jul 06 20:10:55.593256 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:55.593079    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9fdfd089-fbb1-48a7-b0b5-206046bf664c-proc\") pod \"perf-node-gather-daemonset-gk8w9\" (UID: \"9fdfd089-fbb1-48a7-b0b5-206046bf664c\") " pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-gk8w9"
Jul 06 20:10:55.593256 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:55.593097    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwbdd\" (UniqueName: \"kubernetes.io/projected/9fdfd089-fbb1-48a7-b0b5-206046bf664c-kube-api-access-fwbdd\") pod \"perf-node-gather-daemonset-gk8w9\" (UID: \"9fdfd089-fbb1-48a7-b0b5-206046bf664c\") " pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-gk8w9"
Jul 06 20:10:55.593256 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:55.593148    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9fdfd089-fbb1-48a7-b0b5-206046bf664c-sys\") pod \"perf-node-gather-daemonset-gk8w9\" (UID: \"9fdfd089-fbb1-48a7-b0b5-206046bf664c\") " pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-gk8w9"
Jul 06 20:10:55.593256 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:55.593163    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9fdfd089-fbb1-48a7-b0b5-206046bf664c-podres\") pod \"perf-node-gather-daemonset-gk8w9\" (UID: \"9fdfd089-fbb1-48a7-b0b5-206046bf664c\") " pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-gk8w9"
Jul 06 20:10:55.593256 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:55.593185    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9fdfd089-fbb1-48a7-b0b5-206046bf664c-proc\") pod \"perf-node-gather-daemonset-gk8w9\" (UID: \"9fdfd089-fbb1-48a7-b0b5-206046bf664c\") " pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-gk8w9"
Jul 06 20:10:55.593256 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:55.593208    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9fdfd089-fbb1-48a7-b0b5-206046bf664c-lib-modules\") pod \"perf-node-gather-daemonset-gk8w9\" (UID: \"9fdfd089-fbb1-48a7-b0b5-206046bf664c\") " pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-gk8w9"
Jul 06 20:10:55.593256 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:55.593254    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9fdfd089-fbb1-48a7-b0b5-206046bf664c-sys\") pod \"perf-node-gather-daemonset-gk8w9\" (UID: \"9fdfd089-fbb1-48a7-b0b5-206046bf664c\") " pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-gk8w9"
Jul 06 20:10:55.593525 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:55.593367    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9fdfd089-fbb1-48a7-b0b5-206046bf664c-podres\") pod \"perf-node-gather-daemonset-gk8w9\" (UID: \"9fdfd089-fbb1-48a7-b0b5-206046bf664c\") " pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-gk8w9"
Jul 06 20:10:55.608069 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:55.608039    2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwbdd\" (UniqueName: \"kubernetes.io/projected/9fdfd089-fbb1-48a7-b0b5-206046bf664c-kube-api-access-fwbdd\") pod \"perf-node-gather-daemonset-gk8w9\" (UID: \"9fdfd089-fbb1-48a7-b0b5-206046bf664c\") " pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-gk8w9"
Jul 06 20:10:55.717109 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:55.717007    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-gk8w9"
Jul 06 20:10:55.866592 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:55.866567    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n7wvf/perf-node-gather-daemonset-gk8w9"]
Jul 06 20:10:55.869177 ip-10-0-131-150 kubenswrapper[2555]: W0706 20:10:55.869154    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9fdfd089_fbb1_48a7_b0b5_206046bf664c.slice/crio-93f4752eb1a0099d18635c2c3505efe3bcffbfc7f10dc2b5e024228f275ec3b6 WatchSource:0}: Error finding container 93f4752eb1a0099d18635c2c3505efe3bcffbfc7f10dc2b5e024228f275ec3b6: Status 404 returned error can't find the container with id 93f4752eb1a0099d18635c2c3505efe3bcffbfc7f10dc2b5e024228f275ec3b6
Jul 06 20:10:56.015558 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:56.015456    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-gk8w9" event={"ID":"9fdfd089-fbb1-48a7-b0b5-206046bf664c","Type":"ContainerStarted","Data":"f5ac0f6538e034ffbad7fd8daf3cd9dbae41e916307236735554bb61f3be11e7"}
Jul 06 20:10:56.015558 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:56.015509    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-gk8w9" event={"ID":"9fdfd089-fbb1-48a7-b0b5-206046bf664c","Type":"ContainerStarted","Data":"93f4752eb1a0099d18635c2c3505efe3bcffbfc7f10dc2b5e024228f275ec3b6"}
Jul 06 20:10:56.015754 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:56.015557    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-gk8w9"
Jul 06 20:10:56.045229 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:10:56.045177    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-gk8w9" podStartSLOduration=1.045159992 podStartE2EDuration="1.045159992s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:10:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:10:56.042987797 +0000 UTC m=+2713.819021196" watchObservedRunningTime="2026-07-06 20:10:56.045159992 +0000 UTC m=+2713.821193391"
Jul 06 20:11:00.441196 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:11:00.441166    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kzrzz_d8f4fbdd-f51d-47be-9c53-d613bd801d28/dns/0.log"
Jul 06 20:11:00.476193 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:11:00.476165    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kzrzz_d8f4fbdd-f51d-47be-9c53-d613bd801d28/kube-rbac-proxy/0.log"
Jul 06 20:11:00.678639 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:11:00.678603    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5d2dt_e8893200-b607-4e1e-8a6c-fb4a31110947/dns-node-resolver/0.log"
Jul 06 20:11:01.459670 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:11:01.459644    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qtvrs_ae5d3a7d-3488-4ab3-b388-51db77bb6da4/node-ca/0.log"
Jul 06 20:11:02.031345 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:11:02.031315    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-gk8w9"
Jul 06 20:11:02.528787 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:11:02.528760    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf496pgf_01a9fe94-8e63-47fc-a801-6b333efea455/istio-proxy/0.log"
Jul 06 20:11:02.700505 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:11:02.700478    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-68c9f86fd7-c2cxh_3735bed5-1e21-47cb-9288-d6a433b3126a/kube-auth-proxy/0.log"
Jul 06 20:11:02.799117 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:11:02.799034    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pddls_681e84da-8c38-4be9-8d5e-6580d45e0a39/istio-proxy/0.log"
Jul 06 20:11:02.826268 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:11:02.826226    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pddls_681e84da-8c38-4be9-8d5e-6580d45e0a39/istio-proxy/1.log"
Jul 06 20:11:03.926556 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:11:03.926526    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qpv6m_55eea3e5-2d23-4877-a59c-99fb920ff42e/serve-healthcheck-canary/0.log"
Jul 06 20:11:04.892175 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:11:04.892145    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g5bhj_d1e0130c-e466-447b-92f0-4326dfbb3413/kube-rbac-proxy/0.log"
Jul 06 20:11:04.925053 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:11:04.925020    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g5bhj_d1e0130c-e466-447b-92f0-4326dfbb3413/exporter/0.log"
Jul 06 20:11:04.958625 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:11:04.958587    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g5bhj_d1e0130c-e466-447b-92f0-4326dfbb3413/extractor/0.log"
Jul 06 20:11:05.950726 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:11:05.950685    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf496pgf_01a9fe94-8e63-47fc-a801-6b333efea455/istio-proxy/0.log"
Jul 06 20:11:06.077037 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:11:06.076948    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-68c9f86fd7-c2cxh_3735bed5-1e21-47cb-9288-d6a433b3126a/kube-auth-proxy/0.log"
Jul 06 20:11:06.124757 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:11:06.124712    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pddls_681e84da-8c38-4be9-8d5e-6580d45e0a39/istio-proxy/0.log"
Jul 06 20:11:06.154802 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:11:06.154775    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pddls_681e84da-8c38-4be9-8d5e-6580d45e0a39/istio-proxy/1.log"
Jul 06 20:11:07.545045 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:11:07.545007    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf496pgf_01a9fe94-8e63-47fc-a801-6b333efea455/istio-proxy/0.log"
Jul 06 20:11:07.546052 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:11:07.546031    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-w9qgc_82abcd40-00bb-43f3-8b0d-8753994fb246/manager/2.log"
Jul 06 20:11:07.555475 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:11:07.555453    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-w9qgc_82abcd40-00bb-43f3-8b0d-8753994fb246/manager/1.log"
Jul 06 20:11:07.604656 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:11:07.604619    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-cn4dn_15f0cac8-027a-43a0-aecb-269352712038/manager/0.log"
Jul 06 20:11:07.693321 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:11:07.693289    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-cn4dn_15f0cac8-027a-43a0-aecb-269352712038/manager/1.log"
Jul 06 20:11:07.711438 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:11:07.711382    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-68c9f86fd7-c2cxh_3735bed5-1e21-47cb-9288-d6a433b3126a/kube-auth-proxy/0.log"
Jul 06 20:11:07.798449 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:11:07.798337    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pddls_681e84da-8c38-4be9-8d5e-6580d45e0a39/istio-proxy/0.log"
Jul 06 20:11:07.824922 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:11:07.824871    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pddls_681e84da-8c38-4be9-8d5e-6580d45e0a39/istio-proxy/1.log"
Jul 06 20:11:07.838340 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:11:07.838315    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722785-22w4d_92e9b25c-d31d-4964-96a3-ab9f59619d8c/cleanup/0.log"
Jul 06 20:11:07.901225 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:11:07.901196    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722800-5pmzb_80d08180-e0c1-431b-b1b0-85f7c200269a/cleanup/0.log"
Jul 06 20:11:08.063884 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:11:08.063802    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-bxj9s_9b16bf4a-9f95-4ae2-af21-a3cbfbafa00c/server/0.log"
Jul 06 20:11:08.114579 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:11:08.114543    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-s5bxj_86789700-3004-4ad7-be6d-8484c1d1ae9c/manager/1.log"
Jul 06 20:11:08.138709 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:11:08.138681    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-s5bxj_86789700-3004-4ad7-be6d-8484c1d1ae9c/manager/2.log"
Jul 06 20:11:08.204483 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:11:08.204444    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79c9ddb849-cx94f_c7dee535-a870-4e31-9a68-5aaaaff90be2/manager/2.log"
Jul 06 20:11:08.206974 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:11:08.206950    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79c9ddb849-cx94f_c7dee535-a870-4e31-9a68-5aaaaff90be2/manager/1.log"
Jul 06 20:11:08.262350 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:11:08.262311    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79c9ddb849-cx94f_c7dee535-a870-4e31-9a68-5aaaaff90be2/copy-manifests/0.log"
Jul 06 20:11:09.955784 ip-10-0-131-150 kubenswrapper[2555]: I0706 20:11:09.955754    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-tgfvm_bcbade22-7345-4c27-b92b-e9551fadd075/openshift-lws-operator/0.log"