Jul 02 20:32:46.208458 ip-10-0-135-220 systemd[1]: Starting Kubernetes Kubelet...
Jul 02 20:32:46.656966 ip-10-0-135-220 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 20:32:46.656966 ip-10-0-135-220 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 02 20:32:46.656966 ip-10-0-135-220 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 20:32:46.656966 ip-10-0-135-220 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 02 20:32:46.656966 ip-10-0-135-220 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 20:32:46.656966 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.600516    2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 02 20:32:46.656966 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.604989    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 20:32:46.656966 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605000    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 20:32:46.656966 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605003    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 20:32:46.656966 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605010    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 20:32:46.656966 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605013    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 20:32:46.656966 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605016    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 20:32:46.656966 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605019    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 20:32:46.656966 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605021    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 20:32:46.659058 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605024    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 20:32:46.659058 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605026    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 20:32:46.659058 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605031    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 20:32:46.659058 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605034    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 20:32:46.659058 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605037    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 20:32:46.659058 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605040    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 20:32:46.659058 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605044    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 20:32:46.659058 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605047    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 20:32:46.659058 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605051    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 20:32:46.659058 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605054    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 20:32:46.659058 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605057    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 20:32:46.659058 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605060    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 20:32:46.659058 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605063    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 20:32:46.659058 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605066    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 20:32:46.659058 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605069    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 20:32:46.659058 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605072    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 20:32:46.659058 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605075    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 20:32:46.659058 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605077    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 20:32:46.659058 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605080    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 20:32:46.661349 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605083    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 20:32:46.661349 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605086    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 20:32:46.661349 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605088    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 20:32:46.661349 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605091    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 20:32:46.661349 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605094    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 20:32:46.661349 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605096    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 20:32:46.661349 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605099    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 20:32:46.661349 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605101    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 20:32:46.661349 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605105    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 20:32:46.661349 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605108    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 20:32:46.661349 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605111    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 20:32:46.661349 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605115    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 20:32:46.661349 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605118    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 20:32:46.661349 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605122    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 20:32:46.661349 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605125    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 20:32:46.661349 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605128    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 20:32:46.661349 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605130    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 20:32:46.661349 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605133    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 20:32:46.661349 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605149    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 20:32:46.661349 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605152    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 20:32:46.663272 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605154    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 20:32:46.663272 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605157    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 20:32:46.663272 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605159    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 20:32:46.663272 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605162    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 20:32:46.663272 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605165    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 20:32:46.663272 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605167    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 20:32:46.663272 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605170    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 20:32:46.663272 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605172    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 20:32:46.663272 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605175    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 20:32:46.663272 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605178    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 20:32:46.663272 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605180    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 20:32:46.663272 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605184    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 20:32:46.663272 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605187    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 20:32:46.663272 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605189    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 20:32:46.663272 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605192    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 20:32:46.663272 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605195    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 20:32:46.663272 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605198    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 20:32:46.663272 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605201    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 20:32:46.663272 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605204    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 20:32:46.663272 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605208    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 20:32:46.665510 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605211    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 20:32:46.665510 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605213    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 20:32:46.665510 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605216    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 20:32:46.665510 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605219    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 20:32:46.665510 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605221    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 20:32:46.665510 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605224    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 20:32:46.665510 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605227    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 20:32:46.665510 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605229    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 20:32:46.665510 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605232    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 20:32:46.665510 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605234    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 20:32:46.665510 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605237    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 20:32:46.665510 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605240    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 20:32:46.665510 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605243    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 20:32:46.665510 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605245    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 20:32:46.665510 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605248    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 20:32:46.665510 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605250    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 20:32:46.665510 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605254    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 20:32:46.665510 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605256    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 20:32:46.665510 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605259    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 20:32:46.665510 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605261    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 20:32:46.667686 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605264    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 20:32:46.667686 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605266    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 20:32:46.667686 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605269    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 20:32:46.667686 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605271    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 20:32:46.667686 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605274    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 20:32:46.667686 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605276    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 20:32:46.667686 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605279    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 20:32:46.667686 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605281    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 20:32:46.667686 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605284    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 20:32:46.667686 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605286    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 20:32:46.667686 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605289    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 20:32:46.667686 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.605291    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 20:32:46.667686 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607848    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 20:32:46.667686 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607859    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 20:32:46.667686 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607863    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 20:32:46.667686 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607866    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 20:32:46.667686 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607871    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 20:32:46.667686 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607874    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 20:32:46.667686 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607877    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 20:32:46.667686 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607879    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 20:32:46.670426 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607883    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 20:32:46.670426 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607887    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 20:32:46.670426 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607890    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 20:32:46.670426 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607892    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 20:32:46.670426 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607895    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 20:32:46.670426 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607898    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 20:32:46.670426 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607901    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 20:32:46.670426 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607903    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 20:32:46.670426 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607906    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 20:32:46.670426 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607909    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 20:32:46.670426 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607912    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 20:32:46.670426 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607915    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 20:32:46.670426 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607918    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 20:32:46.670426 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607920    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 20:32:46.670426 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607922    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 20:32:46.670426 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607925    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 20:32:46.670426 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607927    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 20:32:46.670426 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607930    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 20:32:46.670426 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607932    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 20:32:46.669549 ip-10-0-135-220 systemd[1]: Started Kubernetes Kubelet.
Jul 02 20:32:46.671197 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607935    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 20:32:46.671197 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607937    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 20:32:46.671197 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607940    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 20:32:46.671197 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607942    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 20:32:46.671197 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607945    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 20:32:46.671197 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607948    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 20:32:46.671197 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607952    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 20:32:46.671197 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607954    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 20:32:46.671197 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607966    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 20:32:46.671197 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607970    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 20:32:46.671197 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607973    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 20:32:46.671197 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607976    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 20:32:46.671197 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607978    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 20:32:46.671197 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607980    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 20:32:46.671197 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607983    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 20:32:46.671197 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607985    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 20:32:46.671197 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607988    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 20:32:46.671197 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607991    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 20:32:46.671197 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607993    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 20:32:46.671197 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607996    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 20:32:46.672417 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.607999    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 20:32:46.672417 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608002    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 20:32:46.672417 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608004    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 20:32:46.672417 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608007    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 20:32:46.672417 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608010    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 20:32:46.672417 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608013    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 20:32:46.672417 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608015    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 20:32:46.672417 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608018    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 20:32:46.672417 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608020    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 20:32:46.672417 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608023    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 20:32:46.672417 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608025    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 20:32:46.672417 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608028    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 20:32:46.672417 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608030    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 20:32:46.672417 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608033    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 20:32:46.672417 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608035    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 20:32:46.672417 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608038    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 20:32:46.672417 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608041    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 20:32:46.672417 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608043    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 20:32:46.672417 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608047    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 20:32:46.673319 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608051    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 20:32:46.673319 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608054    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 20:32:46.673319 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608058    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 20:32:46.673319 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608061    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 20:32:46.673319 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608064    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 20:32:46.673319 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608067    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 20:32:46.673319 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608070    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 20:32:46.673319 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608073    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 20:32:46.673319 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608076    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 20:32:46.673319 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608079    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 20:32:46.673319 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608082    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 20:32:46.673319 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608084    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 20:32:46.673319 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608087    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 20:32:46.673319 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608090    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 20:32:46.673319 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608093    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 20:32:46.673319 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608095    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 20:32:46.673319 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608098    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 20:32:46.673319 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608101    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 20:32:46.673319 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608104    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 20:32:46.673319 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608107    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 20:32:46.674416 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608109    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 20:32:46.674416 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608112    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 20:32:46.674416 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608116    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 20:32:46.674416 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608119    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 20:32:46.674416 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608122    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 20:32:46.674416 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608125    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 20:32:46.674416 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608127    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 20:32:46.674416 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608130    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 20:32:46.674416 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608132    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 20:32:46.674416 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608151    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 20:32:46.674416 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608154    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 20:32:46.674416 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608157    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 20:32:46.674416 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608160    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 20:32:46.674416 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608556    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 20:32:46.674416 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608562    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 20:32:46.674416 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608565    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 20:32:46.674416 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608568    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 20:32:46.674416 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608571    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 20:32:46.674416 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608573    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 20:32:46.674416 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608576    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 20:32:46.675325 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608579    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 20:32:46.675325 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608581    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 20:32:46.675325 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608584    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 20:32:46.675325 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608587    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 20:32:46.675325 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608589    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 20:32:46.675325 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608593    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 20:32:46.675325 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608598    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 20:32:46.675325 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608601    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 20:32:46.675325 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608604    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 20:32:46.675325 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608608    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 20:32:46.675325 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608611    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 20:32:46.675325 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608614    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 20:32:46.675325 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608617    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 20:32:46.675325 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608619    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 20:32:46.675325 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608625    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 20:32:46.675325 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608628    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 20:32:46.675325 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608630    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 20:32:46.675325 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608633    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 20:32:46.675325 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608636    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 20:32:46.676622 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608638    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 20:32:46.676622 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608641    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 20:32:46.676622 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608643    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 20:32:46.676622 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608646    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 20:32:46.676622 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608649    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 20:32:46.676622 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608651    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 20:32:46.676622 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608654    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 20:32:46.676622 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608656    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 20:32:46.676622 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608659    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 20:32:46.676622 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608661    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 20:32:46.676622 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608664    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 20:32:46.676622 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608667    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 20:32:46.676622 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608669    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 20:32:46.676622 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608672    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 20:32:46.676622 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608675    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 20:32:46.676622 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608677    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 20:32:46.676622 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608680    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 20:32:46.676622 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608682    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 20:32:46.676622 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608684    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 20:32:46.677493 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608687    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 20:32:46.677493 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608689    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 20:32:46.677493 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608692    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 20:32:46.677493 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608694    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 20:32:46.677493 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608697    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 20:32:46.677493 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608699    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 20:32:46.677493 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608702    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 20:32:46.677493 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608705    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 20:32:46.677493 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608710    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 20:32:46.677493 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608712    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 20:32:46.677493 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608716    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 20:32:46.677493 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608719    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 20:32:46.677493 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608722    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 20:32:46.677493 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608725    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 20:32:46.677493 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608727    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 20:32:46.677493 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608730    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 20:32:46.677493 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608732    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 20:32:46.677493 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608735    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 20:32:46.677493 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608738    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 20:32:46.677493 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608740    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 20:32:46.678369 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608743    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 20:32:46.678369 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608745    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 20:32:46.678369 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608747    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 20:32:46.678369 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608750    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 20:32:46.678369 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608752    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 20:32:46.678369 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608755    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 20:32:46.678369 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608758    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 20:32:46.678369 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608761    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 20:32:46.678369 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608763    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 20:32:46.678369 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608766    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 20:32:46.678369 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608768    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 20:32:46.678369 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608771    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 20:32:46.678369 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608773    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 20:32:46.678369 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608775    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 20:32:46.678369 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608778    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 20:32:46.678369 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608780    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 20:32:46.678369 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608783    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 20:32:46.678369 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608786    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 20:32:46.678369 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608788    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 20:32:46.678369 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608791    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 20:32:46.679454 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608796    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 20:32:46.679454 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608798    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 20:32:46.679454 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608801    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 20:32:46.679454 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608803    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 20:32:46.679454 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608806    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 20:32:46.679454 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608809    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 20:32:46.679454 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608811    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 20:32:46.679454 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608814    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 20:32:46.679454 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608816    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 20:32:46.679454 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608819    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 20:32:46.679454 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608821    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 20:32:46.679454 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608824    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 20:32:46.679454 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608826    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 20:32:46.679454 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.608829    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 20:32:46.679454 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.608895    2581 flags.go:64] FLAG: --address="0.0.0.0"
Jul 02 20:32:46.679454 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.608901    2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 02 20:32:46.679454 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.608907    2581 flags.go:64] FLAG: --anonymous-auth="true"
Jul 02 20:32:46.679454 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.608911    2581 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 02 20:32:46.679454 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.608914    2581 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 02 20:32:46.679454 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.608917    2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 02 20:32:46.679454 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.608921    2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 02 20:32:46.680406 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.608925    2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 02 20:32:46.680406 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.608928    2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 02 20:32:46.680406 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.608931    2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 02 20:32:46.680406 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.608935    2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 02 20:32:46.680406 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.608938    2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 02 20:32:46.680406 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.608941    2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 02 20:32:46.680406 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.608945    2581 flags.go:64] FLAG: --cgroup-root=""
Jul 02 20:32:46.680406 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.608948    2581 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 02 20:32:46.680406 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.608951    2581 flags.go:64] FLAG: --client-ca-file=""
Jul 02 20:32:46.680406 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.608954    2581 flags.go:64] FLAG: --cloud-provider="external"
Jul 02 20:32:46.680406 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.608957    2581 flags.go:64] FLAG: --cluster-dns="[]"
Jul 02 20:32:46.680406 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.608963    2581 flags.go:64] FLAG: --cluster-domain=""
Jul 02 20:32:46.680406 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.608966    2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 02 20:32:46.680406 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.608969    2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 02 20:32:46.680406 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.608972    2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 02 20:32:46.680406 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.608975    2581 flags.go:64] FLAG: --container-log-max-files="5"
Jul 02 20:32:46.680406 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.608983    2581 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 02 20:32:46.680406 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.608986    2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 02 20:32:46.680406 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.608989    2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 02 20:32:46.680406 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.608992    2581 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 02 20:32:46.680406 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.608995    2581 flags.go:64] FLAG: --contention-profiling="false"
Jul 02 20:32:46.680406 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.608998    2581 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 02 20:32:46.680406 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609000    2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 02 20:32:46.680406 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609004    2581 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 02 20:32:46.681497 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609007    2581 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 02 20:32:46.681497 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609011    2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 02 20:32:46.681497 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609013    2581 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 02 20:32:46.681497 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609016    2581 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 02 20:32:46.681497 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609019    2581 flags.go:64] FLAG: --enable-load-reader="false"
Jul 02 20:32:46.681497 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609022    2581 flags.go:64] FLAG: --enable-server="true"
Jul 02 20:32:46.681497 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609025    2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 02 20:32:46.681497 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609030    2581 flags.go:64] FLAG: --event-burst="100"
Jul 02 20:32:46.681497 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609033    2581 flags.go:64] FLAG: --event-qps="50"
Jul 02 20:32:46.681497 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609035    2581 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 02 20:32:46.681497 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609038    2581 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 02 20:32:46.681497 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609041    2581 flags.go:64] FLAG: --eviction-hard=""
Jul 02 20:32:46.681497 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609045    2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 02 20:32:46.681497 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609047    2581 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 02 20:32:46.681497 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609050    2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 02 20:32:46.681497 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609053    2581 flags.go:64] FLAG: --eviction-soft=""
Jul 02 20:32:46.681497 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609056    2581 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 02 20:32:46.681497 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609059    2581 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 02 20:32:46.681497 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609063    2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 02 20:32:46.681497 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609068    2581 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 02 20:32:46.681497 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609071    2581 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 02 20:32:46.681497 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609073    2581 flags.go:64] FLAG: --fail-swap-on="true"
Jul 02 20:32:46.681497 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609076    2581 flags.go:64] FLAG: --feature-gates=""
Jul 02 20:32:46.681497 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609080    2581 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 02 20:32:46.681497 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609082    2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 02 20:32:46.682762 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609086    2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 02 20:32:46.682762 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609089    2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 02 20:32:46.682762 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609092    2581 flags.go:64] FLAG: --healthz-port="10248"
Jul 02 20:32:46.682762 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609095    2581 flags.go:64] FLAG: --help="false"
Jul 02 20:32:46.682762 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609097    2581 flags.go:64] FLAG: --hostname-override="ip-10-0-135-220.ec2.internal"
Jul 02 20:32:46.682762 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609100    2581 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 02 20:32:46.682762 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609103    2581 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 02 20:32:46.682762 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609106    2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 02 20:32:46.682762 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609109    2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 02 20:32:46.682762 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609112    2581 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 02 20:32:46.682762 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609115    2581 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 02 20:32:46.682762 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609118    2581 flags.go:64] FLAG: --image-service-endpoint=""
Jul 02 20:32:46.682762 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609121    2581 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 02 20:32:46.682762 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609123    2581 flags.go:64] FLAG: --kube-api-burst="100"
Jul 02 20:32:46.682762 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609126    2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 02 20:32:46.682762 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609129    2581 flags.go:64] FLAG: --kube-api-qps="50"
Jul 02 20:32:46.682762 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609132    2581 flags.go:64] FLAG: --kube-reserved=""
Jul 02 20:32:46.682762 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609149    2581 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 02 20:32:46.682762 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609153    2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 02 20:32:46.682762 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609156    2581 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 02 20:32:46.682762 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609158    2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 02 20:32:46.682762 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609161    2581 flags.go:64] FLAG: --lock-file=""
Jul 02 20:32:46.682762 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609164    2581 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 02 20:32:46.682762 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609166    2581 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 02 20:32:46.686590 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609169    2581 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 02 20:32:46.686590 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609175    2581 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 02 20:32:46.686590 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609181    2581 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 02 20:32:46.686590 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609184    2581 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 02 20:32:46.686590 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609186    2581 flags.go:64] FLAG: --logging-format="text"
Jul 02 20:32:46.686590 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609189    2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 02 20:32:46.686590 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609192    2581 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 02 20:32:46.686590 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609195    2581 flags.go:64] FLAG: --manifest-url=""
Jul 02 20:32:46.686590 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609198    2581 flags.go:64] FLAG: --manifest-url-header=""
Jul 02 20:32:46.686590 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609202    2581 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 02 20:32:46.686590 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609205    2581 flags.go:64] FLAG: --max-open-files="1000000"
Jul 02 20:32:46.686590 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609208    2581 flags.go:64] FLAG: --max-pods="110"
Jul 02 20:32:46.686590 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609211    2581 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 02 20:32:46.686590 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609214    2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 02 20:32:46.686590 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609217    2581 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 02 20:32:46.686590 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609220    2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 02 20:32:46.686590 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609223    2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 02 20:32:46.686590 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609226    2581 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 02 20:32:46.686590 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609228    2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 02 20:32:46.686590 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609236    2581 flags.go:64] FLAG: --node-status-max-images="50"
Jul 02 20:32:46.686590 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609239    2581 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 02 20:32:46.686590 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609242    2581 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 02 20:32:46.686590 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609245    2581 flags.go:64] FLAG: --pod-cidr=""
Jul 02 20:32:46.687988 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609248    2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 02 20:32:46.687988 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609253    2581 flags.go:64] FLAG: --pod-manifest-path=""
Jul 02 20:32:46.687988 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609256    2581 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 02 20:32:46.687988 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609259    2581 flags.go:64] FLAG: --pods-per-core="0"
Jul 02 20:32:46.687988 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609262    2581 flags.go:64] FLAG: --port="10250"
Jul 02 20:32:46.687988 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609265    2581 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 02 20:32:46.687988 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609268    2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0aee0f8722b87bcbe"
Jul 02 20:32:46.687988 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609271    2581 flags.go:64] FLAG: --qos-reserved=""
Jul 02 20:32:46.687988 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609274    2581 flags.go:64] FLAG: --read-only-port="10255"
Jul 02 20:32:46.687988 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609277    2581 flags.go:64] FLAG: --register-node="true"
Jul 02 20:32:46.687988 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609280    2581 flags.go:64] FLAG: --register-with-taints=""
Jul 02 20:32:46.687988 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609284    2581 flags.go:64] FLAG: --registry-burst="10"
Jul 02 20:32:46.687988 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609290    2581 flags.go:64] FLAG: --registry-qps="5"
Jul 02 20:32:46.687988 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609293    2581 flags.go:64] FLAG: --reserved-cpus=""
Jul 02 20:32:46.687988 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609296    2581 flags.go:64] FLAG: --reserved-memory=""
Jul 02 20:32:46.687988 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609300    2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 02 20:32:46.687988 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609303    2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 02 20:32:46.687988 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609306    2581 flags.go:64] FLAG: --rotate-certificates="false"
Jul 02 20:32:46.687988 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609309    2581 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 02 20:32:46.687988 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609311    2581 flags.go:64] FLAG: --runonce="false"
Jul 02 20:32:46.687988 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609314    2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 02 20:32:46.687988 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609317    2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 02 20:32:46.687988 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609320    2581 flags.go:64] FLAG: --seccomp-default="false"
Jul 02 20:32:46.687988 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609323    2581 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 02 20:32:46.687988 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609325    2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 02 20:32:46.703975 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609328    2581 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 02 20:32:46.703975 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609331    2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 02 20:32:46.703975 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609334    2581 flags.go:64] FLAG: --storage-driver-password="root"
Jul 02 20:32:46.703975 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609336    2581 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 02 20:32:46.703975 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609339    2581 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 02 20:32:46.703975 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609342    2581 flags.go:64] FLAG: --storage-driver-user="root"
Jul 02 20:32:46.703975 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609345    2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 02 20:32:46.703975 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609348    2581 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 02 20:32:46.703975 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609351    2581 flags.go:64] FLAG: --system-cgroups=""
Jul 02 20:32:46.703975 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609353    2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 02 20:32:46.703975 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609359    2581 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 02 20:32:46.703975 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609361    2581 flags.go:64] FLAG: --tls-cert-file=""
Jul 02 20:32:46.703975 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609364    2581 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 02 20:32:46.703975 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609368    2581 flags.go:64] FLAG: --tls-min-version=""
Jul 02 20:32:46.703975 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609371    2581 flags.go:64] FLAG: --tls-private-key-file=""
Jul 02 20:32:46.703975 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609373    2581 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 02 20:32:46.703975 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609376    2581 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 02 20:32:46.703975 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609379    2581 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 02 20:32:46.703975 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609383    2581 flags.go:64] FLAG: --v="2"
Jul 02 20:32:46.703975 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609388    2581 flags.go:64] FLAG: --version="false"
Jul 02 20:32:46.703975 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609393    2581 flags.go:64] FLAG: --vmodule=""
Jul 02 20:32:46.703975 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609396    2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 02 20:32:46.703975 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.609400    2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 02 20:32:46.703975 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609521    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 20:32:46.703975 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609525    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 20:32:46.705085 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609528    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 20:32:46.705085 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609531    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 20:32:46.705085 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609534    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 20:32:46.705085 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609536    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 20:32:46.705085 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609539    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 20:32:46.705085 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609541    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 20:32:46.705085 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609544    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 20:32:46.705085 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609547    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 20:32:46.705085 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609549    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 20:32:46.705085 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609552    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 20:32:46.705085 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609554    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 20:32:46.705085 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609557    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 20:32:46.705085 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609559    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 20:32:46.705085 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609562    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 20:32:46.705085 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609565    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 20:32:46.705085 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609568    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 20:32:46.705085 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609570    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 20:32:46.705085 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609573    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 20:32:46.705085 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609575    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 20:32:46.705085 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609578    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 20:32:46.705969 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609580    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 20:32:46.705969 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609583    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 20:32:46.705969 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609585    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 20:32:46.705969 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609588    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 20:32:46.705969 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609591    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 20:32:46.705969 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609596    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 20:32:46.705969 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609600    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 20:32:46.705969 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609602    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 20:32:46.705969 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609605    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 20:32:46.705969 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609608    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 20:32:46.705969 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609610    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 20:32:46.705969 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609613    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 20:32:46.705969 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609615    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 20:32:46.705969 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609618    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 20:32:46.705969 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609621    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 20:32:46.705969 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609623    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 20:32:46.705969 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609626    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 20:32:46.705969 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609628    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 20:32:46.705969 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609631    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 20:32:46.705969 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609634    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 20:32:46.706846 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609636    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 20:32:46.706846 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609639    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 20:32:46.706846 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609641    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 20:32:46.706846 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609644    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 20:32:46.706846 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609646    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 20:32:46.706846 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609649    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 20:32:46.706846 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609651    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 20:32:46.706846 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609654    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 20:32:46.706846 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609657    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 20:32:46.706846 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609659    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 20:32:46.706846 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609662    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 20:32:46.706846 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609664    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 20:32:46.706846 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609666    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 20:32:46.706846 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609669    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 20:32:46.706846 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609673    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 20:32:46.706846 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609676    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 20:32:46.706846 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609680    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 20:32:46.706846 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609684    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 20:32:46.706846 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609689    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 20:32:46.707716 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609693    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 20:32:46.707716 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609697    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 20:32:46.707716 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609700    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 20:32:46.707716 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609703    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 20:32:46.707716 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609706    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 20:32:46.707716 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609709    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 20:32:46.707716 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609711    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 20:32:46.707716 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609714    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 20:32:46.707716 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609717    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 20:32:46.707716 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609719    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 20:32:46.707716 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609721    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 20:32:46.707716 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609724    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 20:32:46.707716 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609726    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 20:32:46.707716 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609729    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 20:32:46.707716 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609731    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 20:32:46.707716 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609734    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 20:32:46.707716 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609736    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 20:32:46.707716 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609739    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 20:32:46.707716 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609741    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 20:32:46.707716 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609744    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 20:32:46.708597 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609746    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 20:32:46.708597 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609750    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 20:32:46.708597 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609753    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 20:32:46.708597 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609756    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 20:32:46.708597 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609758    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 20:32:46.708597 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609761    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 20:32:46.708597 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609764    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 20:32:46.708597 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609766    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 20:32:46.708597 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609769    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 20:32:46.708597 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609772    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 20:32:46.708597 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609775    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 20:32:46.708597 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609779    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 20:32:46.708597 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609782    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 20:32:46.708597 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609784    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 20:32:46.708597 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609787    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 20:32:46.708597 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609790    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 20:32:46.708597 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609792    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 20:32:46.708597 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.609795    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 20:32:46.709467 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.610441    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 20:32:46.709467 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.617170    2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 02 20:32:46.709467 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.617183    2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 02 20:32:46.709467 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.617202    2581 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 02 20:32:46.709467 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.617207    2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 02 20:32:46.709467 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617259    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 20:32:46.709467 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617264    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 20:32:46.709467 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617267    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 20:32:46.709467 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617270    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 20:32:46.709467 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617273    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 20:32:46.709467 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617276    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 20:32:46.709467 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617279    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 20:32:46.709467 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617282    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 20:32:46.709467 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617284    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 20:32:46.709467 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617287    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 20:32:46.710125 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617289    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 20:32:46.710125 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617292    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 20:32:46.710125 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617295    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 20:32:46.710125 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617297    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 20:32:46.710125 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617300    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 20:32:46.710125 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617303    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 20:32:46.710125 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617308    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 20:32:46.710125 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617311    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 20:32:46.710125 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617313    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 20:32:46.710125 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617316    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 20:32:46.710125 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617319    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 20:32:46.710125 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617321    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 20:32:46.710125 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617324    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 20:32:46.710125 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617326    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 20:32:46.710125 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617329    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 20:32:46.710125 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617332    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 20:32:46.710125 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617334    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 20:32:46.710125 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617337    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 20:32:46.710125 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617340    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 20:32:46.710125 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617343    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 20:32:46.711014 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617347    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 20:32:46.711014 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617350    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 20:32:46.711014 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617353    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 20:32:46.711014 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617356    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 20:32:46.711014 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617359    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 20:32:46.711014 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617361    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 20:32:46.711014 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617364    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 20:32:46.711014 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617366    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 20:32:46.711014 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617369    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 20:32:46.711014 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617372    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 20:32:46.711014 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617375    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 20:32:46.711014 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617377    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 20:32:46.711014 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617381    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 20:32:46.711014 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617385    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 20:32:46.711014 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617387    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 20:32:46.711014 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617390    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 20:32:46.711014 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617393    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 20:32:46.711014 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617396    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 20:32:46.711014 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617400    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 20:32:46.711886 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617402    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 20:32:46.711886 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617405    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 20:32:46.711886 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617408    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 20:32:46.711886 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617410    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 20:32:46.711886 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617413    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 20:32:46.711886 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617416    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 20:32:46.711886 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617418    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 20:32:46.711886 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617420    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 20:32:46.711886 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617424    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 20:32:46.711886 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617427    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 20:32:46.711886 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617429    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 20:32:46.711886 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617432    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 20:32:46.711886 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617435    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 20:32:46.711886 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617437    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 20:32:46.711886 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617440    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 20:32:46.711886 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617442    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 20:32:46.711886 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617445    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 20:32:46.711886 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617447    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 20:32:46.711886 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617450    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 20:32:46.712774 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617452    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 20:32:46.712774 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617455    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 20:32:46.712774 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617457    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 20:32:46.712774 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617461    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 20:32:46.712774 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617464    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 20:32:46.712774 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617467    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 20:32:46.712774 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617469    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 20:32:46.712774 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617473    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 20:32:46.712774 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617476    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 20:32:46.712774 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617479    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 20:32:46.712774 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617482    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 20:32:46.712774 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617485    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 20:32:46.712774 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617488    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 20:32:46.712774 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617491    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 20:32:46.712774 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617493    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 20:32:46.712774 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617496    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 20:32:46.712774 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617499    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 20:32:46.712774 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617501    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 20:32:46.712774 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617504    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 20:32:46.712774 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617506    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 20:32:46.713607 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617509    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 20:32:46.713607 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617511    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 20:32:46.713607 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617514    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 20:32:46.713607 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617517    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 20:32:46.713607 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617519    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 20:32:46.713607 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617522    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 20:32:46.713607 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617524    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 20:32:46.713607 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617527    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 20:32:46.713607 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617530    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 20:32:46.713607 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617532    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 20:32:46.713607 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617534    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 20:32:46.713607 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.617539    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 20:32:46.713607 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617656    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 20:32:46.713607 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617661    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 20:32:46.713607 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617664    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 20:32:46.714415 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617667    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 20:32:46.714415 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617671    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 20:32:46.714415 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617673    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 20:32:46.714415 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617676    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 20:32:46.714415 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617678    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 20:32:46.714415 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617681    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 20:32:46.714415 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617684    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 20:32:46.714415 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617686    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 20:32:46.714415 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617689    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 20:32:46.714415 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617693    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 20:32:46.714415 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617695    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 20:32:46.714415 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617698    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 20:32:46.714415 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617700    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 20:32:46.714415 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617703    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 20:32:46.714415 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617706    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 20:32:46.714415 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617708    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 20:32:46.714415 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617711    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 20:32:46.714415 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617714    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 20:32:46.714415 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617716    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 20:32:46.714415 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617719    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 20:32:46.715019 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617722    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 20:32:46.715019 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617724    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 20:32:46.715019 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617727    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 20:32:46.715019 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617729    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 20:32:46.715019 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617731    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 20:32:46.715019 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617734    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 20:32:46.715019 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617736    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 20:32:46.715019 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617738    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 20:32:46.715019 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617741    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 20:32:46.715019 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617744    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 20:32:46.715019 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617747    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 20:32:46.715019 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617749    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 20:32:46.715019 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617752    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 20:32:46.715019 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617756    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 20:32:46.715019 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617759    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 20:32:46.715019 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617761    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 20:32:46.715019 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617763    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 20:32:46.715019 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617766    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 20:32:46.715019 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617769    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 20:32:46.715624 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617771    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 20:32:46.715624 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617773    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 20:32:46.715624 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617777    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 20:32:46.715624 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617780    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 20:32:46.715624 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617782    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 20:32:46.715624 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617785    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 20:32:46.715624 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617788    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 20:32:46.715624 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617790    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 20:32:46.715624 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617793    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 20:32:46.715624 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617795    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 20:32:46.715624 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617798    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 20:32:46.715624 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617801    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 20:32:46.715624 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617803    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 20:32:46.715624 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617806    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 20:32:46.715624 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617809    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 20:32:46.715624 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617811    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 20:32:46.715624 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617814    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 20:32:46.715624 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617816    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 20:32:46.715624 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617819    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 20:32:46.715624 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617821    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 20:32:46.716245 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617824    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 20:32:46.716245 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617827    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 20:32:46.716245 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617831    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 20:32:46.716245 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617834    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 20:32:46.716245 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617837    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 20:32:46.716245 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617840    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 20:32:46.716245 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617843    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 20:32:46.716245 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617846    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 20:32:46.716245 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617849    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 20:32:46.716245 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617851    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 20:32:46.716245 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617854    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 20:32:46.716245 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617856    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 20:32:46.716245 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617859    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 20:32:46.716245 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617861    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 20:32:46.716245 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617865    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 20:32:46.716245 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617867    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 20:32:46.716245 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617870    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 20:32:46.716245 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617873    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 20:32:46.716245 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617875    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 20:32:46.716245 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617877    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 20:32:46.716872 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617881    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 20:32:46.716872 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617885    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 20:32:46.716872 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617887    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 20:32:46.716872 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617890    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 20:32:46.716872 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617892    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 20:32:46.716872 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617896    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 20:32:46.716872 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617899    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 20:32:46.716872 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617903    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 20:32:46.716872 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617906    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 20:32:46.716872 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617908    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 20:32:46.716872 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617911    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 20:32:46.716872 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617913    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 20:32:46.716872 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617916    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 20:32:46.716872 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617918    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 20:32:46.716872 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617920    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 20:32:46.716872 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617923    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 20:32:46.716872 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:46.617925    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 20:32:46.717589 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.617930    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 20:32:46.717589 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.618018    2581 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 02 20:32:46.717589 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.621553    2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 02 20:32:46.717589 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.622936    2581 server.go:1019] "Starting client certificate rotation"
Jul 02 20:32:46.717589 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.623035    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 20:32:46.717589 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.623074    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 20:32:46.717589 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.625305    2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 20:32:46.717589 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.626744    2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 20:32:46.717589 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.638955    2581 log.go:25] "Validated CRI v1 runtime API"
Jul 02 20:32:46.717589 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.641007    2581 log.go:25] "Validated CRI v1 image API"
Jul 02 20:32:46.717589 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.642582    2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 02 20:32:46.717589 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.645344    2581 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9fea1819-965c-4a4a-82a2-ada5b93f5e5d:/dev/nvme0n1p3 e298bca1-b37c-45ed-9847-555bf78819e9:/dev/nvme0n1p4]
Jul 02 20:32:46.718437 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.645358    2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 02 20:32:46.718867 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.650445    2581 manager.go:216] Machine: {Timestamp:2026-07-02 20:32:46.649441865 +0000 UTC m=+0.319955348 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099555 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec260dba65a6c5f065aa7480741276c5 SystemUUID:ec260dba-65a6-c5f0-65aa-7480741276c5 BootID:411a9d14-2933-49db-be34-994fb3c57113 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:3d:b4:7f:3f:89 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:3d:b4:7f:3f:89 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:79:7b:b2:1e:10 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 02 20:32:46.718867 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.650540    2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 02 20:32:46.718867 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.650609    2581 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 02 20:32:46.718867 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.651615    2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 02 20:32:46.718867 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.651636    2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-220.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 02 20:32:46.718867 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.652319    2581 topology_manager.go:138] "Creating topology manager with none policy"
Jul 02 20:32:46.718867 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.652328    2581 container_manager_linux.go:309] "Creating device plugin manager"
Jul 02 20:32:46.718867 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.652335    2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 20:32:46.721636 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.652737    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 20:32:46.721636 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.652963    2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 20:32:46.721636 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.654186    2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 02 20:32:46.721636 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.657002    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 20:32:46.721636 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.657109    2581 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 02 20:32:46.721636 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.657649    2581 kubelet.go:486] "Attempting to sync node with API server"
Jul 02 20:32:46.721636 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.657672    2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 02 20:32:46.721636 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.657695    2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 02 20:32:46.721636 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.657708    2581 kubelet.go:398] "Adding apiserver pod source"
Jul 02 20:32:46.721636 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.657719    2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 02 20:32:46.721636 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.658035    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 20:32:46.721636 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.658051    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 20:32:46.721636 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.660852    2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 02 20:32:46.721636 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.662798    2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 02 20:32:46.721636 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.662824    2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 02 20:32:46.721636 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.664017    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 02 20:32:46.721636 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.664032    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 02 20:32:46.721636 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.664037    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 02 20:32:46.721636 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.664043    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 02 20:32:46.721636 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.664051    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 02 20:32:46.721636 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.664056    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 02 20:32:46.721636 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.664069    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 02 20:32:46.721636 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.664076    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 02 20:32:46.721636 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.664083    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 02 20:32:46.721636 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.664089    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 02 20:32:46.721636 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.664106    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 02 20:32:46.721636 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.664112    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 02 20:32:46.721636 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.664132    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 02 20:32:46.721636 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.664152    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 02 20:32:46.721636 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.668809    2581 server.go:1268] "Started kubelet"
Jul 02 20:32:46.721636 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.668874    2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 02 20:32:46.721636 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.668876    2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 02 20:32:46.721636 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.668982    2581 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 02 20:32:46.721636 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.717677    2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 02 20:32:46.721636 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.717979    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qrlgd"
Jul 02 20:32:46.721636 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.718011    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qrlgd"
Jul 02 20:32:46.721636 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:46.718408    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-220.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 02 20:32:46.721636 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:46.718630    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 02 20:32:46.722852 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.718676    2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-220.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 02 20:32:46.722852 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.720645    2581 server.go:310] "Adding debug handlers to kubelet server"
Jul 02 20:32:46.722852 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:46.722070    2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 02 20:32:46.849290 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.725178    2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 02 20:32:46.849290 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:46.725249    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-220.ec2.internal\" not found"
Jul 02 20:32:46.849290 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.725255    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 02 20:32:46.849290 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.725840    2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 02 20:32:46.849290 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.725860    2581 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 02 20:32:46.849290 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.725875    2581 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 02 20:32:46.849290 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.725945    2581 reconstruct.go:97] "Volume reconstruction finished"
Jul 02 20:32:46.849290 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.725955    2581 reconciler.go:29] "Reconciler: start to sync state"
Jul 02 20:32:46.849290 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.725959    2581 factory.go:55] Registering systemd factory
Jul 02 20:32:46.849290 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.725973    2581 factory.go:223] Registration of the systemd container factory successfully
Jul 02 20:32:46.849290 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.726207    2581 factory.go:153] Registering CRI-O factory
Jul 02 20:32:46.849290 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.726216    2581 factory.go:223] Registration of the crio container factory successfully
Jul 02 20:32:46.849290 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.726262    2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 02 20:32:46.849290 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.726282    2581 factory.go:103] Registering Raw factory
Jul 02 20:32:46.849290 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.726297    2581 manager.go:1196] Started watching for new ooms in manager
Jul 02 20:32:46.849290 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.726654    2581 manager.go:349] Starting recovery of all containers
Jul 02 20:32:46.849290 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.728514    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 20:32:46.849290 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:46.737689    2581 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-220.ec2.internal\" not found" node="ip-10-0-135-220.ec2.internal"
Jul 02 20:32:46.849290 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.740084    2581 manager.go:354] Recovery completed
Jul 02 20:32:46.849290 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.744039    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 20:32:46.849290 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.747512    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-220.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 20:32:46.849290 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.747536    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-220.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 20:32:46.849290 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.747550    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-220.ec2.internal" event="NodeHasSufficientPID"
Jul 02 20:32:46.849290 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.750510    2581 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 02 20:32:46.849290 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.750519    2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 02 20:32:46.849290 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.750534    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 20:32:46.849290 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.750564    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 20:32:46.849290 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.751644    2581 policy_none.go:49] "None policy: Start"
Jul 02 20:32:46.849290 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.751656    2581 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 02 20:32:46.849290 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.751667    2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 02 20:32:46.849290 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.751720    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-220.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 20:32:46.849290 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.751741    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-220.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 20:32:46.849290 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.751750    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-220.ec2.internal" event="NodeHasSufficientPID"
Jul 02 20:32:46.849290 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.752729    2581 policy_none.go:47] "Start"
Jul 02 20:32:46.849290 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.802202    2581 manager.go:337] "Starting Device Plugin manager"
Jul 02 20:32:46.849290 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:46.802340    2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 02 20:32:46.849290 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.802352    2581 server.go:87] "Starting device plugin registration server"
Jul 02 20:32:46.849290 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.802547    2581 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 02 20:32:46.849290 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.802558    2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 02 20:32:46.849290 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.802665    2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 02 20:32:46.849290 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.802753    2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 02 20:32:46.849290 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.802762    2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 02 20:32:46.849290 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:46.803085    2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 02 20:32:46.849290 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:46.803132    2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-220.ec2.internal\" not found"
Jul 02 20:32:46.951923 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.873677    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 02 20:32:46.951923 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.874803    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 02 20:32:46.951923 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.874831    2581 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 02 20:32:46.951923 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.874848    2581 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 02 20:32:46.951923 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:46.874874    2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 02 20:32:46.951923 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.877414    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 20:32:46.951923 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.903507    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 20:32:46.951923 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.904366    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-220.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 20:32:46.951923 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.904391    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-220.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 20:32:46.951923 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.904400    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-220.ec2.internal" event="NodeHasSufficientPID"
Jul 02 20:32:46.951923 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.904419    2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-220.ec2.internal"
Jul 02 20:32:46.951923 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.914351    2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-220.ec2.internal"
Jul 02 20:32:46.951923 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:46.914368    2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-220.ec2.internal\": node \"ip-10-0-135-220.ec2.internal\" not found"
Jul 02 20:32:46.951923 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:46.945409    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-220.ec2.internal\" not found"
Jul 02 20:32:47.058455 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.975555    2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-220.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-220.ec2.internal"]
Jul 02 20:32:47.058455 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.975612    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 20:32:47.058455 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.976431    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-220.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 20:32:47.058455 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.976458    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-220.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 20:32:47.058455 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.976472    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-220.ec2.internal" event="NodeHasSufficientPID"
Jul 02 20:32:47.058455 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.977867    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 20:32:47.058455 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.977984    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-220.ec2.internal"
Jul 02 20:32:47.058455 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.978014    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 20:32:47.058455 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.978684    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-220.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 20:32:47.058455 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.978697    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-220.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 20:32:47.058455 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.978711    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-220.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 20:32:47.058455 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.978716    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-220.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 20:32:47.058455 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.978726    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-220.ec2.internal" event="NodeHasSufficientPID"
Jul 02 20:32:47.058455 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.978735    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-220.ec2.internal" event="NodeHasSufficientPID"
Jul 02 20:32:47.058455 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.979869    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-220.ec2.internal"
Jul 02 20:32:47.058455 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.979888    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 20:32:47.058455 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.983309    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-220.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 20:32:47.058455 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.983337    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-220.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 20:32:47.058455 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:46.983352    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-220.ec2.internal" event="NodeHasSufficientPID"
Jul 02 20:32:47.058455 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:47.016781    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-220.ec2.internal\" not found" node="ip-10-0-135-220.ec2.internal"
Jul 02 20:32:47.058455 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:47.020979    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-220.ec2.internal\" not found" node="ip-10-0-135-220.ec2.internal"
Jul 02 20:32:47.058455 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:47.028040    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a751abb46464a7d3b2201f93b2e0dce1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-220.ec2.internal\" (UID: \"a751abb46464a7d3b2201f93b2e0dce1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-220.ec2.internal"
Jul 02 20:32:47.058455 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:47.028069    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a751abb46464a7d3b2201f93b2e0dce1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-220.ec2.internal\" (UID: \"a751abb46464a7d3b2201f93b2e0dce1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-220.ec2.internal"
Jul 02 20:32:47.058455 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:47.028092    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/531954a8cc159a19f4ac2e984328d7b3-config\") pod \"kube-apiserver-proxy-ip-10-0-135-220.ec2.internal\" (UID: \"531954a8cc159a19f4ac2e984328d7b3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-220.ec2.internal"
Jul 02 20:32:47.058455 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:47.046229    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-220.ec2.internal\" not found"
Jul 02 20:32:47.174266 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:47.128369    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a751abb46464a7d3b2201f93b2e0dce1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-220.ec2.internal\" (UID: \"a751abb46464a7d3b2201f93b2e0dce1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-220.ec2.internal"
Jul 02 20:32:47.174266 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:47.128424    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/531954a8cc159a19f4ac2e984328d7b3-config\") pod \"kube-apiserver-proxy-ip-10-0-135-220.ec2.internal\" (UID: \"531954a8cc159a19f4ac2e984328d7b3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-220.ec2.internal"
Jul 02 20:32:47.174266 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:47.128460    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/531954a8cc159a19f4ac2e984328d7b3-config\") pod \"kube-apiserver-proxy-ip-10-0-135-220.ec2.internal\" (UID: \"531954a8cc159a19f4ac2e984328d7b3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-220.ec2.internal"
Jul 02 20:32:47.174266 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:47.128496    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a751abb46464a7d3b2201f93b2e0dce1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-220.ec2.internal\" (UID: \"a751abb46464a7d3b2201f93b2e0dce1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-220.ec2.internal"
Jul 02 20:32:47.174266 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:47.128534    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a751abb46464a7d3b2201f93b2e0dce1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-220.ec2.internal\" (UID: \"a751abb46464a7d3b2201f93b2e0dce1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-220.ec2.internal"
Jul 02 20:32:47.174266 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:47.128465    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a751abb46464a7d3b2201f93b2e0dce1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-220.ec2.internal\" (UID: \"a751abb46464a7d3b2201f93b2e0dce1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-220.ec2.internal"
Jul 02 20:32:47.174266 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:47.147375    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-220.ec2.internal\" not found"
Jul 02 20:32:47.333214 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:47.248941    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-220.ec2.internal\" not found"
Jul 02 20:32:47.333214 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:47.321898    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-220.ec2.internal"
Jul 02 20:32:47.333214 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:47.324249    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-220.ec2.internal"
Jul 02 20:32:47.442058 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:47.349318    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-220.ec2.internal\" not found"
Jul 02 20:32:47.452853 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:47.450400    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-220.ec2.internal\" not found"
Jul 02 20:32:47.608045 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:47.551335    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-220.ec2.internal\" not found"
Jul 02 20:32:47.750198 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:47.626923    2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 02 20:32:47.750198 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:47.627091    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 02 20:32:47.750198 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:47.627087    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 02 20:32:47.750198 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:47.651824    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-220.ec2.internal\" not found"
Jul 02 20:32:47.750198 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:47.699636    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 20:32:47.750198 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:47.722094    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 20:27:46 +0000 UTC" deadline="2028-03-07 21:32:06.841503812 +0000 UTC"
Jul 02 20:32:47.750198 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:47.722116    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14736h59m19.119390278s"
Jul 02 20:32:47.750198 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:47.726156    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 02 20:32:47.750198 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:47.726168    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-220.ec2.internal"
Jul 02 20:32:47.750198 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:47.736230    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 20:32:47.750198 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:47.742178    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 20:32:47.750198 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:47.744161    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-220.ec2.internal"
Jul 02 20:32:47.750198 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:47.747679    2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 20:32:47.754421 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:47.753718    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 20:32:47.763182 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:47.762078    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-sxlf4"
Jul 02 20:32:47.860821 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:47.770246    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-sxlf4"
Jul 02 20:32:48.199592 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:48.199549    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod531954a8cc159a19f4ac2e984328d7b3.slice/crio-b0724b77ce8a757773c67de5d1caa38da02f7f998842e84040f492fc8573df5e WatchSource:0}: Error finding container b0724b77ce8a757773c67de5d1caa38da02f7f998842e84040f492fc8573df5e: Status 404 returned error can't find the container with id b0724b77ce8a757773c67de5d1caa38da02f7f998842e84040f492fc8573df5e
Jul 02 20:32:48.205053 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.205038    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 20:32:48.205981 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:48.205961    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda751abb46464a7d3b2201f93b2e0dce1.slice/crio-614f0a6f78ffb1ecf166838586741a1528064549336eb632504f7d8d789164ca WatchSource:0}: Error finding container 614f0a6f78ffb1ecf166838586741a1528064549336eb632504f7d8d789164ca: Status 404 returned error can't find the container with id 614f0a6f78ffb1ecf166838586741a1528064549336eb632504f7d8d789164ca
Jul 02 20:32:48.487895 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.487824    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 20:32:48.659633 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.659605    2581 apiserver.go:52] "Watching apiserver"
Jul 02 20:32:48.667705 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.667680    2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 02 20:32:48.669767 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.669742    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-djb55","openshift-network-diagnostics/network-check-target-bfsnb","openshift-network-operator/iptables-alerter-dtllk","openshift-ovn-kubernetes/ovnkube-node-rj8jc","kube-system/global-pull-secret-syncer-57lmx","kube-system/konnectivity-agent-9pdnt","openshift-cluster-node-tuning-operator/tuned-g7bq6","openshift-dns/node-resolver-l6psk","openshift-image-registry/node-ca-nq8gr","openshift-multus/multus-additional-cni-plugins-8pl9w","kube-system/kube-apiserver-proxy-ip-10-0-135-220.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkkxz","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-220.ec2.internal","openshift-multus/multus-26b5h"]
Jul 02 20:32:48.672652 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.672633    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-djb55"
Jul 02 20:32:48.672738 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:48.672701    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-djb55" podUID="ea026958-5382-4357-ae6d-e52d6aa5f523"
Jul 02 20:32:48.674925 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.674904    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfsnb"
Jul 02 20:32:48.675004 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:48.674959    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfsnb" podUID="54276aec-aee7-4db9-8cee-f9858de9edb9"
Jul 02 20:32:48.677114 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.677099    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dtllk"
Jul 02 20:32:48.679724 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.679693    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 02 20:32:48.679724 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.679718    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.679878 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.679766    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 02 20:32:48.679974 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.679882    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 02 20:32:48.680994 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.680976    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-62987\""
Jul 02 20:32:48.681979 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.681961    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hvhs5\""
Jul 02 20:32:48.682109 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.682094    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-57lmx"
Jul 02 20:32:48.682249 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:48.682212    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-57lmx" podUID="002584f1-ab2d-4938-976c-f61d553400c5"
Jul 02 20:32:48.682369 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.682352    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 02 20:32:48.682412 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.682379    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 02 20:32:48.682664 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.682649    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 02 20:32:48.682739 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.682687    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 02 20:32:48.682855 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.682843    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 02 20:32:48.683638 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.683620    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 02 20:32:48.684490 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.684471    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9pdnt"
Jul 02 20:32:48.686816 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.686798    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 02 20:32:48.686816 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.686810    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9chv4\""
Jul 02 20:32:48.686960 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.686798    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 02 20:32:48.686960 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.686917    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g7bq6"
Jul 02 20:32:48.689339 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.689323    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l6psk"
Jul 02 20:32:48.689936 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.689921    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vdcx8\""
Jul 02 20:32:48.690181 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.690163    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 02 20:32:48.690277 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.690178    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 02 20:32:48.691552 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.691532    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 02 20:32:48.691698 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.691680    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-p4hgv\""
Jul 02 20:32:48.691841 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.691822    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nq8gr"
Jul 02 20:32:48.691981 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.691964    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 02 20:32:48.695137 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.695111    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 02 20:32:48.695510 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.695490    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 02 20:32:48.695625 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.695606    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vr9ml\""
Jul 02 20:32:48.695770 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.695750    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 02 20:32:48.696486 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.696470    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8pl9w"
Jul 02 20:32:48.698553 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.698537    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkkxz"
Jul 02 20:32:48.699221 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.699203    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9bmsf\""
Jul 02 20:32:48.699378 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.699365    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 02 20:32:48.699530 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.699513    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 02 20:32:48.699601 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.699516    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 02 20:32:48.699601 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.699586    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 02 20:32:48.699687 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.699636    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 02 20:32:48.700911 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.700891    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.701204 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.701058    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 02 20:32:48.701204 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.701089    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fqgqs\""
Jul 02 20:32:48.701204 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.701108    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 02 20:32:48.701204 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.701113    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 02 20:32:48.703051 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.703033    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 02 20:32:48.703745 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.703729    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-htj24\""
Jul 02 20:32:48.727200 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.727169    2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 02 20:32:48.739390 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.739339    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/294fefe5-fc68-4e4a-881a-df004b547621-etc-kubernetes\") pod \"tuned-g7bq6\" (UID: \"294fefe5-fc68-4e4a-881a-df004b547621\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bq6"
Jul 02 20:32:48.739390 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.739372    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/294fefe5-fc68-4e4a-881a-df004b547621-var-lib-kubelet\") pod \"tuned-g7bq6\" (UID: \"294fefe5-fc68-4e4a-881a-df004b547621\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bq6"
Jul 02 20:32:48.739390 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.739390    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0aa1b013-6df8-432c-9b41-46ebcc89f10e-cni-binary-copy\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.739572 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.739407    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/449efae7-b2a8-4dac-9049-867fea38ced0-run-ovn\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.739572 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.739443    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/449efae7-b2a8-4dac-9049-867fea38ced0-host-cni-netd\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.739572 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.739481    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/449efae7-b2a8-4dac-9049-867fea38ced0-env-overrides\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.739572 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.739556    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/449efae7-b2a8-4dac-9049-867fea38ced0-ovn-node-metrics-cert\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.739706 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.739594    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/294fefe5-fc68-4e4a-881a-df004b547621-etc-sysconfig\") pod \"tuned-g7bq6\" (UID: \"294fefe5-fc68-4e4a-881a-df004b547621\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bq6"
Jul 02 20:32:48.739706 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.739621    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/96a8205c-3379-4b12-a3c8-c4d5d5394938-device-dir\") pod \"aws-ebs-csi-driver-node-gkkxz\" (UID: \"96a8205c-3379-4b12-a3c8-c4d5d5394938\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkkxz"
Jul 02 20:32:48.739706 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.739645    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0aa1b013-6df8-432c-9b41-46ebcc89f10e-multus-cni-dir\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.739706 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.739694    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0aa1b013-6df8-432c-9b41-46ebcc89f10e-host-run-netns\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.739895 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.739718    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/449efae7-b2a8-4dac-9049-867fea38ced0-run-systemd\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.739895 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.739737    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/449efae7-b2a8-4dac-9049-867fea38ced0-run-openvswitch\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.739895 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.739760    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8a38f5af-61e0-44a2-ba14-181ce7578683-host\") pod \"node-ca-nq8gr\" (UID: \"8a38f5af-61e0-44a2-ba14-181ce7578683\") " pod="openshift-image-registry/node-ca-nq8gr"
Jul 02 20:32:48.739895 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.739787    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/002584f1-ab2d-4938-976c-f61d553400c5-original-pull-secret\") pod \"global-pull-secret-syncer-57lmx\" (UID: \"002584f1-ab2d-4938-976c-f61d553400c5\") " pod="kube-system/global-pull-secret-syncer-57lmx"
Jul 02 20:32:48.739895 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.739812    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/294fefe5-fc68-4e4a-881a-df004b547621-etc-systemd\") pod \"tuned-g7bq6\" (UID: \"294fefe5-fc68-4e4a-881a-df004b547621\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bq6"
Jul 02 20:32:48.739895 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.739835    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tdmw\" (UniqueName: \"kubernetes.io/projected/294fefe5-fc68-4e4a-881a-df004b547621-kube-api-access-5tdmw\") pod \"tuned-g7bq6\" (UID: \"294fefe5-fc68-4e4a-881a-df004b547621\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bq6"
Jul 02 20:32:48.739895 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.739858    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/96a8205c-3379-4b12-a3c8-c4d5d5394938-registration-dir\") pod \"aws-ebs-csi-driver-node-gkkxz\" (UID: \"96a8205c-3379-4b12-a3c8-c4d5d5394938\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkkxz"
Jul 02 20:32:48.740242 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.739945    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5623241a-9c33-4fd8-8af3-e9cfb9dafeb1-iptables-alerter-script\") pod \"iptables-alerter-dtllk\" (UID: \"5623241a-9c33-4fd8-8af3-e9cfb9dafeb1\") " pod="openshift-network-operator/iptables-alerter-dtllk"
Jul 02 20:32:48.740242 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.739980    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/449efae7-b2a8-4dac-9049-867fea38ced0-host-cni-bin\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.740242 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.740008    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8a38f5af-61e0-44a2-ba14-181ce7578683-serviceca\") pod \"node-ca-nq8gr\" (UID: \"8a38f5af-61e0-44a2-ba14-181ce7578683\") " pod="openshift-image-registry/node-ca-nq8gr"
Jul 02 20:32:48.740242 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.740035    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw4c4\" (UniqueName: \"kubernetes.io/projected/96a8205c-3379-4b12-a3c8-c4d5d5394938-kube-api-access-zw4c4\") pod \"aws-ebs-csi-driver-node-gkkxz\" (UID: \"96a8205c-3379-4b12-a3c8-c4d5d5394938\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkkxz"
Jul 02 20:32:48.740242 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.740061    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0aa1b013-6df8-432c-9b41-46ebcc89f10e-multus-daemon-config\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.740242 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.740086    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0aa1b013-6df8-432c-9b41-46ebcc89f10e-host-run-multus-certs\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.740242 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.740125    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wcq8\" (UniqueName: \"kubernetes.io/projected/54276aec-aee7-4db9-8cee-f9858de9edb9-kube-api-access-2wcq8\") pod \"network-check-target-bfsnb\" (UID: \"54276aec-aee7-4db9-8cee-f9858de9edb9\") " pod="openshift-network-diagnostics/network-check-target-bfsnb"
Jul 02 20:32:48.740242 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.740189    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/449efae7-b2a8-4dac-9049-867fea38ced0-ovnkube-script-lib\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.740242 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.740221    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5d2b6dcb-168e-44a4-a06b-a5d5aa138b99-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8pl9w\" (UID: \"5d2b6dcb-168e-44a4-a06b-a5d5aa138b99\") " pod="openshift-multus/multus-additional-cni-plugins-8pl9w"
Jul 02 20:32:48.740620 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.740265    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4cf8b90d-0190-498c-a52b-327bac88ed94-agent-certs\") pod \"konnectivity-agent-9pdnt\" (UID: \"4cf8b90d-0190-498c-a52b-327bac88ed94\") " pod="kube-system/konnectivity-agent-9pdnt"
Jul 02 20:32:48.740620 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.740296    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b8214272-e568-4b9d-bc4e-dcb7f9f45e60-hosts-file\") pod \"node-resolver-l6psk\" (UID: \"b8214272-e568-4b9d-bc4e-dcb7f9f45e60\") " pod="openshift-dns/node-resolver-l6psk"
Jul 02 20:32:48.740620 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.740320    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/96a8205c-3379-4b12-a3c8-c4d5d5394938-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gkkxz\" (UID: \"96a8205c-3379-4b12-a3c8-c4d5d5394938\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkkxz"
Jul 02 20:32:48.740620 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.740345    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ws7kq\" (UniqueName: \"kubernetes.io/projected/5623241a-9c33-4fd8-8af3-e9cfb9dafeb1-kube-api-access-ws7kq\") pod \"iptables-alerter-dtllk\" (UID: \"5623241a-9c33-4fd8-8af3-e9cfb9dafeb1\") " pod="openshift-network-operator/iptables-alerter-dtllk"
Jul 02 20:32:48.740620 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.740368    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/294fefe5-fc68-4e4a-881a-df004b547621-tmp\") pod \"tuned-g7bq6\" (UID: \"294fefe5-fc68-4e4a-881a-df004b547621\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bq6"
Jul 02 20:32:48.740620 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.740392    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0aa1b013-6df8-432c-9b41-46ebcc89f10e-multus-socket-dir-parent\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.740620 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.740422    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0aa1b013-6df8-432c-9b41-46ebcc89f10e-host-var-lib-cni-multus\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.740620 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.740444    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/449efae7-b2a8-4dac-9049-867fea38ced0-host-slash\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.740620 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.740481    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d2b6dcb-168e-44a4-a06b-a5d5aa138b99-system-cni-dir\") pod \"multus-additional-cni-plugins-8pl9w\" (UID: \"5d2b6dcb-168e-44a4-a06b-a5d5aa138b99\") " pod="openshift-multus/multus-additional-cni-plugins-8pl9w"
Jul 02 20:32:48.740620 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.740511    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d2b6dcb-168e-44a4-a06b-a5d5aa138b99-cnibin\") pod \"multus-additional-cni-plugins-8pl9w\" (UID: \"5d2b6dcb-168e-44a4-a06b-a5d5aa138b99\") " pod="openshift-multus/multus-additional-cni-plugins-8pl9w"
Jul 02 20:32:48.740620 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.740532    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5d2b6dcb-168e-44a4-a06b-a5d5aa138b99-os-release\") pod \"multus-additional-cni-plugins-8pl9w\" (UID: \"5d2b6dcb-168e-44a4-a06b-a5d5aa138b99\") " pod="openshift-multus/multus-additional-cni-plugins-8pl9w"
Jul 02 20:32:48.740620 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.740555    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/96a8205c-3379-4b12-a3c8-c4d5d5394938-socket-dir\") pod \"aws-ebs-csi-driver-node-gkkxz\" (UID: \"96a8205c-3379-4b12-a3c8-c4d5d5394938\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkkxz"
Jul 02 20:32:48.740620 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.740573    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0aa1b013-6df8-432c-9b41-46ebcc89f10e-multus-conf-dir\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.740620 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.740589    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldgq8\" (UniqueName: \"kubernetes.io/projected/0aa1b013-6df8-432c-9b41-46ebcc89f10e-kube-api-access-ldgq8\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.741201 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.740632    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/294fefe5-fc68-4e4a-881a-df004b547621-run\") pod \"tuned-g7bq6\" (UID: \"294fefe5-fc68-4e4a-881a-df004b547621\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bq6"
Jul 02 20:32:48.741201 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.740689    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/294fefe5-fc68-4e4a-881a-df004b547621-sys\") pod \"tuned-g7bq6\" (UID: \"294fefe5-fc68-4e4a-881a-df004b547621\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bq6"
Jul 02 20:32:48.741201 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.740733    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/449efae7-b2a8-4dac-9049-867fea38ced0-var-lib-openvswitch\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.741201 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.740804    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea026958-5382-4357-ae6d-e52d6aa5f523-metrics-certs\") pod \"network-metrics-daemon-djb55\" (UID: \"ea026958-5382-4357-ae6d-e52d6aa5f523\") " pod="openshift-multus/network-metrics-daemon-djb55"
Jul 02 20:32:48.741201 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.740836    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0aa1b013-6df8-432c-9b41-46ebcc89f10e-system-cni-dir\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.741201 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.740876    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/449efae7-b2a8-4dac-9049-867fea38ced0-host-run-ovn-kubernetes\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.741201 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.740915    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d2b6dcb-168e-44a4-a06b-a5d5aa138b99-cni-binary-copy\") pod \"multus-additional-cni-plugins-8pl9w\" (UID: \"5d2b6dcb-168e-44a4-a06b-a5d5aa138b99\") " pod="openshift-multus/multus-additional-cni-plugins-8pl9w"
Jul 02 20:32:48.741201 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.740949    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/96a8205c-3379-4b12-a3c8-c4d5d5394938-sys-fs\") pod \"aws-ebs-csi-driver-node-gkkxz\" (UID: \"96a8205c-3379-4b12-a3c8-c4d5d5394938\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkkxz"
Jul 02 20:32:48.741201 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.740965    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0aa1b013-6df8-432c-9b41-46ebcc89f10e-cnibin\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.741201 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.740993    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0aa1b013-6df8-432c-9b41-46ebcc89f10e-host-run-k8s-cni-cncf-io\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.741201 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.741014    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0aa1b013-6df8-432c-9b41-46ebcc89f10e-hostroot\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.741201 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.741041    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/449efae7-b2a8-4dac-9049-867fea38ced0-host-run-netns\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.741201 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.741064    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8214272-e568-4b9d-bc4e-dcb7f9f45e60-tmp-dir\") pod \"node-resolver-l6psk\" (UID: \"b8214272-e568-4b9d-bc4e-dcb7f9f45e60\") " pod="openshift-dns/node-resolver-l6psk"
Jul 02 20:32:48.741201 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.741081    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxlkd\" (UniqueName: \"kubernetes.io/projected/8a38f5af-61e0-44a2-ba14-181ce7578683-kube-api-access-dxlkd\") pod \"node-ca-nq8gr\" (UID: \"8a38f5af-61e0-44a2-ba14-181ce7578683\") " pod="openshift-image-registry/node-ca-nq8gr"
Jul 02 20:32:48.741787 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.741096    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/96a8205c-3379-4b12-a3c8-c4d5d5394938-etc-selinux\") pod \"aws-ebs-csi-driver-node-gkkxz\" (UID: \"96a8205c-3379-4b12-a3c8-c4d5d5394938\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkkxz"
Jul 02 20:32:48.741787 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.741113    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0aa1b013-6df8-432c-9b41-46ebcc89f10e-host-var-lib-cni-bin\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.741787 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.741138    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0aa1b013-6df8-432c-9b41-46ebcc89f10e-etc-kubernetes\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.741787 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.741178    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5623241a-9c33-4fd8-8af3-e9cfb9dafeb1-host-slash\") pod \"iptables-alerter-dtllk\" (UID: \"5623241a-9c33-4fd8-8af3-e9cfb9dafeb1\") " pod="openshift-network-operator/iptables-alerter-dtllk"
Jul 02 20:32:48.741787 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.741199    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr4lz\" (UniqueName: \"kubernetes.io/projected/5d2b6dcb-168e-44a4-a06b-a5d5aa138b99-kube-api-access-tr4lz\") pod \"multus-additional-cni-plugins-8pl9w\" (UID: \"5d2b6dcb-168e-44a4-a06b-a5d5aa138b99\") " pod="openshift-multus/multus-additional-cni-plugins-8pl9w"
Jul 02 20:32:48.741787 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.741221    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/294fefe5-fc68-4e4a-881a-df004b547621-etc-sysctl-d\") pod \"tuned-g7bq6\" (UID: \"294fefe5-fc68-4e4a-881a-df004b547621\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bq6"
Jul 02 20:32:48.741787 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.741255    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/294fefe5-fc68-4e4a-881a-df004b547621-lib-modules\") pod \"tuned-g7bq6\" (UID: \"294fefe5-fc68-4e4a-881a-df004b547621\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bq6"
Jul 02 20:32:48.741787 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.741286    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/294fefe5-fc68-4e4a-881a-df004b547621-etc-tuned\") pod \"tuned-g7bq6\" (UID: \"294fefe5-fc68-4e4a-881a-df004b547621\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bq6"
Jul 02 20:32:48.741787 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.741310    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0aa1b013-6df8-432c-9b41-46ebcc89f10e-host-var-lib-kubelet\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.741787 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.741337    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/449efae7-b2a8-4dac-9049-867fea38ced0-log-socket\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.741787 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.741369    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5ksc\" (UniqueName: \"kubernetes.io/projected/449efae7-b2a8-4dac-9049-867fea38ced0-kube-api-access-l5ksc\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.741787 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.741393    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/002584f1-ab2d-4938-976c-f61d553400c5-kubelet-config\") pod \"global-pull-secret-syncer-57lmx\" (UID: \"002584f1-ab2d-4938-976c-f61d553400c5\") " pod="kube-system/global-pull-secret-syncer-57lmx"
Jul 02 20:32:48.741787 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.741452    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/294fefe5-fc68-4e4a-881a-df004b547621-etc-modprobe-d\") pod \"tuned-g7bq6\" (UID: \"294fefe5-fc68-4e4a-881a-df004b547621\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bq6"
Jul 02 20:32:48.741787 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.741479    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/294fefe5-fc68-4e4a-881a-df004b547621-etc-sysctl-conf\") pod \"tuned-g7bq6\" (UID: \"294fefe5-fc68-4e4a-881a-df004b547621\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bq6"
Jul 02 20:32:48.742346 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.741504    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/449efae7-b2a8-4dac-9049-867fea38ced0-etc-openvswitch\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.742346 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.741537    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5d2b6dcb-168e-44a4-a06b-a5d5aa138b99-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8pl9w\" (UID: \"5d2b6dcb-168e-44a4-a06b-a5d5aa138b99\") " pod="openshift-multus/multus-additional-cni-plugins-8pl9w"
Jul 02 20:32:48.742346 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.741556    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjgwc\" (UniqueName: \"kubernetes.io/projected/ea026958-5382-4357-ae6d-e52d6aa5f523-kube-api-access-tjgwc\") pod \"network-metrics-daemon-djb55\" (UID: \"ea026958-5382-4357-ae6d-e52d6aa5f523\") " pod="openshift-multus/network-metrics-daemon-djb55"
Jul 02 20:32:48.742346 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.741593    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/294fefe5-fc68-4e4a-881a-df004b547621-host\") pod \"tuned-g7bq6\" (UID: \"294fefe5-fc68-4e4a-881a-df004b547621\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bq6"
Jul 02 20:32:48.742346 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.741625    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/449efae7-b2a8-4dac-9049-867fea38ced0-systemd-units\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.742346 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.741652    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/449efae7-b2a8-4dac-9049-867fea38ced0-node-log\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.742346 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.741681    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/449efae7-b2a8-4dac-9049-867fea38ced0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.742346 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.741705    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/449efae7-b2a8-4dac-9049-867fea38ced0-ovnkube-config\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.742346 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.741727    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/002584f1-ab2d-4938-976c-f61d553400c5-dbus\") pod \"global-pull-secret-syncer-57lmx\" (UID: \"002584f1-ab2d-4938-976c-f61d553400c5\") " pod="kube-system/global-pull-secret-syncer-57lmx"
Jul 02 20:32:48.742346 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.741742    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0aa1b013-6df8-432c-9b41-46ebcc89f10e-os-release\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.742346 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.741756    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/449efae7-b2a8-4dac-9049-867fea38ced0-host-kubelet\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.742346 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.741771    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrw9t\" (UniqueName: \"kubernetes.io/projected/b8214272-e568-4b9d-bc4e-dcb7f9f45e60-kube-api-access-jrw9t\") pod \"node-resolver-l6psk\" (UID: \"b8214272-e568-4b9d-bc4e-dcb7f9f45e60\") " pod="openshift-dns/node-resolver-l6psk"
Jul 02 20:32:48.742346 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.741794    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d2b6dcb-168e-44a4-a06b-a5d5aa138b99-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8pl9w\" (UID: \"5d2b6dcb-168e-44a4-a06b-a5d5aa138b99\") " pod="openshift-multus/multus-additional-cni-plugins-8pl9w"
Jul 02 20:32:48.742768 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.741817    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4cf8b90d-0190-498c-a52b-327bac88ed94-konnectivity-ca\") pod \"konnectivity-agent-9pdnt\" (UID: \"4cf8b90d-0190-498c-a52b-327bac88ed94\") " pod="kube-system/konnectivity-agent-9pdnt"
Jul 02 20:32:48.772817 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.772766    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 20:27:47 +0000 UTC" deadline="2028-01-20 19:13:17.361125052 +0000 UTC"
Jul 02 20:32:48.772817 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.772807    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13606h40m28.588321958s"
Jul 02 20:32:48.843869 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.843309    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5d2b6dcb-168e-44a4-a06b-a5d5aa138b99-os-release\") pod \"multus-additional-cni-plugins-8pl9w\" (UID: \"5d2b6dcb-168e-44a4-a06b-a5d5aa138b99\") " pod="openshift-multus/multus-additional-cni-plugins-8pl9w"
Jul 02 20:32:48.843976 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.843896    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/96a8205c-3379-4b12-a3c8-c4d5d5394938-socket-dir\") pod \"aws-ebs-csi-driver-node-gkkxz\" (UID: \"96a8205c-3379-4b12-a3c8-c4d5d5394938\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkkxz"
Jul 02 20:32:48.843976 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.843934    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0aa1b013-6df8-432c-9b41-46ebcc89f10e-multus-conf-dir\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.844076 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.843983    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldgq8\" (UniqueName: \"kubernetes.io/projected/0aa1b013-6df8-432c-9b41-46ebcc89f10e-kube-api-access-ldgq8\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.844076 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.844014    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/294fefe5-fc68-4e4a-881a-df004b547621-run\") pod \"tuned-g7bq6\" (UID: \"294fefe5-fc68-4e4a-881a-df004b547621\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bq6"
Jul 02 20:32:48.844076 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.844039    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/294fefe5-fc68-4e4a-881a-df004b547621-sys\") pod \"tuned-g7bq6\" (UID: \"294fefe5-fc68-4e4a-881a-df004b547621\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bq6"
Jul 02 20:32:48.844076 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.844069    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/449efae7-b2a8-4dac-9049-867fea38ced0-var-lib-openvswitch\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.844264 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.844100    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea026958-5382-4357-ae6d-e52d6aa5f523-metrics-certs\") pod \"network-metrics-daemon-djb55\" (UID: \"ea026958-5382-4357-ae6d-e52d6aa5f523\") " pod="openshift-multus/network-metrics-daemon-djb55"
Jul 02 20:32:48.844264 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.844134    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0aa1b013-6df8-432c-9b41-46ebcc89f10e-system-cni-dir\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.844264 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.844164    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/449efae7-b2a8-4dac-9049-867fea38ced0-host-run-ovn-kubernetes\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.844264 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.844190    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d2b6dcb-168e-44a4-a06b-a5d5aa138b99-cni-binary-copy\") pod \"multus-additional-cni-plugins-8pl9w\" (UID: \"5d2b6dcb-168e-44a4-a06b-a5d5aa138b99\") " pod="openshift-multus/multus-additional-cni-plugins-8pl9w"
Jul 02 20:32:48.844264 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.844236    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/96a8205c-3379-4b12-a3c8-c4d5d5394938-sys-fs\") pod \"aws-ebs-csi-driver-node-gkkxz\" (UID: \"96a8205c-3379-4b12-a3c8-c4d5d5394938\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkkxz"
Jul 02 20:32:48.844520 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.844267    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0aa1b013-6df8-432c-9b41-46ebcc89f10e-cnibin\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.844520 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.844298    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0aa1b013-6df8-432c-9b41-46ebcc89f10e-host-run-k8s-cni-cncf-io\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.844520 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.844321    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0aa1b013-6df8-432c-9b41-46ebcc89f10e-hostroot\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.844520 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.844349    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/449efae7-b2a8-4dac-9049-867fea38ced0-host-run-netns\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.844520 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.844377    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8214272-e568-4b9d-bc4e-dcb7f9f45e60-tmp-dir\") pod \"node-resolver-l6psk\" (UID: \"b8214272-e568-4b9d-bc4e-dcb7f9f45e60\") " pod="openshift-dns/node-resolver-l6psk"
Jul 02 20:32:48.844520 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.844409    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxlkd\" (UniqueName: \"kubernetes.io/projected/8a38f5af-61e0-44a2-ba14-181ce7578683-kube-api-access-dxlkd\") pod \"node-ca-nq8gr\" (UID: \"8a38f5af-61e0-44a2-ba14-181ce7578683\") " pod="openshift-image-registry/node-ca-nq8gr"
Jul 02 20:32:48.844520 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.844439    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/96a8205c-3379-4b12-a3c8-c4d5d5394938-etc-selinux\") pod \"aws-ebs-csi-driver-node-gkkxz\" (UID: \"96a8205c-3379-4b12-a3c8-c4d5d5394938\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkkxz"
Jul 02 20:32:48.844520 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.844470    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0aa1b013-6df8-432c-9b41-46ebcc89f10e-host-var-lib-cni-bin\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.844520 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.844493    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0aa1b013-6df8-432c-9b41-46ebcc89f10e-etc-kubernetes\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.844874 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.844524    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5623241a-9c33-4fd8-8af3-e9cfb9dafeb1-host-slash\") pod \"iptables-alerter-dtllk\" (UID: \"5623241a-9c33-4fd8-8af3-e9cfb9dafeb1\") " pod="openshift-network-operator/iptables-alerter-dtllk"
Jul 02 20:32:48.844874 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.844557    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr4lz\" (UniqueName: \"kubernetes.io/projected/5d2b6dcb-168e-44a4-a06b-a5d5aa138b99-kube-api-access-tr4lz\") pod \"multus-additional-cni-plugins-8pl9w\" (UID: \"5d2b6dcb-168e-44a4-a06b-a5d5aa138b99\") " pod="openshift-multus/multus-additional-cni-plugins-8pl9w"
Jul 02 20:32:48.844874 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.844588    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/294fefe5-fc68-4e4a-881a-df004b547621-etc-sysctl-d\") pod \"tuned-g7bq6\" (UID: \"294fefe5-fc68-4e4a-881a-df004b547621\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bq6"
Jul 02 20:32:48.844874 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.844617    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/294fefe5-fc68-4e4a-881a-df004b547621-lib-modules\") pod \"tuned-g7bq6\" (UID: \"294fefe5-fc68-4e4a-881a-df004b547621\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bq6"
Jul 02 20:32:48.844874 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.844642    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/294fefe5-fc68-4e4a-881a-df004b547621-etc-tuned\") pod \"tuned-g7bq6\" (UID: \"294fefe5-fc68-4e4a-881a-df004b547621\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bq6"
Jul 02 20:32:48.844874 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.844671    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0aa1b013-6df8-432c-9b41-46ebcc89f10e-host-var-lib-kubelet\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.844874 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.844701    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/449efae7-b2a8-4dac-9049-867fea38ced0-log-socket\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.844874 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.844737    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5ksc\" (UniqueName: \"kubernetes.io/projected/449efae7-b2a8-4dac-9049-867fea38ced0-kube-api-access-l5ksc\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.844874 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.844763    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/002584f1-ab2d-4938-976c-f61d553400c5-kubelet-config\") pod \"global-pull-secret-syncer-57lmx\" (UID: \"002584f1-ab2d-4938-976c-f61d553400c5\") " pod="kube-system/global-pull-secret-syncer-57lmx"
Jul 02 20:32:48.844874 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.844793    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/294fefe5-fc68-4e4a-881a-df004b547621-etc-modprobe-d\") pod \"tuned-g7bq6\" (UID: \"294fefe5-fc68-4e4a-881a-df004b547621\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bq6"
Jul 02 20:32:48.844874 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.844821    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/294fefe5-fc68-4e4a-881a-df004b547621-etc-sysctl-conf\") pod \"tuned-g7bq6\" (UID: \"294fefe5-fc68-4e4a-881a-df004b547621\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bq6"
Jul 02 20:32:48.844874 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.844850    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/449efae7-b2a8-4dac-9049-867fea38ced0-etc-openvswitch\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.845256 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.844880    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5d2b6dcb-168e-44a4-a06b-a5d5aa138b99-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8pl9w\" (UID: \"5d2b6dcb-168e-44a4-a06b-a5d5aa138b99\") " pod="openshift-multus/multus-additional-cni-plugins-8pl9w"
Jul 02 20:32:48.845256 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.844916    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjgwc\" (UniqueName: \"kubernetes.io/projected/ea026958-5382-4357-ae6d-e52d6aa5f523-kube-api-access-tjgwc\") pod \"network-metrics-daemon-djb55\" (UID: \"ea026958-5382-4357-ae6d-e52d6aa5f523\") " pod="openshift-multus/network-metrics-daemon-djb55"
Jul 02 20:32:48.845256 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.844946    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/294fefe5-fc68-4e4a-881a-df004b547621-host\") pod \"tuned-g7bq6\" (UID: \"294fefe5-fc68-4e4a-881a-df004b547621\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bq6"
Jul 02 20:32:48.845256 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.844969    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/449efae7-b2a8-4dac-9049-867fea38ced0-systemd-units\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.845256 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.844997    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/449efae7-b2a8-4dac-9049-867fea38ced0-node-log\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.845256 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.845032    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/449efae7-b2a8-4dac-9049-867fea38ced0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.845256 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.845103    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/449efae7-b2a8-4dac-9049-867fea38ced0-ovnkube-config\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.845256 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.845136    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/002584f1-ab2d-4938-976c-f61d553400c5-dbus\") pod \"global-pull-secret-syncer-57lmx\" (UID: \"002584f1-ab2d-4938-976c-f61d553400c5\") " pod="kube-system/global-pull-secret-syncer-57lmx"
Jul 02 20:32:48.845256 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.845162    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0aa1b013-6df8-432c-9b41-46ebcc89f10e-os-release\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.845256 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.845192    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/449efae7-b2a8-4dac-9049-867fea38ced0-host-kubelet\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.845256 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.845240    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrw9t\" (UniqueName: \"kubernetes.io/projected/b8214272-e568-4b9d-bc4e-dcb7f9f45e60-kube-api-access-jrw9t\") pod \"node-resolver-l6psk\" (UID: \"b8214272-e568-4b9d-bc4e-dcb7f9f45e60\") " pod="openshift-dns/node-resolver-l6psk"
Jul 02 20:32:48.845615 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.845270    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d2b6dcb-168e-44a4-a06b-a5d5aa138b99-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8pl9w\" (UID: \"5d2b6dcb-168e-44a4-a06b-a5d5aa138b99\") " pod="openshift-multus/multus-additional-cni-plugins-8pl9w"
Jul 02 20:32:48.845615 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.845296    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4cf8b90d-0190-498c-a52b-327bac88ed94-konnectivity-ca\") pod \"konnectivity-agent-9pdnt\" (UID: \"4cf8b90d-0190-498c-a52b-327bac88ed94\") " pod="kube-system/konnectivity-agent-9pdnt"
Jul 02 20:32:48.845615 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.845326    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/294fefe5-fc68-4e4a-881a-df004b547621-etc-kubernetes\") pod \"tuned-g7bq6\" (UID: \"294fefe5-fc68-4e4a-881a-df004b547621\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bq6"
Jul 02 20:32:48.845615 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.845362    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/294fefe5-fc68-4e4a-881a-df004b547621-var-lib-kubelet\") pod \"tuned-g7bq6\" (UID: \"294fefe5-fc68-4e4a-881a-df004b547621\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bq6"
Jul 02 20:32:48.845615 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.845393    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0aa1b013-6df8-432c-9b41-46ebcc89f10e-cni-binary-copy\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.845615 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.845425    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/449efae7-b2a8-4dac-9049-867fea38ced0-run-ovn\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.845615 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.845449    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/449efae7-b2a8-4dac-9049-867fea38ced0-host-cni-netd\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.845615 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.845480    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/449efae7-b2a8-4dac-9049-867fea38ced0-env-overrides\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.845615 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.845511    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/449efae7-b2a8-4dac-9049-867fea38ced0-ovn-node-metrics-cert\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.845615 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.845542    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/294fefe5-fc68-4e4a-881a-df004b547621-etc-sysconfig\") pod \"tuned-g7bq6\" (UID: \"294fefe5-fc68-4e4a-881a-df004b547621\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bq6"
Jul 02 20:32:48.845615 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.845579    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/96a8205c-3379-4b12-a3c8-c4d5d5394938-device-dir\") pod \"aws-ebs-csi-driver-node-gkkxz\" (UID: \"96a8205c-3379-4b12-a3c8-c4d5d5394938\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkkxz"
Jul 02 20:32:48.845615 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.845605    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0aa1b013-6df8-432c-9b41-46ebcc89f10e-multus-cni-dir\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.845962 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.845635    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0aa1b013-6df8-432c-9b41-46ebcc89f10e-host-run-netns\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.845962 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.845669    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/449efae7-b2a8-4dac-9049-867fea38ced0-run-systemd\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.845962 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.845702    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/449efae7-b2a8-4dac-9049-867fea38ced0-run-openvswitch\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.845962 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.845727    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8a38f5af-61e0-44a2-ba14-181ce7578683-host\") pod \"node-ca-nq8gr\" (UID: \"8a38f5af-61e0-44a2-ba14-181ce7578683\") " pod="openshift-image-registry/node-ca-nq8gr"
Jul 02 20:32:48.845962 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.845758    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/002584f1-ab2d-4938-976c-f61d553400c5-original-pull-secret\") pod \"global-pull-secret-syncer-57lmx\" (UID: \"002584f1-ab2d-4938-976c-f61d553400c5\") " pod="kube-system/global-pull-secret-syncer-57lmx"
Jul 02 20:32:48.845962 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.845792    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/294fefe5-fc68-4e4a-881a-df004b547621-etc-systemd\") pod \"tuned-g7bq6\" (UID: \"294fefe5-fc68-4e4a-881a-df004b547621\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bq6"
Jul 02 20:32:48.845962 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.845824    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tdmw\" (UniqueName: \"kubernetes.io/projected/294fefe5-fc68-4e4a-881a-df004b547621-kube-api-access-5tdmw\") pod \"tuned-g7bq6\" (UID: \"294fefe5-fc68-4e4a-881a-df004b547621\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bq6"
Jul 02 20:32:48.845962 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.845854    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/96a8205c-3379-4b12-a3c8-c4d5d5394938-registration-dir\") pod \"aws-ebs-csi-driver-node-gkkxz\" (UID: \"96a8205c-3379-4b12-a3c8-c4d5d5394938\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkkxz"
Jul 02 20:32:48.845962 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.845879    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5623241a-9c33-4fd8-8af3-e9cfb9dafeb1-iptables-alerter-script\") pod \"iptables-alerter-dtllk\" (UID: \"5623241a-9c33-4fd8-8af3-e9cfb9dafeb1\") " pod="openshift-network-operator/iptables-alerter-dtllk"
Jul 02 20:32:48.845962 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.845909    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/449efae7-b2a8-4dac-9049-867fea38ced0-host-cni-bin\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.845962 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.845940    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8a38f5af-61e0-44a2-ba14-181ce7578683-serviceca\") pod \"node-ca-nq8gr\" (UID: \"8a38f5af-61e0-44a2-ba14-181ce7578683\") " pod="openshift-image-registry/node-ca-nq8gr"
Jul 02 20:32:48.846307 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.845970    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw4c4\" (UniqueName: \"kubernetes.io/projected/96a8205c-3379-4b12-a3c8-c4d5d5394938-kube-api-access-zw4c4\") pod \"aws-ebs-csi-driver-node-gkkxz\" (UID: \"96a8205c-3379-4b12-a3c8-c4d5d5394938\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkkxz"
Jul 02 20:32:48.846307 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.846005    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0aa1b013-6df8-432c-9b41-46ebcc89f10e-multus-daemon-config\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.846307 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.846033    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0aa1b013-6df8-432c-9b41-46ebcc89f10e-host-run-multus-certs\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.846307 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.846066    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wcq8\" (UniqueName: \"kubernetes.io/projected/54276aec-aee7-4db9-8cee-f9858de9edb9-kube-api-access-2wcq8\") pod \"network-check-target-bfsnb\" (UID: \"54276aec-aee7-4db9-8cee-f9858de9edb9\") " pod="openshift-network-diagnostics/network-check-target-bfsnb"
Jul 02 20:32:48.846307 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.846097    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/449efae7-b2a8-4dac-9049-867fea38ced0-ovnkube-script-lib\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.846307 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.846125    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5d2b6dcb-168e-44a4-a06b-a5d5aa138b99-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8pl9w\" (UID: \"5d2b6dcb-168e-44a4-a06b-a5d5aa138b99\") " pod="openshift-multus/multus-additional-cni-plugins-8pl9w"
Jul 02 20:32:48.846307 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.846155    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4cf8b90d-0190-498c-a52b-327bac88ed94-agent-certs\") pod \"konnectivity-agent-9pdnt\" (UID: \"4cf8b90d-0190-498c-a52b-327bac88ed94\") " pod="kube-system/konnectivity-agent-9pdnt"
Jul 02 20:32:48.846307 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.846277    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/449efae7-b2a8-4dac-9049-867fea38ced0-systemd-units\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.846709 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.846344    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5623241a-9c33-4fd8-8af3-e9cfb9dafeb1-host-slash\") pod \"iptables-alerter-dtllk\" (UID: \"5623241a-9c33-4fd8-8af3-e9cfb9dafeb1\") " pod="openshift-network-operator/iptables-alerter-dtllk"
Jul 02 20:32:48.846709 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.846364    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/96a8205c-3379-4b12-a3c8-c4d5d5394938-device-dir\") pod \"aws-ebs-csi-driver-node-gkkxz\" (UID: \"96a8205c-3379-4b12-a3c8-c4d5d5394938\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkkxz"
Jul 02 20:32:48.846709 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.846381    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0aa1b013-6df8-432c-9b41-46ebcc89f10e-host-run-netns\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.846709 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.846370    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0aa1b013-6df8-432c-9b41-46ebcc89f10e-host-var-lib-kubelet\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.846709 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.846401    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/96a8205c-3379-4b12-a3c8-c4d5d5394938-socket-dir\") pod \"aws-ebs-csi-driver-node-gkkxz\" (UID: \"96a8205c-3379-4b12-a3c8-c4d5d5394938\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkkxz"
Jul 02 20:32:48.846709 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.846431    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b8214272-e568-4b9d-bc4e-dcb7f9f45e60-hosts-file\") pod \"node-resolver-l6psk\" (UID: \"b8214272-e568-4b9d-bc4e-dcb7f9f45e60\") " pod="openshift-dns/node-resolver-l6psk"
Jul 02 20:32:48.846709 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.846450    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0aa1b013-6df8-432c-9b41-46ebcc89f10e-host-var-lib-cni-bin\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.846709 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.846465    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/96a8205c-3379-4b12-a3c8-c4d5d5394938-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gkkxz\" (UID: \"96a8205c-3379-4b12-a3c8-c4d5d5394938\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkkxz"
Jul 02 20:32:48.846709 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.846476    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5d2b6dcb-168e-44a4-a06b-a5d5aa138b99-os-release\") pod \"multus-additional-cni-plugins-8pl9w\" (UID: \"5d2b6dcb-168e-44a4-a06b-a5d5aa138b99\") " pod="openshift-multus/multus-additional-cni-plugins-8pl9w"
Jul 02 20:32:48.846709 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.846537    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/449efae7-b2a8-4dac-9049-867fea38ced0-run-systemd\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.846709 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.846543    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ws7kq\" (UniqueName: \"kubernetes.io/projected/5623241a-9c33-4fd8-8af3-e9cfb9dafeb1-kube-api-access-ws7kq\") pod \"iptables-alerter-dtllk\" (UID: \"5623241a-9c33-4fd8-8af3-e9cfb9dafeb1\") " pod="openshift-network-operator/iptables-alerter-dtllk"
Jul 02 20:32:48.846709 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.846585    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/294fefe5-fc68-4e4a-881a-df004b547621-tmp\") pod \"tuned-g7bq6\" (UID: \"294fefe5-fc68-4e4a-881a-df004b547621\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bq6"
Jul 02 20:32:48.846709 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.846624    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0aa1b013-6df8-432c-9b41-46ebcc89f10e-multus-socket-dir-parent\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.846709 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.846697    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0aa1b013-6df8-432c-9b41-46ebcc89f10e-host-var-lib-cni-multus\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.846709 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.846710    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0aa1b013-6df8-432c-9b41-46ebcc89f10e-host-run-multus-certs\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.847514 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.846735    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/449efae7-b2a8-4dac-9049-867fea38ced0-host-slash\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.847514 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.846781    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d2b6dcb-168e-44a4-a06b-a5d5aa138b99-system-cni-dir\") pod \"multus-additional-cni-plugins-8pl9w\" (UID: \"5d2b6dcb-168e-44a4-a06b-a5d5aa138b99\") " pod="openshift-multus/multus-additional-cni-plugins-8pl9w"
Jul 02 20:32:48.847514 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.846797    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/449efae7-b2a8-4dac-9049-867fea38ced0-host-run-ovn-kubernetes\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.847514 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.846822    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d2b6dcb-168e-44a4-a06b-a5d5aa138b99-cnibin\") pod \"multus-additional-cni-plugins-8pl9w\" (UID: \"5d2b6dcb-168e-44a4-a06b-a5d5aa138b99\") " pod="openshift-multus/multus-additional-cni-plugins-8pl9w"
Jul 02 20:32:48.847514 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.846863    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0aa1b013-6df8-432c-9b41-46ebcc89f10e-multus-socket-dir-parent\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.847514 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.846949    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/96a8205c-3379-4b12-a3c8-c4d5d5394938-etc-selinux\") pod \"aws-ebs-csi-driver-node-gkkxz\" (UID: \"96a8205c-3379-4b12-a3c8-c4d5d5394938\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkkxz"
Jul 02 20:32:48.847514 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.846967    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0aa1b013-6df8-432c-9b41-46ebcc89f10e-multus-conf-dir\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.847514 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.847017    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/96a8205c-3379-4b12-a3c8-c4d5d5394938-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gkkxz\" (UID: \"96a8205c-3379-4b12-a3c8-c4d5d5394938\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkkxz"
Jul 02 20:32:48.847514 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.847058    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/294fefe5-fc68-4e4a-881a-df004b547621-etc-systemd\") pod \"tuned-g7bq6\" (UID: \"294fefe5-fc68-4e4a-881a-df004b547621\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bq6"
Jul 02 20:32:48.847514 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.847074    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/294fefe5-fc68-4e4a-881a-df004b547621-etc-kubernetes\") pod \"tuned-g7bq6\" (UID: \"294fefe5-fc68-4e4a-881a-df004b547621\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bq6"
Jul 02 20:32:48.847514 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.847075    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0aa1b013-6df8-432c-9b41-46ebcc89f10e-os-release\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.847514 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.847103    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8a38f5af-61e0-44a2-ba14-181ce7578683-serviceca\") pod \"node-ca-nq8gr\" (UID: \"8a38f5af-61e0-44a2-ba14-181ce7578683\") " pod="openshift-image-registry/node-ca-nq8gr"
Jul 02 20:32:48.847514 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.847116    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/294fefe5-fc68-4e4a-881a-df004b547621-var-lib-kubelet\") pod \"tuned-g7bq6\" (UID: \"294fefe5-fc68-4e4a-881a-df004b547621\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bq6"
Jul 02 20:32:48.847514 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.847119    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/449efae7-b2a8-4dac-9049-867fea38ced0-host-kubelet\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.847514 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.847133    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b8214272-e568-4b9d-bc4e-dcb7f9f45e60-hosts-file\") pod \"node-resolver-l6psk\" (UID: \"b8214272-e568-4b9d-bc4e-dcb7f9f45e60\") " pod="openshift-dns/node-resolver-l6psk"
Jul 02 20:32:48.848327 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.847266    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/294fefe5-fc68-4e4a-881a-df004b547621-lib-modules\") pod \"tuned-g7bq6\" (UID: \"294fefe5-fc68-4e4a-881a-df004b547621\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bq6"
Jul 02 20:32:48.848327 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.847543    2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 02 20:32:48.848327 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.847554    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/449efae7-b2a8-4dac-9049-867fea38ced0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.848327 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.847619    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0aa1b013-6df8-432c-9b41-46ebcc89f10e-cni-binary-copy\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.848327 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.847628    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8214272-e568-4b9d-bc4e-dcb7f9f45e60-tmp-dir\") pod \"node-resolver-l6psk\" (UID: \"b8214272-e568-4b9d-bc4e-dcb7f9f45e60\") " pod="openshift-dns/node-resolver-l6psk"
Jul 02 20:32:48.848327 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.847702    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/449efae7-b2a8-4dac-9049-867fea38ced0-run-ovn\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.848327 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.847707    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/294fefe5-fc68-4e4a-881a-df004b547621-etc-sysctl-conf\") pod \"tuned-g7bq6\" (UID: \"294fefe5-fc68-4e4a-881a-df004b547621\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bq6"
Jul 02 20:32:48.848327 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.847802    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0aa1b013-6df8-432c-9b41-46ebcc89f10e-multus-cni-dir\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.848327 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.847809    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/002584f1-ab2d-4938-976c-f61d553400c5-dbus\") pod \"global-pull-secret-syncer-57lmx\" (UID: \"002584f1-ab2d-4938-976c-f61d553400c5\") " pod="kube-system/global-pull-secret-syncer-57lmx"
Jul 02 20:32:48.848327 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.847842    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0aa1b013-6df8-432c-9b41-46ebcc89f10e-hostroot\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.848327 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.847854    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0aa1b013-6df8-432c-9b41-46ebcc89f10e-host-run-k8s-cni-cncf-io\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.848327 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.848035    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/294fefe5-fc68-4e4a-881a-df004b547621-etc-sysconfig\") pod \"tuned-g7bq6\" (UID: \"294fefe5-fc68-4e4a-881a-df004b547621\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bq6"
Jul 02 20:32:48.848946 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.848438    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/449efae7-b2a8-4dac-9049-867fea38ced0-env-overrides\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.848946 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.848506    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d2b6dcb-168e-44a4-a06b-a5d5aa138b99-system-cni-dir\") pod \"multus-additional-cni-plugins-8pl9w\" (UID: \"5d2b6dcb-168e-44a4-a06b-a5d5aa138b99\") " pod="openshift-multus/multus-additional-cni-plugins-8pl9w"
Jul 02 20:32:48.848946 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.848550    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d2b6dcb-168e-44a4-a06b-a5d5aa138b99-cni-binary-copy\") pod \"multus-additional-cni-plugins-8pl9w\" (UID: \"5d2b6dcb-168e-44a4-a06b-a5d5aa138b99\") " pod="openshift-multus/multus-additional-cni-plugins-8pl9w"
Jul 02 20:32:48.848946 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.848572    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/002584f1-ab2d-4938-976c-f61d553400c5-kubelet-config\") pod \"global-pull-secret-syncer-57lmx\" (UID: \"002584f1-ab2d-4938-976c-f61d553400c5\") " pod="kube-system/global-pull-secret-syncer-57lmx"
Jul 02 20:32:48.848946 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.847550    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d2b6dcb-168e-44a4-a06b-a5d5aa138b99-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8pl9w\" (UID: \"5d2b6dcb-168e-44a4-a06b-a5d5aa138b99\") " pod="openshift-multus/multus-additional-cni-plugins-8pl9w"
Jul 02 20:32:48.848946 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.848600    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5d2b6dcb-168e-44a4-a06b-a5d5aa138b99-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8pl9w\" (UID: \"5d2b6dcb-168e-44a4-a06b-a5d5aa138b99\") " pod="openshift-multus/multus-additional-cni-plugins-8pl9w"
Jul 02 20:32:48.848946 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.848620    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5623241a-9c33-4fd8-8af3-e9cfb9dafeb1-iptables-alerter-script\") pod \"iptables-alerter-dtllk\" (UID: \"5623241a-9c33-4fd8-8af3-e9cfb9dafeb1\") " pod="openshift-network-operator/iptables-alerter-dtllk"
Jul 02 20:32:48.848946 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.848627    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0aa1b013-6df8-432c-9b41-46ebcc89f10e-cnibin\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.848946 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.848639    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/449efae7-b2a8-4dac-9049-867fea38ced0-host-cni-bin\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.848946 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.848726    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d2b6dcb-168e-44a4-a06b-a5d5aa138b99-cnibin\") pod \"multus-additional-cni-plugins-8pl9w\" (UID: \"5d2b6dcb-168e-44a4-a06b-a5d5aa138b99\") " pod="openshift-multus/multus-additional-cni-plugins-8pl9w"
Jul 02 20:32:48.848946 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:48.848780    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 20:32:48.848946 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.848786    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/449efae7-b2a8-4dac-9049-867fea38ced0-log-socket\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.848946 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.848903    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/294fefe5-fc68-4e4a-881a-df004b547621-etc-sysctl-d\") pod \"tuned-g7bq6\" (UID: \"294fefe5-fc68-4e4a-881a-df004b547621\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bq6"
Jul 02 20:32:48.848946 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.848941    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/449efae7-b2a8-4dac-9049-867fea38ced0-etc-openvswitch\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.849694 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.848964    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/96a8205c-3379-4b12-a3c8-c4d5d5394938-registration-dir\") pod \"aws-ebs-csi-driver-node-gkkxz\" (UID: \"96a8205c-3379-4b12-a3c8-c4d5d5394938\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkkxz"
Jul 02 20:32:48.849694 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.849010    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/294fefe5-fc68-4e4a-881a-df004b547621-host\") pod \"tuned-g7bq6\" (UID: \"294fefe5-fc68-4e4a-881a-df004b547621\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bq6"
Jul 02 20:32:48.849694 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.849029    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/449efae7-b2a8-4dac-9049-867fea38ced0-host-slash\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.849694 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.849075    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/449efae7-b2a8-4dac-9049-867fea38ced0-host-cni-netd\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.849694 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.849078    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0aa1b013-6df8-432c-9b41-46ebcc89f10e-host-var-lib-cni-multus\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.849694 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.849089    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/294fefe5-fc68-4e4a-881a-df004b547621-etc-modprobe-d\") pod \"tuned-g7bq6\" (UID: \"294fefe5-fc68-4e4a-881a-df004b547621\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bq6"
Jul 02 20:32:48.849694 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.849115    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0aa1b013-6df8-432c-9b41-46ebcc89f10e-etc-kubernetes\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.849694 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.849137    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/294fefe5-fc68-4e4a-881a-df004b547621-sys\") pod \"tuned-g7bq6\" (UID: \"294fefe5-fc68-4e4a-881a-df004b547621\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bq6"
Jul 02 20:32:48.849694 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.849161    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/294fefe5-fc68-4e4a-881a-df004b547621-run\") pod \"tuned-g7bq6\" (UID: \"294fefe5-fc68-4e4a-881a-df004b547621\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bq6"
Jul 02 20:32:48.849694 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.849182    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0aa1b013-6df8-432c-9b41-46ebcc89f10e-multus-daemon-config\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.849694 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.849204    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0aa1b013-6df8-432c-9b41-46ebcc89f10e-system-cni-dir\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.849694 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.849379    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8a38f5af-61e0-44a2-ba14-181ce7578683-host\") pod \"node-ca-nq8gr\" (UID: \"8a38f5af-61e0-44a2-ba14-181ce7578683\") " pod="openshift-image-registry/node-ca-nq8gr"
Jul 02 20:32:48.849694 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:48.849209    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea026958-5382-4357-ae6d-e52d6aa5f523-metrics-certs podName:ea026958-5382-4357-ae6d-e52d6aa5f523 nodeName:}" failed. No retries permitted until 2026-07-02 20:32:49.349146627 +0000 UTC m=+3.019660118 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea026958-5382-4357-ae6d-e52d6aa5f523-metrics-certs") pod "network-metrics-daemon-djb55" (UID: "ea026958-5382-4357-ae6d-e52d6aa5f523") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 20:32:48.849694 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:48.849458    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 20:32:48.850417 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:48.849643    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002584f1-ab2d-4938-976c-f61d553400c5-original-pull-secret podName:002584f1-ab2d-4938-976c-f61d553400c5 nodeName:}" failed. No retries permitted until 2026-07-02 20:32:49.349497107 +0000 UTC m=+3.020010596 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/002584f1-ab2d-4938-976c-f61d553400c5-original-pull-secret") pod "global-pull-secret-syncer-57lmx" (UID: "002584f1-ab2d-4938-976c-f61d553400c5") : object "kube-system"/"original-pull-secret" not registered
Jul 02 20:32:48.850417 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.849865    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5d2b6dcb-168e-44a4-a06b-a5d5aa138b99-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8pl9w\" (UID: \"5d2b6dcb-168e-44a4-a06b-a5d5aa138b99\") " pod="openshift-multus/multus-additional-cni-plugins-8pl9w"
Jul 02 20:32:48.850530 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.850429    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/449efae7-b2a8-4dac-9049-867fea38ced0-var-lib-openvswitch\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.850530 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.850456    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/449efae7-b2a8-4dac-9049-867fea38ced0-host-run-netns\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.850530 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.850512    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/449efae7-b2a8-4dac-9049-867fea38ced0-node-log\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.850688 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.850558    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/449efae7-b2a8-4dac-9049-867fea38ced0-run-openvswitch\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.850688 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.850615    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/96a8205c-3379-4b12-a3c8-c4d5d5394938-sys-fs\") pod \"aws-ebs-csi-driver-node-gkkxz\" (UID: \"96a8205c-3379-4b12-a3c8-c4d5d5394938\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkkxz"
Jul 02 20:32:48.851017 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.850987    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4cf8b90d-0190-498c-a52b-327bac88ed94-konnectivity-ca\") pod \"konnectivity-agent-9pdnt\" (UID: \"4cf8b90d-0190-498c-a52b-327bac88ed94\") " pod="kube-system/konnectivity-agent-9pdnt"
Jul 02 20:32:48.852075 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.851742    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/294fefe5-fc68-4e4a-881a-df004b547621-tmp\") pod \"tuned-g7bq6\" (UID: \"294fefe5-fc68-4e4a-881a-df004b547621\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bq6"
Jul 02 20:32:48.852075 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.851968    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4cf8b90d-0190-498c-a52b-327bac88ed94-agent-certs\") pod \"konnectivity-agent-9pdnt\" (UID: \"4cf8b90d-0190-498c-a52b-327bac88ed94\") " pod="kube-system/konnectivity-agent-9pdnt"
Jul 02 20:32:48.852075 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.851980    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/449efae7-b2a8-4dac-9049-867fea38ced0-ovn-node-metrics-cert\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.852075 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.849899    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/449efae7-b2a8-4dac-9049-867fea38ced0-ovnkube-config\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.852075 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.852023    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/449efae7-b2a8-4dac-9049-867fea38ced0-ovnkube-script-lib\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.852448 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.852413    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 20:32:48.853074 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.853052    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/294fefe5-fc68-4e4a-881a-df004b547621-etc-tuned\") pod \"tuned-g7bq6\" (UID: \"294fefe5-fc68-4e4a-881a-df004b547621\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bq6"
Jul 02 20:32:48.855958 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:48.855928    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 20:32:48.855958 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:48.855958    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 20:32:48.856139 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:48.855974    2581 projected.go:196] Error preparing data for projected volume kube-api-access-2wcq8 for pod openshift-network-diagnostics/network-check-target-bfsnb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 20:32:48.856139 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:48.856027    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54276aec-aee7-4db9-8cee-f9858de9edb9-kube-api-access-2wcq8 podName:54276aec-aee7-4db9-8cee-f9858de9edb9 nodeName:}" failed. No retries permitted until 2026-07-02 20:32:49.356009253 +0000 UTC m=+3.026522743 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2wcq8" (UniqueName: "kubernetes.io/projected/54276aec-aee7-4db9-8cee-f9858de9edb9-kube-api-access-2wcq8") pod "network-check-target-bfsnb" (UID: "54276aec-aee7-4db9-8cee-f9858de9edb9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 20:32:48.858699 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.858671    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrw9t\" (UniqueName: \"kubernetes.io/projected/b8214272-e568-4b9d-bc4e-dcb7f9f45e60-kube-api-access-jrw9t\") pod \"node-resolver-l6psk\" (UID: \"b8214272-e568-4b9d-bc4e-dcb7f9f45e60\") " pod="openshift-dns/node-resolver-l6psk"
Jul 02 20:32:48.859707 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.859644    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjgwc\" (UniqueName: \"kubernetes.io/projected/ea026958-5382-4357-ae6d-e52d6aa5f523-kube-api-access-tjgwc\") pod \"network-metrics-daemon-djb55\" (UID: \"ea026958-5382-4357-ae6d-e52d6aa5f523\") " pod="openshift-multus/network-metrics-daemon-djb55"
Jul 02 20:32:48.859894 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.859876    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5ksc\" (UniqueName: \"kubernetes.io/projected/449efae7-b2a8-4dac-9049-867fea38ced0-kube-api-access-l5ksc\") pod \"ovnkube-node-rj8jc\" (UID: \"449efae7-b2a8-4dac-9049-867fea38ced0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:48.859992 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.859975    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldgq8\" (UniqueName: \"kubernetes.io/projected/0aa1b013-6df8-432c-9b41-46ebcc89f10e-kube-api-access-ldgq8\") pod \"multus-26b5h\" (UID: \"0aa1b013-6df8-432c-9b41-46ebcc89f10e\") " pod="openshift-multus/multus-26b5h"
Jul 02 20:32:48.861219 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.861159    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tdmw\" (UniqueName: \"kubernetes.io/projected/294fefe5-fc68-4e4a-881a-df004b547621-kube-api-access-5tdmw\") pod \"tuned-g7bq6\" (UID: \"294fefe5-fc68-4e4a-881a-df004b547621\") " pod="openshift-cluster-node-tuning-operator/tuned-g7bq6"
Jul 02 20:32:48.861219 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.861203    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw4c4\" (UniqueName: \"kubernetes.io/projected/96a8205c-3379-4b12-a3c8-c4d5d5394938-kube-api-access-zw4c4\") pod \"aws-ebs-csi-driver-node-gkkxz\" (UID: \"96a8205c-3379-4b12-a3c8-c4d5d5394938\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkkxz"
Jul 02 20:32:48.861342 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.861252    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ws7kq\" (UniqueName: \"kubernetes.io/projected/5623241a-9c33-4fd8-8af3-e9cfb9dafeb1-kube-api-access-ws7kq\") pod \"iptables-alerter-dtllk\" (UID: \"5623241a-9c33-4fd8-8af3-e9cfb9dafeb1\") " pod="openshift-network-operator/iptables-alerter-dtllk"
Jul 02 20:32:48.861342 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.861309    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr4lz\" (UniqueName: \"kubernetes.io/projected/5d2b6dcb-168e-44a4-a06b-a5d5aa138b99-kube-api-access-tr4lz\") pod \"multus-additional-cni-plugins-8pl9w\" (UID: \"5d2b6dcb-168e-44a4-a06b-a5d5aa138b99\") " pod="openshift-multus/multus-additional-cni-plugins-8pl9w"
Jul 02 20:32:48.861690 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.861671    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxlkd\" (UniqueName: \"kubernetes.io/projected/8a38f5af-61e0-44a2-ba14-181ce7578683-kube-api-access-dxlkd\") pod \"node-ca-nq8gr\" (UID: \"8a38f5af-61e0-44a2-ba14-181ce7578683\") " pod="openshift-image-registry/node-ca-nq8gr"
Jul 02 20:32:48.880754 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.880702    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-220.ec2.internal" event={"ID":"a751abb46464a7d3b2201f93b2e0dce1","Type":"ContainerStarted","Data":"614f0a6f78ffb1ecf166838586741a1528064549336eb632504f7d8d789164ca"}
Jul 02 20:32:48.882488 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.882438    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-220.ec2.internal" event={"ID":"531954a8cc159a19f4ac2e984328d7b3","Type":"ContainerStarted","Data":"b0724b77ce8a757773c67de5d1caa38da02f7f998842e84040f492fc8573df5e"}
Jul 02 20:32:48.989175 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.989091    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dtllk"
Jul 02 20:32:48.997403 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:48.997378    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:32:49.002509 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:49.002469    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5623241a_9c33_4fd8_8af3_e9cfb9dafeb1.slice/crio-353a7f1213c36abff3ed03b5cbd4276946801dceead757e4d74304a1ff7290f5 WatchSource:0}: Error finding container 353a7f1213c36abff3ed03b5cbd4276946801dceead757e4d74304a1ff7290f5: Status 404 returned error can't find the container with id 353a7f1213c36abff3ed03b5cbd4276946801dceead757e4d74304a1ff7290f5
Jul 02 20:32:49.005157 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:49.003866    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9pdnt"
Jul 02 20:32:49.008091 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:49.008067    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g7bq6"
Jul 02 20:32:49.009978 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:49.009951    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod449efae7_b2a8_4dac_9049_867fea38ced0.slice/crio-235aa8d706b8f8a055ed8b8dd7894f0a437de87ecccc8dfc40ce1396dd509e2c WatchSource:0}: Error finding container 235aa8d706b8f8a055ed8b8dd7894f0a437de87ecccc8dfc40ce1396dd509e2c: Status 404 returned error can't find the container with id 235aa8d706b8f8a055ed8b8dd7894f0a437de87ecccc8dfc40ce1396dd509e2c
Jul 02 20:32:49.014720 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:49.014697    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l6psk"
Jul 02 20:32:49.018597 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:49.018564    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cf8b90d_0190_498c_a52b_327bac88ed94.slice/crio-11149d935140f11c4e6d00087980d918d77204b71a94363cd3d593baa539c4ae WatchSource:0}: Error finding container 11149d935140f11c4e6d00087980d918d77204b71a94363cd3d593baa539c4ae: Status 404 returned error can't find the container with id 11149d935140f11c4e6d00087980d918d77204b71a94363cd3d593baa539c4ae
Jul 02 20:32:49.020655 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:49.020496    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nq8gr"
Jul 02 20:32:49.026690 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:49.026637    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8pl9w"
Jul 02 20:32:49.032609 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:49.032409    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkkxz"
Jul 02 20:32:49.039507 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:49.039358    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-26b5h"
Jul 02 20:32:49.040041 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:49.040012    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8214272_e568_4b9d_bc4e_dcb7f9f45e60.slice/crio-c32d34f61523aa30fc5022a642f8898a2208d3717ae1cda48e101d8370245af7 WatchSource:0}: Error finding container c32d34f61523aa30fc5022a642f8898a2208d3717ae1cda48e101d8370245af7: Status 404 returned error can't find the container with id c32d34f61523aa30fc5022a642f8898a2208d3717ae1cda48e101d8370245af7
Jul 02 20:32:49.049746 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:49.049723    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a38f5af_61e0_44a2_ba14_181ce7578683.slice/crio-2ab60c1da58e933e272444ee87b8ca7101e50d43771184bfc33a235f24c9e19e WatchSource:0}: Error finding container 2ab60c1da58e933e272444ee87b8ca7101e50d43771184bfc33a235f24c9e19e: Status 404 returned error can't find the container with id 2ab60c1da58e933e272444ee87b8ca7101e50d43771184bfc33a235f24c9e19e
Jul 02 20:32:49.053933 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:49.053847    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d2b6dcb_168e_44a4_a06b_a5d5aa138b99.slice/crio-29d016c6e5def53c655d9a881accd2dfef99132516d1e7df020e5f04e66e747c WatchSource:0}: Error finding container 29d016c6e5def53c655d9a881accd2dfef99132516d1e7df020e5f04e66e747c: Status 404 returned error can't find the container with id 29d016c6e5def53c655d9a881accd2dfef99132516d1e7df020e5f04e66e747c
Jul 02 20:32:49.057002 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:49.056977    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0aa1b013_6df8_432c_9b41_46ebcc89f10e.slice/crio-86c4c050b64dccca6cf504b9db96e831430422cc81d7aca9f29e3998a6a4e73d WatchSource:0}: Error finding container 86c4c050b64dccca6cf504b9db96e831430422cc81d7aca9f29e3998a6a4e73d: Status 404 returned error can't find the container with id 86c4c050b64dccca6cf504b9db96e831430422cc81d7aca9f29e3998a6a4e73d
Jul 02 20:32:49.057926 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:32:49.057902    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96a8205c_3379_4b12_a3c8_c4d5d5394938.slice/crio-28a89e4361c8a2d7c8fde23a3b6a8e8e2f313484b6c199c340c1cce0eeedcd46 WatchSource:0}: Error finding container 28a89e4361c8a2d7c8fde23a3b6a8e8e2f313484b6c199c340c1cce0eeedcd46: Status 404 returned error can't find the container with id 28a89e4361c8a2d7c8fde23a3b6a8e8e2f313484b6c199c340c1cce0eeedcd46
Jul 02 20:32:49.350786 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:49.350713    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/002584f1-ab2d-4938-976c-f61d553400c5-original-pull-secret\") pod \"global-pull-secret-syncer-57lmx\" (UID: \"002584f1-ab2d-4938-976c-f61d553400c5\") " pod="kube-system/global-pull-secret-syncer-57lmx"
Jul 02 20:32:49.350941 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:49.350793    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea026958-5382-4357-ae6d-e52d6aa5f523-metrics-certs\") pod \"network-metrics-daemon-djb55\" (UID: \"ea026958-5382-4357-ae6d-e52d6aa5f523\") " pod="openshift-multus/network-metrics-daemon-djb55"
Jul 02 20:32:49.350941 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:49.350870    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 20:32:49.350941 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:49.350907    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 20:32:49.350941 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:49.350937    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002584f1-ab2d-4938-976c-f61d553400c5-original-pull-secret podName:002584f1-ab2d-4938-976c-f61d553400c5 nodeName:}" failed. No retries permitted until 2026-07-02 20:32:50.350920627 +0000 UTC m=+4.021434103 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/002584f1-ab2d-4938-976c-f61d553400c5-original-pull-secret") pod "global-pull-secret-syncer-57lmx" (UID: "002584f1-ab2d-4938-976c-f61d553400c5") : object "kube-system"/"original-pull-secret" not registered
Jul 02 20:32:49.351121 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:49.350961    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea026958-5382-4357-ae6d-e52d6aa5f523-metrics-certs podName:ea026958-5382-4357-ae6d-e52d6aa5f523 nodeName:}" failed. No retries permitted until 2026-07-02 20:32:50.350944143 +0000 UTC m=+4.021457617 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea026958-5382-4357-ae6d-e52d6aa5f523-metrics-certs") pod "network-metrics-daemon-djb55" (UID: "ea026958-5382-4357-ae6d-e52d6aa5f523") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 20:32:49.451457 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:49.451417    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wcq8\" (UniqueName: \"kubernetes.io/projected/54276aec-aee7-4db9-8cee-f9858de9edb9-kube-api-access-2wcq8\") pod \"network-check-target-bfsnb\" (UID: \"54276aec-aee7-4db9-8cee-f9858de9edb9\") " pod="openshift-network-diagnostics/network-check-target-bfsnb"
Jul 02 20:32:49.451644 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:49.451581    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 20:32:49.451644 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:49.451600    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 20:32:49.451644 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:49.451613    2581 projected.go:196] Error preparing data for projected volume kube-api-access-2wcq8 for pod openshift-network-diagnostics/network-check-target-bfsnb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 20:32:49.451821 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:49.451678    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54276aec-aee7-4db9-8cee-f9858de9edb9-kube-api-access-2wcq8 podName:54276aec-aee7-4db9-8cee-f9858de9edb9 nodeName:}" failed. No retries permitted until 2026-07-02 20:32:50.451659158 +0000 UTC m=+4.122172632 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2wcq8" (UniqueName: "kubernetes.io/projected/54276aec-aee7-4db9-8cee-f9858de9edb9-kube-api-access-2wcq8") pod "network-check-target-bfsnb" (UID: "54276aec-aee7-4db9-8cee-f9858de9edb9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 20:32:49.773513 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:49.773382    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 20:27:47 +0000 UTC" deadline="2028-03-24 20:50:01.388882356 +0000 UTC"
Jul 02 20:32:49.773513 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:49.773444    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15144h17m11.615442283s"
Jul 02 20:32:49.875468 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:49.875433    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-djb55"
Jul 02 20:32:49.875660 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:49.875606    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-djb55" podUID="ea026958-5382-4357-ae6d-e52d6aa5f523"
Jul 02 20:32:49.888709 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:49.888423    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-26b5h" event={"ID":"0aa1b013-6df8-432c-9b41-46ebcc89f10e","Type":"ContainerStarted","Data":"86c4c050b64dccca6cf504b9db96e831430422cc81d7aca9f29e3998a6a4e73d"}
Jul 02 20:32:49.890774 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:49.890685    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkkxz" event={"ID":"96a8205c-3379-4b12-a3c8-c4d5d5394938","Type":"ContainerStarted","Data":"28a89e4361c8a2d7c8fde23a3b6a8e8e2f313484b6c199c340c1cce0eeedcd46"}
Jul 02 20:32:49.892458 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:49.892388    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nq8gr" event={"ID":"8a38f5af-61e0-44a2-ba14-181ce7578683","Type":"ContainerStarted","Data":"2ab60c1da58e933e272444ee87b8ca7101e50d43771184bfc33a235f24c9e19e"}
Jul 02 20:32:49.894161 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:49.894129    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g7bq6" event={"ID":"294fefe5-fc68-4e4a-881a-df004b547621","Type":"ContainerStarted","Data":"b92d17ebd72a12124f7cc96d7dc201d7ad9358a1db6ebe64d14e061931e06556"}
Jul 02 20:32:49.895779 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:49.895731    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dtllk" event={"ID":"5623241a-9c33-4fd8-8af3-e9cfb9dafeb1","Type":"ContainerStarted","Data":"353a7f1213c36abff3ed03b5cbd4276946801dceead757e4d74304a1ff7290f5"}
Jul 02 20:32:49.897206 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:49.897111    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8pl9w" event={"ID":"5d2b6dcb-168e-44a4-a06b-a5d5aa138b99","Type":"ContainerStarted","Data":"29d016c6e5def53c655d9a881accd2dfef99132516d1e7df020e5f04e66e747c"}
Jul 02 20:32:49.898641 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:49.898564    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l6psk" event={"ID":"b8214272-e568-4b9d-bc4e-dcb7f9f45e60","Type":"ContainerStarted","Data":"c32d34f61523aa30fc5022a642f8898a2208d3717ae1cda48e101d8370245af7"}
Jul 02 20:32:49.904437 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:49.904339    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9pdnt" event={"ID":"4cf8b90d-0190-498c-a52b-327bac88ed94","Type":"ContainerStarted","Data":"11149d935140f11c4e6d00087980d918d77204b71a94363cd3d593baa539c4ae"}
Jul 02 20:32:49.906071 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:49.905984    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc" event={"ID":"449efae7-b2a8-4dac-9049-867fea38ced0","Type":"ContainerStarted","Data":"235aa8d706b8f8a055ed8b8dd7894f0a437de87ecccc8dfc40ce1396dd509e2c"}
Jul 02 20:32:50.357829 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:50.357779    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea026958-5382-4357-ae6d-e52d6aa5f523-metrics-certs\") pod \"network-metrics-daemon-djb55\" (UID: \"ea026958-5382-4357-ae6d-e52d6aa5f523\") " pod="openshift-multus/network-metrics-daemon-djb55"
Jul 02 20:32:50.358025 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:50.357863    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/002584f1-ab2d-4938-976c-f61d553400c5-original-pull-secret\") pod \"global-pull-secret-syncer-57lmx\" (UID: \"002584f1-ab2d-4938-976c-f61d553400c5\") " pod="kube-system/global-pull-secret-syncer-57lmx"
Jul 02 20:32:50.358025 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:50.358009    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 20:32:50.358141 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:50.358071    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002584f1-ab2d-4938-976c-f61d553400c5-original-pull-secret podName:002584f1-ab2d-4938-976c-f61d553400c5 nodeName:}" failed. No retries permitted until 2026-07-02 20:32:52.358052807 +0000 UTC m=+6.028566285 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/002584f1-ab2d-4938-976c-f61d553400c5-original-pull-secret") pod "global-pull-secret-syncer-57lmx" (UID: "002584f1-ab2d-4938-976c-f61d553400c5") : object "kube-system"/"original-pull-secret" not registered
Jul 02 20:32:50.358584 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:50.358561    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 20:32:50.358690 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:50.358625    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea026958-5382-4357-ae6d-e52d6aa5f523-metrics-certs podName:ea026958-5382-4357-ae6d-e52d6aa5f523 nodeName:}" failed. No retries permitted until 2026-07-02 20:32:52.358607717 +0000 UTC m=+6.029121190 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea026958-5382-4357-ae6d-e52d6aa5f523-metrics-certs") pod "network-metrics-daemon-djb55" (UID: "ea026958-5382-4357-ae6d-e52d6aa5f523") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 20:32:50.458607 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:50.458572    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wcq8\" (UniqueName: \"kubernetes.io/projected/54276aec-aee7-4db9-8cee-f9858de9edb9-kube-api-access-2wcq8\") pod \"network-check-target-bfsnb\" (UID: \"54276aec-aee7-4db9-8cee-f9858de9edb9\") " pod="openshift-network-diagnostics/network-check-target-bfsnb"
Jul 02 20:32:50.458812 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:50.458754    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 20:32:50.458812 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:50.458777    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 20:32:50.458812 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:50.458789    2581 projected.go:196] Error preparing data for projected volume kube-api-access-2wcq8 for pod openshift-network-diagnostics/network-check-target-bfsnb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 20:32:50.458974 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:50.458870    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54276aec-aee7-4db9-8cee-f9858de9edb9-kube-api-access-2wcq8 podName:54276aec-aee7-4db9-8cee-f9858de9edb9 nodeName:}" failed. No retries permitted until 2026-07-02 20:32:52.458846215 +0000 UTC m=+6.129359704 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2wcq8" (UniqueName: "kubernetes.io/projected/54276aec-aee7-4db9-8cee-f9858de9edb9-kube-api-access-2wcq8") pod "network-check-target-bfsnb" (UID: "54276aec-aee7-4db9-8cee-f9858de9edb9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 20:32:50.877950 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:50.877919    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-57lmx"
Jul 02 20:32:50.878436 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:50.878053    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-57lmx" podUID="002584f1-ab2d-4938-976c-f61d553400c5"
Jul 02 20:32:50.878504 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:50.878439    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfsnb"
Jul 02 20:32:50.878561 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:50.878525    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfsnb" podUID="54276aec-aee7-4db9-8cee-f9858de9edb9"
Jul 02 20:32:51.875843 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:51.875474    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-djb55"
Jul 02 20:32:51.876106 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:51.875847    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-djb55" podUID="ea026958-5382-4357-ae6d-e52d6aa5f523"
Jul 02 20:32:51.923209 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:51.922492    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-220.ec2.internal" event={"ID":"531954a8cc159a19f4ac2e984328d7b3","Type":"ContainerStarted","Data":"b5afa1592faab67c7ac54c1411d7dd60ad967877db646c7be1517f9aa8c6abe9"}
Jul 02 20:32:52.375369 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:52.375295    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea026958-5382-4357-ae6d-e52d6aa5f523-metrics-certs\") pod \"network-metrics-daemon-djb55\" (UID: \"ea026958-5382-4357-ae6d-e52d6aa5f523\") " pod="openshift-multus/network-metrics-daemon-djb55"
Jul 02 20:32:52.375517 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:52.375374    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/002584f1-ab2d-4938-976c-f61d553400c5-original-pull-secret\") pod \"global-pull-secret-syncer-57lmx\" (UID: \"002584f1-ab2d-4938-976c-f61d553400c5\") " pod="kube-system/global-pull-secret-syncer-57lmx"
Jul 02 20:32:52.375517 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:52.375513    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 20:32:52.375638 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:52.375570    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002584f1-ab2d-4938-976c-f61d553400c5-original-pull-secret podName:002584f1-ab2d-4938-976c-f61d553400c5 nodeName:}" failed. No retries permitted until 2026-07-02 20:32:56.375553013 +0000 UTC m=+10.046066490 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/002584f1-ab2d-4938-976c-f61d553400c5-original-pull-secret") pod "global-pull-secret-syncer-57lmx" (UID: "002584f1-ab2d-4938-976c-f61d553400c5") : object "kube-system"/"original-pull-secret" not registered
Jul 02 20:32:52.376106 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:52.375955    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 20:32:52.376106 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:52.376006    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea026958-5382-4357-ae6d-e52d6aa5f523-metrics-certs podName:ea026958-5382-4357-ae6d-e52d6aa5f523 nodeName:}" failed. No retries permitted until 2026-07-02 20:32:56.375991276 +0000 UTC m=+10.046504750 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea026958-5382-4357-ae6d-e52d6aa5f523-metrics-certs") pod "network-metrics-daemon-djb55" (UID: "ea026958-5382-4357-ae6d-e52d6aa5f523") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 20:32:52.476252 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:52.476217    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wcq8\" (UniqueName: \"kubernetes.io/projected/54276aec-aee7-4db9-8cee-f9858de9edb9-kube-api-access-2wcq8\") pod \"network-check-target-bfsnb\" (UID: \"54276aec-aee7-4db9-8cee-f9858de9edb9\") " pod="openshift-network-diagnostics/network-check-target-bfsnb"
Jul 02 20:32:52.476425 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:52.476380    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 20:32:52.476425 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:52.476399    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 20:32:52.476425 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:52.476412    2581 projected.go:196] Error preparing data for projected volume kube-api-access-2wcq8 for pod openshift-network-diagnostics/network-check-target-bfsnb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 20:32:52.476581 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:52.476465    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54276aec-aee7-4db9-8cee-f9858de9edb9-kube-api-access-2wcq8 podName:54276aec-aee7-4db9-8cee-f9858de9edb9 nodeName:}" failed. No retries permitted until 2026-07-02 20:32:56.476446796 +0000 UTC m=+10.146960269 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2wcq8" (UniqueName: "kubernetes.io/projected/54276aec-aee7-4db9-8cee-f9858de9edb9-kube-api-access-2wcq8") pod "network-check-target-bfsnb" (UID: "54276aec-aee7-4db9-8cee-f9858de9edb9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 20:32:52.876275 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:52.876243    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfsnb"
Jul 02 20:32:52.876442 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:52.876373    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfsnb" podUID="54276aec-aee7-4db9-8cee-f9858de9edb9"
Jul 02 20:32:52.876761 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:52.876738    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-57lmx"
Jul 02 20:32:52.876873 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:52.876845    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-57lmx" podUID="002584f1-ab2d-4938-976c-f61d553400c5"
Jul 02 20:32:52.928669 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:52.928556    2581 generic.go:356] "Generic (PLEG): container finished" podID="a751abb46464a7d3b2201f93b2e0dce1" containerID="b52f39e979ae90fc77d271767b7841e3c393a9f17ac83a75f4f4bddb6455adcb" exitCode=0
Jul 02 20:32:52.929104 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:52.928652    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-220.ec2.internal" event={"ID":"a751abb46464a7d3b2201f93b2e0dce1","Type":"ContainerDied","Data":"b52f39e979ae90fc77d271767b7841e3c393a9f17ac83a75f4f4bddb6455adcb"}
Jul 02 20:32:52.944924 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:52.944871    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-220.ec2.internal" podStartSLOduration=5.944852656 podStartE2EDuration="5.944852656s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:32:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:32:51.938664348 +0000 UTC m=+5.609177841" watchObservedRunningTime="2026-07-02 20:32:52.944852656 +0000 UTC m=+6.615366150"
Jul 02 20:32:53.876075 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:53.876042    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-djb55"
Jul 02 20:32:53.876252 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:53.876197    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-djb55" podUID="ea026958-5382-4357-ae6d-e52d6aa5f523"
Jul 02 20:32:54.877770 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:54.877069    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-57lmx"
Jul 02 20:32:54.877770 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:54.877211    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-57lmx" podUID="002584f1-ab2d-4938-976c-f61d553400c5"
Jul 02 20:32:54.877770 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:54.877572    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfsnb"
Jul 02 20:32:54.877770 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:54.877666    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfsnb" podUID="54276aec-aee7-4db9-8cee-f9858de9edb9"
Jul 02 20:32:55.875896 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:55.875856    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-djb55"
Jul 02 20:32:55.876066 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:55.876002    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-djb55" podUID="ea026958-5382-4357-ae6d-e52d6aa5f523"
Jul 02 20:32:56.408278 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:56.408006    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/002584f1-ab2d-4938-976c-f61d553400c5-original-pull-secret\") pod \"global-pull-secret-syncer-57lmx\" (UID: \"002584f1-ab2d-4938-976c-f61d553400c5\") " pod="kube-system/global-pull-secret-syncer-57lmx"
Jul 02 20:32:56.408278 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:56.408088    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea026958-5382-4357-ae6d-e52d6aa5f523-metrics-certs\") pod \"network-metrics-daemon-djb55\" (UID: \"ea026958-5382-4357-ae6d-e52d6aa5f523\") " pod="openshift-multus/network-metrics-daemon-djb55"
Jul 02 20:32:56.408278 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:56.408176    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 20:32:56.408278 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:56.408193    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 20:32:56.408278 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:56.408240    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea026958-5382-4357-ae6d-e52d6aa5f523-metrics-certs podName:ea026958-5382-4357-ae6d-e52d6aa5f523 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:04.408222693 +0000 UTC m=+18.078736166 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea026958-5382-4357-ae6d-e52d6aa5f523-metrics-certs") pod "network-metrics-daemon-djb55" (UID: "ea026958-5382-4357-ae6d-e52d6aa5f523") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 20:32:56.408278 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:56.408255    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002584f1-ab2d-4938-976c-f61d553400c5-original-pull-secret podName:002584f1-ab2d-4938-976c-f61d553400c5 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:04.408247251 +0000 UTC m=+18.078760723 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/002584f1-ab2d-4938-976c-f61d553400c5-original-pull-secret") pod "global-pull-secret-syncer-57lmx" (UID: "002584f1-ab2d-4938-976c-f61d553400c5") : object "kube-system"/"original-pull-secret" not registered
Jul 02 20:32:56.509224 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:56.508604    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wcq8\" (UniqueName: \"kubernetes.io/projected/54276aec-aee7-4db9-8cee-f9858de9edb9-kube-api-access-2wcq8\") pod \"network-check-target-bfsnb\" (UID: \"54276aec-aee7-4db9-8cee-f9858de9edb9\") " pod="openshift-network-diagnostics/network-check-target-bfsnb"
Jul 02 20:32:56.509224 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:56.508793    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 20:32:56.509224 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:56.508814    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 20:32:56.509224 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:56.508828    2581 projected.go:196] Error preparing data for projected volume kube-api-access-2wcq8 for pod openshift-network-diagnostics/network-check-target-bfsnb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 20:32:56.509224 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:56.508885    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54276aec-aee7-4db9-8cee-f9858de9edb9-kube-api-access-2wcq8 podName:54276aec-aee7-4db9-8cee-f9858de9edb9 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:04.508866174 +0000 UTC m=+18.179379662 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2wcq8" (UniqueName: "kubernetes.io/projected/54276aec-aee7-4db9-8cee-f9858de9edb9-kube-api-access-2wcq8") pod "network-check-target-bfsnb" (UID: "54276aec-aee7-4db9-8cee-f9858de9edb9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 20:32:56.877071 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:56.876463    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-57lmx"
Jul 02 20:32:56.877071 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:56.876575    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-57lmx" podUID="002584f1-ab2d-4938-976c-f61d553400c5"
Jul 02 20:32:56.877071 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:56.876906    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfsnb"
Jul 02 20:32:56.877071 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:56.876990    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfsnb" podUID="54276aec-aee7-4db9-8cee-f9858de9edb9"
Jul 02 20:32:57.875521 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:57.875439    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-djb55"
Jul 02 20:32:57.875956 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:57.875579    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-djb55" podUID="ea026958-5382-4357-ae6d-e52d6aa5f523"
Jul 02 20:32:58.875618 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:58.875129    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfsnb"
Jul 02 20:32:58.875618 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:58.875163    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-57lmx"
Jul 02 20:32:58.875618 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:58.875276    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfsnb" podUID="54276aec-aee7-4db9-8cee-f9858de9edb9"
Jul 02 20:32:58.875618 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:58.875408    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-57lmx" podUID="002584f1-ab2d-4938-976c-f61d553400c5"
Jul 02 20:32:59.875779 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:32:59.875752    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-djb55"
Jul 02 20:32:59.876126 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:32:59.875850    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-djb55" podUID="ea026958-5382-4357-ae6d-e52d6aa5f523"
Jul 02 20:33:00.875814 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:00.875778    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-57lmx"
Jul 02 20:33:00.875814 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:00.875797    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfsnb"
Jul 02 20:33:00.876322 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:00.875919    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-57lmx" podUID="002584f1-ab2d-4938-976c-f61d553400c5"
Jul 02 20:33:00.876322 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:00.875949    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfsnb" podUID="54276aec-aee7-4db9-8cee-f9858de9edb9"
Jul 02 20:33:01.875903 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:01.875876    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-djb55"
Jul 02 20:33:01.876317 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:01.875979    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-djb55" podUID="ea026958-5382-4357-ae6d-e52d6aa5f523"
Jul 02 20:33:02.875828 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:02.875785    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-57lmx"
Jul 02 20:33:02.875828 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:02.875813    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfsnb"
Jul 02 20:33:02.876322 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:02.875929    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-57lmx" podUID="002584f1-ab2d-4938-976c-f61d553400c5"
Jul 02 20:33:02.876322 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:02.876063    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfsnb" podUID="54276aec-aee7-4db9-8cee-f9858de9edb9"
Jul 02 20:33:03.875280 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:03.875215    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-djb55"
Jul 02 20:33:03.875437 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:03.875327    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-djb55" podUID="ea026958-5382-4357-ae6d-e52d6aa5f523"
Jul 02 20:33:04.471665 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:04.471632    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/002584f1-ab2d-4938-976c-f61d553400c5-original-pull-secret\") pod \"global-pull-secret-syncer-57lmx\" (UID: \"002584f1-ab2d-4938-976c-f61d553400c5\") " pod="kube-system/global-pull-secret-syncer-57lmx"
Jul 02 20:33:04.472196 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:04.471696    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea026958-5382-4357-ae6d-e52d6aa5f523-metrics-certs\") pod \"network-metrics-daemon-djb55\" (UID: \"ea026958-5382-4357-ae6d-e52d6aa5f523\") " pod="openshift-multus/network-metrics-daemon-djb55"
Jul 02 20:33:04.472196 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:04.471785    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 20:33:04.472196 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:04.471850    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002584f1-ab2d-4938-976c-f61d553400c5-original-pull-secret podName:002584f1-ab2d-4938-976c-f61d553400c5 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:20.471830072 +0000 UTC m=+34.142343549 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/002584f1-ab2d-4938-976c-f61d553400c5-original-pull-secret") pod "global-pull-secret-syncer-57lmx" (UID: "002584f1-ab2d-4938-976c-f61d553400c5") : object "kube-system"/"original-pull-secret" not registered
Jul 02 20:33:04.472196 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:04.471786    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 20:33:04.472196 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:04.471965    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea026958-5382-4357-ae6d-e52d6aa5f523-metrics-certs podName:ea026958-5382-4357-ae6d-e52d6aa5f523 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:20.4719407 +0000 UTC m=+34.142454172 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea026958-5382-4357-ae6d-e52d6aa5f523-metrics-certs") pod "network-metrics-daemon-djb55" (UID: "ea026958-5382-4357-ae6d-e52d6aa5f523") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 20:33:04.572501 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:04.572469    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wcq8\" (UniqueName: \"kubernetes.io/projected/54276aec-aee7-4db9-8cee-f9858de9edb9-kube-api-access-2wcq8\") pod \"network-check-target-bfsnb\" (UID: \"54276aec-aee7-4db9-8cee-f9858de9edb9\") " pod="openshift-network-diagnostics/network-check-target-bfsnb"
Jul 02 20:33:04.572697 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:04.572659    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 20:33:04.572697 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:04.572683    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 20:33:04.572697 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:04.572698    2581 projected.go:196] Error preparing data for projected volume kube-api-access-2wcq8 for pod openshift-network-diagnostics/network-check-target-bfsnb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 20:33:04.572855 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:04.572765    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54276aec-aee7-4db9-8cee-f9858de9edb9-kube-api-access-2wcq8 podName:54276aec-aee7-4db9-8cee-f9858de9edb9 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:20.572745634 +0000 UTC m=+34.243259119 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2wcq8" (UniqueName: "kubernetes.io/projected/54276aec-aee7-4db9-8cee-f9858de9edb9-kube-api-access-2wcq8") pod "network-check-target-bfsnb" (UID: "54276aec-aee7-4db9-8cee-f9858de9edb9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 20:33:04.875612 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:04.875544    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-57lmx"
Jul 02 20:33:04.875612 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:04.875557    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfsnb"
Jul 02 20:33:04.875821 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:04.875648    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-57lmx" podUID="002584f1-ab2d-4938-976c-f61d553400c5"
Jul 02 20:33:04.875821 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:04.875719    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfsnb" podUID="54276aec-aee7-4db9-8cee-f9858de9edb9"
Jul 02 20:33:05.875626 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:05.875586    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-djb55"
Jul 02 20:33:05.876109 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:05.875726    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-djb55" podUID="ea026958-5382-4357-ae6d-e52d6aa5f523"
Jul 02 20:33:06.876180 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:06.876152    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-57lmx"
Jul 02 20:33:06.876640 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:06.876257    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-57lmx" podUID="002584f1-ab2d-4938-976c-f61d553400c5"
Jul 02 20:33:06.876640 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:06.876310    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfsnb"
Jul 02 20:33:06.876640 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:06.876402    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfsnb" podUID="54276aec-aee7-4db9-8cee-f9858de9edb9"
Jul 02 20:33:07.875218 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:07.875190    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-djb55"
Jul 02 20:33:07.875377 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:07.875324    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-djb55" podUID="ea026958-5382-4357-ae6d-e52d6aa5f523"
Jul 02 20:33:08.875499 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:08.875215    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfsnb"
Jul 02 20:33:08.876236 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:08.875219    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-57lmx"
Jul 02 20:33:08.876236 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:08.875566    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfsnb" podUID="54276aec-aee7-4db9-8cee-f9858de9edb9"
Jul 02 20:33:08.876236 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:08.875634    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-57lmx" podUID="002584f1-ab2d-4938-976c-f61d553400c5"
Jul 02 20:33:08.957049 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:08.957020    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-220.ec2.internal" event={"ID":"a751abb46464a7d3b2201f93b2e0dce1","Type":"ContainerStarted","Data":"c10f41e7e26d1e3f964f5b4b237205bb60934eaa0985771955248f0050436bb6"}
Jul 02 20:33:08.958405 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:08.958383    2581 generic.go:356] "Generic (PLEG): container finished" podID="5d2b6dcb-168e-44a4-a06b-a5d5aa138b99" containerID="e396327ee5cba73a9b297620e37492d05831ff2557ce8311b2cb8c168b30c54a" exitCode=0
Jul 02 20:33:08.958488 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:08.958463    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8pl9w" event={"ID":"5d2b6dcb-168e-44a4-a06b-a5d5aa138b99","Type":"ContainerDied","Data":"e396327ee5cba73a9b297620e37492d05831ff2557ce8311b2cb8c168b30c54a"}
Jul 02 20:33:08.960164 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:08.959954    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l6psk" event={"ID":"b8214272-e568-4b9d-bc4e-dcb7f9f45e60","Type":"ContainerStarted","Data":"44d9f739cbd4dbfc3d0248db46f6de35dd6142e92e82c2601310a408f9e8a53a"}
Jul 02 20:33:08.961344 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:08.961323    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9pdnt" event={"ID":"4cf8b90d-0190-498c-a52b-327bac88ed94","Type":"ContainerStarted","Data":"c410538c32956e0721237d2b21ce6facc29b2f1d8342e3f856e37181d8c68947"}
Jul 02 20:33:08.964391 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:08.964370    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc" event={"ID":"449efae7-b2a8-4dac-9049-867fea38ced0","Type":"ContainerStarted","Data":"b34361aed4dec7add3c4f98cd224910d599928c5a72663e63d19ffd346c70802"}
Jul 02 20:33:08.964481 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:08.964430    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc" event={"ID":"449efae7-b2a8-4dac-9049-867fea38ced0","Type":"ContainerStarted","Data":"b67a01f8ffa9b16fbed191523d06f8840d078314633cd2ea10381c0af277129d"}
Jul 02 20:33:08.964481 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:08.964460    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc" event={"ID":"449efae7-b2a8-4dac-9049-867fea38ced0","Type":"ContainerStarted","Data":"3d55d1623f35ed61713a9eb1b85d06fc234ef2e80692615d0f568f948091dcba"}
Jul 02 20:33:08.964575 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:08.964504    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc" event={"ID":"449efae7-b2a8-4dac-9049-867fea38ced0","Type":"ContainerStarted","Data":"632bf1fd478fe5f6ddcef4e746f070bfbf5a6775a6284c0af48c6204d573f83f"}
Jul 02 20:33:08.964575 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:08.964551    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc" event={"ID":"449efae7-b2a8-4dac-9049-867fea38ced0","Type":"ContainerStarted","Data":"5d7139e8db0837df3a73a9099df36874b4585798a3ab7f1197f76eb31482720c"}
Jul 02 20:33:08.966077 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:08.966021    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-26b5h" event={"ID":"0aa1b013-6df8-432c-9b41-46ebcc89f10e","Type":"ContainerStarted","Data":"e257bb152ac9a64c31676de68a52e0bc7430b2ec112bcc317c84aa148c2e07a1"}
Jul 02 20:33:08.967323 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:08.967303    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkkxz" event={"ID":"96a8205c-3379-4b12-a3c8-c4d5d5394938","Type":"ContainerStarted","Data":"b9820966387e2f2bbb44635c853e880aea726e176306c7d12fb8343f6746721b"}
Jul 02 20:33:08.968544 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:08.968523    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nq8gr" event={"ID":"8a38f5af-61e0-44a2-ba14-181ce7578683","Type":"ContainerStarted","Data":"626aa15c36c321a031b2cb06007a028c0e7a281a2d2a05ff02641cd378c0a961"}
Jul 02 20:33:08.969781 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:08.969757    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g7bq6" event={"ID":"294fefe5-fc68-4e4a-881a-df004b547621","Type":"ContainerStarted","Data":"3b9179a8b5177ba9b32920650a579ae679a6c3ef3831a336294ba1846482867b"}
Jul 02 20:33:09.016300 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:09.016248    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-220.ec2.internal" podStartSLOduration=22.0162369 podStartE2EDuration="22.0162369s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:32:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:08.986224828 +0000 UTC m=+22.656738320" watchObservedRunningTime="2026-07-02 20:33:09.0162369 +0000 UTC m=+22.686750393"
Jul 02 20:33:09.042867 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:09.042794    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-26b5h" podStartSLOduration=2.576984149 podStartE2EDuration="22.042781772s" totalImagesPullingTime="19.465797623s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:32:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:09.016373485 +0000 UTC m=+22.686886975" watchObservedRunningTime="2026-07-02 20:33:09.042781772 +0000 UTC m=+22.713295266"
Jul 02 20:33:09.072278 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:09.072244    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9pdnt" podStartSLOduration=2.8257907209999997 podStartE2EDuration="22.072232009s" totalImagesPullingTime="19.246441288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:32:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:09.072109807 +0000 UTC m=+22.742623301" watchObservedRunningTime="2026-07-02 20:33:09.072232009 +0000 UTC m=+22.742745501"
Jul 02 20:33:09.072374 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:09.072305    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-g7bq6" podStartSLOduration=2.803460706 podStartE2EDuration="22.072301564s" totalImagesPullingTime="19.268840858s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:32:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:09.044965899 +0000 UTC m=+22.715479392" watchObservedRunningTime="2026-07-02 20:33:09.072301564 +0000 UTC m=+22.742815057"
Jul 02 20:33:09.092099 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:09.092050    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-l6psk" podStartSLOduration=7.5264797869999995 podStartE2EDuration="22.092034029s" totalImagesPullingTime="14.565554242s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:32:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:09.091557841 +0000 UTC m=+22.762071334" watchObservedRunningTime="2026-07-02 20:33:09.092034029 +0000 UTC m=+22.762547522"
Jul 02 20:33:09.113128 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:09.113089    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nq8gr" podStartSLOduration=2.874411375 podStartE2EDuration="22.113078393s" totalImagesPullingTime="19.238667018s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:32:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:09.112520767 +0000 UTC m=+22.783034288" watchObservedRunningTime="2026-07-02 20:33:09.113078393 +0000 UTC m=+22.783591886"
Jul 02 20:33:09.195130 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:09.195093    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:09.268533 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:09.268504    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:09.844653 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:09.844627    2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 02 20:33:09.875722 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:09.875697    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-djb55"
Jul 02 20:33:09.876043 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:09.875815    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-djb55" podUID="ea026958-5382-4357-ae6d-e52d6aa5f523"
Jul 02 20:33:09.973813 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:09.973732    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkkxz" event={"ID":"96a8205c-3379-4b12-a3c8-c4d5d5394938","Type":"ContainerStarted","Data":"162061ae5f893f4a75ec07d48587509e5075a98347ed87b88538b6d61d27b374"}
Jul 02 20:33:09.975359 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:09.975337    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dtllk" event={"ID":"5623241a-9c33-4fd8-8af3-e9cfb9dafeb1","Type":"ContainerStarted","Data":"a4e0a70ef170b5f50e19e73f6d903f24b5d05b40461ad4077bcb0df60895b4b8"}
Jul 02 20:33:09.978632 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:09.978565    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc" event={"ID":"449efae7-b2a8-4dac-9049-867fea38ced0","Type":"ContainerStarted","Data":"64a607bc3018383e92dbef92cd4215be62d5967d9c51aef443f236fcb5c14a57"}
Jul 02 20:33:10.282115 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:10.281984    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:10.386641 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:10.386601    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:10.465529 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:10.465494    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:10.819196 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:10.819076    2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T20:33:09.844650781Z","UUID":"8022db0c-5d67-4255-b678-5f78d95eaf8a","Handler":null,"Name":"","Endpoint":""}
Jul 02 20:33:10.828351 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:10.828325    2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 02 20:33:10.828464 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:10.828373    2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 02 20:33:10.876077 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:10.876052    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfsnb"
Jul 02 20:33:10.876530 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:10.876054    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-57lmx"
Jul 02 20:33:10.876530 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:10.876186    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfsnb" podUID="54276aec-aee7-4db9-8cee-f9858de9edb9"
Jul 02 20:33:10.876530 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:10.876291    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-57lmx" podUID="002584f1-ab2d-4938-976c-f61d553400c5"
Jul 02 20:33:11.221776 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:11.221539    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9pdnt"
Jul 02 20:33:11.222314 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:11.222281    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9pdnt"
Jul 02 20:33:11.239559 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:11.239503    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dtllk" podStartSLOduration=4.954160162 podStartE2EDuration="24.23948715s" totalImagesPullingTime="19.285326988s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:32:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:10.010258532 +0000 UTC m=+23.680772026" watchObservedRunningTime="2026-07-02 20:33:11.23948715 +0000 UTC m=+24.910000642"
Jul 02 20:33:11.875800 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:11.875768    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-djb55"
Jul 02 20:33:11.876066 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:11.875902    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-djb55" podUID="ea026958-5382-4357-ae6d-e52d6aa5f523"
Jul 02 20:33:11.988045 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:11.988008    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc" event={"ID":"449efae7-b2a8-4dac-9049-867fea38ced0","Type":"ContainerStarted","Data":"529f3944277a1d4007745c9d5906d49cdd53009e31642c5a6adc54089e84852d"}
Jul 02 20:33:11.989868 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:11.989844    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkkxz" event={"ID":"96a8205c-3379-4b12-a3c8-c4d5d5394938","Type":"ContainerStarted","Data":"227daa50c44fcf5d2c4fbcdc3741a64434491b2283933575981757de3d4ec71b"}
Jul 02 20:33:12.009535 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:12.009483    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkkxz" podStartSLOduration=3.424417344 podStartE2EDuration="25.009464881s" totalImagesPullingTime="21.585047537s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:32:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:12.009369001 +0000 UTC m=+25.679882493" watchObservedRunningTime="2026-07-02 20:33:12.009464881 +0000 UTC m=+25.679978377"
Jul 02 20:33:12.875211 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:12.875183    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfsnb"
Jul 02 20:33:12.875397 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:12.875304    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfsnb" podUID="54276aec-aee7-4db9-8cee-f9858de9edb9"
Jul 02 20:33:12.875397 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:12.875369    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-57lmx"
Jul 02 20:33:12.875558 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:12.875479    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-57lmx" podUID="002584f1-ab2d-4938-976c-f61d553400c5"
Jul 02 20:33:13.875511 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:13.875327    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-djb55"
Jul 02 20:33:13.876178 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:13.875622    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-djb55" podUID="ea026958-5382-4357-ae6d-e52d6aa5f523"
Jul 02 20:33:13.995644 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:13.995614    2581 generic.go:356] "Generic (PLEG): container finished" podID="5d2b6dcb-168e-44a4-a06b-a5d5aa138b99" containerID="fff19267c36797451bfde8706e2f59085008885c57e950cc1fa05d677cff4739" exitCode=0
Jul 02 20:33:13.995763 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:13.995702    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8pl9w" event={"ID":"5d2b6dcb-168e-44a4-a06b-a5d5aa138b99","Type":"ContainerDied","Data":"fff19267c36797451bfde8706e2f59085008885c57e950cc1fa05d677cff4739"}
Jul 02 20:33:13.999435 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:13.999401    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc" event={"ID":"449efae7-b2a8-4dac-9049-867fea38ced0","Type":"ContainerStarted","Data":"09977da108b8e8ad1bb2a960fdee713734f056581c243d7f63cf132c0905a048"}
Jul 02 20:33:13.999668 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:13.999646    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:33:14.014341 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:14.014322    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:33:14.050161 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:14.049629    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc" podStartSLOduration=7.706699326 podStartE2EDuration="27.049612737s" totalImagesPullingTime="19.342913411s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:32:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:14.048789608 +0000 UTC m=+27.719303101" watchObservedRunningTime="2026-07-02 20:33:14.049612737 +0000 UTC m=+27.720126230"
Jul 02 20:33:14.875291 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:14.875217    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfsnb"
Jul 02 20:33:14.875525 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:14.875341    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfsnb" podUID="54276aec-aee7-4db9-8cee-f9858de9edb9"
Jul 02 20:33:14.875525 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:14.875218    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-57lmx"
Jul 02 20:33:14.875925 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:14.875547    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-57lmx" podUID="002584f1-ab2d-4938-976c-f61d553400c5"
Jul 02 20:33:15.002310 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:15.002278    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:33:15.002470 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:15.002356    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:33:15.017210 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:15.017186    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:33:15.545294 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:15.545267    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bfsnb"]
Jul 02 20:33:15.545471 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:15.545368    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfsnb"
Jul 02 20:33:15.545516 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:15.545472    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfsnb" podUID="54276aec-aee7-4db9-8cee-f9858de9edb9"
Jul 02 20:33:15.557826 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:15.557794    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-57lmx"]
Jul 02 20:33:15.557930 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:15.557892    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-57lmx"
Jul 02 20:33:15.557996 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:15.557979    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-57lmx" podUID="002584f1-ab2d-4938-976c-f61d553400c5"
Jul 02 20:33:15.569410 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:15.569390    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-djb55"]
Jul 02 20:33:15.569511 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:15.569470    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-djb55"
Jul 02 20:33:15.569557 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:15.569537    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-djb55" podUID="ea026958-5382-4357-ae6d-e52d6aa5f523"
Jul 02 20:33:16.005946 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:16.005763    2581 generic.go:356] "Generic (PLEG): container finished" podID="5d2b6dcb-168e-44a4-a06b-a5d5aa138b99" containerID="9ec86f5a8044875ceb078b5f32a830018d6c40c33d4e2b0fba3b0742219c6c0d" exitCode=0
Jul 02 20:33:16.006422 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:16.005846    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8pl9w" event={"ID":"5d2b6dcb-168e-44a4-a06b-a5d5aa138b99","Type":"ContainerDied","Data":"9ec86f5a8044875ceb078b5f32a830018d6c40c33d4e2b0fba3b0742219c6c0d"}
Jul 02 20:33:16.875883 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:16.875850    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-57lmx"
Jul 02 20:33:16.876054 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:16.875945    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-57lmx" podUID="002584f1-ab2d-4938-976c-f61d553400c5"
Jul 02 20:33:17.565869 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:17.565843    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9pdnt"
Jul 02 20:33:17.566371 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:17.565986    2581 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 02 20:33:17.566631 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:17.566608    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9pdnt"
Jul 02 20:33:17.632524 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:17.632499    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:17.875537 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:17.875470    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-djb55"
Jul 02 20:33:17.875677 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:17.875470    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfsnb"
Jul 02 20:33:17.875677 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:17.875573    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-djb55" podUID="ea026958-5382-4357-ae6d-e52d6aa5f523"
Jul 02 20:33:17.875677 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:17.875641    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfsnb" podUID="54276aec-aee7-4db9-8cee-f9858de9edb9"
Jul 02 20:33:18.012824 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:18.012791    2581 generic.go:356] "Generic (PLEG): container finished" podID="5d2b6dcb-168e-44a4-a06b-a5d5aa138b99" containerID="2a6b292f10e78b3cebeb7efb9006bc2cbd3ff5a9376a013f16cc1ccbac07391f" exitCode=0
Jul 02 20:33:18.012973 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:18.012874    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8pl9w" event={"ID":"5d2b6dcb-168e-44a4-a06b-a5d5aa138b99","Type":"ContainerDied","Data":"2a6b292f10e78b3cebeb7efb9006bc2cbd3ff5a9376a013f16cc1ccbac07391f"}
Jul 02 20:33:18.875604 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:18.875572    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-57lmx"
Jul 02 20:33:18.876332 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:18.875704    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-57lmx" podUID="002584f1-ab2d-4938-976c-f61d553400c5"
Jul 02 20:33:19.850098 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:19.850060    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:19.875914 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:19.875888    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfsnb"
Jul 02 20:33:19.876339 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:19.876003    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfsnb" podUID="54276aec-aee7-4db9-8cee-f9858de9edb9"
Jul 02 20:33:19.876339 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:19.876062    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-djb55"
Jul 02 20:33:19.876339 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:19.876188    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-djb55" podUID="ea026958-5382-4357-ae6d-e52d6aa5f523"
Jul 02 20:33:19.947178 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:19.947127    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:20.503458 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:20.503429    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea026958-5382-4357-ae6d-e52d6aa5f523-metrics-certs\") pod \"network-metrics-daemon-djb55\" (UID: \"ea026958-5382-4357-ae6d-e52d6aa5f523\") " pod="openshift-multus/network-metrics-daemon-djb55"
Jul 02 20:33:20.503689 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:20.503481    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/002584f1-ab2d-4938-976c-f61d553400c5-original-pull-secret\") pod \"global-pull-secret-syncer-57lmx\" (UID: \"002584f1-ab2d-4938-976c-f61d553400c5\") " pod="kube-system/global-pull-secret-syncer-57lmx"
Jul 02 20:33:20.503689 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:20.503581    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 20:33:20.503689 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:20.503587    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 20:33:20.503689 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:20.503639    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002584f1-ab2d-4938-976c-f61d553400c5-original-pull-secret podName:002584f1-ab2d-4938-976c-f61d553400c5 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:52.503619433 +0000 UTC m=+66.174132907 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/002584f1-ab2d-4938-976c-f61d553400c5-original-pull-secret") pod "global-pull-secret-syncer-57lmx" (UID: "002584f1-ab2d-4938-976c-f61d553400c5") : object "kube-system"/"original-pull-secret" not registered
Jul 02 20:33:20.503689 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:20.503658    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea026958-5382-4357-ae6d-e52d6aa5f523-metrics-certs podName:ea026958-5382-4357-ae6d-e52d6aa5f523 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:52.50364735 +0000 UTC m=+66.174160823 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea026958-5382-4357-ae6d-e52d6aa5f523-metrics-certs") pod "network-metrics-daemon-djb55" (UID: "ea026958-5382-4357-ae6d-e52d6aa5f523") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 20:33:20.604130 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:20.604096    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wcq8\" (UniqueName: \"kubernetes.io/projected/54276aec-aee7-4db9-8cee-f9858de9edb9-kube-api-access-2wcq8\") pod \"network-check-target-bfsnb\" (UID: \"54276aec-aee7-4db9-8cee-f9858de9edb9\") " pod="openshift-network-diagnostics/network-check-target-bfsnb"
Jul 02 20:33:20.604285 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:20.604254    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 20:33:20.604285 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:20.604271    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 20:33:20.604285 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:20.604281    2581 projected.go:196] Error preparing data for projected volume kube-api-access-2wcq8 for pod openshift-network-diagnostics/network-check-target-bfsnb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 20:33:20.604404 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:20.604329    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54276aec-aee7-4db9-8cee-f9858de9edb9-kube-api-access-2wcq8 podName:54276aec-aee7-4db9-8cee-f9858de9edb9 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:52.604311214 +0000 UTC m=+66.274824743 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2wcq8" (UniqueName: "kubernetes.io/projected/54276aec-aee7-4db9-8cee-f9858de9edb9-kube-api-access-2wcq8") pod "network-check-target-bfsnb" (UID: "54276aec-aee7-4db9-8cee-f9858de9edb9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 20:33:20.875728 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:20.875653    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-57lmx"
Jul 02 20:33:20.875910 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:20.875779    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-57lmx" podUID="002584f1-ab2d-4938-976c-f61d553400c5"
Jul 02 20:33:20.877683 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:20.877652    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:20.978941 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:20.978912    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:21.061346 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:21.061315    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-220.ec2.internal" event="NodeReady"
Jul 02 20:33:21.061516 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:21.061457    2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 02 20:33:21.078372 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:21.078345    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:21.125689 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:21.125491    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4tmlm"]
Jul 02 20:33:21.128102 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:21.128052    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mhrst"]
Jul 02 20:33:21.128226 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:21.128199    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4tmlm"
Jul 02 20:33:21.129669 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:21.129647    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mhrst"
Jul 02 20:33:21.131011 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:21.130987    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 02 20:33:21.131011 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:21.131003    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 02 20:33:21.131174 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:21.130986    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fwtcq\""
Jul 02 20:33:21.131685 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:21.131667    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 02 20:33:21.132215 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:21.132196    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 02 20:33:21.132306 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:21.132196    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 02 20:33:21.132306 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:21.132266    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-l286d\""
Jul 02 20:33:21.138445 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:21.138417    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mhrst"]
Jul 02 20:33:21.148674 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:21.148652    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4tmlm"]
Jul 02 20:33:21.166465 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:21.166440    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:21.247964 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:21.247924    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:21.309377 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:21.309349    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4fb5458-6e18-4869-b867-8eb520767a3c-cert\") pod \"ingress-canary-mhrst\" (UID: \"e4fb5458-6e18-4869-b867-8eb520767a3c\") " pod="openshift-ingress-canary/ingress-canary-mhrst"
Jul 02 20:33:21.309551 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:21.309386    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1896b78b-e154-4660-8457-6f3be984428d-metrics-tls\") pod \"dns-default-4tmlm\" (UID: \"1896b78b-e154-4660-8457-6f3be984428d\") " pod="openshift-dns/dns-default-4tmlm"
Jul 02 20:33:21.309551 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:21.309412    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcptj\" (UniqueName: \"kubernetes.io/projected/1896b78b-e154-4660-8457-6f3be984428d-kube-api-access-jcptj\") pod \"dns-default-4tmlm\" (UID: \"1896b78b-e154-4660-8457-6f3be984428d\") " pod="openshift-dns/dns-default-4tmlm"
Jul 02 20:33:21.309551 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:21.309443    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1896b78b-e154-4660-8457-6f3be984428d-tmp-dir\") pod \"dns-default-4tmlm\" (UID: \"1896b78b-e154-4660-8457-6f3be984428d\") " pod="openshift-dns/dns-default-4tmlm"
Jul 02 20:33:21.309551 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:21.309503    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpnv4\" (UniqueName: \"kubernetes.io/projected/e4fb5458-6e18-4869-b867-8eb520767a3c-kube-api-access-bpnv4\") pod \"ingress-canary-mhrst\" (UID: \"e4fb5458-6e18-4869-b867-8eb520767a3c\") " pod="openshift-ingress-canary/ingress-canary-mhrst"
Jul 02 20:33:21.309551 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:21.309527    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1896b78b-e154-4660-8457-6f3be984428d-config-volume\") pod \"dns-default-4tmlm\" (UID: \"1896b78b-e154-4660-8457-6f3be984428d\") " pod="openshift-dns/dns-default-4tmlm"
Jul 02 20:33:21.410796 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:21.410719    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4fb5458-6e18-4869-b867-8eb520767a3c-cert\") pod \"ingress-canary-mhrst\" (UID: \"e4fb5458-6e18-4869-b867-8eb520767a3c\") " pod="openshift-ingress-canary/ingress-canary-mhrst"
Jul 02 20:33:21.410796 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:21.410760    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1896b78b-e154-4660-8457-6f3be984428d-metrics-tls\") pod \"dns-default-4tmlm\" (UID: \"1896b78b-e154-4660-8457-6f3be984428d\") " pod="openshift-dns/dns-default-4tmlm"
Jul 02 20:33:21.410796 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:21.410786    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcptj\" (UniqueName: \"kubernetes.io/projected/1896b78b-e154-4660-8457-6f3be984428d-kube-api-access-jcptj\") pod \"dns-default-4tmlm\" (UID: \"1896b78b-e154-4660-8457-6f3be984428d\") " pod="openshift-dns/dns-default-4tmlm"
Jul 02 20:33:21.411060 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:21.410812    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1896b78b-e154-4660-8457-6f3be984428d-tmp-dir\") pod \"dns-default-4tmlm\" (UID: \"1896b78b-e154-4660-8457-6f3be984428d\") " pod="openshift-dns/dns-default-4tmlm"
Jul 02 20:33:21.411060 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:21.410862    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpnv4\" (UniqueName: \"kubernetes.io/projected/e4fb5458-6e18-4869-b867-8eb520767a3c-kube-api-access-bpnv4\") pod \"ingress-canary-mhrst\" (UID: \"e4fb5458-6e18-4869-b867-8eb520767a3c\") " pod="openshift-ingress-canary/ingress-canary-mhrst"
Jul 02 20:33:21.411060 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:21.410888    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1896b78b-e154-4660-8457-6f3be984428d-config-volume\") pod \"dns-default-4tmlm\" (UID: \"1896b78b-e154-4660-8457-6f3be984428d\") " pod="openshift-dns/dns-default-4tmlm"
Jul 02 20:33:21.411060 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:21.410896    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 20:33:21.411060 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:21.410971    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1896b78b-e154-4660-8457-6f3be984428d-metrics-tls podName:1896b78b-e154-4660-8457-6f3be984428d nodeName:}" failed. No retries permitted until 2026-07-02 20:33:21.910949529 +0000 UTC m=+35.581463001 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1896b78b-e154-4660-8457-6f3be984428d-metrics-tls") pod "dns-default-4tmlm" (UID: "1896b78b-e154-4660-8457-6f3be984428d") : secret "dns-default-metrics-tls" not found
Jul 02 20:33:21.411357 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:21.411206    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1896b78b-e154-4660-8457-6f3be984428d-tmp-dir\") pod \"dns-default-4tmlm\" (UID: \"1896b78b-e154-4660-8457-6f3be984428d\") " pod="openshift-dns/dns-default-4tmlm"
Jul 02 20:33:21.411512 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:21.411491    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1896b78b-e154-4660-8457-6f3be984428d-config-volume\") pod \"dns-default-4tmlm\" (UID: \"1896b78b-e154-4660-8457-6f3be984428d\") " pod="openshift-dns/dns-default-4tmlm"
Jul 02 20:33:21.415318 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:21.415127    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4fb5458-6e18-4869-b867-8eb520767a3c-cert\") pod \"ingress-canary-mhrst\" (UID: \"e4fb5458-6e18-4869-b867-8eb520767a3c\") " pod="openshift-ingress-canary/ingress-canary-mhrst"
Jul 02 20:33:21.420869 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:21.420846    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpnv4\" (UniqueName: \"kubernetes.io/projected/e4fb5458-6e18-4869-b867-8eb520767a3c-kube-api-access-bpnv4\") pod \"ingress-canary-mhrst\" (UID: \"e4fb5458-6e18-4869-b867-8eb520767a3c\") " pod="openshift-ingress-canary/ingress-canary-mhrst"
Jul 02 20:33:21.420981 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:21.420916    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcptj\" (UniqueName: \"kubernetes.io/projected/1896b78b-e154-4660-8457-6f3be984428d-kube-api-access-jcptj\") pod \"dns-default-4tmlm\" (UID: \"1896b78b-e154-4660-8457-6f3be984428d\") " pod="openshift-dns/dns-default-4tmlm"
Jul 02 20:33:21.449835 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:21.449803    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mhrst"
Jul 02 20:33:21.876089 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:21.876056    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfsnb"
Jul 02 20:33:21.876275 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:21.876106    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-djb55"
Jul 02 20:33:21.879653 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:21.879627    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 02 20:33:21.879965 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:21.879664    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2zr7q\""
Jul 02 20:33:21.879965 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:21.879672    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 20:33:21.879965 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:21.879628    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xbw6r\""
Jul 02 20:33:21.879965 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:21.879627    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 02 20:33:21.914327 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:21.914302    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1896b78b-e154-4660-8457-6f3be984428d-metrics-tls\") pod \"dns-default-4tmlm\" (UID: \"1896b78b-e154-4660-8457-6f3be984428d\") " pod="openshift-dns/dns-default-4tmlm"
Jul 02 20:33:21.914447 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:21.914410    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 20:33:21.914505 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:21.914476    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1896b78b-e154-4660-8457-6f3be984428d-metrics-tls podName:1896b78b-e154-4660-8457-6f3be984428d nodeName:}" failed. No retries permitted until 2026-07-02 20:33:22.91445862 +0000 UTC m=+36.584972111 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1896b78b-e154-4660-8457-6f3be984428d-metrics-tls") pod "dns-default-4tmlm" (UID: "1896b78b-e154-4660-8457-6f3be984428d") : secret "dns-default-metrics-tls" not found
Jul 02 20:33:22.326489 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:22.326462    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mhrst"]
Jul 02 20:33:22.329492 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:33:22.329458    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4fb5458_6e18_4869_b867_8eb520767a3c.slice/crio-e7be92da3221ecebfa65cbd8c721f90805bf17600fb4293d0851b25c42d01fec WatchSource:0}: Error finding container e7be92da3221ecebfa65cbd8c721f90805bf17600fb4293d0851b25c42d01fec: Status 404 returned error can't find the container with id e7be92da3221ecebfa65cbd8c721f90805bf17600fb4293d0851b25c42d01fec
Jul 02 20:33:22.875278 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:22.875247    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-57lmx"
Jul 02 20:33:22.878026 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:22.878001    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 20:33:22.921408 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:22.921385    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1896b78b-e154-4660-8457-6f3be984428d-metrics-tls\") pod \"dns-default-4tmlm\" (UID: \"1896b78b-e154-4660-8457-6f3be984428d\") " pod="openshift-dns/dns-default-4tmlm"
Jul 02 20:33:22.921967 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:22.921552    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 20:33:22.921967 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:22.921623    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1896b78b-e154-4660-8457-6f3be984428d-metrics-tls podName:1896b78b-e154-4660-8457-6f3be984428d nodeName:}" failed. No retries permitted until 2026-07-02 20:33:24.921604082 +0000 UTC m=+38.592117555 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1896b78b-e154-4660-8457-6f3be984428d-metrics-tls") pod "dns-default-4tmlm" (UID: "1896b78b-e154-4660-8457-6f3be984428d") : secret "dns-default-metrics-tls" not found
Jul 02 20:33:23.024721 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:23.024689    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mhrst" event={"ID":"e4fb5458-6e18-4869-b867-8eb520767a3c","Type":"ContainerStarted","Data":"e7be92da3221ecebfa65cbd8c721f90805bf17600fb4293d0851b25c42d01fec"}
Jul 02 20:33:23.027960 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:23.027934    2581 generic.go:356] "Generic (PLEG): container finished" podID="5d2b6dcb-168e-44a4-a06b-a5d5aa138b99" containerID="8d7c96f8ce16bbb001e1d73dd76b68c025d410ffc2ebf5c093a276d8b63c53d9" exitCode=0
Jul 02 20:33:23.028064 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:23.027973    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8pl9w" event={"ID":"5d2b6dcb-168e-44a4-a06b-a5d5aa138b99","Type":"ContainerDied","Data":"8d7c96f8ce16bbb001e1d73dd76b68c025d410ffc2ebf5c093a276d8b63c53d9"}
Jul 02 20:33:24.033126 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:24.033098    2581 generic.go:356] "Generic (PLEG): container finished" podID="5d2b6dcb-168e-44a4-a06b-a5d5aa138b99" containerID="5782130bfc053a2d59c02dde4db7ab975370b75beb4f22c4e021bc598aa0c8f8" exitCode=0
Jul 02 20:33:24.033512 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:24.033151    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8pl9w" event={"ID":"5d2b6dcb-168e-44a4-a06b-a5d5aa138b99","Type":"ContainerDied","Data":"5782130bfc053a2d59c02dde4db7ab975370b75beb4f22c4e021bc598aa0c8f8"}
Jul 02 20:33:24.184199 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:24.184004    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:24.285469 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:24.285393    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:24.833736 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:24.833701    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:24.935422 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:24.935383    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1896b78b-e154-4660-8457-6f3be984428d-metrics-tls\") pod \"dns-default-4tmlm\" (UID: \"1896b78b-e154-4660-8457-6f3be984428d\") " pod="openshift-dns/dns-default-4tmlm"
Jul 02 20:33:24.935583 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:24.935503    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 20:33:24.935583 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:24.935577    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1896b78b-e154-4660-8457-6f3be984428d-metrics-tls podName:1896b78b-e154-4660-8457-6f3be984428d nodeName:}" failed. No retries permitted until 2026-07-02 20:33:28.935557509 +0000 UTC m=+42.606070980 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1896b78b-e154-4660-8457-6f3be984428d-metrics-tls") pod "dns-default-4tmlm" (UID: "1896b78b-e154-4660-8457-6f3be984428d") : secret "dns-default-metrics-tls" not found
Jul 02 20:33:25.040485 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:25.040452    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8pl9w" event={"ID":"5d2b6dcb-168e-44a4-a06b-a5d5aa138b99","Type":"ContainerStarted","Data":"8dd6cad0a08a0338a7d4972523592903ea022dbe20c8319c31f68ba6c54d555b"}
Jul 02 20:33:25.190363 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:25.190319    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:25.260588 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:25.260542    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:25.796616 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:25.796586    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:25.891613 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:25.891569    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:26.044196 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:26.044161    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mhrst" event={"ID":"e4fb5458-6e18-4869-b867-8eb520767a3c","Type":"ContainerStarted","Data":"219895fbb1e206f9641383d775061a8368e1f3d1788d2a83296f5fb0d34bc547"}
Jul 02 20:33:26.060439 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:26.060401    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8pl9w" podStartSLOduration=12.943456493 podStartE2EDuration="39.060385173s" totalImagesPullingTime="26.11692868s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:32:47 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:25.067493576 +0000 UTC m=+38.738007067" watchObservedRunningTime="2026-07-02 20:33:26.060385173 +0000 UTC m=+39.730898644"
Jul 02 20:33:26.060654 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:26.060633    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mhrst" podStartSLOduration=1.710983301 podStartE2EDuration="5.060627992s" totalImagesPullingTime="3.349644691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:33:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:26.060078445 +0000 UTC m=+39.730591949" watchObservedRunningTime="2026-07-02 20:33:26.060627992 +0000 UTC m=+39.731141770"
Jul 02 20:33:27.585440 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:27.585407    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:27.641259 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:27.641221    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:28.959153 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:28.959105    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1896b78b-e154-4660-8457-6f3be984428d-metrics-tls\") pod \"dns-default-4tmlm\" (UID: \"1896b78b-e154-4660-8457-6f3be984428d\") " pod="openshift-dns/dns-default-4tmlm"
Jul 02 20:33:28.959509 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:28.959239    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 20:33:28.959509 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:28.959294    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1896b78b-e154-4660-8457-6f3be984428d-metrics-tls podName:1896b78b-e154-4660-8457-6f3be984428d nodeName:}" failed. No retries permitted until 2026-07-02 20:33:36.959278719 +0000 UTC m=+50.629792190 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1896b78b-e154-4660-8457-6f3be984428d-metrics-tls") pod "dns-default-4tmlm" (UID: "1896b78b-e154-4660-8457-6f3be984428d") : secret "dns-default-metrics-tls" not found
Jul 02 20:33:31.783629 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:31.783593    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:31.848955 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:31.848921    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:37.008818 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:37.008789    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1896b78b-e154-4660-8457-6f3be984428d-metrics-tls\") pod \"dns-default-4tmlm\" (UID: \"1896b78b-e154-4660-8457-6f3be984428d\") " pod="openshift-dns/dns-default-4tmlm"
Jul 02 20:33:37.009214 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:37.008912    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 20:33:37.009214 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:37.008963    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1896b78b-e154-4660-8457-6f3be984428d-metrics-tls podName:1896b78b-e154-4660-8457-6f3be984428d nodeName:}" failed. No retries permitted until 2026-07-02 20:33:53.00894874 +0000 UTC m=+66.679462211 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1896b78b-e154-4660-8457-6f3be984428d-metrics-tls") pod "dns-default-4tmlm" (UID: "1896b78b-e154-4660-8457-6f3be984428d") : secret "dns-default-metrics-tls" not found
Jul 02 20:33:37.200886 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:37.200847    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:37.253932 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:37.253899    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:38.297552 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:38.297527    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7ff689d5-rr6lc"]
Jul 02 20:33:38.313590 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:38.313568    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7ff689d5-rr6lc"
Jul 02 20:33:38.316132 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:38.316107    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 02 20:33:38.316283 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:38.316257    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-t7pgl\""
Jul 02 20:33:38.316283 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:38.316273    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7ff689d5-rr6lc"]
Jul 02 20:33:38.316457 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:38.316392    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 02 20:33:38.316517 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:38.316459    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/79f2ade3-bf54-4290-bce9-34d8e1758c00-stats-auth\") pod \"router-default-7ff689d5-rr6lc\" (UID: \"79f2ade3-bf54-4290-bce9-34d8e1758c00\") " pod="openshift-ingress/router-default-7ff689d5-rr6lc"
Jul 02 20:33:38.316641 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:38.316563    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/79f2ade3-bf54-4290-bce9-34d8e1758c00-default-certificate\") pod \"router-default-7ff689d5-rr6lc\" (UID: \"79f2ade3-bf54-4290-bce9-34d8e1758c00\") " pod="openshift-ingress/router-default-7ff689d5-rr6lc"
Jul 02 20:33:38.316641 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:38.316606    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 02 20:33:38.316641 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:38.316612    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79f2ade3-bf54-4290-bce9-34d8e1758c00-metrics-certs\") pod \"router-default-7ff689d5-rr6lc\" (UID: \"79f2ade3-bf54-4290-bce9-34d8e1758c00\") " pod="openshift-ingress/router-default-7ff689d5-rr6lc"
Jul 02 20:33:38.316641 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:38.316623    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 02 20:33:38.317023 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:38.316668    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ldll\" (UniqueName: \"kubernetes.io/projected/79f2ade3-bf54-4290-bce9-34d8e1758c00-kube-api-access-4ldll\") pod \"router-default-7ff689d5-rr6lc\" (UID: \"79f2ade3-bf54-4290-bce9-34d8e1758c00\") " pod="openshift-ingress/router-default-7ff689d5-rr6lc"
Jul 02 20:33:38.317023 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:38.316722    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79f2ade3-bf54-4290-bce9-34d8e1758c00-service-ca-bundle\") pod \"router-default-7ff689d5-rr6lc\" (UID: \"79f2ade3-bf54-4290-bce9-34d8e1758c00\") " pod="openshift-ingress/router-default-7ff689d5-rr6lc"
Jul 02 20:33:38.317023 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:38.316925    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 02 20:33:38.317118 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:38.317074    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 02 20:33:38.417600 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:38.417570    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79f2ade3-bf54-4290-bce9-34d8e1758c00-metrics-certs\") pod \"router-default-7ff689d5-rr6lc\" (UID: \"79f2ade3-bf54-4290-bce9-34d8e1758c00\") " pod="openshift-ingress/router-default-7ff689d5-rr6lc"
Jul 02 20:33:38.417704 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:38.417619    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ldll\" (UniqueName: \"kubernetes.io/projected/79f2ade3-bf54-4290-bce9-34d8e1758c00-kube-api-access-4ldll\") pod \"router-default-7ff689d5-rr6lc\" (UID: \"79f2ade3-bf54-4290-bce9-34d8e1758c00\") " pod="openshift-ingress/router-default-7ff689d5-rr6lc"
Jul 02 20:33:38.417704 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:38.417647    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79f2ade3-bf54-4290-bce9-34d8e1758c00-service-ca-bundle\") pod \"router-default-7ff689d5-rr6lc\" (UID: \"79f2ade3-bf54-4290-bce9-34d8e1758c00\") " pod="openshift-ingress/router-default-7ff689d5-rr6lc"
Jul 02 20:33:38.417704 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:38.417678    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/79f2ade3-bf54-4290-bce9-34d8e1758c00-stats-auth\") pod \"router-default-7ff689d5-rr6lc\" (UID: \"79f2ade3-bf54-4290-bce9-34d8e1758c00\") " pod="openshift-ingress/router-default-7ff689d5-rr6lc"
Jul 02 20:33:38.417865 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:38.417705    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/79f2ade3-bf54-4290-bce9-34d8e1758c00-default-certificate\") pod \"router-default-7ff689d5-rr6lc\" (UID: \"79f2ade3-bf54-4290-bce9-34d8e1758c00\") " pod="openshift-ingress/router-default-7ff689d5-rr6lc"
Jul 02 20:33:38.417865 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:38.417706    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 20:33:38.417865 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:38.417787    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79f2ade3-bf54-4290-bce9-34d8e1758c00-metrics-certs podName:79f2ade3-bf54-4290-bce9-34d8e1758c00 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:38.917767639 +0000 UTC m=+52.588281110 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79f2ade3-bf54-4290-bce9-34d8e1758c00-metrics-certs") pod "router-default-7ff689d5-rr6lc" (UID: "79f2ade3-bf54-4290-bce9-34d8e1758c00") : secret "router-metrics-certs-default" not found
Jul 02 20:33:38.417865 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:38.417823    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/79f2ade3-bf54-4290-bce9-34d8e1758c00-service-ca-bundle podName:79f2ade3-bf54-4290-bce9-34d8e1758c00 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:38.917808646 +0000 UTC m=+52.588322116 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/79f2ade3-bf54-4290-bce9-34d8e1758c00-service-ca-bundle") pod "router-default-7ff689d5-rr6lc" (UID: "79f2ade3-bf54-4290-bce9-34d8e1758c00") : configmap references non-existent config key: service-ca.crt
Jul 02 20:33:38.421532 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:38.421497    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/79f2ade3-bf54-4290-bce9-34d8e1758c00-stats-auth\") pod \"router-default-7ff689d5-rr6lc\" (UID: \"79f2ade3-bf54-4290-bce9-34d8e1758c00\") " pod="openshift-ingress/router-default-7ff689d5-rr6lc"
Jul 02 20:33:38.421621 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:38.421532    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/79f2ade3-bf54-4290-bce9-34d8e1758c00-default-certificate\") pod \"router-default-7ff689d5-rr6lc\" (UID: \"79f2ade3-bf54-4290-bce9-34d8e1758c00\") " pod="openshift-ingress/router-default-7ff689d5-rr6lc"
Jul 02 20:33:38.428868 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:38.428850    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ldll\" (UniqueName: \"kubernetes.io/projected/79f2ade3-bf54-4290-bce9-34d8e1758c00-kube-api-access-4ldll\") pod \"router-default-7ff689d5-rr6lc\" (UID: \"79f2ade3-bf54-4290-bce9-34d8e1758c00\") " pod="openshift-ingress/router-default-7ff689d5-rr6lc"
Jul 02 20:33:38.439378 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:38.439354    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:38.494273 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:38.494246    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:38.897472 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:38.897438    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:38.921349 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:38.921325    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79f2ade3-bf54-4290-bce9-34d8e1758c00-metrics-certs\") pod \"router-default-7ff689d5-rr6lc\" (UID: \"79f2ade3-bf54-4290-bce9-34d8e1758c00\") " pod="openshift-ingress/router-default-7ff689d5-rr6lc"
Jul 02 20:33:38.921465 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:38.921391    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79f2ade3-bf54-4290-bce9-34d8e1758c00-service-ca-bundle\") pod \"router-default-7ff689d5-rr6lc\" (UID: \"79f2ade3-bf54-4290-bce9-34d8e1758c00\") " pod="openshift-ingress/router-default-7ff689d5-rr6lc"
Jul 02 20:33:38.921465 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:38.921456    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 20:33:38.921570 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:38.921509    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79f2ade3-bf54-4290-bce9-34d8e1758c00-metrics-certs podName:79f2ade3-bf54-4290-bce9-34d8e1758c00 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:39.921495743 +0000 UTC m=+53.592009213 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79f2ade3-bf54-4290-bce9-34d8e1758c00-metrics-certs") pod "router-default-7ff689d5-rr6lc" (UID: "79f2ade3-bf54-4290-bce9-34d8e1758c00") : secret "router-metrics-certs-default" not found
Jul 02 20:33:38.921570 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:38.921553    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/79f2ade3-bf54-4290-bce9-34d8e1758c00-service-ca-bundle podName:79f2ade3-bf54-4290-bce9-34d8e1758c00 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:39.921534656 +0000 UTC m=+53.592048145 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/79f2ade3-bf54-4290-bce9-34d8e1758c00-service-ca-bundle") pod "router-default-7ff689d5-rr6lc" (UID: "79f2ade3-bf54-4290-bce9-34d8e1758c00") : configmap references non-existent config key: service-ca.crt
Jul 02 20:33:38.997919 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:38.997890    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:39.928700 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:39.928662    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79f2ade3-bf54-4290-bce9-34d8e1758c00-metrics-certs\") pod \"router-default-7ff689d5-rr6lc\" (UID: \"79f2ade3-bf54-4290-bce9-34d8e1758c00\") " pod="openshift-ingress/router-default-7ff689d5-rr6lc"
Jul 02 20:33:39.929167 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:39.928730    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79f2ade3-bf54-4290-bce9-34d8e1758c00-service-ca-bundle\") pod \"router-default-7ff689d5-rr6lc\" (UID: \"79f2ade3-bf54-4290-bce9-34d8e1758c00\") " pod="openshift-ingress/router-default-7ff689d5-rr6lc"
Jul 02 20:33:39.929167 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:39.928804    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 20:33:39.929167 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:39.928851    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/79f2ade3-bf54-4290-bce9-34d8e1758c00-service-ca-bundle podName:79f2ade3-bf54-4290-bce9-34d8e1758c00 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:41.928832335 +0000 UTC m=+55.599345823 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/79f2ade3-bf54-4290-bce9-34d8e1758c00-service-ca-bundle") pod "router-default-7ff689d5-rr6lc" (UID: "79f2ade3-bf54-4290-bce9-34d8e1758c00") : configmap references non-existent config key: service-ca.crt
Jul 02 20:33:39.929167 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:39.928871    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79f2ade3-bf54-4290-bce9-34d8e1758c00-metrics-certs podName:79f2ade3-bf54-4290-bce9-34d8e1758c00 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:41.928862896 +0000 UTC m=+55.599376378 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79f2ade3-bf54-4290-bce9-34d8e1758c00-metrics-certs") pod "router-default-7ff689d5-rr6lc" (UID: "79f2ade3-bf54-4290-bce9-34d8e1758c00") : secret "router-metrics-certs-default" not found
Jul 02 20:33:41.944396 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:41.944367    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79f2ade3-bf54-4290-bce9-34d8e1758c00-metrics-certs\") pod \"router-default-7ff689d5-rr6lc\" (UID: \"79f2ade3-bf54-4290-bce9-34d8e1758c00\") " pod="openshift-ingress/router-default-7ff689d5-rr6lc"
Jul 02 20:33:41.944747 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:41.944421    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79f2ade3-bf54-4290-bce9-34d8e1758c00-service-ca-bundle\") pod \"router-default-7ff689d5-rr6lc\" (UID: \"79f2ade3-bf54-4290-bce9-34d8e1758c00\") " pod="openshift-ingress/router-default-7ff689d5-rr6lc"
Jul 02 20:33:41.944747 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:41.944519    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 20:33:41.944747 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:41.944543    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/79f2ade3-bf54-4290-bce9-34d8e1758c00-service-ca-bundle podName:79f2ade3-bf54-4290-bce9-34d8e1758c00 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:45.944525798 +0000 UTC m=+59.615039285 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/79f2ade3-bf54-4290-bce9-34d8e1758c00-service-ca-bundle") pod "router-default-7ff689d5-rr6lc" (UID: "79f2ade3-bf54-4290-bce9-34d8e1758c00") : configmap references non-existent config key: service-ca.crt
Jul 02 20:33:41.944747 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:41.944561    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79f2ade3-bf54-4290-bce9-34d8e1758c00-metrics-certs podName:79f2ade3-bf54-4290-bce9-34d8e1758c00 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:45.944551039 +0000 UTC m=+59.615064514 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79f2ade3-bf54-4290-bce9-34d8e1758c00-metrics-certs") pod "router-default-7ff689d5-rr6lc" (UID: "79f2ade3-bf54-4290-bce9-34d8e1758c00") : secret "router-metrics-certs-default" not found
Jul 02 20:33:42.337462 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:42.337430    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-p7g2c"]
Jul 02 20:33:42.339898 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:42.339882    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-p7g2c"
Jul 02 20:33:42.342950 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:42.342929    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 02 20:33:42.343796 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:42.343774    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 02 20:33:42.343920 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:42.343902    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 02 20:33:42.344034 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:42.344021    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 02 20:33:42.346112 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:42.346091    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kzdc8\""
Jul 02 20:33:42.347486 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:42.347461    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5034a174-b85c-4644-8e53-be58c8dd8b51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p7g2c\" (UID: \"5034a174-b85c-4644-8e53-be58c8dd8b51\") " pod="openshift-insights/insights-runtime-extractor-p7g2c"
Jul 02 20:33:42.347573 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:42.347514    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5034a174-b85c-4644-8e53-be58c8dd8b51-crio-socket\") pod \"insights-runtime-extractor-p7g2c\" (UID: \"5034a174-b85c-4644-8e53-be58c8dd8b51\") " pod="openshift-insights/insights-runtime-extractor-p7g2c"
Jul 02 20:33:42.347616 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:42.347594    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5034a174-b85c-4644-8e53-be58c8dd8b51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p7g2c\" (UID: \"5034a174-b85c-4644-8e53-be58c8dd8b51\") " pod="openshift-insights/insights-runtime-extractor-p7g2c"
Jul 02 20:33:42.347651 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:42.347624    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcwvq\" (UniqueName: \"kubernetes.io/projected/5034a174-b85c-4644-8e53-be58c8dd8b51-kube-api-access-rcwvq\") pod \"insights-runtime-extractor-p7g2c\" (UID: \"5034a174-b85c-4644-8e53-be58c8dd8b51\") " pod="openshift-insights/insights-runtime-extractor-p7g2c"
Jul 02 20:33:42.347696 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:42.347658    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5034a174-b85c-4644-8e53-be58c8dd8b51-data-volume\") pod \"insights-runtime-extractor-p7g2c\" (UID: \"5034a174-b85c-4644-8e53-be58c8dd8b51\") " pod="openshift-insights/insights-runtime-extractor-p7g2c"
Jul 02 20:33:42.368011 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:42.367991    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-p7g2c"]
Jul 02 20:33:42.390043 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:42.390012    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:42.448179 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:42.448134    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5034a174-b85c-4644-8e53-be58c8dd8b51-crio-socket\") pod \"insights-runtime-extractor-p7g2c\" (UID: \"5034a174-b85c-4644-8e53-be58c8dd8b51\") " pod="openshift-insights/insights-runtime-extractor-p7g2c"
Jul 02 20:33:42.448303 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:42.448190    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5034a174-b85c-4644-8e53-be58c8dd8b51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p7g2c\" (UID: \"5034a174-b85c-4644-8e53-be58c8dd8b51\") " pod="openshift-insights/insights-runtime-extractor-p7g2c"
Jul 02 20:33:42.448303 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:42.448210    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcwvq\" (UniqueName: \"kubernetes.io/projected/5034a174-b85c-4644-8e53-be58c8dd8b51-kube-api-access-rcwvq\") pod \"insights-runtime-extractor-p7g2c\" (UID: \"5034a174-b85c-4644-8e53-be58c8dd8b51\") " pod="openshift-insights/insights-runtime-extractor-p7g2c"
Jul 02 20:33:42.448303 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:42.448236    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5034a174-b85c-4644-8e53-be58c8dd8b51-data-volume\") pod \"insights-runtime-extractor-p7g2c\" (UID: \"5034a174-b85c-4644-8e53-be58c8dd8b51\") " pod="openshift-insights/insights-runtime-extractor-p7g2c"
Jul 02 20:33:42.448303 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:42.448265    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5034a174-b85c-4644-8e53-be58c8dd8b51-crio-socket\") pod \"insights-runtime-extractor-p7g2c\" (UID: \"5034a174-b85c-4644-8e53-be58c8dd8b51\") " pod="openshift-insights/insights-runtime-extractor-p7g2c"
Jul 02 20:33:42.448303 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:42.448285    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 20:33:42.448549 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:42.448320    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5034a174-b85c-4644-8e53-be58c8dd8b51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p7g2c\" (UID: \"5034a174-b85c-4644-8e53-be58c8dd8b51\") " pod="openshift-insights/insights-runtime-extractor-p7g2c"
Jul 02 20:33:42.448549 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:42.448347    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5034a174-b85c-4644-8e53-be58c8dd8b51-insights-runtime-extractor-tls podName:5034a174-b85c-4644-8e53-be58c8dd8b51 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:42.948331851 +0000 UTC m=+56.618845324 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5034a174-b85c-4644-8e53-be58c8dd8b51-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p7g2c" (UID: "5034a174-b85c-4644-8e53-be58c8dd8b51") : secret "insights-runtime-extractor-tls" not found
Jul 02 20:33:42.448549 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:42.448413    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 20:33:42.448549 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:42.448482    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5034a174-b85c-4644-8e53-be58c8dd8b51-kube-rbac-proxy-cm podName:5034a174-b85c-4644-8e53-be58c8dd8b51 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:42.948465087 +0000 UTC m=+56.618978558 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5034a174-b85c-4644-8e53-be58c8dd8b51-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p7g2c" (UID: "5034a174-b85c-4644-8e53-be58c8dd8b51") : configmap "kube-rbac-proxy" not found
Jul 02 20:33:42.448692 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:42.448574    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5034a174-b85c-4644-8e53-be58c8dd8b51-data-volume\") pod \"insights-runtime-extractor-p7g2c\" (UID: \"5034a174-b85c-4644-8e53-be58c8dd8b51\") " pod="openshift-insights/insights-runtime-extractor-p7g2c"
Jul 02 20:33:42.458124 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:42.458104    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcwvq\" (UniqueName: \"kubernetes.io/projected/5034a174-b85c-4644-8e53-be58c8dd8b51-kube-api-access-rcwvq\") pod \"insights-runtime-extractor-p7g2c\" (UID: \"5034a174-b85c-4644-8e53-be58c8dd8b51\") " pod="openshift-insights/insights-runtime-extractor-p7g2c"
Jul 02 20:33:42.500339 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:42.500318    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:42.953705 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:42.953674    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5034a174-b85c-4644-8e53-be58c8dd8b51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p7g2c\" (UID: \"5034a174-b85c-4644-8e53-be58c8dd8b51\") " pod="openshift-insights/insights-runtime-extractor-p7g2c"
Jul 02 20:33:42.954042 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:42.953741    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5034a174-b85c-4644-8e53-be58c8dd8b51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p7g2c\" (UID: \"5034a174-b85c-4644-8e53-be58c8dd8b51\") " pod="openshift-insights/insights-runtime-extractor-p7g2c"
Jul 02 20:33:42.954042 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:42.953789    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 20:33:42.954042 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:42.953863    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5034a174-b85c-4644-8e53-be58c8dd8b51-kube-rbac-proxy-cm podName:5034a174-b85c-4644-8e53-be58c8dd8b51 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:43.953850628 +0000 UTC m=+57.624364104 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5034a174-b85c-4644-8e53-be58c8dd8b51-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p7g2c" (UID: "5034a174-b85c-4644-8e53-be58c8dd8b51") : configmap "kube-rbac-proxy" not found
Jul 02 20:33:42.954042 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:42.953890    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 20:33:42.954042 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:42.953959    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5034a174-b85c-4644-8e53-be58c8dd8b51-insights-runtime-extractor-tls podName:5034a174-b85c-4644-8e53-be58c8dd8b51 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:43.953944105 +0000 UTC m=+57.624457583 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5034a174-b85c-4644-8e53-be58c8dd8b51-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p7g2c" (UID: "5034a174-b85c-4644-8e53-be58c8dd8b51") : secret "insights-runtime-extractor-tls" not found
Jul 02 20:33:43.960812 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:43.960772    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5034a174-b85c-4644-8e53-be58c8dd8b51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p7g2c\" (UID: \"5034a174-b85c-4644-8e53-be58c8dd8b51\") " pod="openshift-insights/insights-runtime-extractor-p7g2c"
Jul 02 20:33:43.961202 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:43.960841    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5034a174-b85c-4644-8e53-be58c8dd8b51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p7g2c\" (UID: \"5034a174-b85c-4644-8e53-be58c8dd8b51\") " pod="openshift-insights/insights-runtime-extractor-p7g2c"
Jul 02 20:33:43.961202 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:43.960893    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 20:33:43.961202 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:43.960936    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 20:33:43.961202 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:43.960956    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5034a174-b85c-4644-8e53-be58c8dd8b51-kube-rbac-proxy-cm podName:5034a174-b85c-4644-8e53-be58c8dd8b51 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:45.96094201 +0000 UTC m=+59.631455482 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5034a174-b85c-4644-8e53-be58c8dd8b51-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p7g2c" (UID: "5034a174-b85c-4644-8e53-be58c8dd8b51") : configmap "kube-rbac-proxy" not found
Jul 02 20:33:43.961202 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:43.960973    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5034a174-b85c-4644-8e53-be58c8dd8b51-insights-runtime-extractor-tls podName:5034a174-b85c-4644-8e53-be58c8dd8b51 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:45.960962225 +0000 UTC m=+59.631475695 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5034a174-b85c-4644-8e53-be58c8dd8b51-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p7g2c" (UID: "5034a174-b85c-4644-8e53-be58c8dd8b51") : secret "insights-runtime-extractor-tls" not found
Jul 02 20:33:44.308867 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:44.308794    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l6psk_b8214272-e568-4b9d-bc4e-dcb7f9f45e60/dns-node-resolver/0.log"
Jul 02 20:33:45.309739 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:45.309708    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nq8gr_8a38f5af-61e0-44a2-ba14-181ce7578683/node-ca/0.log"
Jul 02 20:33:45.909395 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:45.909368    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mhrst_e4fb5458-6e18-4869-b867-8eb520767a3c/serve-healthcheck-canary/0.log"
Jul 02 20:33:45.975384 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:45.975361    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79f2ade3-bf54-4290-bce9-34d8e1758c00-service-ca-bundle\") pod \"router-default-7ff689d5-rr6lc\" (UID: \"79f2ade3-bf54-4290-bce9-34d8e1758c00\") " pod="openshift-ingress/router-default-7ff689d5-rr6lc"
Jul 02 20:33:45.975467 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:45.975390    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5034a174-b85c-4644-8e53-be58c8dd8b51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p7g2c\" (UID: \"5034a174-b85c-4644-8e53-be58c8dd8b51\") " pod="openshift-insights/insights-runtime-extractor-p7g2c"
Jul 02 20:33:45.975505 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:45.975493    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 20:33:45.975537 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:45.975505    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/79f2ade3-bf54-4290-bce9-34d8e1758c00-service-ca-bundle podName:79f2ade3-bf54-4290-bce9-34d8e1758c00 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:53.975490922 +0000 UTC m=+67.646004394 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/79f2ade3-bf54-4290-bce9-34d8e1758c00-service-ca-bundle") pod "router-default-7ff689d5-rr6lc" (UID: "79f2ade3-bf54-4290-bce9-34d8e1758c00") : configmap references non-existent config key: service-ca.crt
Jul 02 20:33:45.975537 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:45.975536    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5034a174-b85c-4644-8e53-be58c8dd8b51-insights-runtime-extractor-tls podName:5034a174-b85c-4644-8e53-be58c8dd8b51 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:49.97552593 +0000 UTC m=+63.646039401 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5034a174-b85c-4644-8e53-be58c8dd8b51-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p7g2c" (UID: "5034a174-b85c-4644-8e53-be58c8dd8b51") : secret "insights-runtime-extractor-tls" not found
Jul 02 20:33:45.975614 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:45.975556    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79f2ade3-bf54-4290-bce9-34d8e1758c00-metrics-certs\") pod \"router-default-7ff689d5-rr6lc\" (UID: \"79f2ade3-bf54-4290-bce9-34d8e1758c00\") " pod="openshift-ingress/router-default-7ff689d5-rr6lc"
Jul 02 20:33:45.975614 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:45.975586    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5034a174-b85c-4644-8e53-be58c8dd8b51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p7g2c\" (UID: \"5034a174-b85c-4644-8e53-be58c8dd8b51\") " pod="openshift-insights/insights-runtime-extractor-p7g2c"
Jul 02 20:33:45.975678 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:45.975650    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 20:33:45.975707 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:45.975685    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5034a174-b85c-4644-8e53-be58c8dd8b51-kube-rbac-proxy-cm podName:5034a174-b85c-4644-8e53-be58c8dd8b51 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:49.975673825 +0000 UTC m=+63.646187303 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5034a174-b85c-4644-8e53-be58c8dd8b51-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p7g2c" (UID: "5034a174-b85c-4644-8e53-be58c8dd8b51") : configmap "kube-rbac-proxy" not found
Jul 02 20:33:45.975707 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:45.975695    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 20:33:45.975783 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:45.975750    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79f2ade3-bf54-4290-bce9-34d8e1758c00-metrics-certs podName:79f2ade3-bf54-4290-bce9-34d8e1758c00 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:53.975739109 +0000 UTC m=+67.646252581 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79f2ade3-bf54-4290-bce9-34d8e1758c00-metrics-certs") pod "router-default-7ff689d5-rr6lc" (UID: "79f2ade3-bf54-4290-bce9-34d8e1758c00") : secret "router-metrics-certs-default" not found
Jul 02 20:33:47.026884 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:47.026858    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rj8jc"
Jul 02 20:33:47.246920 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:47.246888    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:47.474393 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:47.474353    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:48.326489 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:48.326458    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8x7tn"]
Jul 02 20:33:48.328842 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:48.328825    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8x7tn"
Jul 02 20:33:48.334924 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:48.334899    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 02 20:33:48.336737 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:48.336717    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 02 20:33:48.336833 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:48.336717    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 02 20:33:48.336941 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:48.336921    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 02 20:33:48.337502 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:48.337487    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-cnr7z\""
Jul 02 20:33:48.357575 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:48.357554    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8x7tn"]
Jul 02 20:33:48.396954 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:48.396934    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6d7070e7-f559-4726-88f2-a72ddd851c49-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-8x7tn\" (UID: \"6d7070e7-f559-4726-88f2-a72ddd851c49\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8x7tn"
Jul 02 20:33:48.397042 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:48.397000    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhdpx\" (UniqueName: \"kubernetes.io/projected/6d7070e7-f559-4726-88f2-a72ddd851c49-kube-api-access-fhdpx\") pod \"kube-storage-version-migrator-operator-846bf668f7-8x7tn\" (UID: \"6d7070e7-f559-4726-88f2-a72ddd851c49\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8x7tn"
Jul 02 20:33:48.397114 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:48.397073    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6d7070e7-f559-4726-88f2-a72ddd851c49-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-8x7tn\" (UID: \"6d7070e7-f559-4726-88f2-a72ddd851c49\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8x7tn"
Jul 02 20:33:48.498402 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:48.498375    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhdpx\" (UniqueName: \"kubernetes.io/projected/6d7070e7-f559-4726-88f2-a72ddd851c49-kube-api-access-fhdpx\") pod \"kube-storage-version-migrator-operator-846bf668f7-8x7tn\" (UID: \"6d7070e7-f559-4726-88f2-a72ddd851c49\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8x7tn"
Jul 02 20:33:48.498499 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:48.498411    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6d7070e7-f559-4726-88f2-a72ddd851c49-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-8x7tn\" (UID: \"6d7070e7-f559-4726-88f2-a72ddd851c49\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8x7tn"
Jul 02 20:33:48.498623 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:48.498599    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6d7070e7-f559-4726-88f2-a72ddd851c49-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-8x7tn\" (UID: \"6d7070e7-f559-4726-88f2-a72ddd851c49\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8x7tn"
Jul 02 20:33:48.499059 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:48.499038    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6d7070e7-f559-4726-88f2-a72ddd851c49-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-8x7tn\" (UID: \"6d7070e7-f559-4726-88f2-a72ddd851c49\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8x7tn"
Jul 02 20:33:48.500448 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:48.500432    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6d7070e7-f559-4726-88f2-a72ddd851c49-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-8x7tn\" (UID: \"6d7070e7-f559-4726-88f2-a72ddd851c49\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8x7tn"
Jul 02 20:33:48.508335 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:48.508318    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhdpx\" (UniqueName: \"kubernetes.io/projected/6d7070e7-f559-4726-88f2-a72ddd851c49-kube-api-access-fhdpx\") pod \"kube-storage-version-migrator-operator-846bf668f7-8x7tn\" (UID: \"6d7070e7-f559-4726-88f2-a72ddd851c49\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8x7tn"
Jul 02 20:33:48.637565 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:48.637510    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8x7tn"
Jul 02 20:33:48.767283 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:48.767256    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8x7tn"]
Jul 02 20:33:48.770730 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:33:48.770702    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d7070e7_f559_4726_88f2_a72ddd851c49.slice/crio-b71bdbccc8a578d826fd791e49602a5247829e3ddf3de75bf768064a2edc8641 WatchSource:0}: Error finding container b71bdbccc8a578d826fd791e49602a5247829e3ddf3de75bf768064a2edc8641: Status 404 returned error can't find the container with id b71bdbccc8a578d826fd791e49602a5247829e3ddf3de75bf768064a2edc8641
Jul 02 20:33:49.094130 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:49.094097    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8x7tn" event={"ID":"6d7070e7-f559-4726-88f2-a72ddd851c49","Type":"ContainerStarted","Data":"b71bdbccc8a578d826fd791e49602a5247829e3ddf3de75bf768064a2edc8641"}
Jul 02 20:33:50.010430 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:50.010392    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5034a174-b85c-4644-8e53-be58c8dd8b51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p7g2c\" (UID: \"5034a174-b85c-4644-8e53-be58c8dd8b51\") " pod="openshift-insights/insights-runtime-extractor-p7g2c"
Jul 02 20:33:50.010805 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:50.010542    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 20:33:50.010805 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:50.010558    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5034a174-b85c-4644-8e53-be58c8dd8b51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p7g2c\" (UID: \"5034a174-b85c-4644-8e53-be58c8dd8b51\") " pod="openshift-insights/insights-runtime-extractor-p7g2c"
Jul 02 20:33:50.010805 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:50.010605    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5034a174-b85c-4644-8e53-be58c8dd8b51-insights-runtime-extractor-tls podName:5034a174-b85c-4644-8e53-be58c8dd8b51 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:58.010589114 +0000 UTC m=+71.681102585 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5034a174-b85c-4644-8e53-be58c8dd8b51-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p7g2c" (UID: "5034a174-b85c-4644-8e53-be58c8dd8b51") : secret "insights-runtime-extractor-tls" not found
Jul 02 20:33:50.010805 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:50.010635    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 20:33:50.010805 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:50.010689    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5034a174-b85c-4644-8e53-be58c8dd8b51-kube-rbac-proxy-cm podName:5034a174-b85c-4644-8e53-be58c8dd8b51 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:58.010673778 +0000 UTC m=+71.681187249 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5034a174-b85c-4644-8e53-be58c8dd8b51-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p7g2c" (UID: "5034a174-b85c-4644-8e53-be58c8dd8b51") : configmap "kube-rbac-proxy" not found
Jul 02 20:33:50.915660 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:50.915628    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:50.991722 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:50.991649    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:51.101450 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:51.101415    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8x7tn" event={"ID":"6d7070e7-f559-4726-88f2-a72ddd851c49","Type":"ContainerStarted","Data":"9e0234168eba3f733709b02f677b7c913076939685372d52a73a33a47761a1ee"}
Jul 02 20:33:51.118911 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:51.118862    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8x7tn" podStartSLOduration=1.1502503609999999 podStartE2EDuration="3.118849406s" totalImagesPullingTime="1.968599045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:33:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:51.118365587 +0000 UTC m=+64.788879083" watchObservedRunningTime="2026-07-02 20:33:51.118849406 +0000 UTC m=+64.789362899"
Jul 02 20:33:52.529272 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:52.529239    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea026958-5382-4357-ae6d-e52d6aa5f523-metrics-certs\") pod \"network-metrics-daemon-djb55\" (UID: \"ea026958-5382-4357-ae6d-e52d6aa5f523\") " pod="openshift-multus/network-metrics-daemon-djb55"
Jul 02 20:33:52.529696 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:52.529306    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/002584f1-ab2d-4938-976c-f61d553400c5-original-pull-secret\") pod \"global-pull-secret-syncer-57lmx\" (UID: \"002584f1-ab2d-4938-976c-f61d553400c5\") " pod="kube-system/global-pull-secret-syncer-57lmx"
Jul 02 20:33:52.532317 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:52.532291    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 20:33:52.532450 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:52.532433    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 20:33:52.539746 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:52.539728    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 02 20:33:52.539796 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:52.539781    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea026958-5382-4357-ae6d-e52d6aa5f523-metrics-certs podName:ea026958-5382-4357-ae6d-e52d6aa5f523 nodeName:}" failed. No retries permitted until 2026-07-02 20:34:56.539767173 +0000 UTC m=+130.210280647 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea026958-5382-4357-ae6d-e52d6aa5f523-metrics-certs") pod "network-metrics-daemon-djb55" (UID: "ea026958-5382-4357-ae6d-e52d6aa5f523") : secret "metrics-daemon-secret" not found
Jul 02 20:33:52.541946 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:52.541927    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/002584f1-ab2d-4938-976c-f61d553400c5-original-pull-secret\") pod \"global-pull-secret-syncer-57lmx\" (UID: \"002584f1-ab2d-4938-976c-f61d553400c5\") " pod="kube-system/global-pull-secret-syncer-57lmx"
Jul 02 20:33:52.584962 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:52.584938    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-57lmx"
Jul 02 20:33:52.630847 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:52.630486    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wcq8\" (UniqueName: \"kubernetes.io/projected/54276aec-aee7-4db9-8cee-f9858de9edb9-kube-api-access-2wcq8\") pod \"network-check-target-bfsnb\" (UID: \"54276aec-aee7-4db9-8cee-f9858de9edb9\") " pod="openshift-network-diagnostics/network-check-target-bfsnb"
Jul 02 20:33:52.634856 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:52.634835    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 02 20:33:52.644206 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:52.644167    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 02 20:33:52.654216 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:52.654194    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wcq8\" (UniqueName: \"kubernetes.io/projected/54276aec-aee7-4db9-8cee-f9858de9edb9-kube-api-access-2wcq8\") pod \"network-check-target-bfsnb\" (UID: \"54276aec-aee7-4db9-8cee-f9858de9edb9\") " pod="openshift-network-diagnostics/network-check-target-bfsnb"
Jul 02 20:33:52.710019 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:52.709992    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-57lmx"]
Jul 02 20:33:52.713066 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:33:52.713035    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod002584f1_ab2d_4938_976c_f61d553400c5.slice/crio-2965ca9afdffb991694be2c39d43aae655ea676f60456c43671e85b13ef32b35 WatchSource:0}: Error finding container 2965ca9afdffb991694be2c39d43aae655ea676f60456c43671e85b13ef32b35: Status 404 returned error can't find the container with id 2965ca9afdffb991694be2c39d43aae655ea676f60456c43671e85b13ef32b35
Jul 02 20:33:52.789604 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:52.789546    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2zr7q\""
Jul 02 20:33:52.797875 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:52.797853    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfsnb"
Jul 02 20:33:52.900869 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:52.900842    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:52.929163 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:52.929123    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bfsnb"]
Jul 02 20:33:52.933161 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:33:52.933116    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54276aec_aee7_4db9_8cee_f9858de9edb9.slice/crio-ebdbbabd9c2584a8e023c97e6f3e835523cba5d5cbe6f06fceb7b83329ff00f1 WatchSource:0}: Error finding container ebdbbabd9c2584a8e023c97e6f3e835523cba5d5cbe6f06fceb7b83329ff00f1: Status 404 returned error can't find the container with id ebdbbabd9c2584a8e023c97e6f3e835523cba5d5cbe6f06fceb7b83329ff00f1
Jul 02 20:33:53.000713 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:53.000687    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:53.032881 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:53.032860    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1896b78b-e154-4660-8457-6f3be984428d-metrics-tls\") pod \"dns-default-4tmlm\" (UID: \"1896b78b-e154-4660-8457-6f3be984428d\") " pod="openshift-dns/dns-default-4tmlm"
Jul 02 20:33:53.033011 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:53.032996    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 20:33:53.033063 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:53.033054    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1896b78b-e154-4660-8457-6f3be984428d-metrics-tls podName:1896b78b-e154-4660-8457-6f3be984428d nodeName:}" failed. No retries permitted until 2026-07-02 20:34:25.033036488 +0000 UTC m=+98.703549960 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1896b78b-e154-4660-8457-6f3be984428d-metrics-tls") pod "dns-default-4tmlm" (UID: "1896b78b-e154-4660-8457-6f3be984428d") : secret "dns-default-metrics-tls" not found
Jul 02 20:33:53.106587 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:53.106520    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-57lmx" event={"ID":"002584f1-ab2d-4938-976c-f61d553400c5","Type":"ContainerStarted","Data":"2965ca9afdffb991694be2c39d43aae655ea676f60456c43671e85b13ef32b35"}
Jul 02 20:33:53.107570 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:53.107549    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bfsnb" event={"ID":"54276aec-aee7-4db9-8cee-f9858de9edb9","Type":"ContainerStarted","Data":"ebdbbabd9c2584a8e023c97e6f3e835523cba5d5cbe6f06fceb7b83329ff00f1"}
Jul 02 20:33:53.181707 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:53.181680    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:53.251861 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:53.251833    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:53.607618 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:53.607584    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:53.672317 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:53.672285    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:53.875579 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:53.875505    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6bb7f74d8-9s75v"]
Jul 02 20:33:53.880199 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:53.880174    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bb7f74d8-9s75v"
Jul 02 20:33:53.882939 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:53.882916    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 02 20:33:53.883276 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:53.883253    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 02 20:33:53.883406 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:53.883388    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 02 20:33:53.883599 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:53.883584    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vjz5v\""
Jul 02 20:33:53.891873 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:53.890469    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 02 20:33:53.898434 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:53.897918    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bb7f74d8-9s75v"]
Jul 02 20:33:53.911468 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:53.911402    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:53.940916 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:53.940890    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-registry-certificates\") pod \"image-registry-6bb7f74d8-9s75v\" (UID: \"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c\") " pod="openshift-image-registry/image-registry-6bb7f74d8-9s75v"
Jul 02 20:33:53.941018 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:53.940932    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mw4t\" (UniqueName: \"kubernetes.io/projected/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-kube-api-access-6mw4t\") pod \"image-registry-6bb7f74d8-9s75v\" (UID: \"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c\") " pod="openshift-image-registry/image-registry-6bb7f74d8-9s75v"
Jul 02 20:33:53.941018 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:53.940959    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-trusted-ca\") pod \"image-registry-6bb7f74d8-9s75v\" (UID: \"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c\") " pod="openshift-image-registry/image-registry-6bb7f74d8-9s75v"
Jul 02 20:33:53.941018 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:53.940989    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-installation-pull-secrets\") pod \"image-registry-6bb7f74d8-9s75v\" (UID: \"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c\") " pod="openshift-image-registry/image-registry-6bb7f74d8-9s75v"
Jul 02 20:33:53.941223 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:53.941072    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-registry-tls\") pod \"image-registry-6bb7f74d8-9s75v\" (UID: \"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c\") " pod="openshift-image-registry/image-registry-6bb7f74d8-9s75v"
Jul 02 20:33:53.941223 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:53.941105    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-image-registry-private-configuration\") pod \"image-registry-6bb7f74d8-9s75v\" (UID: \"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c\") " pod="openshift-image-registry/image-registry-6bb7f74d8-9s75v"
Jul 02 20:33:53.941223 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:53.941133    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-ca-trust-extracted\") pod \"image-registry-6bb7f74d8-9s75v\" (UID: \"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c\") " pod="openshift-image-registry/image-registry-6bb7f74d8-9s75v"
Jul 02 20:33:53.941364 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:53.941228    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-bound-sa-token\") pod \"image-registry-6bb7f74d8-9s75v\" (UID: \"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c\") " pod="openshift-image-registry/image-registry-6bb7f74d8-9s75v"
Jul 02 20:33:53.990901 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:53.990868    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:54.042286 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:54.042253    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-image-registry-private-configuration\") pod \"image-registry-6bb7f74d8-9s75v\" (UID: \"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c\") " pod="openshift-image-registry/image-registry-6bb7f74d8-9s75v"
Jul 02 20:33:54.042286 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:54.042289    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-ca-trust-extracted\") pod \"image-registry-6bb7f74d8-9s75v\" (UID: \"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c\") " pod="openshift-image-registry/image-registry-6bb7f74d8-9s75v"
Jul 02 20:33:54.042508 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:54.042487    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79f2ade3-bf54-4290-bce9-34d8e1758c00-service-ca-bundle\") pod \"router-default-7ff689d5-rr6lc\" (UID: \"79f2ade3-bf54-4290-bce9-34d8e1758c00\") " pod="openshift-ingress/router-default-7ff689d5-rr6lc"
Jul 02 20:33:54.042582 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:54.042549    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-bound-sa-token\") pod \"image-registry-6bb7f74d8-9s75v\" (UID: \"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c\") " pod="openshift-image-registry/image-registry-6bb7f74d8-9s75v"
Jul 02 20:33:54.042645 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:54.042596    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-registry-certificates\") pod \"image-registry-6bb7f74d8-9s75v\" (UID: \"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c\") " pod="openshift-image-registry/image-registry-6bb7f74d8-9s75v"
Jul 02 20:33:54.042645 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:54.042634    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-ca-trust-extracted\") pod \"image-registry-6bb7f74d8-9s75v\" (UID: \"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c\") " pod="openshift-image-registry/image-registry-6bb7f74d8-9s75v"
Jul 02 20:33:54.042743 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:54.042638    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/79f2ade3-bf54-4290-bce9-34d8e1758c00-service-ca-bundle podName:79f2ade3-bf54-4290-bce9-34d8e1758c00 nodeName:}" failed. No retries permitted until 2026-07-02 20:34:10.042619167 +0000 UTC m=+83.713132642 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/79f2ade3-bf54-4290-bce9-34d8e1758c00-service-ca-bundle") pod "router-default-7ff689d5-rr6lc" (UID: "79f2ade3-bf54-4290-bce9-34d8e1758c00") : configmap references non-existent config key: service-ca.crt
Jul 02 20:33:54.042743 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:54.042675    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mw4t\" (UniqueName: \"kubernetes.io/projected/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-kube-api-access-6mw4t\") pod \"image-registry-6bb7f74d8-9s75v\" (UID: \"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c\") " pod="openshift-image-registry/image-registry-6bb7f74d8-9s75v"
Jul 02 20:33:54.042743 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:54.042705    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-trusted-ca\") pod \"image-registry-6bb7f74d8-9s75v\" (UID: \"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c\") " pod="openshift-image-registry/image-registry-6bb7f74d8-9s75v"
Jul 02 20:33:54.042743 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:54.042734    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-installation-pull-secrets\") pod \"image-registry-6bb7f74d8-9s75v\" (UID: \"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c\") " pod="openshift-image-registry/image-registry-6bb7f74d8-9s75v"
Jul 02 20:33:54.042930 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:54.042779    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79f2ade3-bf54-4290-bce9-34d8e1758c00-metrics-certs\") pod \"router-default-7ff689d5-rr6lc\" (UID: \"79f2ade3-bf54-4290-bce9-34d8e1758c00\") " pod="openshift-ingress/router-default-7ff689d5-rr6lc"
Jul 02 20:33:54.042930 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:54.042858    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-registry-tls\") pod \"image-registry-6bb7f74d8-9s75v\" (UID: \"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c\") " pod="openshift-image-registry/image-registry-6bb7f74d8-9s75v"
Jul 02 20:33:54.043007 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:54.042981    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 20:33:54.043007 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:54.042994    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bb7f74d8-9s75v: secret "image-registry-tls" not found
Jul 02 20:33:54.043083 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:54.043038    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-registry-tls podName:16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c nodeName:}" failed. No retries permitted until 2026-07-02 20:33:54.543022764 +0000 UTC m=+68.213536254 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-registry-tls") pod "image-registry-6bb7f74d8-9s75v" (UID: "16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c") : secret "image-registry-tls" not found
Jul 02 20:33:54.043189 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:54.043168    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-registry-certificates\") pod \"image-registry-6bb7f74d8-9s75v\" (UID: \"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c\") " pod="openshift-image-registry/image-registry-6bb7f74d8-9s75v"
Jul 02 20:33:54.043189 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:54.043182    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 20:33:54.043321 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:54.043252    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79f2ade3-bf54-4290-bce9-34d8e1758c00-metrics-certs podName:79f2ade3-bf54-4290-bce9-34d8e1758c00 nodeName:}" failed. No retries permitted until 2026-07-02 20:34:10.043233008 +0000 UTC m=+83.713746482 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79f2ade3-bf54-4290-bce9-34d8e1758c00-metrics-certs") pod "router-default-7ff689d5-rr6lc" (UID: "79f2ade3-bf54-4290-bce9-34d8e1758c00") : secret "router-metrics-certs-default" not found
Jul 02 20:33:54.043770 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:54.043751    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-trusted-ca\") pod \"image-registry-6bb7f74d8-9s75v\" (UID: \"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c\") " pod="openshift-image-registry/image-registry-6bb7f74d8-9s75v"
Jul 02 20:33:54.045082 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:54.045056    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-image-registry-private-configuration\") pod \"image-registry-6bb7f74d8-9s75v\" (UID: \"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c\") " pod="openshift-image-registry/image-registry-6bb7f74d8-9s75v"
Jul 02 20:33:54.045465 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:54.045444    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-installation-pull-secrets\") pod \"image-registry-6bb7f74d8-9s75v\" (UID: \"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c\") " pod="openshift-image-registry/image-registry-6bb7f74d8-9s75v"
Jul 02 20:33:54.054449 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:54.053245    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mw4t\" (UniqueName: \"kubernetes.io/projected/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-kube-api-access-6mw4t\") pod \"image-registry-6bb7f74d8-9s75v\" (UID: \"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c\") " pod="openshift-image-registry/image-registry-6bb7f74d8-9s75v"
Jul 02 20:33:54.055210 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:54.055190    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-bound-sa-token\") pod \"image-registry-6bb7f74d8-9s75v\" (UID: \"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c\") " pod="openshift-image-registry/image-registry-6bb7f74d8-9s75v"
Jul 02 20:33:54.062539 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:54.062508    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:54.547222 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:54.547189    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-registry-tls\") pod \"image-registry-6bb7f74d8-9s75v\" (UID: \"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c\") " pod="openshift-image-registry/image-registry-6bb7f74d8-9s75v"
Jul 02 20:33:54.547392 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:54.547328    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 20:33:54.547392 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:54.547341    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bb7f74d8-9s75v: secret "image-registry-tls" not found
Jul 02 20:33:54.547472 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:54.547408    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-registry-tls podName:16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c nodeName:}" failed. No retries permitted until 2026-07-02 20:33:55.547388249 +0000 UTC m=+69.217901734 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-registry-tls") pod "image-registry-6bb7f74d8-9s75v" (UID: "16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c") : secret "image-registry-tls" not found
Jul 02 20:33:55.521909 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:55.521879    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:55.553925 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:55.553886    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-registry-tls\") pod \"image-registry-6bb7f74d8-9s75v\" (UID: \"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c\") " pod="openshift-image-registry/image-registry-6bb7f74d8-9s75v"
Jul 02 20:33:55.554074 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:55.554008    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 20:33:55.554074 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:55.554020    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bb7f74d8-9s75v: secret "image-registry-tls" not found
Jul 02 20:33:55.554184 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:55.554090    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-registry-tls podName:16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c nodeName:}" failed. No retries permitted until 2026-07-02 20:33:57.554073742 +0000 UTC m=+71.224587213 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-registry-tls") pod "image-registry-6bb7f74d8-9s75v" (UID: "16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c") : secret "image-registry-tls" not found
Jul 02 20:33:55.593081 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:55.593051    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:56.200108 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:56.200071    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:56.300202 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:56.300173    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:56.700712 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:56.700673    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:57.569472 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:57.569450    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-registry-tls\") pod \"image-registry-6bb7f74d8-9s75v\" (UID: \"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c\") " pod="openshift-image-registry/image-registry-6bb7f74d8-9s75v"
Jul 02 20:33:57.569625 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:57.569592    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 20:33:57.569625 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:57.569608    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bb7f74d8-9s75v: secret "image-registry-tls" not found
Jul 02 20:33:57.569729 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:57.569655    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-registry-tls podName:16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c nodeName:}" failed. No retries permitted until 2026-07-02 20:34:01.569640833 +0000 UTC m=+75.240154321 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-registry-tls") pod "image-registry-6bb7f74d8-9s75v" (UID: "16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c") : secret "image-registry-tls" not found
Jul 02 20:33:58.074343 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:58.074301    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5034a174-b85c-4644-8e53-be58c8dd8b51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p7g2c\" (UID: \"5034a174-b85c-4644-8e53-be58c8dd8b51\") " pod="openshift-insights/insights-runtime-extractor-p7g2c"
Jul 02 20:33:58.074808 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:58.074433    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5034a174-b85c-4644-8e53-be58c8dd8b51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p7g2c\" (UID: \"5034a174-b85c-4644-8e53-be58c8dd8b51\") " pod="openshift-insights/insights-runtime-extractor-p7g2c"
Jul 02 20:33:58.074808 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:58.074440    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 20:33:58.074808 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:33:58.074549    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5034a174-b85c-4644-8e53-be58c8dd8b51-insights-runtime-extractor-tls podName:5034a174-b85c-4644-8e53-be58c8dd8b51 nodeName:}" failed. No retries permitted until 2026-07-02 20:34:14.074528324 +0000 UTC m=+87.745041798 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5034a174-b85c-4644-8e53-be58c8dd8b51-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p7g2c" (UID: "5034a174-b85c-4644-8e53-be58c8dd8b51") : secret "insights-runtime-extractor-tls" not found
Jul 02 20:33:58.074972 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:58.074822    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5034a174-b85c-4644-8e53-be58c8dd8b51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p7g2c\" (UID: \"5034a174-b85c-4644-8e53-be58c8dd8b51\") " pod="openshift-insights/insights-runtime-extractor-p7g2c"
Jul 02 20:33:58.121978 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:58.121943    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bfsnb" event={"ID":"54276aec-aee7-4db9-8cee-f9858de9edb9","Type":"ContainerStarted","Data":"ab286919bc248ed98958493bb0532cccc3bd2c5a001aa9d49f1c08d03d811efa"}
Jul 02 20:33:58.122126 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:58.122060    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bfsnb"
Jul 02 20:33:58.123337 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:58.123315    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-57lmx" event={"ID":"002584f1-ab2d-4938-976c-f61d553400c5","Type":"ContainerStarted","Data":"2867eae7eece1fed55c00e0a60f1e2ce1e32c35d10ab27e87cc5ac6af02d6d49"}
Jul 02 20:33:58.140353 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:58.140307    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bfsnb" podStartSLOduration=66.546618642 podStartE2EDuration="1m11.140291699s" totalImagesPullingTime="4.593673057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:32:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:58.139989851 +0000 UTC m=+71.810503344" watchObservedRunningTime="2026-07-02 20:33:58.140291699 +0000 UTC m=+71.810805193"
Jul 02 20:33:58.154721 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:58.154689    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-57lmx" podStartSLOduration=66.337511073 podStartE2EDuration="1m11.154678062s" totalImagesPullingTime="4.817166989s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:32:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:58.154322944 +0000 UTC m=+71.824836437" watchObservedRunningTime="2026-07-02 20:33:58.154678062 +0000 UTC m=+71.825191555"
Jul 02 20:33:58.913219 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:58.913188    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:59.014425 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:59.014394    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:59.115467 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:59.115424    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:59.216643 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:59.216614    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:59.287247 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:59.287214    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:33:59.815324 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:33:59.815298    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:00.219985 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:00.219955    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:00.282084 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:00.282058    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:01.034568 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:01.034531    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:01.210849 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:01.210814    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:01.417097 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:01.417015    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:01.600332 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:01.600301    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-registry-tls\") pod \"image-registry-6bb7f74d8-9s75v\" (UID: \"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c\") " pod="openshift-image-registry/image-registry-6bb7f74d8-9s75v"
Jul 02 20:34:01.600454 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:34:01.600441    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 20:34:01.600489 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:34:01.600456    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bb7f74d8-9s75v: secret "image-registry-tls" not found
Jul 02 20:34:01.600524 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:34:01.600511    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-registry-tls podName:16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c nodeName:}" failed. No retries permitted until 2026-07-02 20:34:09.60049253 +0000 UTC m=+83.271006002 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-registry-tls") pod "image-registry-6bb7f74d8-9s75v" (UID: "16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c") : secret "image-registry-tls" not found
Jul 02 20:34:01.816889 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:01.816852    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:02.312882 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:02.312855    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:02.411361 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:02.411324    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:02.601249 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:02.601171    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:02.804581 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:02.804552    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:03.203047 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:03.203010    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:03.260003 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:03.259971    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:03.607544 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:03.607513    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:04.004045 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:04.004013    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:04.211969 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:04.211937    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:04.813708 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:04.813676    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:05.208506 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:05.208415    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:05.278110 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:05.278082    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:05.609227 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:05.609188    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:05.818077 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:05.818026    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:06.244836 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:06.244803    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:07.015879 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:07.015848    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:07.210334 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:07.210290    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:07.608998 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:07.608965    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:07.791462 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:07.791433    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:07.892517 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:07.892439    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:07.993228 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:07.993198    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:08.071332 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:08.071302    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:08.211523 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:08.211493    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:08.808630 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:08.808598    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:09.211563 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:09.211538    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:09.412462 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:09.412434    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:09.613983 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:09.613909    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:09.656207 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:09.656184    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-registry-tls\") pod \"image-registry-6bb7f74d8-9s75v\" (UID: \"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c\") " pod="openshift-image-registry/image-registry-6bb7f74d8-9s75v"
Jul 02 20:34:09.658473 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:09.658453    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-registry-tls\") pod \"image-registry-6bb7f74d8-9s75v\" (UID: \"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c\") " pod="openshift-image-registry/image-registry-6bb7f74d8-9s75v"
Jul 02 20:34:09.793820 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:09.793800    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bb7f74d8-9s75v"
Jul 02 20:34:09.917063 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:09.917034    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bb7f74d8-9s75v"]
Jul 02 20:34:09.919916 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:34:09.919888    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16b3c4fd_b01e_4c8f_bb8c_e3fa4c719e2c.slice/crio-a0c612d0069f6ec4e7014edec8ff76e269d10466d9070fdbba361beecbdfdfd5 WatchSource:0}: Error finding container a0c612d0069f6ec4e7014edec8ff76e269d10466d9070fdbba361beecbdfdfd5: Status 404 returned error can't find the container with id a0c612d0069f6ec4e7014edec8ff76e269d10466d9070fdbba361beecbdfdfd5
Jul 02 20:34:10.059992 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:10.059959    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79f2ade3-bf54-4290-bce9-34d8e1758c00-service-ca-bundle\") pod \"router-default-7ff689d5-rr6lc\" (UID: \"79f2ade3-bf54-4290-bce9-34d8e1758c00\") " pod="openshift-ingress/router-default-7ff689d5-rr6lc"
Jul 02 20:34:10.060133 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:10.060048    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79f2ade3-bf54-4290-bce9-34d8e1758c00-metrics-certs\") pod \"router-default-7ff689d5-rr6lc\" (UID: \"79f2ade3-bf54-4290-bce9-34d8e1758c00\") " pod="openshift-ingress/router-default-7ff689d5-rr6lc"
Jul 02 20:34:10.060682 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:10.060645    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79f2ade3-bf54-4290-bce9-34d8e1758c00-service-ca-bundle\") pod \"router-default-7ff689d5-rr6lc\" (UID: \"79f2ade3-bf54-4290-bce9-34d8e1758c00\") " pod="openshift-ingress/router-default-7ff689d5-rr6lc"
Jul 02 20:34:10.062315 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:10.062294    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79f2ade3-bf54-4290-bce9-34d8e1758c00-metrics-certs\") pod \"router-default-7ff689d5-rr6lc\" (UID: \"79f2ade3-bf54-4290-bce9-34d8e1758c00\") " pod="openshift-ingress/router-default-7ff689d5-rr6lc"
Jul 02 20:34:10.126041 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:10.125954    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-t7pgl\""
Jul 02 20:34:10.134847 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:10.134816    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7ff689d5-rr6lc"
Jul 02 20:34:10.154003 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:10.153978    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bb7f74d8-9s75v" event={"ID":"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c","Type":"ContainerStarted","Data":"13be8799039f5cbb8fae90dfcfced8b08fb2a6ad3cf97fcb15184dba20987899"}
Jul 02 20:34:10.154118 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:10.154053    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bb7f74d8-9s75v" event={"ID":"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c","Type":"ContainerStarted","Data":"a0c612d0069f6ec4e7014edec8ff76e269d10466d9070fdbba361beecbdfdfd5"}
Jul 02 20:34:10.154206 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:10.154112    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6bb7f74d8-9s75v"
Jul 02 20:34:10.173613 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:10.173529    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6bb7f74d8-9s75v" podStartSLOduration=17.173512617 podStartE2EDuration="17.173512617s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:33:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:10.172841208 +0000 UTC m=+83.843354704" watchObservedRunningTime="2026-07-02 20:34:10.173512617 +0000 UTC m=+83.844026110"
Jul 02 20:34:10.258827 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:10.258732    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7ff689d5-rr6lc"]
Jul 02 20:34:10.261095 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:34:10.261066    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79f2ade3_bf54_4290_bce9_34d8e1758c00.slice/crio-ba44742ca449d2c0f46f9f231294a6f449123b6070a71f58c4b871a8720177ca WatchSource:0}: Error finding container ba44742ca449d2c0f46f9f231294a6f449123b6070a71f58c4b871a8720177ca: Status 404 returned error can't find the container with id ba44742ca449d2c0f46f9f231294a6f449123b6070a71f58c4b871a8720177ca
Jul 02 20:34:11.158104 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:11.158070    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7ff689d5-rr6lc" event={"ID":"79f2ade3-bf54-4290-bce9-34d8e1758c00","Type":"ContainerStarted","Data":"64a4d079ba133cf1f9fb0b80d88a850d675519d7e6a913dcb4b5ac5c3d9bd83c"}
Jul 02 20:34:11.158104 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:11.158120    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7ff689d5-rr6lc" event={"ID":"79f2ade3-bf54-4290-bce9-34d8e1758c00","Type":"ContainerStarted","Data":"ba44742ca449d2c0f46f9f231294a6f449123b6070a71f58c4b871a8720177ca"}
Jul 02 20:34:11.179098 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:11.179041    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7ff689d5-rr6lc" podStartSLOduration=33.179028092 podStartE2EDuration="33.179028092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:33:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:11.177167917 +0000 UTC m=+84.847681407" watchObservedRunningTime="2026-07-02 20:34:11.179028092 +0000 UTC m=+84.849541585"
Jul 02 20:34:12.030348 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:12.030318    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:12.130515 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:12.130480    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:12.135424 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:12.135401    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7ff689d5-rr6lc"
Jul 02 20:34:12.137479 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:12.137461    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7ff689d5-rr6lc"
Jul 02 20:34:12.163318 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:12.163289    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7ff689d5-rr6lc"
Jul 02 20:34:12.164376 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:12.164357    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7ff689d5-rr6lc"
Jul 02 20:34:12.339619 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:12.339550    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:12.707444 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:12.707361    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:12.807740 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:12.807709    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:13.036353 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:13.036326    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:13.139535 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:13.139500    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:13.235621 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:13.235589    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:13.525604 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:13.525577    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:13.621944 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:13.621911    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:13.726133 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:13.726102    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:13.823174 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:13.823087    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:13.934399 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:13.934368    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:14.047369 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:14.047340    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:14.090404 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:14.090337    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5034a174-b85c-4644-8e53-be58c8dd8b51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p7g2c\" (UID: \"5034a174-b85c-4644-8e53-be58c8dd8b51\") " pod="openshift-insights/insights-runtime-extractor-p7g2c"
Jul 02 20:34:14.092370 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:14.092351    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5034a174-b85c-4644-8e53-be58c8dd8b51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p7g2c\" (UID: \"5034a174-b85c-4644-8e53-be58c8dd8b51\") " pod="openshift-insights/insights-runtime-extractor-p7g2c"
Jul 02 20:34:14.152102 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:14.152078    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kzdc8\""
Jul 02 20:34:14.159286 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:14.159272    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-p7g2c"
Jul 02 20:34:14.284981 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:14.284951    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-p7g2c"]
Jul 02 20:34:14.288364 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:34:14.288338    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5034a174_b85c_4644_8e53_be58c8dd8b51.slice/crio-efd53a8a38dcb72ce8d04d40e6ffa5ed744e147dd8b8dc3011a6473ac9ce54ed WatchSource:0}: Error finding container efd53a8a38dcb72ce8d04d40e6ffa5ed744e147dd8b8dc3011a6473ac9ce54ed: Status 404 returned error can't find the container with id efd53a8a38dcb72ce8d04d40e6ffa5ed744e147dd8b8dc3011a6473ac9ce54ed
Jul 02 20:34:15.176426 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:15.176387    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p7g2c" event={"ID":"5034a174-b85c-4644-8e53-be58c8dd8b51","Type":"ContainerStarted","Data":"efd53a8a38dcb72ce8d04d40e6ffa5ed744e147dd8b8dc3011a6473ac9ce54ed"}
Jul 02 20:34:17.545609 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:17.545582    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-rblfw"]
Jul 02 20:34:17.548923 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:17.548901    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-rblfw"
Jul 02 20:34:17.558906 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:17.558881    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-fr499\""
Jul 02 20:34:17.558906 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:17.558897    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 02 20:34:17.560378 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:17.560358    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 02 20:34:17.562092 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:17.562069    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b4b8dcfc7-n5798"]
Jul 02 20:34:17.565266 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:17.565245    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b4b8dcfc7-n5798"
Jul 02 20:34:17.568390 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:17.568352    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 02 20:34:17.568390 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:17.568378    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 02 20:34:17.568390 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:17.568395    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 02 20:34:17.568706 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:17.568684    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 02 20:34:17.568859 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:17.568762    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 02 20:34:17.568960 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:17.568935    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 02 20:34:17.569032 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:17.568988    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 02 20:34:17.577107 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:17.577084    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-rblfw"]
Jul 02 20:34:17.581897 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:17.581877    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b4b8dcfc7-n5798"]
Jul 02 20:34:17.617681 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:17.617652    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6bb7f74d8-9s75v"]
Jul 02 20:34:17.619446 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:17.619426    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/636a9d41-86d4-473d-b6cf-9327ee3b4b5f-hub\") pod \"cluster-proxy-proxy-agent-5b4b8dcfc7-n5798\" (UID: \"636a9d41-86d4-473d-b6cf-9327ee3b4b5f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b4b8dcfc7-n5798"
Jul 02 20:34:17.619548 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:17.619498    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/636a9d41-86d4-473d-b6cf-9327ee3b4b5f-ca\") pod \"cluster-proxy-proxy-agent-5b4b8dcfc7-n5798\" (UID: \"636a9d41-86d4-473d-b6cf-9327ee3b4b5f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b4b8dcfc7-n5798"
Jul 02 20:34:17.619609 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:17.619563    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/52dd8318-3ebb-47ed-98ea-1d4e02bca006-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rblfw\" (UID: \"52dd8318-3ebb-47ed-98ea-1d4e02bca006\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rblfw"
Jul 02 20:34:17.619609 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:17.619586    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/636a9d41-86d4-473d-b6cf-9327ee3b4b5f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5b4b8dcfc7-n5798\" (UID: \"636a9d41-86d4-473d-b6cf-9327ee3b4b5f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b4b8dcfc7-n5798"
Jul 02 20:34:17.619716 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:17.619616    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/636a9d41-86d4-473d-b6cf-9327ee3b4b5f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5b4b8dcfc7-n5798\" (UID: \"636a9d41-86d4-473d-b6cf-9327ee3b4b5f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b4b8dcfc7-n5798"
Jul 02 20:34:17.619716 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:17.619690    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvbhn\" (UniqueName: \"kubernetes.io/projected/636a9d41-86d4-473d-b6cf-9327ee3b4b5f-kube-api-access-gvbhn\") pod \"cluster-proxy-proxy-agent-5b4b8dcfc7-n5798\" (UID: \"636a9d41-86d4-473d-b6cf-9327ee3b4b5f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b4b8dcfc7-n5798"
Jul 02 20:34:17.619822 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:17.619728    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/52dd8318-3ebb-47ed-98ea-1d4e02bca006-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-rblfw\" (UID: \"52dd8318-3ebb-47ed-98ea-1d4e02bca006\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rblfw"
Jul 02 20:34:17.619822 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:17.619767    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/636a9d41-86d4-473d-b6cf-9327ee3b4b5f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5b4b8dcfc7-n5798\" (UID: \"636a9d41-86d4-473d-b6cf-9327ee3b4b5f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b4b8dcfc7-n5798"
Jul 02 20:34:17.720308 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:17.720276    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/636a9d41-86d4-473d-b6cf-9327ee3b4b5f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5b4b8dcfc7-n5798\" (UID: \"636a9d41-86d4-473d-b6cf-9327ee3b4b5f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b4b8dcfc7-n5798"
Jul 02 20:34:17.720467 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:17.720391    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvbhn\" (UniqueName: \"kubernetes.io/projected/636a9d41-86d4-473d-b6cf-9327ee3b4b5f-kube-api-access-gvbhn\") pod \"cluster-proxy-proxy-agent-5b4b8dcfc7-n5798\" (UID: \"636a9d41-86d4-473d-b6cf-9327ee3b4b5f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b4b8dcfc7-n5798"
Jul 02 20:34:17.720467 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:17.720433    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/52dd8318-3ebb-47ed-98ea-1d4e02bca006-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-rblfw\" (UID: \"52dd8318-3ebb-47ed-98ea-1d4e02bca006\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rblfw"
Jul 02 20:34:17.720625 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:17.720582    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/636a9d41-86d4-473d-b6cf-9327ee3b4b5f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5b4b8dcfc7-n5798\" (UID: \"636a9d41-86d4-473d-b6cf-9327ee3b4b5f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b4b8dcfc7-n5798"
Jul 02 20:34:17.720722 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:17.720672    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/636a9d41-86d4-473d-b6cf-9327ee3b4b5f-hub\") pod \"cluster-proxy-proxy-agent-5b4b8dcfc7-n5798\" (UID: \"636a9d41-86d4-473d-b6cf-9327ee3b4b5f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b4b8dcfc7-n5798"
Jul 02 20:34:17.720804 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:17.720730    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/636a9d41-86d4-473d-b6cf-9327ee3b4b5f-ca\") pod \"cluster-proxy-proxy-agent-5b4b8dcfc7-n5798\" (UID: \"636a9d41-86d4-473d-b6cf-9327ee3b4b5f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b4b8dcfc7-n5798"
Jul 02 20:34:17.720804 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:17.720769    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/52dd8318-3ebb-47ed-98ea-1d4e02bca006-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rblfw\" (UID: \"52dd8318-3ebb-47ed-98ea-1d4e02bca006\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rblfw"
Jul 02 20:34:17.720804 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:17.720794    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/636a9d41-86d4-473d-b6cf-9327ee3b4b5f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5b4b8dcfc7-n5798\" (UID: \"636a9d41-86d4-473d-b6cf-9327ee3b4b5f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b4b8dcfc7-n5798"
Jul 02 20:34:17.721232 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:17.721208    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/52dd8318-3ebb-47ed-98ea-1d4e02bca006-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-rblfw\" (UID: \"52dd8318-3ebb-47ed-98ea-1d4e02bca006\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rblfw"
Jul 02 20:34:17.721391 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:17.721370    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/636a9d41-86d4-473d-b6cf-9327ee3b4b5f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5b4b8dcfc7-n5798\" (UID: \"636a9d41-86d4-473d-b6cf-9327ee3b4b5f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b4b8dcfc7-n5798"
Jul 02 20:34:17.723726 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:17.723702    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/636a9d41-86d4-473d-b6cf-9327ee3b4b5f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5b4b8dcfc7-n5798\" (UID: \"636a9d41-86d4-473d-b6cf-9327ee3b4b5f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b4b8dcfc7-n5798"
Jul 02 20:34:17.723888 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:17.723864    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/52dd8318-3ebb-47ed-98ea-1d4e02bca006-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rblfw\" (UID: \"52dd8318-3ebb-47ed-98ea-1d4e02bca006\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rblfw"
Jul 02 20:34:17.724003 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:17.723928    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/636a9d41-86d4-473d-b6cf-9327ee3b4b5f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5b4b8dcfc7-n5798\" (UID: \"636a9d41-86d4-473d-b6cf-9327ee3b4b5f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b4b8dcfc7-n5798"
Jul 02 20:34:17.724331 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:17.724311    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/636a9d41-86d4-473d-b6cf-9327ee3b4b5f-hub\") pod \"cluster-proxy-proxy-agent-5b4b8dcfc7-n5798\" (UID: \"636a9d41-86d4-473d-b6cf-9327ee3b4b5f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b4b8dcfc7-n5798"
Jul 02 20:34:17.724457 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:17.724440    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/636a9d41-86d4-473d-b6cf-9327ee3b4b5f-ca\") pod \"cluster-proxy-proxy-agent-5b4b8dcfc7-n5798\" (UID: \"636a9d41-86d4-473d-b6cf-9327ee3b4b5f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b4b8dcfc7-n5798"
Jul 02 20:34:17.730391 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:17.730347    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvbhn\" (UniqueName: \"kubernetes.io/projected/636a9d41-86d4-473d-b6cf-9327ee3b4b5f-kube-api-access-gvbhn\") pod \"cluster-proxy-proxy-agent-5b4b8dcfc7-n5798\" (UID: \"636a9d41-86d4-473d-b6cf-9327ee3b4b5f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b4b8dcfc7-n5798"
Jul 02 20:34:17.731737 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:17.731704    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:17.829843 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:17.829752    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:17.859004 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:17.858974    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-rblfw"
Jul 02 20:34:17.884510 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:17.884489    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b4b8dcfc7-n5798"
Jul 02 20:34:17.995544 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:17.995517    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-rblfw"]
Jul 02 20:34:18.000485 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:34:18.000454    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52dd8318_3ebb_47ed_98ea_1d4e02bca006.slice/crio-a0561ca55cd2858650d9dfac7a7550db4a0aa3f09d177efd63d5fb2d3ff7bfca WatchSource:0}: Error finding container a0561ca55cd2858650d9dfac7a7550db4a0aa3f09d177efd63d5fb2d3ff7bfca: Status 404 returned error can't find the container with id a0561ca55cd2858650d9dfac7a7550db4a0aa3f09d177efd63d5fb2d3ff7bfca
Jul 02 20:34:18.026069 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:18.026045    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b4b8dcfc7-n5798"]
Jul 02 20:34:18.029069 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:34:18.029046    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod636a9d41_86d4_473d_b6cf_9327ee3b4b5f.slice/crio-589f4ab6acc17bab3c61bf1698ede1f3e166ce21b5f64f049fba6945f5fdcc6b WatchSource:0}: Error finding container 589f4ab6acc17bab3c61bf1698ede1f3e166ce21b5f64f049fba6945f5fdcc6b: Status 404 returned error can't find the container with id 589f4ab6acc17bab3c61bf1698ede1f3e166ce21b5f64f049fba6945f5fdcc6b
Jul 02 20:34:18.186971 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:18.186911    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b4b8dcfc7-n5798" event={"ID":"636a9d41-86d4-473d-b6cf-9327ee3b4b5f","Type":"ContainerStarted","Data":"589f4ab6acc17bab3c61bf1698ede1f3e166ce21b5f64f049fba6945f5fdcc6b"}
Jul 02 20:34:18.188239 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:18.188206    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p7g2c" event={"ID":"5034a174-b85c-4644-8e53-be58c8dd8b51","Type":"ContainerStarted","Data":"d2e0cf1a212371ea37e82101085a5c9c781f1b73fc08f655f6325cdf07da8d26"}
Jul 02 20:34:18.189257 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:18.189234    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-rblfw" event={"ID":"52dd8318-3ebb-47ed-98ea-1d4e02bca006","Type":"ContainerStarted","Data":"a0561ca55cd2858650d9dfac7a7550db4a0aa3f09d177efd63d5fb2d3ff7bfca"}
Jul 02 20:34:19.196064 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:19.196025    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p7g2c" event={"ID":"5034a174-b85c-4644-8e53-be58c8dd8b51","Type":"ContainerStarted","Data":"4b352822dde6b74e25e148f5d05ca7d69c63e3f18479292a9ad38126d45badb7"}
Jul 02 20:34:20.201438 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:20.201330    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-rblfw" event={"ID":"52dd8318-3ebb-47ed-98ea-1d4e02bca006","Type":"ContainerStarted","Data":"1e468658359031beb2f80ea55e37dd3cc51d4b7721ec814752b3cebdf8dbef63"}
Jul 02 20:34:20.219276 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:20.218888    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-rblfw" podStartSLOduration=1.6225750460000001 podStartE2EDuration="3.218864921s" totalImagesPullingTime="1.596289875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:20.217966831 +0000 UTC m=+93.888480309" watchObservedRunningTime="2026-07-02 20:34:20.218864921 +0000 UTC m=+93.889378415"
Jul 02 20:34:20.328241 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:20.328202    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:20.428160 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:20.428106    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:21.222385 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:21.222349    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:21.307862 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:21.307828    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:21.503388 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:21.503308    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:22.210300 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:22.210267    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p7g2c" event={"ID":"5034a174-b85c-4644-8e53-be58c8dd8b51","Type":"ContainerStarted","Data":"bc9933e57bcb46d69f53e834567aaef0e4c45739b777ae17e0cab382a6e4083c"}
Jul 02 20:34:22.227725 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:22.227679    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-p7g2c" podStartSLOduration=32.887178757 podStartE2EDuration="40.227664101s" totalImagesPullingTime="7.340485344s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:33:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:22.226542303 +0000 UTC m=+95.897055796" watchObservedRunningTime="2026-07-02 20:34:22.227664101 +0000 UTC m=+95.898177594"
Jul 02 20:34:22.975671 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:22.975629    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:23.075971 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:23.075936    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:24.220416 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:24.220378    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b4b8dcfc7-n5798" event={"ID":"636a9d41-86d4-473d-b6cf-9327ee3b4b5f","Type":"ContainerStarted","Data":"664897ac799c9ee8bc1c76a2a6b8a920dae85ab721a6d7981025aa2f83b24d6c"}
Jul 02 20:34:24.220818 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:24.220425    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b4b8dcfc7-n5798" event={"ID":"636a9d41-86d4-473d-b6cf-9327ee3b4b5f","Type":"ContainerStarted","Data":"3962b756662dcec2323a8a569009f89624a1b58920d16183a947b2c5e87b21f0"}
Jul 02 20:34:24.220818 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:24.220442    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b4b8dcfc7-n5798" event={"ID":"636a9d41-86d4-473d-b6cf-9327ee3b4b5f","Type":"ContainerStarted","Data":"993a7061714b840c1657f67dad110e56f6d74028ed03aa0f5cbc3281db9075cc"}
Jul 02 20:34:24.242658 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:24.242608    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b4b8dcfc7-n5798" podStartSLOduration=1.41634207 podStartE2EDuration="7.242594193s" totalImagesPullingTime="5.826252123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:24.241843684 +0000 UTC m=+97.912357188" watchObservedRunningTime="2026-07-02 20:34:24.242594193 +0000 UTC m=+97.913107686"
Jul 02 20:34:24.577374 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:24.577288    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:25.082403 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:25.082368    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1896b78b-e154-4660-8457-6f3be984428d-metrics-tls\") pod \"dns-default-4tmlm\" (UID: \"1896b78b-e154-4660-8457-6f3be984428d\") " pod="openshift-dns/dns-default-4tmlm"
Jul 02 20:34:25.084605 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:25.084582    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1896b78b-e154-4660-8457-6f3be984428d-metrics-tls\") pod \"dns-default-4tmlm\" (UID: \"1896b78b-e154-4660-8457-6f3be984428d\") " pod="openshift-dns/dns-default-4tmlm"
Jul 02 20:34:25.343017 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:25.342939    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fwtcq\""
Jul 02 20:34:25.350620 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:25.350597    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4tmlm"
Jul 02 20:34:25.470878 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:25.470846    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4tmlm"]
Jul 02 20:34:25.473909 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:34:25.473871    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1896b78b_e154_4660_8457_6f3be984428d.slice/crio-686f15a2ed9ee2f684fc11b5c5ccd6cf229f9d0b5134e0298a7651375d8e80b3 WatchSource:0}: Error finding container 686f15a2ed9ee2f684fc11b5c5ccd6cf229f9d0b5134e0298a7651375d8e80b3: Status 404 returned error can't find the container with id 686f15a2ed9ee2f684fc11b5c5ccd6cf229f9d0b5134e0298a7651375d8e80b3
Jul 02 20:34:26.228412 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:26.228374    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4tmlm" event={"ID":"1896b78b-e154-4660-8457-6f3be984428d","Type":"ContainerStarted","Data":"686f15a2ed9ee2f684fc11b5c5ccd6cf229f9d0b5134e0298a7651375d8e80b3"}
Jul 02 20:34:26.371311 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:26.371264    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:26.592079 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:26.591984    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:26.658254 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:26.658131    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vpvxx"]
Jul 02 20:34:26.661626 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:26.661603    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vpvxx"
Jul 02 20:34:26.665010 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:26.664985    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 02 20:34:26.665150 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:26.665119    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 02 20:34:26.665219 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:26.665153    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 02 20:34:26.665305 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:26.665280    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 02 20:34:26.665723 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:26.665705    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 02 20:34:26.665851 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:26.665831    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 02 20:34:26.669897 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:26.669881    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2rvrc\""
Jul 02 20:34:26.722950 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:26.722908    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:26.794844 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:26.794811    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9be1c58b-679c-41a2-a221-00be6b9a82b5-node-exporter-textfile\") pod \"node-exporter-vpvxx\" (UID: \"9be1c58b-679c-41a2-a221-00be6b9a82b5\") " pod="openshift-monitoring/node-exporter-vpvxx"
Jul 02 20:34:26.794844 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:26.794845    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9be1c58b-679c-41a2-a221-00be6b9a82b5-node-exporter-wtmp\") pod \"node-exporter-vpvxx\" (UID: \"9be1c58b-679c-41a2-a221-00be6b9a82b5\") " pod="openshift-monitoring/node-exporter-vpvxx"
Jul 02 20:34:26.795075 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:26.794922    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9be1c58b-679c-41a2-a221-00be6b9a82b5-node-exporter-tls\") pod \"node-exporter-vpvxx\" (UID: \"9be1c58b-679c-41a2-a221-00be6b9a82b5\") " pod="openshift-monitoring/node-exporter-vpvxx"
Jul 02 20:34:26.795075 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:26.794978    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9be1c58b-679c-41a2-a221-00be6b9a82b5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vpvxx\" (UID: \"9be1c58b-679c-41a2-a221-00be6b9a82b5\") " pod="openshift-monitoring/node-exporter-vpvxx"
Jul 02 20:34:26.795075 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:26.795006    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4c4hn\" (UniqueName: \"kubernetes.io/projected/9be1c58b-679c-41a2-a221-00be6b9a82b5-kube-api-access-4c4hn\") pod \"node-exporter-vpvxx\" (UID: \"9be1c58b-679c-41a2-a221-00be6b9a82b5\") " pod="openshift-monitoring/node-exporter-vpvxx"
Jul 02 20:34:26.795075 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:26.795068    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9be1c58b-679c-41a2-a221-00be6b9a82b5-node-exporter-accelerators-collector-config\") pod \"node-exporter-vpvxx\" (UID: \"9be1c58b-679c-41a2-a221-00be6b9a82b5\") " pod="openshift-monitoring/node-exporter-vpvxx"
Jul 02 20:34:26.795345 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:26.795096    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9be1c58b-679c-41a2-a221-00be6b9a82b5-sys\") pod \"node-exporter-vpvxx\" (UID: \"9be1c58b-679c-41a2-a221-00be6b9a82b5\") " pod="openshift-monitoring/node-exporter-vpvxx"
Jul 02 20:34:26.795345 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:26.795160    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9be1c58b-679c-41a2-a221-00be6b9a82b5-root\") pod \"node-exporter-vpvxx\" (UID: \"9be1c58b-679c-41a2-a221-00be6b9a82b5\") " pod="openshift-monitoring/node-exporter-vpvxx"
Jul 02 20:34:26.795345 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:26.795188    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9be1c58b-679c-41a2-a221-00be6b9a82b5-metrics-client-ca\") pod \"node-exporter-vpvxx\" (UID: \"9be1c58b-679c-41a2-a221-00be6b9a82b5\") " pod="openshift-monitoring/node-exporter-vpvxx"
Jul 02 20:34:26.806453 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:26.806430    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:26.896410 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:26.896382    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9be1c58b-679c-41a2-a221-00be6b9a82b5-root\") pod \"node-exporter-vpvxx\" (UID: \"9be1c58b-679c-41a2-a221-00be6b9a82b5\") " pod="openshift-monitoring/node-exporter-vpvxx"
Jul 02 20:34:26.896529 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:26.896419    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9be1c58b-679c-41a2-a221-00be6b9a82b5-metrics-client-ca\") pod \"node-exporter-vpvxx\" (UID: \"9be1c58b-679c-41a2-a221-00be6b9a82b5\") " pod="openshift-monitoring/node-exporter-vpvxx"
Jul 02 20:34:26.896529 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:26.896453    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9be1c58b-679c-41a2-a221-00be6b9a82b5-root\") pod \"node-exporter-vpvxx\" (UID: \"9be1c58b-679c-41a2-a221-00be6b9a82b5\") " pod="openshift-monitoring/node-exporter-vpvxx"
Jul 02 20:34:26.896529 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:26.896476    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9be1c58b-679c-41a2-a221-00be6b9a82b5-node-exporter-textfile\") pod \"node-exporter-vpvxx\" (UID: \"9be1c58b-679c-41a2-a221-00be6b9a82b5\") " pod="openshift-monitoring/node-exporter-vpvxx"
Jul 02 20:34:26.896529 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:26.896500    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9be1c58b-679c-41a2-a221-00be6b9a82b5-node-exporter-wtmp\") pod \"node-exporter-vpvxx\" (UID: \"9be1c58b-679c-41a2-a221-00be6b9a82b5\") " pod="openshift-monitoring/node-exporter-vpvxx"
Jul 02 20:34:26.896730 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:26.896540    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9be1c58b-679c-41a2-a221-00be6b9a82b5-node-exporter-tls\") pod \"node-exporter-vpvxx\" (UID: \"9be1c58b-679c-41a2-a221-00be6b9a82b5\") " pod="openshift-monitoring/node-exporter-vpvxx"
Jul 02 20:34:26.896730 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:26.896568    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9be1c58b-679c-41a2-a221-00be6b9a82b5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vpvxx\" (UID: \"9be1c58b-679c-41a2-a221-00be6b9a82b5\") " pod="openshift-monitoring/node-exporter-vpvxx"
Jul 02 20:34:26.896730 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:26.896589    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4c4hn\" (UniqueName: \"kubernetes.io/projected/9be1c58b-679c-41a2-a221-00be6b9a82b5-kube-api-access-4c4hn\") pod \"node-exporter-vpvxx\" (UID: \"9be1c58b-679c-41a2-a221-00be6b9a82b5\") " pod="openshift-monitoring/node-exporter-vpvxx"
Jul 02 20:34:26.896730 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:26.896610    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9be1c58b-679c-41a2-a221-00be6b9a82b5-node-exporter-accelerators-collector-config\") pod \"node-exporter-vpvxx\" (UID: \"9be1c58b-679c-41a2-a221-00be6b9a82b5\") " pod="openshift-monitoring/node-exporter-vpvxx"
Jul 02 20:34:26.896730 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:26.896627    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9be1c58b-679c-41a2-a221-00be6b9a82b5-sys\") pod \"node-exporter-vpvxx\" (UID: \"9be1c58b-679c-41a2-a221-00be6b9a82b5\") " pod="openshift-monitoring/node-exporter-vpvxx"
Jul 02 20:34:26.896730 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:26.896682    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9be1c58b-679c-41a2-a221-00be6b9a82b5-node-exporter-wtmp\") pod \"node-exporter-vpvxx\" (UID: \"9be1c58b-679c-41a2-a221-00be6b9a82b5\") " pod="openshift-monitoring/node-exporter-vpvxx"
Jul 02 20:34:26.896730 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:26.896688    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9be1c58b-679c-41a2-a221-00be6b9a82b5-sys\") pod \"node-exporter-vpvxx\" (UID: \"9be1c58b-679c-41a2-a221-00be6b9a82b5\") " pod="openshift-monitoring/node-exporter-vpvxx"
Jul 02 20:34:26.897046 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:34:26.896777    2581 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 02 20:34:26.897046 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:26.896786    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9be1c58b-679c-41a2-a221-00be6b9a82b5-node-exporter-textfile\") pod \"node-exporter-vpvxx\" (UID: \"9be1c58b-679c-41a2-a221-00be6b9a82b5\") " pod="openshift-monitoring/node-exporter-vpvxx"
Jul 02 20:34:26.897046 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:34:26.896828    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9be1c58b-679c-41a2-a221-00be6b9a82b5-node-exporter-tls podName:9be1c58b-679c-41a2-a221-00be6b9a82b5 nodeName:}" failed. No retries permitted until 2026-07-02 20:34:27.396809507 +0000 UTC m=+101.067323006 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/9be1c58b-679c-41a2-a221-00be6b9a82b5-node-exporter-tls") pod "node-exporter-vpvxx" (UID: "9be1c58b-679c-41a2-a221-00be6b9a82b5") : secret "node-exporter-tls" not found
Jul 02 20:34:26.897046 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:26.897036    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9be1c58b-679c-41a2-a221-00be6b9a82b5-metrics-client-ca\") pod \"node-exporter-vpvxx\" (UID: \"9be1c58b-679c-41a2-a221-00be6b9a82b5\") " pod="openshift-monitoring/node-exporter-vpvxx"
Jul 02 20:34:26.897435 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:26.897411    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9be1c58b-679c-41a2-a221-00be6b9a82b5-node-exporter-accelerators-collector-config\") pod \"node-exporter-vpvxx\" (UID: \"9be1c58b-679c-41a2-a221-00be6b9a82b5\") " pod="openshift-monitoring/node-exporter-vpvxx"
Jul 02 20:34:26.899325 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:26.899303    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9be1c58b-679c-41a2-a221-00be6b9a82b5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vpvxx\" (UID: \"9be1c58b-679c-41a2-a221-00be6b9a82b5\") " pod="openshift-monitoring/node-exporter-vpvxx"
Jul 02 20:34:26.906520 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:26.906491    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:26.907533 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:26.907517    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4c4hn\" (UniqueName: \"kubernetes.io/projected/9be1c58b-679c-41a2-a221-00be6b9a82b5-kube-api-access-4c4hn\") pod \"node-exporter-vpvxx\" (UID: \"9be1c58b-679c-41a2-a221-00be6b9a82b5\") " pod="openshift-monitoring/node-exporter-vpvxx"
Jul 02 20:34:27.015252 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:27.015200    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:27.212737 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:27.212702    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:27.232916 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:27.232887    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4tmlm" event={"ID":"1896b78b-e154-4660-8457-6f3be984428d","Type":"ContainerStarted","Data":"8d78c83430f50e17a6f478f5090b6470514273c98eaa7fdcc38e9e619f0e67ca"}
Jul 02 20:34:27.233044 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:27.232942    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4tmlm" event={"ID":"1896b78b-e154-4660-8457-6f3be984428d","Type":"ContainerStarted","Data":"adeb3e0744a3e8c0bad689840b1a9a8212053bfd3a823623eed5e04de2a8d0e2"}
Jul 02 20:34:27.233044 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:27.233011    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4tmlm"
Jul 02 20:34:27.249744 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:27.249686    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4tmlm" podStartSLOduration=64.868469368 podStartE2EDuration="1m6.24967009s" totalImagesPullingTime="1.381200722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:33:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:27.249496064 +0000 UTC m=+100.920009557" watchObservedRunningTime="2026-07-02 20:34:27.24967009 +0000 UTC m=+100.920183584"
Jul 02 20:34:27.314829 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:27.314803    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:27.400884 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:27.400853    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9be1c58b-679c-41a2-a221-00be6b9a82b5-node-exporter-tls\") pod \"node-exporter-vpvxx\" (UID: \"9be1c58b-679c-41a2-a221-00be6b9a82b5\") " pod="openshift-monitoring/node-exporter-vpvxx"
Jul 02 20:34:27.403109 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:27.403086    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9be1c58b-679c-41a2-a221-00be6b9a82b5-node-exporter-tls\") pod \"node-exporter-vpvxx\" (UID: \"9be1c58b-679c-41a2-a221-00be6b9a82b5\") " pod="openshift-monitoring/node-exporter-vpvxx"
Jul 02 20:34:27.572254 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:27.572181    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vpvxx"
Jul 02 20:34:27.581920 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:34:27.581899    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9be1c58b_679c_41a2_a221_00be6b9a82b5.slice/crio-9ccd4251e9005418bc669c0639aac8dd7ee00a571519b78edddb54832215d3fd WatchSource:0}: Error finding container 9ccd4251e9005418bc669c0639aac8dd7ee00a571519b78edddb54832215d3fd: Status 404 returned error can't find the container with id 9ccd4251e9005418bc669c0639aac8dd7ee00a571519b78edddb54832215d3fd
Jul 02 20:34:27.596787 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:27.596761    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:27.627181 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:27.627165    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6bb7f74d8-9s75v"
Jul 02 20:34:27.696312 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:27.696283    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:27.771083 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:27.771055    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:28.237126 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:28.237095    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vpvxx" event={"ID":"9be1c58b-679c-41a2-a221-00be6b9a82b5","Type":"ContainerStarted","Data":"9ccd4251e9005418bc669c0639aac8dd7ee00a571519b78edddb54832215d3fd"}
Jul 02 20:34:28.551029 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:28.550948    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:29.031039 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:29.031014    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:29.128459 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:29.128428    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bfsnb"
Jul 02 20:34:29.130386 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:29.130361    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:29.242310 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:29.242282    2581 generic.go:356] "Generic (PLEG): container finished" podID="9be1c58b-679c-41a2-a221-00be6b9a82b5" containerID="d80e95b11f22c827c82ec85a6c954609b4bd4527964fa45e94cba6cc830cb98b" exitCode=0
Jul 02 20:34:29.242452 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:29.242349    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vpvxx" event={"ID":"9be1c58b-679c-41a2-a221-00be6b9a82b5","Type":"ContainerDied","Data":"d80e95b11f22c827c82ec85a6c954609b4bd4527964fa45e94cba6cc830cb98b"}
Jul 02 20:34:29.549319 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:29.549245    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:29.648361 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:29.648318    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:29.760045 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:29.760013    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:29.864373 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:29.864302    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:30.247992 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:30.247956    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vpvxx" event={"ID":"9be1c58b-679c-41a2-a221-00be6b9a82b5","Type":"ContainerStarted","Data":"54c0b681d05610fdc30e390d3c5d60f68a38a179033ad7298a3e6896056a4e88"}
Jul 02 20:34:30.248203 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:30.248008    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vpvxx" event={"ID":"9be1c58b-679c-41a2-a221-00be6b9a82b5","Type":"ContainerStarted","Data":"74b8b603afb0d8873b04a478df61defe85e37c01a4adbd940babc23521e4bebc"}
Jul 02 20:34:30.267773 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:30.267728    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vpvxx" podStartSLOduration=2.840980878 podStartE2EDuration="4.267713278s" totalImagesPullingTime="1.337076174s" totalInitContainerRuntime="89.656226ms" isStatefulPod=true podCreationTimestamp="2026-07-02 20:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:30.267320055 +0000 UTC m=+103.937833548" watchObservedRunningTime="2026-07-02 20:34:30.267713278 +0000 UTC m=+103.938226770"
Jul 02 20:34:31.103823 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:31.103788    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:31.184993 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:31.184943    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:31.394970 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:31.394865    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:31.473271 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:31.473242    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:31.817988 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:31.817938    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:32.808157 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:32.808106    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:37.239564 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:37.239537    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4tmlm"
Jul 02 20:34:39.348172 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:39.348115    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:39.404673 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:39.404636    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:40.116750 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:40.116717    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:40.214075 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:40.214041    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:40.272081 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:40.272045    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:41.460537 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:41.460508    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:41.590336 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:41.590303    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:41.688811 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:41.688777    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:42.182241 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:42.182205    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:42.276630 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:42.276593    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:42.640098 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:42.640055    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6bb7f74d8-9s75v" podUID="16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c" containerName="registry" containerID="cri-o://13be8799039f5cbb8fae90dfcfced8b08fb2a6ad3cf97fcb15184dba20987899" gracePeriod=30
Jul 02 20:34:42.878528 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:42.878509    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bb7f74d8-9s75v"
Jul 02 20:34:42.920132 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:42.920073    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-registry-tls\") pod \"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c\" (UID: \"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c\") "
Jul 02 20:34:42.920132 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:42.920110    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-bound-sa-token\") pod \"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c\" (UID: \"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c\") "
Jul 02 20:34:42.920132 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:42.920130    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-registry-certificates\") pod \"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c\" (UID: \"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c\") "
Jul 02 20:34:42.920380 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:42.920190    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-trusted-ca\") pod \"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c\" (UID: \"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c\") "
Jul 02 20:34:42.920380 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:42.920231    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mw4t\" (UniqueName: \"kubernetes.io/projected/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-kube-api-access-6mw4t\") pod \"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c\" (UID: \"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c\") "
Jul 02 20:34:42.920380 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:42.920273    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-image-registry-private-configuration\") pod \"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c\" (UID: \"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c\") "
Jul 02 20:34:42.920380 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:42.920299    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-installation-pull-secrets\") pod \"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c\" (UID: \"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c\") "
Jul 02 20:34:42.920380 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:42.920339    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-ca-trust-extracted\") pod \"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c\" (UID: \"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c\") "
Jul 02 20:34:42.920800 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:42.920765    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c" (UID: "16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:34:42.920800 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:42.920776    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c" (UID: "16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:34:42.922505 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:42.922466    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c" (UID: "16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:34:42.922816 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:42.922791    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c" (UID: "16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:34:42.922911 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:42.922888    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-kube-api-access-6mw4t" (OuterVolumeSpecName: "kube-api-access-6mw4t") pod "16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c" (UID: "16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c"). InnerVolumeSpecName "kube-api-access-6mw4t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:34:42.923060 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:42.923038    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c" (UID: "16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:34:42.923167 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:42.923115    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c" (UID: "16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:34:42.928729 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:42.928709    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c" (UID: "16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:34:43.021024 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.021002    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-trusted-ca\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:34:43.021024 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.021022    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mw4t\" (UniqueName: \"kubernetes.io/projected/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-kube-api-access-6mw4t\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:34:43.021158 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.021032    2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-image-registry-private-configuration\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:34:43.021158 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.021041    2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-installation-pull-secrets\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:34:43.021158 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.021049    2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-ca-trust-extracted\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:34:43.021158 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.021057    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-registry-tls\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:34:43.021158 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.021064    2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-bound-sa-token\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:34:43.021158 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.021072    2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c-registry-certificates\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:34:43.235200 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.235169    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f5ddb6477-zh82b"]
Jul 02 20:34:43.235401 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.235388    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c" containerName="registry"
Jul 02 20:34:43.235449 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.235403    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c" containerName="registry"
Jul 02 20:34:43.235483 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.235449    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c" containerName="registry"
Jul 02 20:34:43.238809 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.238788    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f5ddb6477-zh82b"
Jul 02 20:34:43.241450 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.241403    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 02 20:34:43.241450 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.241409    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 02 20:34:43.241607 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.241471    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8lhlp\""
Jul 02 20:34:43.241607 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.241413    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 02 20:34:43.242263 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.242247    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 02 20:34:43.242353 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.242285    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 02 20:34:43.242353 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.242318    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 02 20:34:43.242593 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.242567    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 02 20:34:43.248316 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.247707    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 02 20:34:43.252338 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.250064    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f5ddb6477-zh82b"]
Jul 02 20:34:43.289503 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.289474    2581 generic.go:356] "Generic (PLEG): container finished" podID="16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c" containerID="13be8799039f5cbb8fae90dfcfced8b08fb2a6ad3cf97fcb15184dba20987899" exitCode=0
Jul 02 20:34:43.289591 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.289522    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bb7f74d8-9s75v"
Jul 02 20:34:43.289591 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.289553    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bb7f74d8-9s75v" event={"ID":"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c","Type":"ContainerDied","Data":"13be8799039f5cbb8fae90dfcfced8b08fb2a6ad3cf97fcb15184dba20987899"}
Jul 02 20:34:43.289664 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.289589    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bb7f74d8-9s75v" event={"ID":"16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c","Type":"ContainerDied","Data":"a0c612d0069f6ec4e7014edec8ff76e269d10466d9070fdbba361beecbdfdfd5"}
Jul 02 20:34:43.289664 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.289612    2581 scope.go:117] "RemoveContainer" containerID="13be8799039f5cbb8fae90dfcfced8b08fb2a6ad3cf97fcb15184dba20987899"
Jul 02 20:34:43.297707 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.297693    2581 scope.go:117] "RemoveContainer" containerID="13be8799039f5cbb8fae90dfcfced8b08fb2a6ad3cf97fcb15184dba20987899"
Jul 02 20:34:43.297983 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:34:43.297964    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13be8799039f5cbb8fae90dfcfced8b08fb2a6ad3cf97fcb15184dba20987899\": container with ID starting with 13be8799039f5cbb8fae90dfcfced8b08fb2a6ad3cf97fcb15184dba20987899 not found: ID does not exist" containerID="13be8799039f5cbb8fae90dfcfced8b08fb2a6ad3cf97fcb15184dba20987899"
Jul 02 20:34:43.298034 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.297991    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13be8799039f5cbb8fae90dfcfced8b08fb2a6ad3cf97fcb15184dba20987899"} err="failed to get container status \"13be8799039f5cbb8fae90dfcfced8b08fb2a6ad3cf97fcb15184dba20987899\": rpc error: code = NotFound desc = could not find container \"13be8799039f5cbb8fae90dfcfced8b08fb2a6ad3cf97fcb15184dba20987899\": container with ID starting with 13be8799039f5cbb8fae90dfcfced8b08fb2a6ad3cf97fcb15184dba20987899 not found: ID does not exist"
Jul 02 20:34:43.309203 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.309179    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6bb7f74d8-9s75v"]
Jul 02 20:34:43.313518 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.313501    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6bb7f74d8-9s75v"]
Jul 02 20:34:43.322715 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.322691    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcqv7\" (UniqueName: \"kubernetes.io/projected/a9f763dd-24c0-4ce3-9892-6b80640ca9c8-kube-api-access-pcqv7\") pod \"console-6f5ddb6477-zh82b\" (UID: \"a9f763dd-24c0-4ce3-9892-6b80640ca9c8\") " pod="openshift-console/console-6f5ddb6477-zh82b"
Jul 02 20:34:43.322782 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.322732    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9f763dd-24c0-4ce3-9892-6b80640ca9c8-trusted-ca-bundle\") pod \"console-6f5ddb6477-zh82b\" (UID: \"a9f763dd-24c0-4ce3-9892-6b80640ca9c8\") " pod="openshift-console/console-6f5ddb6477-zh82b"
Jul 02 20:34:43.322782 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.322750    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a9f763dd-24c0-4ce3-9892-6b80640ca9c8-console-serving-cert\") pod \"console-6f5ddb6477-zh82b\" (UID: \"a9f763dd-24c0-4ce3-9892-6b80640ca9c8\") " pod="openshift-console/console-6f5ddb6477-zh82b"
Jul 02 20:34:43.322782 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.322768    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a9f763dd-24c0-4ce3-9892-6b80640ca9c8-console-oauth-config\") pod \"console-6f5ddb6477-zh82b\" (UID: \"a9f763dd-24c0-4ce3-9892-6b80640ca9c8\") " pod="openshift-console/console-6f5ddb6477-zh82b"
Jul 02 20:34:43.322879 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.322792    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a9f763dd-24c0-4ce3-9892-6b80640ca9c8-service-ca\") pod \"console-6f5ddb6477-zh82b\" (UID: \"a9f763dd-24c0-4ce3-9892-6b80640ca9c8\") " pod="openshift-console/console-6f5ddb6477-zh82b"
Jul 02 20:34:43.322879 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.322865    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a9f763dd-24c0-4ce3-9892-6b80640ca9c8-console-config\") pod \"console-6f5ddb6477-zh82b\" (UID: \"a9f763dd-24c0-4ce3-9892-6b80640ca9c8\") " pod="openshift-console/console-6f5ddb6477-zh82b"
Jul 02 20:34:43.322954 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.322940    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a9f763dd-24c0-4ce3-9892-6b80640ca9c8-oauth-serving-cert\") pod \"console-6f5ddb6477-zh82b\" (UID: \"a9f763dd-24c0-4ce3-9892-6b80640ca9c8\") " pod="openshift-console/console-6f5ddb6477-zh82b"
Jul 02 20:34:43.424054 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.424025    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcqv7\" (UniqueName: \"kubernetes.io/projected/a9f763dd-24c0-4ce3-9892-6b80640ca9c8-kube-api-access-pcqv7\") pod \"console-6f5ddb6477-zh82b\" (UID: \"a9f763dd-24c0-4ce3-9892-6b80640ca9c8\") " pod="openshift-console/console-6f5ddb6477-zh82b"
Jul 02 20:34:43.424185 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.424067    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9f763dd-24c0-4ce3-9892-6b80640ca9c8-trusted-ca-bundle\") pod \"console-6f5ddb6477-zh82b\" (UID: \"a9f763dd-24c0-4ce3-9892-6b80640ca9c8\") " pod="openshift-console/console-6f5ddb6477-zh82b"
Jul 02 20:34:43.424185 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.424084    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a9f763dd-24c0-4ce3-9892-6b80640ca9c8-console-serving-cert\") pod \"console-6f5ddb6477-zh82b\" (UID: \"a9f763dd-24c0-4ce3-9892-6b80640ca9c8\") " pod="openshift-console/console-6f5ddb6477-zh82b"
Jul 02 20:34:43.424185 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.424101    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a9f763dd-24c0-4ce3-9892-6b80640ca9c8-console-oauth-config\") pod \"console-6f5ddb6477-zh82b\" (UID: \"a9f763dd-24c0-4ce3-9892-6b80640ca9c8\") " pod="openshift-console/console-6f5ddb6477-zh82b"
Jul 02 20:34:43.424185 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.424115    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a9f763dd-24c0-4ce3-9892-6b80640ca9c8-service-ca\") pod \"console-6f5ddb6477-zh82b\" (UID: \"a9f763dd-24c0-4ce3-9892-6b80640ca9c8\") " pod="openshift-console/console-6f5ddb6477-zh82b"
Jul 02 20:34:43.424185 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.424132    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a9f763dd-24c0-4ce3-9892-6b80640ca9c8-console-config\") pod \"console-6f5ddb6477-zh82b\" (UID: \"a9f763dd-24c0-4ce3-9892-6b80640ca9c8\") " pod="openshift-console/console-6f5ddb6477-zh82b"
Jul 02 20:34:43.424185 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.424182    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a9f763dd-24c0-4ce3-9892-6b80640ca9c8-oauth-serving-cert\") pod \"console-6f5ddb6477-zh82b\" (UID: \"a9f763dd-24c0-4ce3-9892-6b80640ca9c8\") " pod="openshift-console/console-6f5ddb6477-zh82b"
Jul 02 20:34:43.424824 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.424803    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a9f763dd-24c0-4ce3-9892-6b80640ca9c8-service-ca\") pod \"console-6f5ddb6477-zh82b\" (UID: \"a9f763dd-24c0-4ce3-9892-6b80640ca9c8\") " pod="openshift-console/console-6f5ddb6477-zh82b"
Jul 02 20:34:43.424910 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.424859    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a9f763dd-24c0-4ce3-9892-6b80640ca9c8-oauth-serving-cert\") pod \"console-6f5ddb6477-zh82b\" (UID: \"a9f763dd-24c0-4ce3-9892-6b80640ca9c8\") " pod="openshift-console/console-6f5ddb6477-zh82b"
Jul 02 20:34:43.425056 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.425034    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a9f763dd-24c0-4ce3-9892-6b80640ca9c8-console-config\") pod \"console-6f5ddb6477-zh82b\" (UID: \"a9f763dd-24c0-4ce3-9892-6b80640ca9c8\") " pod="openshift-console/console-6f5ddb6477-zh82b"
Jul 02 20:34:43.425117 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.425034    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9f763dd-24c0-4ce3-9892-6b80640ca9c8-trusted-ca-bundle\") pod \"console-6f5ddb6477-zh82b\" (UID: \"a9f763dd-24c0-4ce3-9892-6b80640ca9c8\") " pod="openshift-console/console-6f5ddb6477-zh82b"
Jul 02 20:34:43.426493 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.426464    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a9f763dd-24c0-4ce3-9892-6b80640ca9c8-console-oauth-config\") pod \"console-6f5ddb6477-zh82b\" (UID: \"a9f763dd-24c0-4ce3-9892-6b80640ca9c8\") " pod="openshift-console/console-6f5ddb6477-zh82b"
Jul 02 20:34:43.426633 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.426614    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a9f763dd-24c0-4ce3-9892-6b80640ca9c8-console-serving-cert\") pod \"console-6f5ddb6477-zh82b\" (UID: \"a9f763dd-24c0-4ce3-9892-6b80640ca9c8\") " pod="openshift-console/console-6f5ddb6477-zh82b"
Jul 02 20:34:43.432028 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.432010    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcqv7\" (UniqueName: \"kubernetes.io/projected/a9f763dd-24c0-4ce3-9892-6b80640ca9c8-kube-api-access-pcqv7\") pod \"console-6f5ddb6477-zh82b\" (UID: \"a9f763dd-24c0-4ce3-9892-6b80640ca9c8\") " pod="openshift-console/console-6f5ddb6477-zh82b"
Jul 02 20:34:43.550781 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.550734    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f5ddb6477-zh82b"
Jul 02 20:34:43.669732 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:43.669702    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f5ddb6477-zh82b"]
Jul 02 20:34:43.672944 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:34:43.672921    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9f763dd_24c0_4ce3_9892_6b80640ca9c8.slice/crio-897a4aa2db8b44fb7239bda2ebc27e33fdfa29f7e47bb7d328c8e0ea58123768 WatchSource:0}: Error finding container 897a4aa2db8b44fb7239bda2ebc27e33fdfa29f7e47bb7d328c8e0ea58123768: Status 404 returned error can't find the container with id 897a4aa2db8b44fb7239bda2ebc27e33fdfa29f7e47bb7d328c8e0ea58123768
Jul 02 20:34:44.294818 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:44.294748    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f5ddb6477-zh82b" event={"ID":"a9f763dd-24c0-4ce3-9892-6b80640ca9c8","Type":"ContainerStarted","Data":"897a4aa2db8b44fb7239bda2ebc27e33fdfa29f7e47bb7d328c8e0ea58123768"}
Jul 02 20:34:44.880998 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:44.880967    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c" path="/var/lib/kubelet/pods/16b3c4fd-b01e-4c8f-bb8c-e3fa4c719e2c/volumes"
Jul 02 20:34:45.543758 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:45.543721    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:45.643754 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:45.643722    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:46.407288 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:46.407259    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:46.516651 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:46.516621    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:47.305311 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:47.305277    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f5ddb6477-zh82b" event={"ID":"a9f763dd-24c0-4ce3-9892-6b80640ca9c8","Type":"ContainerStarted","Data":"03d7f9d7471c815c3b08d2ed63db5b98ad280788b460d3dc7d915c25940b2e39"}
Jul 02 20:34:47.326254 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:47.326213    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f5ddb6477-zh82b" podStartSLOduration=1.611637255 podStartE2EDuration="4.326198661s" totalImagesPullingTime="2.714561406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:34:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:47.324652509 +0000 UTC m=+120.995166003" watchObservedRunningTime="2026-07-02 20:34:47.326198661 +0000 UTC m=+120.996712154"
Jul 02 20:34:52.981623 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:52.981583    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:53.083490 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:53.083456    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:53.551040 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:53.551009    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f5ddb6477-zh82b"
Jul 02 20:34:53.551219 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:53.551058    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f5ddb6477-zh82b"
Jul 02 20:34:53.558130 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:53.558107    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f5ddb6477-zh82b"
Jul 02 20:34:54.330809 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:54.330781    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f5ddb6477-zh82b"
Jul 02 20:34:54.493279 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:54.493242    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:54.548649 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:54.548616    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:54.609481 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:54.609420    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:56.614364 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:56.614329    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea026958-5382-4357-ae6d-e52d6aa5f523-metrics-certs\") pod \"network-metrics-daemon-djb55\" (UID: \"ea026958-5382-4357-ae6d-e52d6aa5f523\") " pod="openshift-multus/network-metrics-daemon-djb55"
Jul 02 20:34:56.616465 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:56.616445    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea026958-5382-4357-ae6d-e52d6aa5f523-metrics-certs\") pod \"network-metrics-daemon-djb55\" (UID: \"ea026958-5382-4357-ae6d-e52d6aa5f523\") " pod="openshift-multus/network-metrics-daemon-djb55"
Jul 02 20:34:56.695219 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:56.695196    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xbw6r\""
Jul 02 20:34:56.703022 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:56.703004    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-djb55"
Jul 02 20:34:57.040398 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:57.040370    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-djb55"]
Jul 02 20:34:57.042491 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:34:57.042464    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea026958_5382_4357_ae6d_e52d6aa5f523.slice/crio-b08dde5c1f7523f38a824756b7c2d286f309eea7acd6bf4a73f285fbd6dacbeb WatchSource:0}: Error finding container b08dde5c1f7523f38a824756b7c2d286f309eea7acd6bf4a73f285fbd6dacbeb: Status 404 returned error can't find the container with id b08dde5c1f7523f38a824756b7c2d286f309eea7acd6bf4a73f285fbd6dacbeb
Jul 02 20:34:57.339085 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:57.339056    2581 generic.go:356] "Generic (PLEG): container finished" podID="6d7070e7-f559-4726-88f2-a72ddd851c49" containerID="9e0234168eba3f733709b02f677b7c913076939685372d52a73a33a47761a1ee" exitCode=0
Jul 02 20:34:57.339232 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:57.339128    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8x7tn" event={"ID":"6d7070e7-f559-4726-88f2-a72ddd851c49","Type":"ContainerDied","Data":"9e0234168eba3f733709b02f677b7c913076939685372d52a73a33a47761a1ee"}
Jul 02 20:34:57.339476 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:57.339461    2581 scope.go:117] "RemoveContainer" containerID="9e0234168eba3f733709b02f677b7c913076939685372d52a73a33a47761a1ee"
Jul 02 20:34:57.340244 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:57.340221    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-djb55" event={"ID":"ea026958-5382-4357-ae6d-e52d6aa5f523","Type":"ContainerStarted","Data":"b08dde5c1f7523f38a824756b7c2d286f309eea7acd6bf4a73f285fbd6dacbeb"}
Jul 02 20:34:58.344598 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:58.344561    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8x7tn" event={"ID":"6d7070e7-f559-4726-88f2-a72ddd851c49","Type":"ContainerStarted","Data":"34c2a409d829ab867859b97ef43407683d74ab4cc9f43a29331165d75f2ca07d"}
Jul 02 20:34:59.349387 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:59.349353    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-djb55" event={"ID":"ea026958-5382-4357-ae6d-e52d6aa5f523","Type":"ContainerStarted","Data":"0cfa1fa72f6a4bd6bca3abe3f294ac9d16c3b3f277258e8d570ae59b2bc891f9"}
Jul 02 20:34:59.349747 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:59.349445    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-djb55" event={"ID":"ea026958-5382-4357-ae6d-e52d6aa5f523","Type":"ContainerStarted","Data":"38763356efcc4bc278d5d19772259773201435a3ce243664fbbefd409d77e4af"}
Jul 02 20:34:59.368090 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:59.368040    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-djb55" podStartSLOduration=130.933358358 podStartE2EDuration="2m12.368020278s" totalImagesPullingTime="1.43466192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:32:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:59.364830552 +0000 UTC m=+133.035344045" watchObservedRunningTime="2026-07-02 20:34:59.368020278 +0000 UTC m=+133.038533775"
Jul 02 20:34:59.459970 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:59.459908    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:34:59.521187 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:34:59.521134    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:35:00.881263 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:35:00.881231    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:35:00.986240 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:35:00.986202    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:35:01.051318 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:35:01.051290    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:35:07.977446 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:35:07.977410    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:35:08.084154 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:35:08.084100    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:35:08.300648 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:35:08.300556    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:35:08.399859 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:35:08.399827    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:35:26.599486 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:35:26.599452    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:35:26.657631 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:35:26.657595    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:35:42.694474 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:35:42.694385    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:35:42.796466 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:35:42.796432    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:35:44.735743 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:35:44.735706    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:35:44.835168 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:35:44.835120    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:35:44.935801 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:35:44.935770    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:35:45.482530 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:35:45.482489    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:35:54.564975 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:35:54.564926    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:35:54.631010 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:35:54.630979    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:35:55.728223 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:35:55.728186    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f5ddb6477-zh82b"]
Jul 02 20:35:55.822283 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:35:55.822243    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:35:55.878686 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:35:55.878648    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:35:55.942722 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:35:55.942688    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:36:08.003207 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:08.003165    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:36:08.099947 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:08.099903    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:36:20.756932 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:20.756872    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6f5ddb6477-zh82b" podUID="a9f763dd-24c0-4ce3-9892-6b80640ca9c8" containerName="console" containerID="cri-o://03d7f9d7471c815c3b08d2ed63db5b98ad280788b460d3dc7d915c25940b2e39" gracePeriod=15
Jul 02 20:36:20.984927 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:20.984905    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f5ddb6477-zh82b"
Jul 02 20:36:21.067803 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:21.067711    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pcqv7\" (UniqueName: \"kubernetes.io/projected/a9f763dd-24c0-4ce3-9892-6b80640ca9c8-kube-api-access-pcqv7\") pod \"a9f763dd-24c0-4ce3-9892-6b80640ca9c8\" (UID: \"a9f763dd-24c0-4ce3-9892-6b80640ca9c8\") "
Jul 02 20:36:21.067803 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:21.067782    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a9f763dd-24c0-4ce3-9892-6b80640ca9c8-oauth-serving-cert\") pod \"a9f763dd-24c0-4ce3-9892-6b80640ca9c8\" (UID: \"a9f763dd-24c0-4ce3-9892-6b80640ca9c8\") "
Jul 02 20:36:21.068010 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:21.067811    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a9f763dd-24c0-4ce3-9892-6b80640ca9c8-console-oauth-config\") pod \"a9f763dd-24c0-4ce3-9892-6b80640ca9c8\" (UID: \"a9f763dd-24c0-4ce3-9892-6b80640ca9c8\") "
Jul 02 20:36:21.068010 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:21.067866    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a9f763dd-24c0-4ce3-9892-6b80640ca9c8-console-serving-cert\") pod \"a9f763dd-24c0-4ce3-9892-6b80640ca9c8\" (UID: \"a9f763dd-24c0-4ce3-9892-6b80640ca9c8\") "
Jul 02 20:36:21.068010 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:21.067891    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9f763dd-24c0-4ce3-9892-6b80640ca9c8-trusted-ca-bundle\") pod \"a9f763dd-24c0-4ce3-9892-6b80640ca9c8\" (UID: \"a9f763dd-24c0-4ce3-9892-6b80640ca9c8\") "
Jul 02 20:36:21.068010 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:21.067926    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a9f763dd-24c0-4ce3-9892-6b80640ca9c8-service-ca\") pod \"a9f763dd-24c0-4ce3-9892-6b80640ca9c8\" (UID: \"a9f763dd-24c0-4ce3-9892-6b80640ca9c8\") "
Jul 02 20:36:21.068010 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:21.067949    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a9f763dd-24c0-4ce3-9892-6b80640ca9c8-console-config\") pod \"a9f763dd-24c0-4ce3-9892-6b80640ca9c8\" (UID: \"a9f763dd-24c0-4ce3-9892-6b80640ca9c8\") "
Jul 02 20:36:21.068369 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:21.068330    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9f763dd-24c0-4ce3-9892-6b80640ca9c8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a9f763dd-24c0-4ce3-9892-6b80640ca9c8" (UID: "a9f763dd-24c0-4ce3-9892-6b80640ca9c8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:36:21.068497 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:21.068464    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9f763dd-24c0-4ce3-9892-6b80640ca9c8-service-ca" (OuterVolumeSpecName: "service-ca") pod "a9f763dd-24c0-4ce3-9892-6b80640ca9c8" (UID: "a9f763dd-24c0-4ce3-9892-6b80640ca9c8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:36:21.068497 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:21.068481    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9f763dd-24c0-4ce3-9892-6b80640ca9c8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a9f763dd-24c0-4ce3-9892-6b80640ca9c8" (UID: "a9f763dd-24c0-4ce3-9892-6b80640ca9c8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:36:21.068497 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:21.068475    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9f763dd-24c0-4ce3-9892-6b80640ca9c8-console-config" (OuterVolumeSpecName: "console-config") pod "a9f763dd-24c0-4ce3-9892-6b80640ca9c8" (UID: "a9f763dd-24c0-4ce3-9892-6b80640ca9c8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:36:21.069945 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:21.069925    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9f763dd-24c0-4ce3-9892-6b80640ca9c8-kube-api-access-pcqv7" (OuterVolumeSpecName: "kube-api-access-pcqv7") pod "a9f763dd-24c0-4ce3-9892-6b80640ca9c8" (UID: "a9f763dd-24c0-4ce3-9892-6b80640ca9c8"). InnerVolumeSpecName "kube-api-access-pcqv7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:36:21.070038 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:21.069956    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9f763dd-24c0-4ce3-9892-6b80640ca9c8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a9f763dd-24c0-4ce3-9892-6b80640ca9c8" (UID: "a9f763dd-24c0-4ce3-9892-6b80640ca9c8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:36:21.070038 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:21.070021    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9f763dd-24c0-4ce3-9892-6b80640ca9c8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a9f763dd-24c0-4ce3-9892-6b80640ca9c8" (UID: "a9f763dd-24c0-4ce3-9892-6b80640ca9c8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:36:21.168900 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:21.168866    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a9f763dd-24c0-4ce3-9892-6b80640ca9c8-oauth-serving-cert\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:36:21.168900 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:21.168892    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a9f763dd-24c0-4ce3-9892-6b80640ca9c8-console-oauth-config\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:36:21.168900 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:21.168901    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a9f763dd-24c0-4ce3-9892-6b80640ca9c8-console-serving-cert\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:36:21.169107 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:21.168911    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9f763dd-24c0-4ce3-9892-6b80640ca9c8-trusted-ca-bundle\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:36:21.169107 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:21.168921    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a9f763dd-24c0-4ce3-9892-6b80640ca9c8-service-ca\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:36:21.169107 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:21.168928    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a9f763dd-24c0-4ce3-9892-6b80640ca9c8-console-config\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:36:21.169107 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:21.168937    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pcqv7\" (UniqueName: \"kubernetes.io/projected/a9f763dd-24c0-4ce3-9892-6b80640ca9c8-kube-api-access-pcqv7\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:36:21.605104 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:21.605071    2581 generic.go:356] "Generic (PLEG): container finished" podID="a9f763dd-24c0-4ce3-9892-6b80640ca9c8" containerID="03d7f9d7471c815c3b08d2ed63db5b98ad280788b460d3dc7d915c25940b2e39" exitCode=0
Jul 02 20:36:21.605274 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:21.605108    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f5ddb6477-zh82b" event={"ID":"a9f763dd-24c0-4ce3-9892-6b80640ca9c8","Type":"ContainerDied","Data":"03d7f9d7471c815c3b08d2ed63db5b98ad280788b460d3dc7d915c25940b2e39"}
Jul 02 20:36:21.605274 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:21.605122    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f5ddb6477-zh82b"
Jul 02 20:36:21.605274 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:21.605173    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f5ddb6477-zh82b" event={"ID":"a9f763dd-24c0-4ce3-9892-6b80640ca9c8","Type":"ContainerDied","Data":"897a4aa2db8b44fb7239bda2ebc27e33fdfa29f7e47bb7d328c8e0ea58123768"}
Jul 02 20:36:21.605274 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:21.605209    2581 scope.go:117] "RemoveContainer" containerID="03d7f9d7471c815c3b08d2ed63db5b98ad280788b460d3dc7d915c25940b2e39"
Jul 02 20:36:21.612898 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:21.612879    2581 scope.go:117] "RemoveContainer" containerID="03d7f9d7471c815c3b08d2ed63db5b98ad280788b460d3dc7d915c25940b2e39"
Jul 02 20:36:21.613165 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:36:21.613123    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03d7f9d7471c815c3b08d2ed63db5b98ad280788b460d3dc7d915c25940b2e39\": container with ID starting with 03d7f9d7471c815c3b08d2ed63db5b98ad280788b460d3dc7d915c25940b2e39 not found: ID does not exist" containerID="03d7f9d7471c815c3b08d2ed63db5b98ad280788b460d3dc7d915c25940b2e39"
Jul 02 20:36:21.613223 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:21.613168    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03d7f9d7471c815c3b08d2ed63db5b98ad280788b460d3dc7d915c25940b2e39"} err="failed to get container status \"03d7f9d7471c815c3b08d2ed63db5b98ad280788b460d3dc7d915c25940b2e39\": rpc error: code = NotFound desc = could not find container \"03d7f9d7471c815c3b08d2ed63db5b98ad280788b460d3dc7d915c25940b2e39\": container with ID starting with 03d7f9d7471c815c3b08d2ed63db5b98ad280788b460d3dc7d915c25940b2e39 not found: ID does not exist"
Jul 02 20:36:21.625004 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:21.624985    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f5ddb6477-zh82b"]
Jul 02 20:36:21.628951 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:21.628933    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f5ddb6477-zh82b"]
Jul 02 20:36:22.880190 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:22.880128    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9f763dd-24c0-4ce3-9892-6b80640ca9c8" path="/var/lib/kubelet/pods/a9f763dd-24c0-4ce3-9892-6b80640ca9c8/volumes"
Jul 02 20:36:35.419264 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:35.419229    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:36:35.512322 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:35.512289    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:36:36.164092 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:36.164055    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lrfxn"]
Jul 02 20:36:36.164349 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:36.164333    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9f763dd-24c0-4ce3-9892-6b80640ca9c8" containerName="console"
Jul 02 20:36:36.164349 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:36.164345    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9f763dd-24c0-4ce3-9892-6b80640ca9c8" containerName="console"
Jul 02 20:36:36.164444 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:36.164394    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9f763dd-24c0-4ce3-9892-6b80640ca9c8" containerName="console"
Jul 02 20:36:36.168554 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:36.168538    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lrfxn"
Jul 02 20:36:36.171307 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:36.171283    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nbdpw\""
Jul 02 20:36:36.171421 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:36.171356    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 02 20:36:36.171421 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:36.171357    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 02 20:36:36.177782 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:36.177761    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lrfxn"]
Jul 02 20:36:36.264981 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:36.264953    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lrfxn\" (UID: \"f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lrfxn"
Jul 02 20:36:36.264981 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:36.264984    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pd6r\" (UniqueName: \"kubernetes.io/projected/f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700-kube-api-access-8pd6r\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lrfxn\" (UID: \"f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lrfxn"
Jul 02 20:36:36.265134 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:36.265005    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lrfxn\" (UID: \"f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lrfxn"
Jul 02 20:36:36.365828 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:36.365807    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lrfxn\" (UID: \"f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lrfxn"
Jul 02 20:36:36.365896 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:36.365835    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pd6r\" (UniqueName: \"kubernetes.io/projected/f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700-kube-api-access-8pd6r\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lrfxn\" (UID: \"f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lrfxn"
Jul 02 20:36:36.365896 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:36.365855    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lrfxn\" (UID: \"f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lrfxn"
Jul 02 20:36:36.366259 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:36.366244    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lrfxn\" (UID: \"f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lrfxn"
Jul 02 20:36:36.366302 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:36.366258    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lrfxn\" (UID: \"f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lrfxn"
Jul 02 20:36:36.376434 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:36.376406    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pd6r\" (UniqueName: \"kubernetes.io/projected/f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700-kube-api-access-8pd6r\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lrfxn\" (UID: \"f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lrfxn"
Jul 02 20:36:36.477471 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:36.477444    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lrfxn"
Jul 02 20:36:36.600291 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:36.600219    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lrfxn"]
Jul 02 20:36:36.603751 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:36:36.603726    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6ffb6b0_ca3d_41e7_8bca_dee4ffb63700.slice/crio-564da852fbe04a68c4e2d022e293551ea06131fec853652ed64575a215e57dc4 WatchSource:0}: Error finding container 564da852fbe04a68c4e2d022e293551ea06131fec853652ed64575a215e57dc4: Status 404 returned error can't find the container with id 564da852fbe04a68c4e2d022e293551ea06131fec853652ed64575a215e57dc4
Jul 02 20:36:36.653819 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:36.653794    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lrfxn" event={"ID":"f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700","Type":"ContainerStarted","Data":"564da852fbe04a68c4e2d022e293551ea06131fec853652ed64575a215e57dc4"}
Jul 02 20:36:43.679047 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:43.679019    2581 generic.go:356] "Generic (PLEG): container finished" podID="f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700" containerID="2fd5cb83f0a7194acf39280a03b1a2fae83abedd92414fd7c644f0344a3cc88e" exitCode=0
Jul 02 20:36:43.679390 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:43.679079    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lrfxn" event={"ID":"f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700","Type":"ContainerDied","Data":"2fd5cb83f0a7194acf39280a03b1a2fae83abedd92414fd7c644f0344a3cc88e"}
Jul 02 20:36:46.690482 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:46.690445    2581 generic.go:356] "Generic (PLEG): container finished" podID="f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700" containerID="144b2a3cdf4053d06b5e10cfbd755ba54204e8be8e276e1be1673ca33843f39f" exitCode=0
Jul 02 20:36:46.690894 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:46.690509    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lrfxn" event={"ID":"f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700","Type":"ContainerDied","Data":"144b2a3cdf4053d06b5e10cfbd755ba54204e8be8e276e1be1673ca33843f39f"}
Jul 02 20:36:53.716573 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:53.716536    2581 generic.go:356] "Generic (PLEG): container finished" podID="f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700" containerID="30ba8261757614e62751eebf02e4be95952d9f1c5d35d8768bb6a61a48ee141f" exitCode=0
Jul 02 20:36:53.716924 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:53.716588    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lrfxn" event={"ID":"f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700","Type":"ContainerDied","Data":"30ba8261757614e62751eebf02e4be95952d9f1c5d35d8768bb6a61a48ee141f"}
Jul 02 20:36:54.832798 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:54.832774    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lrfxn"
Jul 02 20:36:54.895564 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:54.895539    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8pd6r\" (UniqueName: \"kubernetes.io/projected/f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700-kube-api-access-8pd6r\") pod \"f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700\" (UID: \"f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700\") "
Jul 02 20:36:54.895683 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:54.895575    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700-util\") pod \"f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700\" (UID: \"f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700\") "
Jul 02 20:36:54.895683 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:54.895614    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700-bundle\") pod \"f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700\" (UID: \"f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700\") "
Jul 02 20:36:54.896265 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:54.896241    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700-bundle" (OuterVolumeSpecName: "bundle") pod "f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700" (UID: "f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:36:54.897756 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:54.897727    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700-kube-api-access-8pd6r" (OuterVolumeSpecName: "kube-api-access-8pd6r") pod "f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700" (UID: "f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700"). InnerVolumeSpecName "kube-api-access-8pd6r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:36:54.899622 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:54.899604    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700-util" (OuterVolumeSpecName: "util") pod "f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700" (UID: "f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:36:54.996087 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:54.996025    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700-util\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:36:54.996087 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:54.996056    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700-bundle\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:36:54.996087 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:54.996066    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8pd6r\" (UniqueName: \"kubernetes.io/projected/f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700-kube-api-access-8pd6r\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:36:55.724572 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:55.724540    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lrfxn" event={"ID":"f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700","Type":"ContainerDied","Data":"564da852fbe04a68c4e2d022e293551ea06131fec853652ed64575a215e57dc4"}
Jul 02 20:36:55.724762 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:55.724584    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="564da852fbe04a68c4e2d022e293551ea06131fec853652ed64575a215e57dc4"
Jul 02 20:36:55.724762 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:55.724586    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lrfxn"
Jul 02 20:36:57.254316 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:57.254276    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:36:58.083078 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:36:58.083038    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:00.855150 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:00.855101    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:00.917258 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:00.917217    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:03.090085 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:03.090046    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:03.224631 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:03.224590    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:03.340157 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:03.340070    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:03.459370 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:03.459336    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:03.509008 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:03.508981    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f948mm"]
Jul 02 20:37:03.509243 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:03.509230    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700" containerName="util"
Jul 02 20:37:03.509292 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:03.509245    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700" containerName="util"
Jul 02 20:37:03.509292 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:03.509257    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700" containerName="pull"
Jul 02 20:37:03.509292 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:03.509273    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700" containerName="pull"
Jul 02 20:37:03.509383 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:03.509293    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700" containerName="extract"
Jul 02 20:37:03.509383 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:03.509299    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700" containerName="extract"
Jul 02 20:37:03.509383 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:03.509334    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6ffb6b0-ca3d-41e7-8bca-dee4ffb63700" containerName="extract"
Jul 02 20:37:03.512800 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:03.512785    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f948mm"
Jul 02 20:37:03.515877 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:03.515858    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nbdpw\""
Jul 02 20:37:03.516383 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:03.516366    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 02 20:37:03.516579 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:03.516561    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 02 20:37:03.525791 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:03.525767    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f948mm"]
Jul 02 20:37:03.551154 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:03.551110    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95dnc\" (UniqueName: \"kubernetes.io/projected/5d1800e9-8af8-4c1a-9660-878c71de6df2-kube-api-access-95dnc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f948mm\" (UID: \"5d1800e9-8af8-4c1a-9660-878c71de6df2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f948mm"
Jul 02 20:37:03.551275 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:03.551169    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d1800e9-8af8-4c1a-9660-878c71de6df2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f948mm\" (UID: \"5d1800e9-8af8-4c1a-9660-878c71de6df2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f948mm"
Jul 02 20:37:03.551275 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:03.551190    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d1800e9-8af8-4c1a-9660-878c71de6df2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f948mm\" (UID: \"5d1800e9-8af8-4c1a-9660-878c71de6df2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f948mm"
Jul 02 20:37:03.651539 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:03.651488    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95dnc\" (UniqueName: \"kubernetes.io/projected/5d1800e9-8af8-4c1a-9660-878c71de6df2-kube-api-access-95dnc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f948mm\" (UID: \"5d1800e9-8af8-4c1a-9660-878c71de6df2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f948mm"
Jul 02 20:37:03.651618 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:03.651538    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d1800e9-8af8-4c1a-9660-878c71de6df2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f948mm\" (UID: \"5d1800e9-8af8-4c1a-9660-878c71de6df2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f948mm"
Jul 02 20:37:03.651674 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:03.651651    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d1800e9-8af8-4c1a-9660-878c71de6df2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f948mm\" (UID: \"5d1800e9-8af8-4c1a-9660-878c71de6df2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f948mm"
Jul 02 20:37:03.651818 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:03.651804    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d1800e9-8af8-4c1a-9660-878c71de6df2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f948mm\" (UID: \"5d1800e9-8af8-4c1a-9660-878c71de6df2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f948mm"
Jul 02 20:37:03.651971 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:03.651953    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d1800e9-8af8-4c1a-9660-878c71de6df2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f948mm\" (UID: \"5d1800e9-8af8-4c1a-9660-878c71de6df2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f948mm"
Jul 02 20:37:03.670275 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:03.670247    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95dnc\" (UniqueName: \"kubernetes.io/projected/5d1800e9-8af8-4c1a-9660-878c71de6df2-kube-api-access-95dnc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f948mm\" (UID: \"5d1800e9-8af8-4c1a-9660-878c71de6df2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f948mm"
Jul 02 20:37:03.821131 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:03.821102    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f948mm"
Jul 02 20:37:03.961276 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:03.961252    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f948mm"]
Jul 02 20:37:03.964233 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:37:03.964199    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d1800e9_8af8_4c1a_9660_878c71de6df2.slice/crio-1f04caa2da1f19237aa697e31077c48276d3531a4e8a8ad7516093ff98f70a3d WatchSource:0}: Error finding container 1f04caa2da1f19237aa697e31077c48276d3531a4e8a8ad7516093ff98f70a3d: Status 404 returned error can't find the container with id 1f04caa2da1f19237aa697e31077c48276d3531a4e8a8ad7516093ff98f70a3d
Jul 02 20:37:04.756913 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:04.756883    2581 generic.go:356] "Generic (PLEG): container finished" podID="5d1800e9-8af8-4c1a-9660-878c71de6df2" containerID="4454811c357c00d95956365dedab7d783f34bae59397fca94b0ec2ee7aa9ee22" exitCode=0
Jul 02 20:37:04.757280 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:04.756957    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f948mm" event={"ID":"5d1800e9-8af8-4c1a-9660-878c71de6df2","Type":"ContainerDied","Data":"4454811c357c00d95956365dedab7d783f34bae59397fca94b0ec2ee7aa9ee22"}
Jul 02 20:37:04.757280 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:04.756995    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f948mm" event={"ID":"5d1800e9-8af8-4c1a-9660-878c71de6df2","Type":"ContainerStarted","Data":"1f04caa2da1f19237aa697e31077c48276d3531a4e8a8ad7516093ff98f70a3d"}
Jul 02 20:37:05.466667 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:05.466638    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:05.687374 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:05.687345    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:07.663698 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:07.663659    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:07.729912 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:07.729877    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:08.777697 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:08.777668    2581 generic.go:356] "Generic (PLEG): container finished" podID="5d1800e9-8af8-4c1a-9660-878c71de6df2" containerID="aa55158f1512a3e25d509368886bf1a44867c04703bb14619b436bec3eb95b08" exitCode=0
Jul 02 20:37:08.778094 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:08.777703    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f948mm" event={"ID":"5d1800e9-8af8-4c1a-9660-878c71de6df2","Type":"ContainerDied","Data":"aa55158f1512a3e25d509368886bf1a44867c04703bb14619b436bec3eb95b08"}
Jul 02 20:37:09.783539 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:09.783505    2581 generic.go:356] "Generic (PLEG): container finished" podID="5d1800e9-8af8-4c1a-9660-878c71de6df2" containerID="0f1c13dca12100fd3e6e9458ac2247640a1b6154808e5cbd72d419950865ac88" exitCode=0
Jul 02 20:37:09.783934 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:09.783554    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f948mm" event={"ID":"5d1800e9-8af8-4c1a-9660-878c71de6df2","Type":"ContainerDied","Data":"0f1c13dca12100fd3e6e9458ac2247640a1b6154808e5cbd72d419950865ac88"}
Jul 02 20:37:10.910031 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:10.910009    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f948mm"
Jul 02 20:37:11.003416 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:11.003388    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d1800e9-8af8-4c1a-9660-878c71de6df2-bundle\") pod \"5d1800e9-8af8-4c1a-9660-878c71de6df2\" (UID: \"5d1800e9-8af8-4c1a-9660-878c71de6df2\") "
Jul 02 20:37:11.003561 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:11.003424    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-95dnc\" (UniqueName: \"kubernetes.io/projected/5d1800e9-8af8-4c1a-9660-878c71de6df2-kube-api-access-95dnc\") pod \"5d1800e9-8af8-4c1a-9660-878c71de6df2\" (UID: \"5d1800e9-8af8-4c1a-9660-878c71de6df2\") "
Jul 02 20:37:11.003561 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:11.003454    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d1800e9-8af8-4c1a-9660-878c71de6df2-util\") pod \"5d1800e9-8af8-4c1a-9660-878c71de6df2\" (UID: \"5d1800e9-8af8-4c1a-9660-878c71de6df2\") "
Jul 02 20:37:11.003776 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:11.003753    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d1800e9-8af8-4c1a-9660-878c71de6df2-bundle" (OuterVolumeSpecName: "bundle") pod "5d1800e9-8af8-4c1a-9660-878c71de6df2" (UID: "5d1800e9-8af8-4c1a-9660-878c71de6df2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:37:11.005476 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:11.005448    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d1800e9-8af8-4c1a-9660-878c71de6df2-kube-api-access-95dnc" (OuterVolumeSpecName: "kube-api-access-95dnc") pod "5d1800e9-8af8-4c1a-9660-878c71de6df2" (UID: "5d1800e9-8af8-4c1a-9660-878c71de6df2"). InnerVolumeSpecName "kube-api-access-95dnc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:37:11.008112 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:11.008075    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d1800e9-8af8-4c1a-9660-878c71de6df2-util" (OuterVolumeSpecName: "util") pod "5d1800e9-8af8-4c1a-9660-878c71de6df2" (UID: "5d1800e9-8af8-4c1a-9660-878c71de6df2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:37:11.103918 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:11.103851    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d1800e9-8af8-4c1a-9660-878c71de6df2-util\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:37:11.103918 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:11.103873    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d1800e9-8af8-4c1a-9660-878c71de6df2-bundle\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:37:11.103918 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:11.103888    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95dnc\" (UniqueName: \"kubernetes.io/projected/5d1800e9-8af8-4c1a-9660-878c71de6df2-kube-api-access-95dnc\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:37:11.792940 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:11.792905    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f948mm" event={"ID":"5d1800e9-8af8-4c1a-9660-878c71de6df2","Type":"ContainerDied","Data":"1f04caa2da1f19237aa697e31077c48276d3531a4e8a8ad7516093ff98f70a3d"}
Jul 02 20:37:11.792940 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:11.792936    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f948mm"
Jul 02 20:37:11.793177 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:11.792955    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1f04caa2da1f19237aa697e31077c48276d3531a4e8a8ad7516093ff98f70a3d"
Jul 02 20:37:13.303388 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:13.303359    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:16.264002 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:16.263964    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:16.363027 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:16.362992    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:17.731383 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:17.731345    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lcr6m"]
Jul 02 20:37:17.731753 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:17.731574    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d1800e9-8af8-4c1a-9660-878c71de6df2" containerName="util"
Jul 02 20:37:17.731753 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:17.731585    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d1800e9-8af8-4c1a-9660-878c71de6df2" containerName="util"
Jul 02 20:37:17.731753 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:17.731606    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d1800e9-8af8-4c1a-9660-878c71de6df2" containerName="extract"
Jul 02 20:37:17.731753 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:17.731612    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d1800e9-8af8-4c1a-9660-878c71de6df2" containerName="extract"
Jul 02 20:37:17.731753 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:17.731638    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d1800e9-8af8-4c1a-9660-878c71de6df2" containerName="pull"
Jul 02 20:37:17.731753 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:17.731643    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d1800e9-8af8-4c1a-9660-878c71de6df2" containerName="pull"
Jul 02 20:37:17.731753 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:17.731691    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d1800e9-8af8-4c1a-9660-878c71de6df2" containerName="extract"
Jul 02 20:37:17.734480 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:17.734466    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lcr6m"
Jul 02 20:37:17.736730 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:17.736705    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 02 20:37:17.737674 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:17.737655    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 02 20:37:17.737793 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:17.737658    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-ml5t7\""
Jul 02 20:37:17.743722 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:17.743701    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lcr6m"]
Jul 02 20:37:17.748663 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:17.748644    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvpx9\" (UniqueName: \"kubernetes.io/projected/e1dc66e1-24cd-4043-bc61-5697cf51c145-kube-api-access-cvpx9\") pod \"openshift-lws-operator-fd8ccff4c-lcr6m\" (UID: \"e1dc66e1-24cd-4043-bc61-5697cf51c145\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lcr6m"
Jul 02 20:37:17.748740 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:17.748678    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1dc66e1-24cd-4043-bc61-5697cf51c145-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lcr6m\" (UID: \"e1dc66e1-24cd-4043-bc61-5697cf51c145\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lcr6m"
Jul 02 20:37:17.849543 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:17.849512    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvpx9\" (UniqueName: \"kubernetes.io/projected/e1dc66e1-24cd-4043-bc61-5697cf51c145-kube-api-access-cvpx9\") pod \"openshift-lws-operator-fd8ccff4c-lcr6m\" (UID: \"e1dc66e1-24cd-4043-bc61-5697cf51c145\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lcr6m"
Jul 02 20:37:17.849665 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:17.849559    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1dc66e1-24cd-4043-bc61-5697cf51c145-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lcr6m\" (UID: \"e1dc66e1-24cd-4043-bc61-5697cf51c145\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lcr6m"
Jul 02 20:37:17.849899 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:17.849883    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1dc66e1-24cd-4043-bc61-5697cf51c145-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lcr6m\" (UID: \"e1dc66e1-24cd-4043-bc61-5697cf51c145\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lcr6m"
Jul 02 20:37:17.857736 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:17.857720    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvpx9\" (UniqueName: \"kubernetes.io/projected/e1dc66e1-24cd-4043-bc61-5697cf51c145-kube-api-access-cvpx9\") pod \"openshift-lws-operator-fd8ccff4c-lcr6m\" (UID: \"e1dc66e1-24cd-4043-bc61-5697cf51c145\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lcr6m"
Jul 02 20:37:18.042693 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:18.042627    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lcr6m"
Jul 02 20:37:18.163572 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:18.163490    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lcr6m"]
Jul 02 20:37:18.166236 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:37:18.166209    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode1dc66e1_24cd_4043_bc61_5697cf51c145.slice/crio-751928b8d27b367558458c57cae4cedb95d4bac3cc72f6550807fb66389044c8 WatchSource:0}: Error finding container 751928b8d27b367558458c57cae4cedb95d4bac3cc72f6550807fb66389044c8: Status 404 returned error can't find the container with id 751928b8d27b367558458c57cae4cedb95d4bac3cc72f6550807fb66389044c8
Jul 02 20:37:18.817172 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:18.817123    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lcr6m" event={"ID":"e1dc66e1-24cd-4043-bc61-5697cf51c145","Type":"ContainerStarted","Data":"751928b8d27b367558458c57cae4cedb95d4bac3cc72f6550807fb66389044c8"}
Jul 02 20:37:21.829091 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:21.829057    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lcr6m" event={"ID":"e1dc66e1-24cd-4043-bc61-5697cf51c145","Type":"ContainerStarted","Data":"77388a1f0c7c665137cabad54b8aa0d39794f0fb82dc81a3a9296bf5fdd4b7da"}
Jul 02 20:37:22.722838 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:22.722807    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:22.825846 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:22.825813    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:24.406769 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:24.406718    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lcr6m" podStartSLOduration=4.591419065 podStartE2EDuration="7.406701942s" totalImagesPullingTime="2.815282877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:37:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:37:21.864564313 +0000 UTC m=+275.535077807" watchObservedRunningTime="2026-07-02 20:37:24.406701942 +0000 UTC m=+278.077215437"
Jul 02 20:37:24.407664 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:24.407645    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49ttq"]
Jul 02 20:37:24.430740 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:24.430720    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49ttq"]
Jul 02 20:37:24.430856 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:24.430805    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49ttq"
Jul 02 20:37:24.433595 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:24.433571    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 02 20:37:24.433595 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:24.433571    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 02 20:37:24.434261 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:24.434245    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nbdpw\""
Jul 02 20:37:24.497709 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:24.497684    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/944148da-1109-4107-a424-2f7b03728c31-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49ttq\" (UID: \"944148da-1109-4107-a424-2f7b03728c31\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49ttq"
Jul 02 20:37:24.497828 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:24.497721    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vb5bn\" (UniqueName: \"kubernetes.io/projected/944148da-1109-4107-a424-2f7b03728c31-kube-api-access-vb5bn\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49ttq\" (UID: \"944148da-1109-4107-a424-2f7b03728c31\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49ttq"
Jul 02 20:37:24.497828 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:24.497748    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/944148da-1109-4107-a424-2f7b03728c31-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49ttq\" (UID: \"944148da-1109-4107-a424-2f7b03728c31\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49ttq"
Jul 02 20:37:24.522491 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:24.522462    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:24.598753 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:24.598728    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vb5bn\" (UniqueName: \"kubernetes.io/projected/944148da-1109-4107-a424-2f7b03728c31-kube-api-access-vb5bn\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49ttq\" (UID: \"944148da-1109-4107-a424-2f7b03728c31\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49ttq"
Jul 02 20:37:24.598860 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:24.598759    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/944148da-1109-4107-a424-2f7b03728c31-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49ttq\" (UID: \"944148da-1109-4107-a424-2f7b03728c31\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49ttq"
Jul 02 20:37:24.598860 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:24.598813    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/944148da-1109-4107-a424-2f7b03728c31-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49ttq\" (UID: \"944148da-1109-4107-a424-2f7b03728c31\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49ttq"
Jul 02 20:37:24.599111 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:24.599097    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/944148da-1109-4107-a424-2f7b03728c31-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49ttq\" (UID: \"944148da-1109-4107-a424-2f7b03728c31\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49ttq"
Jul 02 20:37:24.599191 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:24.599173    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/944148da-1109-4107-a424-2f7b03728c31-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49ttq\" (UID: \"944148da-1109-4107-a424-2f7b03728c31\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49ttq"
Jul 02 20:37:24.609890 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:24.609865    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vb5bn\" (UniqueName: \"kubernetes.io/projected/944148da-1109-4107-a424-2f7b03728c31-kube-api-access-vb5bn\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49ttq\" (UID: \"944148da-1109-4107-a424-2f7b03728c31\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49ttq"
Jul 02 20:37:24.739832 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:24.739812    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49ttq"
Jul 02 20:37:24.863593 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:24.863563    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49ttq"]
Jul 02 20:37:24.867126 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:37:24.867101    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod944148da_1109_4107_a424_2f7b03728c31.slice/crio-b6c8749e5c82aba9230899e5d05ee2020d1a1b955ece9d776348c19f587aacf0 WatchSource:0}: Error finding container b6c8749e5c82aba9230899e5d05ee2020d1a1b955ece9d776348c19f587aacf0: Status 404 returned error can't find the container with id b6c8749e5c82aba9230899e5d05ee2020d1a1b955ece9d776348c19f587aacf0
Jul 02 20:37:25.431030 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:25.430946    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:25.846762 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:25.846736    2581 generic.go:356] "Generic (PLEG): container finished" podID="944148da-1109-4107-a424-2f7b03728c31" containerID="dd2b1340b38d14dcb6444d7598fadea9f50697f7a9c20644961643afee202000" exitCode=0
Jul 02 20:37:25.846919 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:25.846769    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49ttq" event={"ID":"944148da-1109-4107-a424-2f7b03728c31","Type":"ContainerDied","Data":"dd2b1340b38d14dcb6444d7598fadea9f50697f7a9c20644961643afee202000"}
Jul 02 20:37:25.846919 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:25.846801    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49ttq" event={"ID":"944148da-1109-4107-a424-2f7b03728c31","Type":"ContainerStarted","Data":"b6c8749e5c82aba9230899e5d05ee2020d1a1b955ece9d776348c19f587aacf0"}
Jul 02 20:37:26.544578 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:37:26.544553    2581 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod944148da_1109_4107_a424_2f7b03728c31.slice/crio-3e11128ea279243a8551c2f94465324bae7a2f88f0ccc9f1e6d6bc0f340e6279.scope\": RecentStats: unable to find data in memory cache]"
Jul 02 20:37:26.851585 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:26.851551    2581 generic.go:356] "Generic (PLEG): container finished" podID="944148da-1109-4107-a424-2f7b03728c31" containerID="3e11128ea279243a8551c2f94465324bae7a2f88f0ccc9f1e6d6bc0f340e6279" exitCode=0
Jul 02 20:37:26.851737 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:26.851624    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49ttq" event={"ID":"944148da-1109-4107-a424-2f7b03728c31","Type":"ContainerDied","Data":"3e11128ea279243a8551c2f94465324bae7a2f88f0ccc9f1e6d6bc0f340e6279"}
Jul 02 20:37:27.857533 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:27.857502    2581 generic.go:356] "Generic (PLEG): container finished" podID="944148da-1109-4107-a424-2f7b03728c31" containerID="473dc785e6e4eb47e2d58f1e3dbcf9bcfafb84256871a392c994c1b2bae8fa02" exitCode=0
Jul 02 20:37:27.857905 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:27.857587    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49ttq" event={"ID":"944148da-1109-4107-a424-2f7b03728c31","Type":"ContainerDied","Data":"473dc785e6e4eb47e2d58f1e3dbcf9bcfafb84256871a392c994c1b2bae8fa02"}
Jul 02 20:37:28.978100 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:28.978074    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49ttq"
Jul 02 20:37:29.028840 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:29.028816    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vb5bn\" (UniqueName: \"kubernetes.io/projected/944148da-1109-4107-a424-2f7b03728c31-kube-api-access-vb5bn\") pod \"944148da-1109-4107-a424-2f7b03728c31\" (UID: \"944148da-1109-4107-a424-2f7b03728c31\") "
Jul 02 20:37:29.028941 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:29.028881    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/944148da-1109-4107-a424-2f7b03728c31-bundle\") pod \"944148da-1109-4107-a424-2f7b03728c31\" (UID: \"944148da-1109-4107-a424-2f7b03728c31\") "
Jul 02 20:37:29.028941 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:29.028915    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/944148da-1109-4107-a424-2f7b03728c31-util\") pod \"944148da-1109-4107-a424-2f7b03728c31\" (UID: \"944148da-1109-4107-a424-2f7b03728c31\") "
Jul 02 20:37:29.029613 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:29.029590    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/944148da-1109-4107-a424-2f7b03728c31-bundle" (OuterVolumeSpecName: "bundle") pod "944148da-1109-4107-a424-2f7b03728c31" (UID: "944148da-1109-4107-a424-2f7b03728c31"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:37:29.030727 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:29.030706    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/944148da-1109-4107-a424-2f7b03728c31-kube-api-access-vb5bn" (OuterVolumeSpecName: "kube-api-access-vb5bn") pod "944148da-1109-4107-a424-2f7b03728c31" (UID: "944148da-1109-4107-a424-2f7b03728c31"). InnerVolumeSpecName "kube-api-access-vb5bn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:37:29.034447 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:29.034427    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/944148da-1109-4107-a424-2f7b03728c31-util" (OuterVolumeSpecName: "util") pod "944148da-1109-4107-a424-2f7b03728c31" (UID: "944148da-1109-4107-a424-2f7b03728c31"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:37:29.130280 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:29.130231    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/944148da-1109-4107-a424-2f7b03728c31-bundle\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:37:29.130280 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:29.130249    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/944148da-1109-4107-a424-2f7b03728c31-util\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:37:29.130280 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:29.130257    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vb5bn\" (UniqueName: \"kubernetes.io/projected/944148da-1109-4107-a424-2f7b03728c31-kube-api-access-vb5bn\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:37:29.865929 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:29.865891    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49ttq" event={"ID":"944148da-1109-4107-a424-2f7b03728c31","Type":"ContainerDied","Data":"b6c8749e5c82aba9230899e5d05ee2020d1a1b955ece9d776348c19f587aacf0"}
Jul 02 20:37:29.866090 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:29.865935    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af49ttq"
Jul 02 20:37:29.866090 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:29.865945    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b6c8749e5c82aba9230899e5d05ee2020d1a1b955ece9d776348c19f587aacf0"
Jul 02 20:37:32.765981 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:32.765944    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:36.793592 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:36.793556    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:36.955661 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:36.955625    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:37.534754 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:37.534722    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:37.794240 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:37.794156    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:38.019016 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:38.018983    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68b94c7db-9795d"]
Jul 02 20:37:38.019254 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:38.019241    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="944148da-1109-4107-a424-2f7b03728c31" containerName="util"
Jul 02 20:37:38.019301 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:38.019256    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="944148da-1109-4107-a424-2f7b03728c31" containerName="util"
Jul 02 20:37:38.019301 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:38.019269    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="944148da-1109-4107-a424-2f7b03728c31" containerName="pull"
Jul 02 20:37:38.019301 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:38.019274    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="944148da-1109-4107-a424-2f7b03728c31" containerName="pull"
Jul 02 20:37:38.019301 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:38.019280    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="944148da-1109-4107-a424-2f7b03728c31" containerName="extract"
Jul 02 20:37:38.019301 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:38.019286    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="944148da-1109-4107-a424-2f7b03728c31" containerName="extract"
Jul 02 20:37:38.019444 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:38.019321    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="944148da-1109-4107-a424-2f7b03728c31" containerName="extract"
Jul 02 20:37:38.023274 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:38.023254    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-9795d"
Jul 02 20:37:38.024746 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:38.024724    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:38.028196 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:38.028165    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 02 20:37:38.028445 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:38.028425    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-s2djl\""
Jul 02 20:37:38.028713 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:38.028695    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 02 20:37:38.028825 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:38.028706    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 02 20:37:38.028825 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:38.028696    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 02 20:37:38.057662 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:38.057586    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68b94c7db-9795d"]
Jul 02 20:37:38.087421 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:38.087390    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/81040c78-7e3b-4aa2-8843-643ba9554151-manifests\") pod \"opendatahub-operator-controller-manager-68b94c7db-9795d\" (UID: \"81040c78-7e3b-4aa2-8843-643ba9554151\") " pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-9795d"
Jul 02 20:37:38.087558 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:38.087424    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81040c78-7e3b-4aa2-8843-643ba9554151-tmp\") pod \"opendatahub-operator-controller-manager-68b94c7db-9795d\" (UID: \"81040c78-7e3b-4aa2-8843-643ba9554151\") " pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-9795d"
Jul 02 20:37:38.087558 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:38.087450    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81040c78-7e3b-4aa2-8843-643ba9554151-webhook-cert\") pod \"opendatahub-operator-controller-manager-68b94c7db-9795d\" (UID: \"81040c78-7e3b-4aa2-8843-643ba9554151\") " pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-9795d"
Jul 02 20:37:38.087558 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:38.087532    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/81040c78-7e3b-4aa2-8843-643ba9554151-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68b94c7db-9795d\" (UID: \"81040c78-7e3b-4aa2-8843-643ba9554151\") " pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-9795d"
Jul 02 20:37:38.087656 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:38.087562    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd5dq\" (UniqueName: \"kubernetes.io/projected/81040c78-7e3b-4aa2-8843-643ba9554151-kube-api-access-hd5dq\") pod \"opendatahub-operator-controller-manager-68b94c7db-9795d\" (UID: \"81040c78-7e3b-4aa2-8843-643ba9554151\") " pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-9795d"
Jul 02 20:37:38.187854 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:38.187827    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/81040c78-7e3b-4aa2-8843-643ba9554151-manifests\") pod \"opendatahub-operator-controller-manager-68b94c7db-9795d\" (UID: \"81040c78-7e3b-4aa2-8843-643ba9554151\") " pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-9795d"
Jul 02 20:37:38.187992 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:38.187861    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81040c78-7e3b-4aa2-8843-643ba9554151-tmp\") pod \"opendatahub-operator-controller-manager-68b94c7db-9795d\" (UID: \"81040c78-7e3b-4aa2-8843-643ba9554151\") " pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-9795d"
Jul 02 20:37:38.187992 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:38.187888    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81040c78-7e3b-4aa2-8843-643ba9554151-webhook-cert\") pod \"opendatahub-operator-controller-manager-68b94c7db-9795d\" (UID: \"81040c78-7e3b-4aa2-8843-643ba9554151\") " pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-9795d"
Jul 02 20:37:38.187992 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:38.187915    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/81040c78-7e3b-4aa2-8843-643ba9554151-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68b94c7db-9795d\" (UID: \"81040c78-7e3b-4aa2-8843-643ba9554151\") " pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-9795d"
Jul 02 20:37:38.187992 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:38.187953    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd5dq\" (UniqueName: \"kubernetes.io/projected/81040c78-7e3b-4aa2-8843-643ba9554151-kube-api-access-hd5dq\") pod \"opendatahub-operator-controller-manager-68b94c7db-9795d\" (UID: \"81040c78-7e3b-4aa2-8843-643ba9554151\") " pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-9795d"
Jul 02 20:37:38.188306 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:38.188286    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/81040c78-7e3b-4aa2-8843-643ba9554151-manifests\") pod \"opendatahub-operator-controller-manager-68b94c7db-9795d\" (UID: \"81040c78-7e3b-4aa2-8843-643ba9554151\") " pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-9795d"
Jul 02 20:37:38.190294 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:38.190263    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81040c78-7e3b-4aa2-8843-643ba9554151-tmp\") pod \"opendatahub-operator-controller-manager-68b94c7db-9795d\" (UID: \"81040c78-7e3b-4aa2-8843-643ba9554151\") " pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-9795d"
Jul 02 20:37:38.190493 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:38.190352    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81040c78-7e3b-4aa2-8843-643ba9554151-webhook-cert\") pod \"opendatahub-operator-controller-manager-68b94c7db-9795d\" (UID: \"81040c78-7e3b-4aa2-8843-643ba9554151\") " pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-9795d"
Jul 02 20:37:38.193656 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:38.190776    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/81040c78-7e3b-4aa2-8843-643ba9554151-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68b94c7db-9795d\" (UID: \"81040c78-7e3b-4aa2-8843-643ba9554151\") " pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-9795d"
Jul 02 20:37:38.202339 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:38.202310    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd5dq\" (UniqueName: \"kubernetes.io/projected/81040c78-7e3b-4aa2-8843-643ba9554151-kube-api-access-hd5dq\") pod \"opendatahub-operator-controller-manager-68b94c7db-9795d\" (UID: \"81040c78-7e3b-4aa2-8843-643ba9554151\") " pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-9795d"
Jul 02 20:37:38.289024 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:38.288996    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:38.333347 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:38.333293    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-9795d"
Jul 02 20:37:38.387980 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:38.387951    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:38.469831 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:38.469803    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68b94c7db-9795d"]
Jul 02 20:37:38.472597 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:38.472571    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:38.473771 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:37:38.473748    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81040c78_7e3b_4aa2_8843_643ba9554151.slice/crio-c039007db522c1b0fac50965056911ff4992569e6ab3bbe9ca83b92c09c8c585 WatchSource:0}: Error finding container c039007db522c1b0fac50965056911ff4992569e6ab3bbe9ca83b92c09c8c585: Status 404 returned error can't find the container with id c039007db522c1b0fac50965056911ff4992569e6ab3bbe9ca83b92c09c8c585
Jul 02 20:37:38.578721 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:38.578685    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:38.670428 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:38.670363    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:38.772889 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:38.772864    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:38.903511 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:38.903483    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-9795d" event={"ID":"81040c78-7e3b-4aa2-8843-643ba9554151","Type":"ContainerStarted","Data":"c039007db522c1b0fac50965056911ff4992569e6ab3bbe9ca83b92c09c8c585"}
Jul 02 20:37:41.919561 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:41.919480    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-9795d" event={"ID":"81040c78-7e3b-4aa2-8843-643ba9554151","Type":"ContainerStarted","Data":"47d04d49c6cf1e31d2688adb45af6d700f96c72abfc15ec984ba4a7c451c569d"}
Jul 02 20:37:42.924058 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:42.923979    2581 generic.go:356] "Generic (PLEG): container finished" podID="81040c78-7e3b-4aa2-8843-643ba9554151" containerID="47d04d49c6cf1e31d2688adb45af6d700f96c72abfc15ec984ba4a7c451c569d" exitCode=0
Jul 02 20:37:42.924058 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:42.924030    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-9795d" event={"ID":"81040c78-7e3b-4aa2-8843-643ba9554151","Type":"ContainerDied","Data":"47d04d49c6cf1e31d2688adb45af6d700f96c72abfc15ec984ba4a7c451c569d"}
Jul 02 20:37:43.933854 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:43.933813    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-9795d" event={"ID":"81040c78-7e3b-4aa2-8843-643ba9554151","Type":"ContainerStarted","Data":"594cc40a743c93106852b5da8fc5af3c0d05c42cb093a9939ac5d78e7886524a"}
Jul 02 20:37:43.934292 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:43.933918    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-9795d"
Jul 02 20:37:43.967182 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:43.967109    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-9795d" podStartSLOduration=2.560492642 podStartE2EDuration="6.967090326s" totalImagesPullingTime="3.40454289s" totalInitContainerRuntime="1.002054794s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:37:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:37:43.964164135 +0000 UTC m=+297.634677629" watchObservedRunningTime="2026-07-02 20:37:43.967090326 +0000 UTC m=+297.637603820"
Jul 02 20:37:44.899972 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:44.899933    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:45.303089 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:45.303041    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:46.748792 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:46.748766    2581 kubelet.go:1648] "Image garbage collection succeeded"
Jul 02 20:37:54.940221 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:54.940192    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-68b94c7db-9795d"
Jul 02 20:37:57.259546 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:57.259500    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:57.459634 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:57.459601    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:57.873172 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:57.873127    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:58.018504 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:58.018474    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6b7c78b9ff-mfqm7"]
Jul 02 20:37:58.023782 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:58.023757    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6b7c78b9ff-mfqm7"
Jul 02 20:37:58.027116 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:58.027095    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 02 20:37:58.027252 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:58.027098    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 02 20:37:58.048316 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:58.048292    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6b7c78b9ff-mfqm7"]
Jul 02 20:37:58.129344 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:58.129255    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:58.135337 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:58.135311    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d720f11-000d-4f79-9630-b7fc1aced41d-tmp\") pod \"kube-auth-proxy-6b7c78b9ff-mfqm7\" (UID: \"5d720f11-000d-4f79-9630-b7fc1aced41d\") " pod="openshift-ingress/kube-auth-proxy-6b7c78b9ff-mfqm7"
Jul 02 20:37:58.135486 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:58.135369    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdmps\" (UniqueName: \"kubernetes.io/projected/5d720f11-000d-4f79-9630-b7fc1aced41d-kube-api-access-qdmps\") pod \"kube-auth-proxy-6b7c78b9ff-mfqm7\" (UID: \"5d720f11-000d-4f79-9630-b7fc1aced41d\") " pod="openshift-ingress/kube-auth-proxy-6b7c78b9ff-mfqm7"
Jul 02 20:37:58.135486 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:58.135419    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d720f11-000d-4f79-9630-b7fc1aced41d-tls-certs\") pod \"kube-auth-proxy-6b7c78b9ff-mfqm7\" (UID: \"5d720f11-000d-4f79-9630-b7fc1aced41d\") " pod="openshift-ingress/kube-auth-proxy-6b7c78b9ff-mfqm7"
Jul 02 20:37:58.236280 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:58.236236    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdmps\" (UniqueName: \"kubernetes.io/projected/5d720f11-000d-4f79-9630-b7fc1aced41d-kube-api-access-qdmps\") pod \"kube-auth-proxy-6b7c78b9ff-mfqm7\" (UID: \"5d720f11-000d-4f79-9630-b7fc1aced41d\") " pod="openshift-ingress/kube-auth-proxy-6b7c78b9ff-mfqm7"
Jul 02 20:37:58.236280 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:58.236277    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d720f11-000d-4f79-9630-b7fc1aced41d-tls-certs\") pod \"kube-auth-proxy-6b7c78b9ff-mfqm7\" (UID: \"5d720f11-000d-4f79-9630-b7fc1aced41d\") " pod="openshift-ingress/kube-auth-proxy-6b7c78b9ff-mfqm7"
Jul 02 20:37:58.236540 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:58.236302    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d720f11-000d-4f79-9630-b7fc1aced41d-tmp\") pod \"kube-auth-proxy-6b7c78b9ff-mfqm7\" (UID: \"5d720f11-000d-4f79-9630-b7fc1aced41d\") " pod="openshift-ingress/kube-auth-proxy-6b7c78b9ff-mfqm7"
Jul 02 20:37:58.238615 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:58.238589    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d720f11-000d-4f79-9630-b7fc1aced41d-tmp\") pod \"kube-auth-proxy-6b7c78b9ff-mfqm7\" (UID: \"5d720f11-000d-4f79-9630-b7fc1aced41d\") " pod="openshift-ingress/kube-auth-proxy-6b7c78b9ff-mfqm7"
Jul 02 20:37:58.238954 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:58.238930    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d720f11-000d-4f79-9630-b7fc1aced41d-tls-certs\") pod \"kube-auth-proxy-6b7c78b9ff-mfqm7\" (UID: \"5d720f11-000d-4f79-9630-b7fc1aced41d\") " pod="openshift-ingress/kube-auth-proxy-6b7c78b9ff-mfqm7"
Jul 02 20:37:58.264310 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:58.264289    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdmps\" (UniqueName: \"kubernetes.io/projected/5d720f11-000d-4f79-9630-b7fc1aced41d-kube-api-access-qdmps\") pod \"kube-auth-proxy-6b7c78b9ff-mfqm7\" (UID: \"5d720f11-000d-4f79-9630-b7fc1aced41d\") " pod="openshift-ingress/kube-auth-proxy-6b7c78b9ff-mfqm7"
Jul 02 20:37:58.335589 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:58.335554    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6b7c78b9ff-mfqm7"
Jul 02 20:37:58.361884 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:58.361848    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-htrmh"]
Jul 02 20:37:58.365968 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:58.365947    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-htrmh"
Jul 02 20:37:58.374307 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:58.374284    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 02 20:37:58.374447 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:58.374295    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-52pv8\""
Jul 02 20:37:58.390326 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:58.390301    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-htrmh"]
Jul 02 20:37:58.436818 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:58.436682    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:58.437694 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:58.437572    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crd5c\" (UniqueName: \"kubernetes.io/projected/f6a3ca25-8474-4b07-b804-21cc151b987f-kube-api-access-crd5c\") pod \"odh-model-controller-7998c67dc4-htrmh\" (UID: \"f6a3ca25-8474-4b07-b804-21cc151b987f\") " pod="opendatahub/odh-model-controller-7998c67dc4-htrmh"
Jul 02 20:37:58.437694 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:58.437655    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f6a3ca25-8474-4b07-b804-21cc151b987f-cert\") pod \"odh-model-controller-7998c67dc4-htrmh\" (UID: \"f6a3ca25-8474-4b07-b804-21cc151b987f\") " pod="opendatahub/odh-model-controller-7998c67dc4-htrmh"
Jul 02 20:37:58.488892 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:58.488861    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6b7c78b9ff-mfqm7"]
Jul 02 20:37:58.494530 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:37:58.494505    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d720f11_000d_4f79_9630_b7fc1aced41d.slice/crio-5c2d9d6934ebed4b2b817be42e2e96a0429538277a0aa7164c4880c7d2efbd61 WatchSource:0}: Error finding container 5c2d9d6934ebed4b2b817be42e2e96a0429538277a0aa7164c4880c7d2efbd61: Status 404 returned error can't find the container with id 5c2d9d6934ebed4b2b817be42e2e96a0429538277a0aa7164c4880c7d2efbd61
Jul 02 20:37:58.496250 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:58.496233    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 20:37:58.538341 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:58.538318    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crd5c\" (UniqueName: \"kubernetes.io/projected/f6a3ca25-8474-4b07-b804-21cc151b987f-kube-api-access-crd5c\") pod \"odh-model-controller-7998c67dc4-htrmh\" (UID: \"f6a3ca25-8474-4b07-b804-21cc151b987f\") " pod="opendatahub/odh-model-controller-7998c67dc4-htrmh"
Jul 02 20:37:58.538442 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:58.538365    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f6a3ca25-8474-4b07-b804-21cc151b987f-cert\") pod \"odh-model-controller-7998c67dc4-htrmh\" (UID: \"f6a3ca25-8474-4b07-b804-21cc151b987f\") " pod="opendatahub/odh-model-controller-7998c67dc4-htrmh"
Jul 02 20:37:58.538489 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:37:58.538460    2581 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 02 20:37:58.538528 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:37:58.538520    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6a3ca25-8474-4b07-b804-21cc151b987f-cert podName:f6a3ca25-8474-4b07-b804-21cc151b987f nodeName:}" failed. No retries permitted until 2026-07-02 20:37:59.038505263 +0000 UTC m=+312.709018735 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f6a3ca25-8474-4b07-b804-21cc151b987f-cert") pod "odh-model-controller-7998c67dc4-htrmh" (UID: "f6a3ca25-8474-4b07-b804-21cc151b987f") : secret "odh-model-controller-webhook-cert" not found
Jul 02 20:37:58.571763 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:58.571738    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crd5c\" (UniqueName: \"kubernetes.io/projected/f6a3ca25-8474-4b07-b804-21cc151b987f-kube-api-access-crd5c\") pod \"odh-model-controller-7998c67dc4-htrmh\" (UID: \"f6a3ca25-8474-4b07-b804-21cc151b987f\") " pod="opendatahub/odh-model-controller-7998c67dc4-htrmh"
Jul 02 20:37:58.654441 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:58.654372    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:58.744678 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:58.744642    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:58.989036 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:58.988992    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6b7c78b9ff-mfqm7" event={"ID":"5d720f11-000d-4f79-9630-b7fc1aced41d","Type":"ContainerStarted","Data":"5c2d9d6934ebed4b2b817be42e2e96a0429538277a0aa7164c4880c7d2efbd61"}
Jul 02 20:37:59.042972 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:59.042941    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f6a3ca25-8474-4b07-b804-21cc151b987f-cert\") pod \"odh-model-controller-7998c67dc4-htrmh\" (UID: \"f6a3ca25-8474-4b07-b804-21cc151b987f\") " pod="opendatahub/odh-model-controller-7998c67dc4-htrmh"
Jul 02 20:37:59.045243 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:59.045214    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f6a3ca25-8474-4b07-b804-21cc151b987f-cert\") pod \"odh-model-controller-7998c67dc4-htrmh\" (UID: \"f6a3ca25-8474-4b07-b804-21cc151b987f\") " pod="opendatahub/odh-model-controller-7998c67dc4-htrmh"
Jul 02 20:37:59.277903 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:59.277790    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-htrmh"
Jul 02 20:37:59.438812 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:37:59.438776    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6a3ca25_8474_4b07_b804_21cc151b987f.slice/crio-df8513ae3bac96f0164535f928a9a12b8b52e4c82d69af89a45a4e3c43878ec8 WatchSource:0}: Error finding container df8513ae3bac96f0164535f928a9a12b8b52e4c82d69af89a45a4e3c43878ec8: Status 404 returned error can't find the container with id df8513ae3bac96f0164535f928a9a12b8b52e4c82d69af89a45a4e3c43878ec8
Jul 02 20:37:59.441217 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:59.441109    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-htrmh"]
Jul 02 20:37:59.463094 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:59.463057    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:59.487569 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:59.487537    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-6d4cj"]
Jul 02 20:37:59.491768 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:59.491748    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-6d4cj"
Jul 02 20:37:59.494935 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:59.494915    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-dm7rb\""
Jul 02 20:37:59.495311 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:59.495296    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 02 20:37:59.530850 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:59.530778    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-6d4cj"]
Jul 02 20:37:59.646701 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:59.646666    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d131827-61dd-4d81-95df-d3ae5ad17915-tls-certs\") pod \"model-serving-api-54d89bd5fc-6d4cj\" (UID: \"6d131827-61dd-4d81-95df-d3ae5ad17915\") " pod="opendatahub/model-serving-api-54d89bd5fc-6d4cj"
Jul 02 20:37:59.646869 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:59.646762    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvq8h\" (UniqueName: \"kubernetes.io/projected/6d131827-61dd-4d81-95df-d3ae5ad17915-kube-api-access-zvq8h\") pod \"model-serving-api-54d89bd5fc-6d4cj\" (UID: \"6d131827-61dd-4d81-95df-d3ae5ad17915\") " pod="opendatahub/model-serving-api-54d89bd5fc-6d4cj"
Jul 02 20:37:59.651385 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:59.651346    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:59.747338 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:59.747300    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d131827-61dd-4d81-95df-d3ae5ad17915-tls-certs\") pod \"model-serving-api-54d89bd5fc-6d4cj\" (UID: \"6d131827-61dd-4d81-95df-d3ae5ad17915\") " pod="opendatahub/model-serving-api-54d89bd5fc-6d4cj"
Jul 02 20:37:59.747527 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:59.747381    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvq8h\" (UniqueName: \"kubernetes.io/projected/6d131827-61dd-4d81-95df-d3ae5ad17915-kube-api-access-zvq8h\") pod \"model-serving-api-54d89bd5fc-6d4cj\" (UID: \"6d131827-61dd-4d81-95df-d3ae5ad17915\") " pod="opendatahub/model-serving-api-54d89bd5fc-6d4cj"
Jul 02 20:37:59.750121 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:59.750096    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d131827-61dd-4d81-95df-d3ae5ad17915-tls-certs\") pod \"model-serving-api-54d89bd5fc-6d4cj\" (UID: \"6d131827-61dd-4d81-95df-d3ae5ad17915\") " pod="opendatahub/model-serving-api-54d89bd5fc-6d4cj"
Jul 02 20:37:59.758272 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:59.758240    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvq8h\" (UniqueName: \"kubernetes.io/projected/6d131827-61dd-4d81-95df-d3ae5ad17915-kube-api-access-zvq8h\") pod \"model-serving-api-54d89bd5fc-6d4cj\" (UID: \"6d131827-61dd-4d81-95df-d3ae5ad17915\") " pod="opendatahub/model-serving-api-54d89bd5fc-6d4cj"
Jul 02 20:37:59.802061 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:59.801979    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-6d4cj"
Jul 02 20:37:59.884387 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:59.884329    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:59.885454 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:59.885425    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-h9hfw"]
Jul 02 20:37:59.889774 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:59.889753    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-h9hfw"
Jul 02 20:37:59.892406 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:59.892252    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 02 20:37:59.892577 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:59.892551    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-zvj8g\""
Jul 02 20:37:59.892667 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:59.892597    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 02 20:37:59.892667 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:59.892626    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 02 20:37:59.892860 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:59.892837    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 02 20:37:59.907713 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:59.907678    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-h9hfw"]
Jul 02 20:37:59.948900 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:59.948870    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f6e6a5c-603d-46e8-a405-7a6ae84c55bb-istio-token\") pod \"istiod-openshift-gateway-7574459656-h9hfw\" (UID: \"6f6e6a5c-603d-46e8-a405-7a6ae84c55bb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h9hfw"
Jul 02 20:37:59.949064 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:59.948915    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wvfq\" (UniqueName: \"kubernetes.io/projected/6f6e6a5c-603d-46e8-a405-7a6ae84c55bb-kube-api-access-2wvfq\") pod \"istiod-openshift-gateway-7574459656-h9hfw\" (UID: \"6f6e6a5c-603d-46e8-a405-7a6ae84c55bb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h9hfw"
Jul 02 20:37:59.949064 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:59.948942    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6f6e6a5c-603d-46e8-a405-7a6ae84c55bb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-h9hfw\" (UID: \"6f6e6a5c-603d-46e8-a405-7a6ae84c55bb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h9hfw"
Jul 02 20:37:59.949064 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:59.948985    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6f6e6a5c-603d-46e8-a405-7a6ae84c55bb-cacerts\") pod \"istiod-openshift-gateway-7574459656-h9hfw\" (UID: \"6f6e6a5c-603d-46e8-a405-7a6ae84c55bb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h9hfw"
Jul 02 20:37:59.949064 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:59.949009    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6f6e6a5c-603d-46e8-a405-7a6ae84c55bb-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-h9hfw\" (UID: \"6f6e6a5c-603d-46e8-a405-7a6ae84c55bb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h9hfw"
Jul 02 20:37:59.949064 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:59.949029    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6f6e6a5c-603d-46e8-a405-7a6ae84c55bb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-h9hfw\" (UID: \"6f6e6a5c-603d-46e8-a405-7a6ae84c55bb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h9hfw"
Jul 02 20:37:59.949064 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:59.949058    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f6e6a5c-603d-46e8-a405-7a6ae84c55bb-local-certs\") pod \"istiod-openshift-gateway-7574459656-h9hfw\" (UID: \"6f6e6a5c-603d-46e8-a405-7a6ae84c55bb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h9hfw"
Jul 02 20:37:59.963130 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:59.963104    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-6d4cj"]
Jul 02 20:37:59.965501 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:37:59.965463    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d131827_61dd_4d81_95df_d3ae5ad17915.slice/crio-899401d9d701567253132bfd485a7dccf49251eb1505011597dbeec2f5756354 WatchSource:0}: Error finding container 899401d9d701567253132bfd485a7dccf49251eb1505011597dbeec2f5756354: Status 404 returned error can't find the container with id 899401d9d701567253132bfd485a7dccf49251eb1505011597dbeec2f5756354
Jul 02 20:37:59.968230 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:59.968184    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:37:59.994210 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:59.994175    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-6d4cj" event={"ID":"6d131827-61dd-4d81-95df-d3ae5ad17915","Type":"ContainerStarted","Data":"899401d9d701567253132bfd485a7dccf49251eb1505011597dbeec2f5756354"}
Jul 02 20:37:59.995456 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:37:59.995435    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-htrmh" event={"ID":"f6a3ca25-8474-4b07-b804-21cc151b987f","Type":"ContainerStarted","Data":"df8513ae3bac96f0164535f928a9a12b8b52e4c82d69af89a45a4e3c43878ec8"}
Jul 02 20:38:00.050600 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:00.049931    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6f6e6a5c-603d-46e8-a405-7a6ae84c55bb-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-h9hfw\" (UID: \"6f6e6a5c-603d-46e8-a405-7a6ae84c55bb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h9hfw"
Jul 02 20:38:00.050600 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:00.049983    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6f6e6a5c-603d-46e8-a405-7a6ae84c55bb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-h9hfw\" (UID: \"6f6e6a5c-603d-46e8-a405-7a6ae84c55bb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h9hfw"
Jul 02 20:38:00.050600 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:00.050050    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f6e6a5c-603d-46e8-a405-7a6ae84c55bb-local-certs\") pod \"istiod-openshift-gateway-7574459656-h9hfw\" (UID: \"6f6e6a5c-603d-46e8-a405-7a6ae84c55bb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h9hfw"
Jul 02 20:38:00.050600 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:00.050095    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f6e6a5c-603d-46e8-a405-7a6ae84c55bb-istio-token\") pod \"istiod-openshift-gateway-7574459656-h9hfw\" (UID: \"6f6e6a5c-603d-46e8-a405-7a6ae84c55bb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h9hfw"
Jul 02 20:38:00.050600 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:00.050174    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wvfq\" (UniqueName: \"kubernetes.io/projected/6f6e6a5c-603d-46e8-a405-7a6ae84c55bb-kube-api-access-2wvfq\") pod \"istiod-openshift-gateway-7574459656-h9hfw\" (UID: \"6f6e6a5c-603d-46e8-a405-7a6ae84c55bb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h9hfw"
Jul 02 20:38:00.050600 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:00.050203    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6f6e6a5c-603d-46e8-a405-7a6ae84c55bb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-h9hfw\" (UID: \"6f6e6a5c-603d-46e8-a405-7a6ae84c55bb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h9hfw"
Jul 02 20:38:00.050600 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:00.050241    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6f6e6a5c-603d-46e8-a405-7a6ae84c55bb-cacerts\") pod \"istiod-openshift-gateway-7574459656-h9hfw\" (UID: \"6f6e6a5c-603d-46e8-a405-7a6ae84c55bb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h9hfw"
Jul 02 20:38:00.051643 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:00.051609    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6f6e6a5c-603d-46e8-a405-7a6ae84c55bb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-h9hfw\" (UID: \"6f6e6a5c-603d-46e8-a405-7a6ae84c55bb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h9hfw"
Jul 02 20:38:00.053218 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:00.053126    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6f6e6a5c-603d-46e8-a405-7a6ae84c55bb-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-h9hfw\" (UID: \"6f6e6a5c-603d-46e8-a405-7a6ae84c55bb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h9hfw"
Jul 02 20:38:00.054815 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:00.054772    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6f6e6a5c-603d-46e8-a405-7a6ae84c55bb-cacerts\") pod \"istiod-openshift-gateway-7574459656-h9hfw\" (UID: \"6f6e6a5c-603d-46e8-a405-7a6ae84c55bb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h9hfw"
Jul 02 20:38:00.056248 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:00.056157    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f6e6a5c-603d-46e8-a405-7a6ae84c55bb-local-certs\") pod \"istiod-openshift-gateway-7574459656-h9hfw\" (UID: \"6f6e6a5c-603d-46e8-a405-7a6ae84c55bb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h9hfw"
Jul 02 20:38:00.056632 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:00.056593    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6f6e6a5c-603d-46e8-a405-7a6ae84c55bb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-h9hfw\" (UID: \"6f6e6a5c-603d-46e8-a405-7a6ae84c55bb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h9hfw"
Jul 02 20:38:00.062035 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:00.061640    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f6e6a5c-603d-46e8-a405-7a6ae84c55bb-istio-token\") pod \"istiod-openshift-gateway-7574459656-h9hfw\" (UID: \"6f6e6a5c-603d-46e8-a405-7a6ae84c55bb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h9hfw"
Jul 02 20:38:00.062180 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:00.062066    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wvfq\" (UniqueName: \"kubernetes.io/projected/6f6e6a5c-603d-46e8-a405-7a6ae84c55bb-kube-api-access-2wvfq\") pod \"istiod-openshift-gateway-7574459656-h9hfw\" (UID: \"6f6e6a5c-603d-46e8-a405-7a6ae84c55bb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-h9hfw"
Jul 02 20:38:00.201557 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:00.201525    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-h9hfw"
Jul 02 20:38:00.381756 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:00.381728    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-h9hfw"]
Jul 02 20:38:00.385430 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:38:00.385396    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f6e6a5c_603d_46e8_a405_7a6ae84c55bb.slice/crio-262ca72cf83d7ca7c3b49325620ea27db4cb31a6f45cd86f949519c2ad73d3a4 WatchSource:0}: Error finding container 262ca72cf83d7ca7c3b49325620ea27db4cb31a6f45cd86f949519c2ad73d3a4: Status 404 returned error can't find the container with id 262ca72cf83d7ca7c3b49325620ea27db4cb31a6f45cd86f949519c2ad73d3a4
Jul 02 20:38:01.001091 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:01.001055    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-h9hfw" event={"ID":"6f6e6a5c-603d-46e8-a405-7a6ae84c55bb","Type":"ContainerStarted","Data":"262ca72cf83d7ca7c3b49325620ea27db4cb31a6f45cd86f949519c2ad73d3a4"}
Jul 02 20:38:01.176903 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:01.176865    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:04.023197 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:04.023091    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-6d4cj" event={"ID":"6d131827-61dd-4d81-95df-d3ae5ad17915","Type":"ContainerStarted","Data":"968bc4aa849c547151b03b7f7056153b0a0d03fbe027e6f38b829a1593e450d8"}
Jul 02 20:38:04.023197 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:04.023182    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-6d4cj"
Jul 02 20:38:04.024898 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:04.024870    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-htrmh" event={"ID":"f6a3ca25-8474-4b07-b804-21cc151b987f","Type":"ContainerStarted","Data":"cb3a65e461f5d84725cdc1d2f8da21e967c83d752d7652e341af1dce4ac76448"}
Jul 02 20:38:04.025014 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:04.024936    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-htrmh"
Jul 02 20:38:04.027373 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:04.027349    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6b7c78b9ff-mfqm7" event={"ID":"5d720f11-000d-4f79-9630-b7fc1aced41d","Type":"ContainerStarted","Data":"0710c1a2d9168c3a33f6d30d206a61a46fd1334a6560cba4f100c2118ec088c9"}
Jul 02 20:38:04.046351 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:04.046300    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-6d4cj" podStartSLOduration=1.2952851459999999 podStartE2EDuration="5.04628133s" totalImagesPullingTime="3.750996184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:37:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:38:04.045172963 +0000 UTC m=+317.715686457" watchObservedRunningTime="2026-07-02 20:38:04.04628133 +0000 UTC m=+317.716794824"
Jul 02 20:38:04.066131 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:04.066085    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6b7c78b9ff-mfqm7" podStartSLOduration=1.8482238720000002 podStartE2EDuration="7.066070365s" totalImagesPullingTime="5.217846493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:37:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:38:04.063628328 +0000 UTC m=+317.734141819" watchObservedRunningTime="2026-07-02 20:38:04.066070365 +0000 UTC m=+317.736583849"
Jul 02 20:38:04.082226 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:04.082176    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-htrmh" podStartSLOduration=1.792934931 podStartE2EDuration="6.082157633s" totalImagesPullingTime="4.289222702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:37:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:38:04.080115747 +0000 UTC m=+317.750629240" watchObservedRunningTime="2026-07-02 20:38:04.082157633 +0000 UTC m=+317.752671126"
Jul 02 20:38:05.171467 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:05.171430    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:38:05.171744 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:05.171497    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:38:05.793882 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:05.793842    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:06.038819 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:06.038787    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-h9hfw" event={"ID":"6f6e6a5c-603d-46e8-a405-7a6ae84c55bb","Type":"ContainerStarted","Data":"f3c27227b2a0e972417395bb0a223992c63c2093386d8b2512cf9f3330a4155a"}
Jul 02 20:38:06.039042 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:06.039019    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-h9hfw"
Jul 02 20:38:06.040878 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:06.040847    2581 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-h9hfw container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 02 20:38:06.040979 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:06.040902    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-h9hfw" podUID="6f6e6a5c-603d-46e8-a405-7a6ae84c55bb" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 20:38:06.077488 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:06.077395    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-h9hfw" podStartSLOduration=2.294236295 podStartE2EDuration="7.07737785s" totalImagesPullingTime="4.783141555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:37:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:38:06.075438631 +0000 UTC m=+319.745952138" watchObservedRunningTime="2026-07-02 20:38:06.07737785 +0000 UTC m=+319.747891343"
Jul 02 20:38:07.043303 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:07.043268    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-h9hfw"
Jul 02 20:38:07.200828 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:07.200794    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:11.085151 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:11.085111    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:11.272152 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:11.272106    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:11.533925 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:11.533887    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:11.689987 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:11.689953    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:11.782442 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:11.782414    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:13.470132 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:13.470099    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-h9hfw"]
Jul 02 20:38:13.470549 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:13.470286    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-h9hfw" podUID="6f6e6a5c-603d-46e8-a405-7a6ae84c55bb" containerName="discovery" containerID="cri-o://f3c27227b2a0e972417395bb0a223992c63c2093386d8b2512cf9f3330a4155a" gracePeriod=30
Jul 02 20:38:13.708301 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:13.708279    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-h9hfw"
Jul 02 20:38:13.868986 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:13.868922    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6f6e6a5c-603d-46e8-a405-7a6ae84c55bb-istio-csr-dns-cert\") pod \"6f6e6a5c-603d-46e8-a405-7a6ae84c55bb\" (UID: \"6f6e6a5c-603d-46e8-a405-7a6ae84c55bb\") "
Jul 02 20:38:13.868986 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:13.868951    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f6e6a5c-603d-46e8-a405-7a6ae84c55bb-istio-token\") pod \"6f6e6a5c-603d-46e8-a405-7a6ae84c55bb\" (UID: \"6f6e6a5c-603d-46e8-a405-7a6ae84c55bb\") "
Jul 02 20:38:13.868986 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:13.868967    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6f6e6a5c-603d-46e8-a405-7a6ae84c55bb-istio-kubeconfig\") pod \"6f6e6a5c-603d-46e8-a405-7a6ae84c55bb\" (UID: \"6f6e6a5c-603d-46e8-a405-7a6ae84c55bb\") "
Jul 02 20:38:13.869277 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:13.869000    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6f6e6a5c-603d-46e8-a405-7a6ae84c55bb-istio-csr-ca-configmap\") pod \"6f6e6a5c-603d-46e8-a405-7a6ae84c55bb\" (UID: \"6f6e6a5c-603d-46e8-a405-7a6ae84c55bb\") "
Jul 02 20:38:13.869277 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:13.869053    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6f6e6a5c-603d-46e8-a405-7a6ae84c55bb-cacerts\") pod \"6f6e6a5c-603d-46e8-a405-7a6ae84c55bb\" (UID: \"6f6e6a5c-603d-46e8-a405-7a6ae84c55bb\") "
Jul 02 20:38:13.869277 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:13.869103    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f6e6a5c-603d-46e8-a405-7a6ae84c55bb-local-certs\") pod \"6f6e6a5c-603d-46e8-a405-7a6ae84c55bb\" (UID: \"6f6e6a5c-603d-46e8-a405-7a6ae84c55bb\") "
Jul 02 20:38:13.869277 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:13.869130    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wvfq\" (UniqueName: \"kubernetes.io/projected/6f6e6a5c-603d-46e8-a405-7a6ae84c55bb-kube-api-access-2wvfq\") pod \"6f6e6a5c-603d-46e8-a405-7a6ae84c55bb\" (UID: \"6f6e6a5c-603d-46e8-a405-7a6ae84c55bb\") "
Jul 02 20:38:13.869486 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:13.869430    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f6e6a5c-603d-46e8-a405-7a6ae84c55bb-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "6f6e6a5c-603d-46e8-a405-7a6ae84c55bb" (UID: "6f6e6a5c-603d-46e8-a405-7a6ae84c55bb"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:38:13.871351 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:13.871323    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f6e6a5c-603d-46e8-a405-7a6ae84c55bb-istio-token" (OuterVolumeSpecName: "istio-token") pod "6f6e6a5c-603d-46e8-a405-7a6ae84c55bb" (UID: "6f6e6a5c-603d-46e8-a405-7a6ae84c55bb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:38:13.871452 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:13.871377    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f6e6a5c-603d-46e8-a405-7a6ae84c55bb-local-certs" (OuterVolumeSpecName: "local-certs") pod "6f6e6a5c-603d-46e8-a405-7a6ae84c55bb" (UID: "6f6e6a5c-603d-46e8-a405-7a6ae84c55bb"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:38:13.871568 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:13.871550    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f6e6a5c-603d-46e8-a405-7a6ae84c55bb-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "6f6e6a5c-603d-46e8-a405-7a6ae84c55bb" (UID: "6f6e6a5c-603d-46e8-a405-7a6ae84c55bb"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:38:13.871627 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:13.871612    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f6e6a5c-603d-46e8-a405-7a6ae84c55bb-cacerts" (OuterVolumeSpecName: "cacerts") pod "6f6e6a5c-603d-46e8-a405-7a6ae84c55bb" (UID: "6f6e6a5c-603d-46e8-a405-7a6ae84c55bb"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:38:13.871664 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:13.871634    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f6e6a5c-603d-46e8-a405-7a6ae84c55bb-kube-api-access-2wvfq" (OuterVolumeSpecName: "kube-api-access-2wvfq") pod "6f6e6a5c-603d-46e8-a405-7a6ae84c55bb" (UID: "6f6e6a5c-603d-46e8-a405-7a6ae84c55bb"). InnerVolumeSpecName "kube-api-access-2wvfq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:38:13.871738 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:13.871718    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f6e6a5c-603d-46e8-a405-7a6ae84c55bb-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "6f6e6a5c-603d-46e8-a405-7a6ae84c55bb" (UID: "6f6e6a5c-603d-46e8-a405-7a6ae84c55bb"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:38:13.970236 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:13.970209    2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6f6e6a5c-603d-46e8-a405-7a6ae84c55bb-istio-csr-dns-cert\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:38:13.970236 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:13.970235    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f6e6a5c-603d-46e8-a405-7a6ae84c55bb-istio-token\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:38:13.970417 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:13.970251    2581 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6f6e6a5c-603d-46e8-a405-7a6ae84c55bb-istio-kubeconfig\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:38:13.970417 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:13.970262    2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6f6e6a5c-603d-46e8-a405-7a6ae84c55bb-istio-csr-ca-configmap\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:38:13.970417 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:13.970274    2581 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6f6e6a5c-603d-46e8-a405-7a6ae84c55bb-cacerts\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:38:13.970417 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:13.970285    2581 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f6e6a5c-603d-46e8-a405-7a6ae84c55bb-local-certs\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:38:13.970417 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:13.970297    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wvfq\" (UniqueName: \"kubernetes.io/projected/6f6e6a5c-603d-46e8-a405-7a6ae84c55bb-kube-api-access-2wvfq\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:38:14.071785 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:14.071750    2581 generic.go:356] "Generic (PLEG): container finished" podID="6f6e6a5c-603d-46e8-a405-7a6ae84c55bb" containerID="f3c27227b2a0e972417395bb0a223992c63c2093386d8b2512cf9f3330a4155a" exitCode=0
Jul 02 20:38:14.071929 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:14.071794    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-h9hfw"
Jul 02 20:38:14.071929 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:14.071814    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-h9hfw" event={"ID":"6f6e6a5c-603d-46e8-a405-7a6ae84c55bb","Type":"ContainerDied","Data":"f3c27227b2a0e972417395bb0a223992c63c2093386d8b2512cf9f3330a4155a"}
Jul 02 20:38:14.071929 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:14.071856    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-h9hfw" event={"ID":"6f6e6a5c-603d-46e8-a405-7a6ae84c55bb","Type":"ContainerDied","Data":"262ca72cf83d7ca7c3b49325620ea27db4cb31a6f45cd86f949519c2ad73d3a4"}
Jul 02 20:38:14.071929 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:14.071878    2581 scope.go:117] "RemoveContainer" containerID="f3c27227b2a0e972417395bb0a223992c63c2093386d8b2512cf9f3330a4155a"
Jul 02 20:38:14.080790 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:14.080776    2581 scope.go:117] "RemoveContainer" containerID="f3c27227b2a0e972417395bb0a223992c63c2093386d8b2512cf9f3330a4155a"
Jul 02 20:38:14.081018 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:38:14.080996    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3c27227b2a0e972417395bb0a223992c63c2093386d8b2512cf9f3330a4155a\": container with ID starting with f3c27227b2a0e972417395bb0a223992c63c2093386d8b2512cf9f3330a4155a not found: ID does not exist" containerID="f3c27227b2a0e972417395bb0a223992c63c2093386d8b2512cf9f3330a4155a"
Jul 02 20:38:14.081064 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:14.081026    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3c27227b2a0e972417395bb0a223992c63c2093386d8b2512cf9f3330a4155a"} err="failed to get container status \"f3c27227b2a0e972417395bb0a223992c63c2093386d8b2512cf9f3330a4155a\": rpc error: code = NotFound desc = could not find container \"f3c27227b2a0e972417395bb0a223992c63c2093386d8b2512cf9f3330a4155a\": container with ID starting with f3c27227b2a0e972417395bb0a223992c63c2093386d8b2512cf9f3330a4155a not found: ID does not exist"
Jul 02 20:38:14.115124 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:14.113938    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-h9hfw"]
Jul 02 20:38:14.122564 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:14.122509    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-h9hfw"]
Jul 02 20:38:14.879952 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:14.879916    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f6e6a5c-603d-46e8-a405-7a6ae84c55bb" path="/var/lib/kubelet/pods/6f6e6a5c-603d-46e8-a405-7a6ae84c55bb/volumes"
Jul 02 20:38:15.034892 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:15.034867    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-htrmh"
Jul 02 20:38:15.036791 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:15.036772    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-6d4cj"
Jul 02 20:38:55.873389 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:55.873351    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:57.767127 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:57.767094    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:57.848073 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:57.848046    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:58.936541 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:58.936506    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:59.059010 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:59.058980    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mz5bv"]
Jul 02 20:38:59.059259 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:59.059246    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f6e6a5c-603d-46e8-a405-7a6ae84c55bb" containerName="discovery"
Jul 02 20:38:59.059328 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:59.059261    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f6e6a5c-603d-46e8-a405-7a6ae84c55bb" containerName="discovery"
Jul 02 20:38:59.059328 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:59.059307    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f6e6a5c-603d-46e8-a405-7a6ae84c55bb" containerName="discovery"
Jul 02 20:38:59.061755 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:59.061728    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mz5bv"
Jul 02 20:38:59.078255 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:59.078226    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 02 20:38:59.079054 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:59.079037    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 02 20:38:59.079124 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:59.079038    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-w796f\""
Jul 02 20:38:59.083657 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:59.083635    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:59.087520 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:59.087500    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mz5bv"]
Jul 02 20:38:59.178336 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:59.178300    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vxsw\" (UniqueName: \"kubernetes.io/projected/fbe11615-c796-4751-9934-0811b7382d01-kube-api-access-2vxsw\") pod \"kuadrant-operator-catalog-mz5bv\" (UID: \"fbe11615-c796-4751-9934-0811b7382d01\") " pod="kuadrant-system/kuadrant-operator-catalog-mz5bv"
Jul 02 20:38:59.218074 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:59.218046    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:38:59.278654 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:59.278626    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vxsw\" (UniqueName: \"kubernetes.io/projected/fbe11615-c796-4751-9934-0811b7382d01-kube-api-access-2vxsw\") pod \"kuadrant-operator-catalog-mz5bv\" (UID: \"fbe11615-c796-4751-9934-0811b7382d01\") " pod="kuadrant-system/kuadrant-operator-catalog-mz5bv"
Jul 02 20:38:59.290793 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:59.290761    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vxsw\" (UniqueName: \"kubernetes.io/projected/fbe11615-c796-4751-9934-0811b7382d01-kube-api-access-2vxsw\") pod \"kuadrant-operator-catalog-mz5bv\" (UID: \"fbe11615-c796-4751-9934-0811b7382d01\") " pod="kuadrant-system/kuadrant-operator-catalog-mz5bv"
Jul 02 20:38:59.370969 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:59.370946    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mz5bv"
Jul 02 20:38:59.389967 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:59.389943    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mz5bv"]
Jul 02 20:38:59.508455 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:59.508426    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mz5bv"]
Jul 02 20:38:59.510564 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:38:59.510533    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbe11615_c796_4751_9934_0811b7382d01.slice/crio-215755f393206fd0f9e011135cb487b455b006ba1134c3cd7b130201c4d0ee0a WatchSource:0}: Error finding container 215755f393206fd0f9e011135cb487b455b006ba1134c3cd7b130201c4d0ee0a: Status 404 returned error can't find the container with id 215755f393206fd0f9e011135cb487b455b006ba1134c3cd7b130201c4d0ee0a
Jul 02 20:38:59.607554 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:59.607523    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sck8x"]
Jul 02 20:38:59.610333 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:59.610313    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sck8x"
Jul 02 20:38:59.632074 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:59.632056    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sck8x"]
Jul 02 20:38:59.680879 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:59.680851    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kphzw\" (UniqueName: \"kubernetes.io/projected/f1d353ab-cd4d-4e5d-8a8a-d52b4d28d2e9-kube-api-access-kphzw\") pod \"kuadrant-operator-catalog-sck8x\" (UID: \"f1d353ab-cd4d-4e5d-8a8a-d52b4d28d2e9\") " pod="kuadrant-system/kuadrant-operator-catalog-sck8x"
Jul 02 20:38:59.781582 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:59.781506    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kphzw\" (UniqueName: \"kubernetes.io/projected/f1d353ab-cd4d-4e5d-8a8a-d52b4d28d2e9-kube-api-access-kphzw\") pod \"kuadrant-operator-catalog-sck8x\" (UID: \"f1d353ab-cd4d-4e5d-8a8a-d52b4d28d2e9\") " pod="kuadrant-system/kuadrant-operator-catalog-sck8x"
Jul 02 20:38:59.793684 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:59.793663    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kphzw\" (UniqueName: \"kubernetes.io/projected/f1d353ab-cd4d-4e5d-8a8a-d52b4d28d2e9-kube-api-access-kphzw\") pod \"kuadrant-operator-catalog-sck8x\" (UID: \"f1d353ab-cd4d-4e5d-8a8a-d52b4d28d2e9\") " pod="kuadrant-system/kuadrant-operator-catalog-sck8x"
Jul 02 20:38:59.918707 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:38:59.918677    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sck8x"
Jul 02 20:39:00.045892 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:00.045867    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sck8x"]
Jul 02 20:39:00.047477 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:39:00.047450    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1d353ab_cd4d_4e5d_8a8a_d52b4d28d2e9.slice/crio-d413688bdfe21092344379415229c3ac65ac2e856705b8afff23256e574512e0 WatchSource:0}: Error finding container d413688bdfe21092344379415229c3ac65ac2e856705b8afff23256e574512e0: Status 404 returned error can't find the container with id d413688bdfe21092344379415229c3ac65ac2e856705b8afff23256e574512e0
Jul 02 20:39:00.256766 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:00.256714    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sck8x" event={"ID":"f1d353ab-cd4d-4e5d-8a8a-d52b4d28d2e9","Type":"ContainerStarted","Data":"d413688bdfe21092344379415229c3ac65ac2e856705b8afff23256e574512e0"}
Jul 02 20:39:00.257967 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:00.257931    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mz5bv" event={"ID":"fbe11615-c796-4751-9934-0811b7382d01","Type":"ContainerStarted","Data":"215755f393206fd0f9e011135cb487b455b006ba1134c3cd7b130201c4d0ee0a"}
Jul 02 20:39:02.271891 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:02.271858    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sck8x" event={"ID":"f1d353ab-cd4d-4e5d-8a8a-d52b4d28d2e9","Type":"ContainerStarted","Data":"e549989ac89e5b9db9015c04d83b518de2a02039074701520da69bf05d97cf80"}
Jul 02 20:39:02.273254 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:02.273228    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mz5bv" event={"ID":"fbe11615-c796-4751-9934-0811b7382d01","Type":"ContainerStarted","Data":"70826bdc1caf0669abeba6a085098a3af40eb28bd775d79bf83849811b1d53ae"}
Jul 02 20:39:02.273349 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:02.273324    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-mz5bv" podUID="fbe11615-c796-4751-9934-0811b7382d01" containerName="registry-server" containerID="cri-o://70826bdc1caf0669abeba6a085098a3af40eb28bd775d79bf83849811b1d53ae" gracePeriod=2
Jul 02 20:39:02.288948 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:02.288908    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-sck8x" podStartSLOduration=1.7792618199999999 podStartE2EDuration="3.28889396s" totalImagesPullingTime="1.50963214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:38:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:39:02.287881058 +0000 UTC m=+375.958394553" watchObservedRunningTime="2026-07-02 20:39:02.28889396 +0000 UTC m=+375.959407452"
Jul 02 20:39:02.316041 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:02.315998    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-mz5bv" podStartSLOduration=1.272477458 podStartE2EDuration="3.315984736s" totalImagesPullingTime="2.043507278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:38:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:39:02.315215 +0000 UTC m=+375.985728496" watchObservedRunningTime="2026-07-02 20:39:02.315984736 +0000 UTC m=+375.986498246"
Jul 02 20:39:02.508725 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:02.508703    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mz5bv"
Jul 02 20:39:02.601895 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:02.601816    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vxsw\" (UniqueName: \"kubernetes.io/projected/fbe11615-c796-4751-9934-0811b7382d01-kube-api-access-2vxsw\") pod \"fbe11615-c796-4751-9934-0811b7382d01\" (UID: \"fbe11615-c796-4751-9934-0811b7382d01\") "
Jul 02 20:39:02.603950 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:02.603922    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbe11615-c796-4751-9934-0811b7382d01-kube-api-access-2vxsw" (OuterVolumeSpecName: "kube-api-access-2vxsw") pod "fbe11615-c796-4751-9934-0811b7382d01" (UID: "fbe11615-c796-4751-9934-0811b7382d01"). InnerVolumeSpecName "kube-api-access-2vxsw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:39:02.702598 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:02.702563    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vxsw\" (UniqueName: \"kubernetes.io/projected/fbe11615-c796-4751-9934-0811b7382d01-kube-api-access-2vxsw\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:39:03.278476 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:03.278442    2581 generic.go:356] "Generic (PLEG): container finished" podID="fbe11615-c796-4751-9934-0811b7382d01" containerID="70826bdc1caf0669abeba6a085098a3af40eb28bd775d79bf83849811b1d53ae" exitCode=0
Jul 02 20:39:03.278855 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:03.278490    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mz5bv"
Jul 02 20:39:03.278855 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:03.278530    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mz5bv" event={"ID":"fbe11615-c796-4751-9934-0811b7382d01","Type":"ContainerDied","Data":"70826bdc1caf0669abeba6a085098a3af40eb28bd775d79bf83849811b1d53ae"}
Jul 02 20:39:03.278855 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:03.278578    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mz5bv" event={"ID":"fbe11615-c796-4751-9934-0811b7382d01","Type":"ContainerDied","Data":"215755f393206fd0f9e011135cb487b455b006ba1134c3cd7b130201c4d0ee0a"}
Jul 02 20:39:03.278855 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:03.278599    2581 scope.go:117] "RemoveContainer" containerID="70826bdc1caf0669abeba6a085098a3af40eb28bd775d79bf83849811b1d53ae"
Jul 02 20:39:03.286738 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:03.286717    2581 scope.go:117] "RemoveContainer" containerID="70826bdc1caf0669abeba6a085098a3af40eb28bd775d79bf83849811b1d53ae"
Jul 02 20:39:03.286977 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:39:03.286959    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70826bdc1caf0669abeba6a085098a3af40eb28bd775d79bf83849811b1d53ae\": container with ID starting with 70826bdc1caf0669abeba6a085098a3af40eb28bd775d79bf83849811b1d53ae not found: ID does not exist" containerID="70826bdc1caf0669abeba6a085098a3af40eb28bd775d79bf83849811b1d53ae"
Jul 02 20:39:03.287033 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:03.286984    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70826bdc1caf0669abeba6a085098a3af40eb28bd775d79bf83849811b1d53ae"} err="failed to get container status \"70826bdc1caf0669abeba6a085098a3af40eb28bd775d79bf83849811b1d53ae\": rpc error: code = NotFound desc = could not find container \"70826bdc1caf0669abeba6a085098a3af40eb28bd775d79bf83849811b1d53ae\": container with ID starting with 70826bdc1caf0669abeba6a085098a3af40eb28bd775d79bf83849811b1d53ae not found: ID does not exist"
Jul 02 20:39:03.296243 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:03.296216    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mz5bv"]
Jul 02 20:39:03.303656 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:03.303639    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mz5bv"]
Jul 02 20:39:04.880472 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:04.880437    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbe11615-c796-4751-9934-0811b7382d01" path="/var/lib/kubelet/pods/fbe11615-c796-4751-9934-0811b7382d01/volumes"
Jul 02 20:39:07.555524 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:07.555489    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:39:09.919331 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:09.919296    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-sck8x"
Jul 02 20:39:09.919767 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:09.919347    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-sck8x"
Jul 02 20:39:09.941225 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:09.941202    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-sck8x"
Jul 02 20:39:10.329661 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:10.329635    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-sck8x"
Jul 02 20:39:14.266541 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:14.266510    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6tm4"]
Jul 02 20:39:14.266900 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:14.266768    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbe11615-c796-4751-9934-0811b7382d01" containerName="registry-server"
Jul 02 20:39:14.266900 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:14.266778    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbe11615-c796-4751-9934-0811b7382d01" containerName="registry-server"
Jul 02 20:39:14.266900 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:14.266824    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbe11615-c796-4751-9934-0811b7382d01" containerName="registry-server"
Jul 02 20:39:14.269722 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:14.269707    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6tm4"
Jul 02 20:39:14.280412 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:14.280391    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-z69l8\""
Jul 02 20:39:14.287253 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:14.287230    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6tm4"]
Jul 02 20:39:14.386182 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:14.386134    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqwgz\" (UniqueName: \"kubernetes.io/projected/a77b72cd-490c-42d4-a299-584c5f9535e6-kube-api-access-bqwgz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6tm4\" (UID: \"a77b72cd-490c-42d4-a299-584c5f9535e6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6tm4"
Jul 02 20:39:14.386324 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:14.386226    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a77b72cd-490c-42d4-a299-584c5f9535e6-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6tm4\" (UID: \"a77b72cd-490c-42d4-a299-584c5f9535e6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6tm4"
Jul 02 20:39:14.386324 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:14.386251    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a77b72cd-490c-42d4-a299-584c5f9535e6-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6tm4\" (UID: \"a77b72cd-490c-42d4-a299-584c5f9535e6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6tm4"
Jul 02 20:39:14.487445 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:14.487414    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqwgz\" (UniqueName: \"kubernetes.io/projected/a77b72cd-490c-42d4-a299-584c5f9535e6-kube-api-access-bqwgz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6tm4\" (UID: \"a77b72cd-490c-42d4-a299-584c5f9535e6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6tm4"
Jul 02 20:39:14.487559 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:14.487481    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a77b72cd-490c-42d4-a299-584c5f9535e6-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6tm4\" (UID: \"a77b72cd-490c-42d4-a299-584c5f9535e6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6tm4"
Jul 02 20:39:14.487559 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:14.487505    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a77b72cd-490c-42d4-a299-584c5f9535e6-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6tm4\" (UID: \"a77b72cd-490c-42d4-a299-584c5f9535e6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6tm4"
Jul 02 20:39:14.487827 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:14.487805    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a77b72cd-490c-42d4-a299-584c5f9535e6-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6tm4\" (UID: \"a77b72cd-490c-42d4-a299-584c5f9535e6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6tm4"
Jul 02 20:39:14.487893 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:14.487829    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a77b72cd-490c-42d4-a299-584c5f9535e6-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6tm4\" (UID: \"a77b72cd-490c-42d4-a299-584c5f9535e6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6tm4"
Jul 02 20:39:14.496154 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:14.496122    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqwgz\" (UniqueName: \"kubernetes.io/projected/a77b72cd-490c-42d4-a299-584c5f9535e6-kube-api-access-bqwgz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6tm4\" (UID: \"a77b72cd-490c-42d4-a299-584c5f9535e6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6tm4"
Jul 02 20:39:14.578083 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:14.578031    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6tm4"
Jul 02 20:39:14.742850 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:14.742825    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6tm4"]
Jul 02 20:39:14.744565 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:39:14.744539    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda77b72cd_490c_42d4_a299_584c5f9535e6.slice/crio-16ea6bb1c6d92a1e4187a80ad194e7b3a00ac5df31753fca57ced7de5f937b3a WatchSource:0}: Error finding container 16ea6bb1c6d92a1e4187a80ad194e7b3a00ac5df31753fca57ced7de5f937b3a: Status 404 returned error can't find the container with id 16ea6bb1c6d92a1e4187a80ad194e7b3a00ac5df31753fca57ced7de5f937b3a
Jul 02 20:39:14.871570 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:14.871538    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxlqf"]
Jul 02 20:39:14.876391 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:14.876370    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxlqf"
Jul 02 20:39:14.886103 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:14.886080    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxlqf"]
Jul 02 20:39:14.991342 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:14.991318    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fad2b71e-a9d1-412f-a727-e412b0d438bc-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxlqf\" (UID: \"fad2b71e-a9d1-412f-a727-e412b0d438bc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxlqf"
Jul 02 20:39:14.991457 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:14.991353    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fad2b71e-a9d1-412f-a727-e412b0d438bc-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxlqf\" (UID: \"fad2b71e-a9d1-412f-a727-e412b0d438bc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxlqf"
Jul 02 20:39:14.991457 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:14.991372    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzf5q\" (UniqueName: \"kubernetes.io/projected/fad2b71e-a9d1-412f-a727-e412b0d438bc-kube-api-access-wzf5q\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxlqf\" (UID: \"fad2b71e-a9d1-412f-a727-e412b0d438bc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxlqf"
Jul 02 20:39:15.092024 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:15.091945    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fad2b71e-a9d1-412f-a727-e412b0d438bc-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxlqf\" (UID: \"fad2b71e-a9d1-412f-a727-e412b0d438bc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxlqf"
Jul 02 20:39:15.092024 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:15.091996    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fad2b71e-a9d1-412f-a727-e412b0d438bc-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxlqf\" (UID: \"fad2b71e-a9d1-412f-a727-e412b0d438bc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxlqf"
Jul 02 20:39:15.092235 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:15.092110    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzf5q\" (UniqueName: \"kubernetes.io/projected/fad2b71e-a9d1-412f-a727-e412b0d438bc-kube-api-access-wzf5q\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxlqf\" (UID: \"fad2b71e-a9d1-412f-a727-e412b0d438bc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxlqf"
Jul 02 20:39:15.092409 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:15.092390    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fad2b71e-a9d1-412f-a727-e412b0d438bc-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxlqf\" (UID: \"fad2b71e-a9d1-412f-a727-e412b0d438bc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxlqf"
Jul 02 20:39:15.092444 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:15.092405    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fad2b71e-a9d1-412f-a727-e412b0d438bc-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxlqf\" (UID: \"fad2b71e-a9d1-412f-a727-e412b0d438bc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxlqf"
Jul 02 20:39:15.101022 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:15.100996    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzf5q\" (UniqueName: \"kubernetes.io/projected/fad2b71e-a9d1-412f-a727-e412b0d438bc-kube-api-access-wzf5q\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxlqf\" (UID: \"fad2b71e-a9d1-412f-a727-e412b0d438bc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxlqf"
Jul 02 20:39:15.204493 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:15.204460    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxlqf"
Jul 02 20:39:15.329066 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:15.329026    2581 generic.go:356] "Generic (PLEG): container finished" podID="a77b72cd-490c-42d4-a299-584c5f9535e6" containerID="bdcb8f324581aa29f39d340925a4659e21ebfd96482bbd069c443fbc37da7faf" exitCode=0
Jul 02 20:39:15.329470 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:15.329156    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6tm4" event={"ID":"a77b72cd-490c-42d4-a299-584c5f9535e6","Type":"ContainerDied","Data":"bdcb8f324581aa29f39d340925a4659e21ebfd96482bbd069c443fbc37da7faf"}
Jul 02 20:39:15.329470 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:15.329213    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6tm4" event={"ID":"a77b72cd-490c-42d4-a299-584c5f9535e6","Type":"ContainerStarted","Data":"16ea6bb1c6d92a1e4187a80ad194e7b3a00ac5df31753fca57ced7de5f937b3a"}
Jul 02 20:39:15.332086 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:15.332048    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxlqf"]
Jul 02 20:39:15.333896 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:39:15.333873    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfad2b71e_a9d1_412f_a727_e412b0d438bc.slice/crio-37a4fbb75f39fd8c9d34cdd2d522c522fc865cc06adfdb2077d2edc1faab91ac WatchSource:0}: Error finding container 37a4fbb75f39fd8c9d34cdd2d522c522fc865cc06adfdb2077d2edc1faab91ac: Status 404 returned error can't find the container with id 37a4fbb75f39fd8c9d34cdd2d522c522fc865cc06adfdb2077d2edc1faab91ac
Jul 02 20:39:15.338658 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:15.338639    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkflt"]
Jul 02 20:39:15.341753 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:15.341734    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkflt"
Jul 02 20:39:15.353709 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:15.353686    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkflt"]
Jul 02 20:39:15.394887 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:15.394863    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d62e6708-f73f-4c45-a7c1-8885fe64d21b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkflt\" (UID: \"d62e6708-f73f-4c45-a7c1-8885fe64d21b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkflt"
Jul 02 20:39:15.394979 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:15.394895    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d62e6708-f73f-4c45-a7c1-8885fe64d21b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkflt\" (UID: \"d62e6708-f73f-4c45-a7c1-8885fe64d21b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkflt"
Jul 02 20:39:15.394979 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:15.394936    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psjmp\" (UniqueName: \"kubernetes.io/projected/d62e6708-f73f-4c45-a7c1-8885fe64d21b-kube-api-access-psjmp\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkflt\" (UID: \"d62e6708-f73f-4c45-a7c1-8885fe64d21b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkflt"
Jul 02 20:39:15.496265 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:15.496239    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d62e6708-f73f-4c45-a7c1-8885fe64d21b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkflt\" (UID: \"d62e6708-f73f-4c45-a7c1-8885fe64d21b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkflt"
Jul 02 20:39:15.496380 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:15.496273    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d62e6708-f73f-4c45-a7c1-8885fe64d21b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkflt\" (UID: \"d62e6708-f73f-4c45-a7c1-8885fe64d21b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkflt"
Jul 02 20:39:15.496380 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:15.496295    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psjmp\" (UniqueName: \"kubernetes.io/projected/d62e6708-f73f-4c45-a7c1-8885fe64d21b-kube-api-access-psjmp\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkflt\" (UID: \"d62e6708-f73f-4c45-a7c1-8885fe64d21b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkflt"
Jul 02 20:39:15.496606 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:15.496586    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d62e6708-f73f-4c45-a7c1-8885fe64d21b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkflt\" (UID: \"d62e6708-f73f-4c45-a7c1-8885fe64d21b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkflt"
Jul 02 20:39:15.496646 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:15.496629    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d62e6708-f73f-4c45-a7c1-8885fe64d21b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkflt\" (UID: \"d62e6708-f73f-4c45-a7c1-8885fe64d21b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkflt"
Jul 02 20:39:15.505872 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:15.505846    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psjmp\" (UniqueName: \"kubernetes.io/projected/d62e6708-f73f-4c45-a7c1-8885fe64d21b-kube-api-access-psjmp\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkflt\" (UID: \"d62e6708-f73f-4c45-a7c1-8885fe64d21b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkflt"
Jul 02 20:39:15.653081 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:15.653020    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkflt"
Jul 02 20:39:15.741769 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:15.741741    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f9klb"]
Jul 02 20:39:15.746103 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:15.746083    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f9klb"
Jul 02 20:39:15.776412 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:15.776386    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f9klb"]
Jul 02 20:39:15.798771 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:15.798744    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/122ecb52-2f72-4443-9e00-c876ed5ca369-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f9klb\" (UID: \"122ecb52-2f72-4443-9e00-c876ed5ca369\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f9klb"
Jul 02 20:39:15.798879 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:15.798775    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/122ecb52-2f72-4443-9e00-c876ed5ca369-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f9klb\" (UID: \"122ecb52-2f72-4443-9e00-c876ed5ca369\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f9klb"
Jul 02 20:39:15.798879 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:15.798816    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgjsx\" (UniqueName: \"kubernetes.io/projected/122ecb52-2f72-4443-9e00-c876ed5ca369-kube-api-access-bgjsx\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f9klb\" (UID: \"122ecb52-2f72-4443-9e00-c876ed5ca369\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f9klb"
Jul 02 20:39:15.805094 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:15.805064    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkflt"]
Jul 02 20:39:15.808001 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:39:15.807975    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd62e6708_f73f_4c45_a7c1_8885fe64d21b.slice/crio-06c871d378e1325319205de74b5b4b82f26fb0a52798aa012460552a2b5aedac WatchSource:0}: Error finding container 06c871d378e1325319205de74b5b4b82f26fb0a52798aa012460552a2b5aedac: Status 404 returned error can't find the container with id 06c871d378e1325319205de74b5b4b82f26fb0a52798aa012460552a2b5aedac
Jul 02 20:39:15.899958 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:15.899932    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/122ecb52-2f72-4443-9e00-c876ed5ca369-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f9klb\" (UID: \"122ecb52-2f72-4443-9e00-c876ed5ca369\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f9klb"
Jul 02 20:39:15.900056 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:15.899968    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/122ecb52-2f72-4443-9e00-c876ed5ca369-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f9klb\" (UID: \"122ecb52-2f72-4443-9e00-c876ed5ca369\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f9klb"
Jul 02 20:39:15.900056 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:15.900014    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgjsx\" (UniqueName: \"kubernetes.io/projected/122ecb52-2f72-4443-9e00-c876ed5ca369-kube-api-access-bgjsx\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f9klb\" (UID: \"122ecb52-2f72-4443-9e00-c876ed5ca369\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f9klb"
Jul 02 20:39:15.900373 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:15.900351    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/122ecb52-2f72-4443-9e00-c876ed5ca369-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f9klb\" (UID: \"122ecb52-2f72-4443-9e00-c876ed5ca369\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f9klb"
Jul 02 20:39:15.900424 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:15.900362    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/122ecb52-2f72-4443-9e00-c876ed5ca369-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f9klb\" (UID: \"122ecb52-2f72-4443-9e00-c876ed5ca369\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f9klb"
Jul 02 20:39:15.913102 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:15.913056    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgjsx\" (UniqueName: \"kubernetes.io/projected/122ecb52-2f72-4443-9e00-c876ed5ca369-kube-api-access-bgjsx\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f9klb\" (UID: \"122ecb52-2f72-4443-9e00-c876ed5ca369\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f9klb"
Jul 02 20:39:16.056215 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:16.056130    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f9klb"
Jul 02 20:39:16.302460 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:16.302416    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f9klb"]
Jul 02 20:39:16.304868 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:39:16.304842    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod122ecb52_2f72_4443_9e00_c876ed5ca369.slice/crio-ae2bae0fa897d2bc9ee1a13c6a04766931b21705a20cf85295e0b9bbcd7d16cf WatchSource:0}: Error finding container ae2bae0fa897d2bc9ee1a13c6a04766931b21705a20cf85295e0b9bbcd7d16cf: Status 404 returned error can't find the container with id ae2bae0fa897d2bc9ee1a13c6a04766931b21705a20cf85295e0b9bbcd7d16cf
Jul 02 20:39:16.334195 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:16.334168    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f9klb" event={"ID":"122ecb52-2f72-4443-9e00-c876ed5ca369","Type":"ContainerStarted","Data":"ae2bae0fa897d2bc9ee1a13c6a04766931b21705a20cf85295e0b9bbcd7d16cf"}
Jul 02 20:39:16.335520 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:16.335499    2581 generic.go:356] "Generic (PLEG): container finished" podID="d62e6708-f73f-4c45-a7c1-8885fe64d21b" containerID="d0fa03cd52bdb32b79edb3a198dd228977abebc48b6fe732062682dee691b250" exitCode=0
Jul 02 20:39:16.335620 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:16.335563    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkflt" event={"ID":"d62e6708-f73f-4c45-a7c1-8885fe64d21b","Type":"ContainerDied","Data":"d0fa03cd52bdb32b79edb3a198dd228977abebc48b6fe732062682dee691b250"}
Jul 02 20:39:16.335620 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:16.335593    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkflt" event={"ID":"d62e6708-f73f-4c45-a7c1-8885fe64d21b","Type":"ContainerStarted","Data":"06c871d378e1325319205de74b5b4b82f26fb0a52798aa012460552a2b5aedac"}
Jul 02 20:39:16.337095 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:16.337068    2581 generic.go:356] "Generic (PLEG): container finished" podID="fad2b71e-a9d1-412f-a727-e412b0d438bc" containerID="cac51759b826b6af861abc5c50bb96902042417de5d3b36e73826247e0e641b8" exitCode=0
Jul 02 20:39:16.337263 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:16.337170    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxlqf" event={"ID":"fad2b71e-a9d1-412f-a727-e412b0d438bc","Type":"ContainerDied","Data":"cac51759b826b6af861abc5c50bb96902042417de5d3b36e73826247e0e641b8"}
Jul 02 20:39:16.337263 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:16.337207    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxlqf" event={"ID":"fad2b71e-a9d1-412f-a727-e412b0d438bc","Type":"ContainerStarted","Data":"37a4fbb75f39fd8c9d34cdd2d522c522fc865cc06adfdb2077d2edc1faab91ac"}
Jul 02 20:39:16.338897 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:16.338875    2581 generic.go:356] "Generic (PLEG): container finished" podID="a77b72cd-490c-42d4-a299-584c5f9535e6" containerID="31a8ab9729ca96127a4d815c37e774438349a7e18ae339d7e17372f2512ada67" exitCode=0
Jul 02 20:39:16.338974 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:16.338921    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6tm4" event={"ID":"a77b72cd-490c-42d4-a299-584c5f9535e6","Type":"ContainerDied","Data":"31a8ab9729ca96127a4d815c37e774438349a7e18ae339d7e17372f2512ada67"}
Jul 02 20:39:17.344243 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:17.344218    2581 generic.go:356] "Generic (PLEG): container finished" podID="122ecb52-2f72-4443-9e00-c876ed5ca369" containerID="762200864b99ffcfda1991f8a0cda410a8e3f8b7161dd76cc3227dd7f29c8009" exitCode=0
Jul 02 20:39:17.344560 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:17.344303    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f9klb" event={"ID":"122ecb52-2f72-4443-9e00-c876ed5ca369","Type":"ContainerDied","Data":"762200864b99ffcfda1991f8a0cda410a8e3f8b7161dd76cc3227dd7f29c8009"}
Jul 02 20:39:17.346104 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:17.346083    2581 generic.go:356] "Generic (PLEG): container finished" podID="fad2b71e-a9d1-412f-a727-e412b0d438bc" containerID="df9aeb461696023cb736b9e8e4899e17559de660ec1c277ed47920c269602d75" exitCode=0
Jul 02 20:39:17.346208 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:17.346173    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxlqf" event={"ID":"fad2b71e-a9d1-412f-a727-e412b0d438bc","Type":"ContainerDied","Data":"df9aeb461696023cb736b9e8e4899e17559de660ec1c277ed47920c269602d75"}
Jul 02 20:39:17.348387 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:17.348288    2581 generic.go:356] "Generic (PLEG): container finished" podID="a77b72cd-490c-42d4-a299-584c5f9535e6" containerID="67415714013e9507505e55364f233c0257280aeeeceabea0612280e65fe224de" exitCode=0
Jul 02 20:39:17.348387 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:17.348380    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6tm4" event={"ID":"a77b72cd-490c-42d4-a299-584c5f9535e6","Type":"ContainerDied","Data":"67415714013e9507505e55364f233c0257280aeeeceabea0612280e65fe224de"}
Jul 02 20:39:18.354371 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:18.354346    2581 generic.go:356] "Generic (PLEG): container finished" podID="122ecb52-2f72-4443-9e00-c876ed5ca369" containerID="70c57ce0a97090e790c91bc256ce14ffc3cb0a766497d506fce88528b5c57009" exitCode=0
Jul 02 20:39:18.354737 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:18.354419    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f9klb" event={"ID":"122ecb52-2f72-4443-9e00-c876ed5ca369","Type":"ContainerDied","Data":"70c57ce0a97090e790c91bc256ce14ffc3cb0a766497d506fce88528b5c57009"}
Jul 02 20:39:18.356183 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:18.356166    2581 generic.go:356] "Generic (PLEG): container finished" podID="d62e6708-f73f-4c45-a7c1-8885fe64d21b" containerID="214378bdf88ec1806f53d44f4202d86ca4aa2cdbce029e0521ecb4bf14a23060" exitCode=0
Jul 02 20:39:18.356285 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:18.356197    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkflt" event={"ID":"d62e6708-f73f-4c45-a7c1-8885fe64d21b","Type":"ContainerDied","Data":"214378bdf88ec1806f53d44f4202d86ca4aa2cdbce029e0521ecb4bf14a23060"}
Jul 02 20:39:18.358362 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:18.358341    2581 generic.go:356] "Generic (PLEG): container finished" podID="fad2b71e-a9d1-412f-a727-e412b0d438bc" containerID="9cabcda1b0d9fb7139f8b47f7bfcbe42f6fb61b9b9c4bd1b002b0c19dfc6bbf5" exitCode=0
Jul 02 20:39:18.358457 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:18.358419    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxlqf" event={"ID":"fad2b71e-a9d1-412f-a727-e412b0d438bc","Type":"ContainerDied","Data":"9cabcda1b0d9fb7139f8b47f7bfcbe42f6fb61b9b9c4bd1b002b0c19dfc6bbf5"}
Jul 02 20:39:18.485165 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:18.485048    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6tm4"
Jul 02 20:39:18.621042 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:18.621022    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a77b72cd-490c-42d4-a299-584c5f9535e6-bundle\") pod \"a77b72cd-490c-42d4-a299-584c5f9535e6\" (UID: \"a77b72cd-490c-42d4-a299-584c5f9535e6\") "
Jul 02 20:39:18.621193 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:18.621066    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a77b72cd-490c-42d4-a299-584c5f9535e6-util\") pod \"a77b72cd-490c-42d4-a299-584c5f9535e6\" (UID: \"a77b72cd-490c-42d4-a299-584c5f9535e6\") "
Jul 02 20:39:18.621193 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:18.621101    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqwgz\" (UniqueName: \"kubernetes.io/projected/a77b72cd-490c-42d4-a299-584c5f9535e6-kube-api-access-bqwgz\") pod \"a77b72cd-490c-42d4-a299-584c5f9535e6\" (UID: \"a77b72cd-490c-42d4-a299-584c5f9535e6\") "
Jul 02 20:39:18.621561 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:18.621536    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a77b72cd-490c-42d4-a299-584c5f9535e6-bundle" (OuterVolumeSpecName: "bundle") pod "a77b72cd-490c-42d4-a299-584c5f9535e6" (UID: "a77b72cd-490c-42d4-a299-584c5f9535e6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:39:18.622979 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:18.622953    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a77b72cd-490c-42d4-a299-584c5f9535e6-kube-api-access-bqwgz" (OuterVolumeSpecName: "kube-api-access-bqwgz") pod "a77b72cd-490c-42d4-a299-584c5f9535e6" (UID: "a77b72cd-490c-42d4-a299-584c5f9535e6"). InnerVolumeSpecName "kube-api-access-bqwgz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:39:18.626651 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:18.626629    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a77b72cd-490c-42d4-a299-584c5f9535e6-util" (OuterVolumeSpecName: "util") pod "a77b72cd-490c-42d4-a299-584c5f9535e6" (UID: "a77b72cd-490c-42d4-a299-584c5f9535e6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:39:18.722202 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:18.722179    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a77b72cd-490c-42d4-a299-584c5f9535e6-util\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:39:18.722202 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:18.722201    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqwgz\" (UniqueName: \"kubernetes.io/projected/a77b72cd-490c-42d4-a299-584c5f9535e6-kube-api-access-bqwgz\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:39:18.722315 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:18.722211    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a77b72cd-490c-42d4-a299-584c5f9535e6-bundle\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:39:19.365081 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:19.365044    2581 generic.go:356] "Generic (PLEG): container finished" podID="122ecb52-2f72-4443-9e00-c876ed5ca369" containerID="d2496ae39b12ec61f7f8367816b12c3634f1355b534905bac5d556d1c37a8072" exitCode=0
Jul 02 20:39:19.365565 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:19.365134    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f9klb" event={"ID":"122ecb52-2f72-4443-9e00-c876ed5ca369","Type":"ContainerDied","Data":"d2496ae39b12ec61f7f8367816b12c3634f1355b534905bac5d556d1c37a8072"}
Jul 02 20:39:19.367206 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:19.367184    2581 generic.go:356] "Generic (PLEG): container finished" podID="d62e6708-f73f-4c45-a7c1-8885fe64d21b" containerID="2026a93fa9bd74f4236189f09c69f2c385c6edaa623ac002376a623cc82dd6e2" exitCode=0
Jul 02 20:39:19.367327 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:19.367210    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkflt" event={"ID":"d62e6708-f73f-4c45-a7c1-8885fe64d21b","Type":"ContainerDied","Data":"2026a93fa9bd74f4236189f09c69f2c385c6edaa623ac002376a623cc82dd6e2"}
Jul 02 20:39:19.368975 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:19.368950    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6tm4"
Jul 02 20:39:19.369053 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:19.368986    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6tm4" event={"ID":"a77b72cd-490c-42d4-a299-584c5f9535e6","Type":"ContainerDied","Data":"16ea6bb1c6d92a1e4187a80ad194e7b3a00ac5df31753fca57ced7de5f937b3a"}
Jul 02 20:39:19.369053 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:19.369019    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="16ea6bb1c6d92a1e4187a80ad194e7b3a00ac5df31753fca57ced7de5f937b3a"
Jul 02 20:39:19.495272 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:19.495251    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxlqf"
Jul 02 20:39:19.628533 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:19.628461    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fad2b71e-a9d1-412f-a727-e412b0d438bc-util\") pod \"fad2b71e-a9d1-412f-a727-e412b0d438bc\" (UID: \"fad2b71e-a9d1-412f-a727-e412b0d438bc\") "
Jul 02 20:39:19.628533 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:19.628503    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzf5q\" (UniqueName: \"kubernetes.io/projected/fad2b71e-a9d1-412f-a727-e412b0d438bc-kube-api-access-wzf5q\") pod \"fad2b71e-a9d1-412f-a727-e412b0d438bc\" (UID: \"fad2b71e-a9d1-412f-a727-e412b0d438bc\") "
Jul 02 20:39:19.628533 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:19.628532    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fad2b71e-a9d1-412f-a727-e412b0d438bc-bundle\") pod \"fad2b71e-a9d1-412f-a727-e412b0d438bc\" (UID: \"fad2b71e-a9d1-412f-a727-e412b0d438bc\") "
Jul 02 20:39:19.629006 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:19.628984    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fad2b71e-a9d1-412f-a727-e412b0d438bc-bundle" (OuterVolumeSpecName: "bundle") pod "fad2b71e-a9d1-412f-a727-e412b0d438bc" (UID: "fad2b71e-a9d1-412f-a727-e412b0d438bc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:39:19.630523 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:19.630497    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fad2b71e-a9d1-412f-a727-e412b0d438bc-kube-api-access-wzf5q" (OuterVolumeSpecName: "kube-api-access-wzf5q") pod "fad2b71e-a9d1-412f-a727-e412b0d438bc" (UID: "fad2b71e-a9d1-412f-a727-e412b0d438bc"). InnerVolumeSpecName "kube-api-access-wzf5q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:39:19.633534 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:19.633496    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fad2b71e-a9d1-412f-a727-e412b0d438bc-util" (OuterVolumeSpecName: "util") pod "fad2b71e-a9d1-412f-a727-e412b0d438bc" (UID: "fad2b71e-a9d1-412f-a727-e412b0d438bc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:39:19.729211 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:19.729188    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fad2b71e-a9d1-412f-a727-e412b0d438bc-util\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:39:19.729211 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:19.729210    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzf5q\" (UniqueName: \"kubernetes.io/projected/fad2b71e-a9d1-412f-a727-e412b0d438bc-kube-api-access-wzf5q\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:39:19.729357 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:19.729220    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fad2b71e-a9d1-412f-a727-e412b0d438bc-bundle\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:39:20.375388 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:20.375362    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxlqf"
Jul 02 20:39:20.375729 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:20.375400    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxlqf" event={"ID":"fad2b71e-a9d1-412f-a727-e412b0d438bc","Type":"ContainerDied","Data":"37a4fbb75f39fd8c9d34cdd2d522c522fc865cc06adfdb2077d2edc1faab91ac"}
Jul 02 20:39:20.375729 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:20.375450    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="37a4fbb75f39fd8c9d34cdd2d522c522fc865cc06adfdb2077d2edc1faab91ac"
Jul 02 20:39:20.497565 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:20.497545    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkflt"
Jul 02 20:39:20.530108 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:20.530085    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f9klb"
Jul 02 20:39:20.635088 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:20.635008    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/122ecb52-2f72-4443-9e00-c876ed5ca369-util\") pod \"122ecb52-2f72-4443-9e00-c876ed5ca369\" (UID: \"122ecb52-2f72-4443-9e00-c876ed5ca369\") "
Jul 02 20:39:20.635088 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:20.635050    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bgjsx\" (UniqueName: \"kubernetes.io/projected/122ecb52-2f72-4443-9e00-c876ed5ca369-kube-api-access-bgjsx\") pod \"122ecb52-2f72-4443-9e00-c876ed5ca369\" (UID: \"122ecb52-2f72-4443-9e00-c876ed5ca369\") "
Jul 02 20:39:20.635299 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:20.635093    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d62e6708-f73f-4c45-a7c1-8885fe64d21b-util\") pod \"d62e6708-f73f-4c45-a7c1-8885fe64d21b\" (UID: \"d62e6708-f73f-4c45-a7c1-8885fe64d21b\") "
Jul 02 20:39:20.635299 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:20.635112    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/122ecb52-2f72-4443-9e00-c876ed5ca369-bundle\") pod \"122ecb52-2f72-4443-9e00-c876ed5ca369\" (UID: \"122ecb52-2f72-4443-9e00-c876ed5ca369\") "
Jul 02 20:39:20.635299 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:20.635173    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d62e6708-f73f-4c45-a7c1-8885fe64d21b-bundle\") pod \"d62e6708-f73f-4c45-a7c1-8885fe64d21b\" (UID: \"d62e6708-f73f-4c45-a7c1-8885fe64d21b\") "
Jul 02 20:39:20.635299 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:20.635216    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-psjmp\" (UniqueName: \"kubernetes.io/projected/d62e6708-f73f-4c45-a7c1-8885fe64d21b-kube-api-access-psjmp\") pod \"d62e6708-f73f-4c45-a7c1-8885fe64d21b\" (UID: \"d62e6708-f73f-4c45-a7c1-8885fe64d21b\") "
Jul 02 20:39:20.635736 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:20.635674    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d62e6708-f73f-4c45-a7c1-8885fe64d21b-bundle" (OuterVolumeSpecName: "bundle") pod "d62e6708-f73f-4c45-a7c1-8885fe64d21b" (UID: "d62e6708-f73f-4c45-a7c1-8885fe64d21b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:39:20.635842 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:20.635760    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/122ecb52-2f72-4443-9e00-c876ed5ca369-bundle" (OuterVolumeSpecName: "bundle") pod "122ecb52-2f72-4443-9e00-c876ed5ca369" (UID: "122ecb52-2f72-4443-9e00-c876ed5ca369"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:39:20.637361 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:20.637335    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/122ecb52-2f72-4443-9e00-c876ed5ca369-kube-api-access-bgjsx" (OuterVolumeSpecName: "kube-api-access-bgjsx") pod "122ecb52-2f72-4443-9e00-c876ed5ca369" (UID: "122ecb52-2f72-4443-9e00-c876ed5ca369"). InnerVolumeSpecName "kube-api-access-bgjsx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:39:20.637469 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:20.637394    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d62e6708-f73f-4c45-a7c1-8885fe64d21b-kube-api-access-psjmp" (OuterVolumeSpecName: "kube-api-access-psjmp") pod "d62e6708-f73f-4c45-a7c1-8885fe64d21b" (UID: "d62e6708-f73f-4c45-a7c1-8885fe64d21b"). InnerVolumeSpecName "kube-api-access-psjmp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:39:20.643776 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:20.643749    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/122ecb52-2f72-4443-9e00-c876ed5ca369-util" (OuterVolumeSpecName: "util") pod "122ecb52-2f72-4443-9e00-c876ed5ca369" (UID: "122ecb52-2f72-4443-9e00-c876ed5ca369"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:39:20.643927 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:20.643911    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d62e6708-f73f-4c45-a7c1-8885fe64d21b-util" (OuterVolumeSpecName: "util") pod "d62e6708-f73f-4c45-a7c1-8885fe64d21b" (UID: "d62e6708-f73f-4c45-a7c1-8885fe64d21b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:39:20.736023 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:20.735993    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d62e6708-f73f-4c45-a7c1-8885fe64d21b-util\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:39:20.736023 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:20.736019    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/122ecb52-2f72-4443-9e00-c876ed5ca369-bundle\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:39:20.736023 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:20.736028    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d62e6708-f73f-4c45-a7c1-8885fe64d21b-bundle\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:39:20.736231 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:20.736036    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-psjmp\" (UniqueName: \"kubernetes.io/projected/d62e6708-f73f-4c45-a7c1-8885fe64d21b-kube-api-access-psjmp\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:39:20.736231 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:20.736045    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/122ecb52-2f72-4443-9e00-c876ed5ca369-util\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:39:20.736231 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:20.736053    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgjsx\" (UniqueName: \"kubernetes.io/projected/122ecb52-2f72-4443-9e00-c876ed5ca369-kube-api-access-bgjsx\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:39:21.381599 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:21.381573    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f9klb"
Jul 02 20:39:21.382051 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:21.381567    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f9klb" event={"ID":"122ecb52-2f72-4443-9e00-c876ed5ca369","Type":"ContainerDied","Data":"ae2bae0fa897d2bc9ee1a13c6a04766931b21705a20cf85295e0b9bbcd7d16cf"}
Jul 02 20:39:21.382051 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:21.381687    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ae2bae0fa897d2bc9ee1a13c6a04766931b21705a20cf85295e0b9bbcd7d16cf"
Jul 02 20:39:21.383655 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:21.383633    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkflt"
Jul 02 20:39:21.383655 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:21.383643    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkflt" event={"ID":"d62e6708-f73f-4c45-a7c1-8885fe64d21b","Type":"ContainerDied","Data":"06c871d378e1325319205de74b5b4b82f26fb0a52798aa012460552a2b5aedac"}
Jul 02 20:39:21.383837 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:21.383682    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="06c871d378e1325319205de74b5b4b82f26fb0a52798aa012460552a2b5aedac"
Jul 02 20:39:28.680149 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:28.680111    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:39:31.178815 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:31.178785    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7ff9r"]
Jul 02 20:39:31.179224 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:31.179052    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d62e6708-f73f-4c45-a7c1-8885fe64d21b" containerName="pull"
Jul 02 20:39:31.179224 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:31.179061    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d62e6708-f73f-4c45-a7c1-8885fe64d21b" containerName="pull"
Jul 02 20:39:31.179224 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:31.179071    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fad2b71e-a9d1-412f-a727-e412b0d438bc" containerName="util"
Jul 02 20:39:31.179224 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:31.179077    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fad2b71e-a9d1-412f-a727-e412b0d438bc" containerName="util"
Jul 02 20:39:31.179224 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:31.179084    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a77b72cd-490c-42d4-a299-584c5f9535e6" containerName="pull"
Jul 02 20:39:31.179224 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:31.179089    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a77b72cd-490c-42d4-a299-584c5f9535e6" containerName="pull"
Jul 02 20:39:31.179224 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:31.179096    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="122ecb52-2f72-4443-9e00-c876ed5ca369" containerName="extract"
Jul 02 20:39:31.179224 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:31.179101    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="122ecb52-2f72-4443-9e00-c876ed5ca369" containerName="extract"
Jul 02 20:39:31.179224 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:31.179111    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="122ecb52-2f72-4443-9e00-c876ed5ca369" containerName="pull"
Jul 02 20:39:31.179224 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:31.179116    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="122ecb52-2f72-4443-9e00-c876ed5ca369" containerName="pull"
Jul 02 20:39:31.179224 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:31.179124    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="122ecb52-2f72-4443-9e00-c876ed5ca369" containerName="util"
Jul 02 20:39:31.179224 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:31.179131    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="122ecb52-2f72-4443-9e00-c876ed5ca369" containerName="util"
Jul 02 20:39:31.179224 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:31.179149    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a77b72cd-490c-42d4-a299-584c5f9535e6" containerName="util"
Jul 02 20:39:31.179224 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:31.179154    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a77b72cd-490c-42d4-a299-584c5f9535e6" containerName="util"
Jul 02 20:39:31.179224 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:31.179163    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fad2b71e-a9d1-412f-a727-e412b0d438bc" containerName="pull"
Jul 02 20:39:31.179224 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:31.179168    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fad2b71e-a9d1-412f-a727-e412b0d438bc" containerName="pull"
Jul 02 20:39:31.179224 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:31.179174    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d62e6708-f73f-4c45-a7c1-8885fe64d21b" containerName="util"
Jul 02 20:39:31.179224 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:31.179178    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d62e6708-f73f-4c45-a7c1-8885fe64d21b" containerName="util"
Jul 02 20:39:31.179224 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:31.179183    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a77b72cd-490c-42d4-a299-584c5f9535e6" containerName="extract"
Jul 02 20:39:31.179224 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:31.179188    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a77b72cd-490c-42d4-a299-584c5f9535e6" containerName="extract"
Jul 02 20:39:31.179224 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:31.179195    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d62e6708-f73f-4c45-a7c1-8885fe64d21b" containerName="extract"
Jul 02 20:39:31.179224 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:31.179200    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d62e6708-f73f-4c45-a7c1-8885fe64d21b" containerName="extract"
Jul 02 20:39:31.179224 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:31.179206    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fad2b71e-a9d1-412f-a727-e412b0d438bc" containerName="extract"
Jul 02 20:39:31.179224 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:31.179211    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fad2b71e-a9d1-412f-a727-e412b0d438bc" containerName="extract"
Jul 02 20:39:31.179910 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:31.179251    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a77b72cd-490c-42d4-a299-584c5f9535e6" containerName="extract"
Jul 02 20:39:31.179910 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:31.179260    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d62e6708-f73f-4c45-a7c1-8885fe64d21b" containerName="extract"
Jul 02 20:39:31.179910 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:31.179266    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fad2b71e-a9d1-412f-a727-e412b0d438bc" containerName="extract"
Jul 02 20:39:31.179910 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:31.179271    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="122ecb52-2f72-4443-9e00-c876ed5ca369" containerName="extract"
Jul 02 20:39:31.183264 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:31.183249    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7ff9r"
Jul 02 20:39:31.186691 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:31.186666    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-7t8kh\""
Jul 02 20:39:31.186788 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:31.186766    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 02 20:39:31.195425 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:31.195404    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7ff9r"]
Jul 02 20:39:31.312548 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:31.312506    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8757b\" (UniqueName: \"kubernetes.io/projected/655294f6-dcdd-431e-8b12-e7ccfe820f52-kube-api-access-8757b\") pod \"dns-operator-controller-manager-864dd78c4c-7ff9r\" (UID: \"655294f6-dcdd-431e-8b12-e7ccfe820f52\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7ff9r"
Jul 02 20:39:31.413123 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:31.413097    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8757b\" (UniqueName: \"kubernetes.io/projected/655294f6-dcdd-431e-8b12-e7ccfe820f52-kube-api-access-8757b\") pod \"dns-operator-controller-manager-864dd78c4c-7ff9r\" (UID: \"655294f6-dcdd-431e-8b12-e7ccfe820f52\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7ff9r"
Jul 02 20:39:31.428479 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:31.428455    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8757b\" (UniqueName: \"kubernetes.io/projected/655294f6-dcdd-431e-8b12-e7ccfe820f52-kube-api-access-8757b\") pod \"dns-operator-controller-manager-864dd78c4c-7ff9r\" (UID: \"655294f6-dcdd-431e-8b12-e7ccfe820f52\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7ff9r"
Jul 02 20:39:31.492941 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:31.492918    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7ff9r"
Jul 02 20:39:31.629243 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:31.629216    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7ff9r"]
Jul 02 20:39:31.631361 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:39:31.631338    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod655294f6_dcdd_431e_8b12_e7ccfe820f52.slice/crio-2167713ddf7890a51c919117fe6eb34d5ecac6a4e5cd07044edebc32d6158238 WatchSource:0}: Error finding container 2167713ddf7890a51c919117fe6eb34d5ecac6a4e5cd07044edebc32d6158238: Status 404 returned error can't find the container with id 2167713ddf7890a51c919117fe6eb34d5ecac6a4e5cd07044edebc32d6158238
Jul 02 20:39:32.436202 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:32.436168    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7ff9r" event={"ID":"655294f6-dcdd-431e-8b12-e7ccfe820f52","Type":"ContainerStarted","Data":"2167713ddf7890a51c919117fe6eb34d5ecac6a4e5cd07044edebc32d6158238"}
Jul 02 20:39:32.685250 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:32.685208    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:39:34.446871 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:34.446830    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7ff9r" event={"ID":"655294f6-dcdd-431e-8b12-e7ccfe820f52","Type":"ContainerStarted","Data":"74c33379d1856f7b0a170f9267a6a54956a200d75253bed995e3bee8a68b4e9b"}
Jul 02 20:39:34.447283 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:34.446984    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7ff9r"
Jul 02 20:39:34.475634 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:34.475589    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7ff9r" podStartSLOduration=1.177166532 podStartE2EDuration="3.475575382s" totalImagesPullingTime="2.29840885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:39:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:39:34.47444298 +0000 UTC m=+408.144956473" watchObservedRunningTime="2026-07-02 20:39:34.475575382 +0000 UTC m=+408.146088874"
Jul 02 20:39:34.562451 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:34.562422    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtjbc"]
Jul 02 20:39:34.570194 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:34.570171    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtjbc"
Jul 02 20:39:34.572577 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:34.572556    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-xcvxk\""
Jul 02 20:39:34.578869 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:34.578847    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtjbc"]
Jul 02 20:39:34.636881 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:34.636854    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5sf2\" (UniqueName: \"kubernetes.io/projected/a564abdf-416c-4c04-a56d-05cbd41397ee-kube-api-access-q5sf2\") pod \"limitador-operator-controller-manager-859d7b78bd-vtjbc\" (UID: \"a564abdf-416c-4c04-a56d-05cbd41397ee\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtjbc"
Jul 02 20:39:34.737446 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:34.737418    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5sf2\" (UniqueName: \"kubernetes.io/projected/a564abdf-416c-4c04-a56d-05cbd41397ee-kube-api-access-q5sf2\") pod \"limitador-operator-controller-manager-859d7b78bd-vtjbc\" (UID: \"a564abdf-416c-4c04-a56d-05cbd41397ee\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtjbc"
Jul 02 20:39:34.749469 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:34.749444    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5sf2\" (UniqueName: \"kubernetes.io/projected/a564abdf-416c-4c04-a56d-05cbd41397ee-kube-api-access-q5sf2\") pod \"limitador-operator-controller-manager-859d7b78bd-vtjbc\" (UID: \"a564abdf-416c-4c04-a56d-05cbd41397ee\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtjbc"
Jul 02 20:39:34.879912 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:34.879890    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtjbc"
Jul 02 20:39:35.004724 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:35.004698    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtjbc"]
Jul 02 20:39:35.006546 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:39:35.006515    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda564abdf_416c_4c04_a56d_05cbd41397ee.slice/crio-89cb1321d1e0e3ca0ed231fc3ed121a8396c5b6d825ae6a2d54672c802477b96 WatchSource:0}: Error finding container 89cb1321d1e0e3ca0ed231fc3ed121a8396c5b6d825ae6a2d54672c802477b96: Status 404 returned error can't find the container with id 89cb1321d1e0e3ca0ed231fc3ed121a8396c5b6d825ae6a2d54672c802477b96
Jul 02 20:39:35.264017 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:35.263932    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:39:35.452404 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:35.452373    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtjbc" event={"ID":"a564abdf-416c-4c04-a56d-05cbd41397ee","Type":"ContainerStarted","Data":"89cb1321d1e0e3ca0ed231fc3ed121a8396c5b6d825ae6a2d54672c802477b96"}
Jul 02 20:39:35.580453 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:35.580378    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:39:36.524521 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:36.524484    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:39:37.463200 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:37.463163    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtjbc" event={"ID":"a564abdf-416c-4c04-a56d-05cbd41397ee","Type":"ContainerStarted","Data":"9ca6fcf7b63113b6f708eaa9cad0f125680ecba6ed13d22f0ab4d2e9d78c2be9"}
Jul 02 20:39:37.463376 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:37.463255    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtjbc"
Jul 02 20:39:38.499641 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:38.499601    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:39:39.864294 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:39.864258    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:39:39.916384 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:39.916340    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtjbc" podStartSLOduration=4.127769788 podStartE2EDuration="5.916324766s" totalImagesPullingTime="1.788554978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:39:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:39:37.492262752 +0000 UTC m=+411.162776245" watchObservedRunningTime="2026-07-02 20:39:39.916324766 +0000 UTC m=+413.586838250"
Jul 02 20:39:39.917057 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:39.917039    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw9zm"]
Jul 02 20:39:39.920155 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:39.920127    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw9zm"
Jul 02 20:39:39.923628 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:39.923609    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wtvgr\""
Jul 02 20:39:39.933996 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:39.933976    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw9zm"]
Jul 02 20:39:40.079619 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:40.079584    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0192f1eb-c73e-46b3-82fe-d624f408a3d5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kw9zm\" (UID: \"0192f1eb-c73e-46b3-82fe-d624f408a3d5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw9zm"
Jul 02 20:39:40.079774 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:40.079641    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52xm6\" (UniqueName: \"kubernetes.io/projected/0192f1eb-c73e-46b3-82fe-d624f408a3d5-kube-api-access-52xm6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kw9zm\" (UID: \"0192f1eb-c73e-46b3-82fe-d624f408a3d5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw9zm"
Jul 02 20:39:40.180268 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:40.180184    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0192f1eb-c73e-46b3-82fe-d624f408a3d5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kw9zm\" (UID: \"0192f1eb-c73e-46b3-82fe-d624f408a3d5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw9zm"
Jul 02 20:39:40.180268 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:40.180243    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52xm6\" (UniqueName: \"kubernetes.io/projected/0192f1eb-c73e-46b3-82fe-d624f408a3d5-kube-api-access-52xm6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kw9zm\" (UID: \"0192f1eb-c73e-46b3-82fe-d624f408a3d5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw9zm"
Jul 02 20:39:40.180551 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:40.180530    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0192f1eb-c73e-46b3-82fe-d624f408a3d5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kw9zm\" (UID: \"0192f1eb-c73e-46b3-82fe-d624f408a3d5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw9zm"
Jul 02 20:39:40.204677 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:40.204647    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52xm6\" (UniqueName: \"kubernetes.io/projected/0192f1eb-c73e-46b3-82fe-d624f408a3d5-kube-api-access-52xm6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kw9zm\" (UID: \"0192f1eb-c73e-46b3-82fe-d624f408a3d5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw9zm"
Jul 02 20:39:40.230223 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:40.230201    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw9zm"
Jul 02 20:39:40.321072 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:40.321029    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:39:40.410741 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:40.410718    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw9zm"]
Jul 02 20:39:40.413364 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:39:40.413330    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0192f1eb_c73e_46b3_82fe_d624f408a3d5.slice/crio-4d931fa8e439dcdc20c5f49de3e0b6cb25416dd1f45572cbcfe386d6d8369c7b WatchSource:0}: Error finding container 4d931fa8e439dcdc20c5f49de3e0b6cb25416dd1f45572cbcfe386d6d8369c7b: Status 404 returned error can't find the container with id 4d931fa8e439dcdc20c5f49de3e0b6cb25416dd1f45572cbcfe386d6d8369c7b
Jul 02 20:39:40.478686 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:40.478654    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw9zm" event={"ID":"0192f1eb-c73e-46b3-82fe-d624f408a3d5","Type":"ContainerStarted","Data":"4d931fa8e439dcdc20c5f49de3e0b6cb25416dd1f45572cbcfe386d6d8369c7b"}
Jul 02 20:39:40.569133 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:40.569101    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:39:40.674693 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:40.674665    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:39:42.673279 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:42.673246    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-r9bqt"]
Jul 02 20:39:42.679492 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:42.679468    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-r9bqt"
Jul 02 20:39:42.682300 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:42.682278    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-c5ths\""
Jul 02 20:39:42.691906 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:42.691881    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-r9bqt"]
Jul 02 20:39:42.801153 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:42.801119    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znbrs\" (UniqueName: \"kubernetes.io/projected/80a4a842-16ed-49c9-a9b6-93735f675111-kube-api-access-znbrs\") pod \"authorino-operator-75cc8d5cb7-r9bqt\" (UID: \"80a4a842-16ed-49c9-a9b6-93735f675111\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-r9bqt"
Jul 02 20:39:42.901754 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:42.901725    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znbrs\" (UniqueName: \"kubernetes.io/projected/80a4a842-16ed-49c9-a9b6-93735f675111-kube-api-access-znbrs\") pod \"authorino-operator-75cc8d5cb7-r9bqt\" (UID: \"80a4a842-16ed-49c9-a9b6-93735f675111\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-r9bqt"
Jul 02 20:39:42.912177 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:42.912133    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znbrs\" (UniqueName: \"kubernetes.io/projected/80a4a842-16ed-49c9-a9b6-93735f675111-kube-api-access-znbrs\") pod \"authorino-operator-75cc8d5cb7-r9bqt\" (UID: \"80a4a842-16ed-49c9-a9b6-93735f675111\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-r9bqt"
Jul 02 20:39:42.990272 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:42.990237    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-r9bqt"
Jul 02 20:39:43.137234 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:43.137203    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-r9bqt"]
Jul 02 20:39:43.139186 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:39:43.139156    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80a4a842_16ed_49c9_a9b6_93735f675111.slice/crio-2fcedb31758e98b1db74a05a53b80c1b5502e4ac6c708a8128f5335d372ac6e5 WatchSource:0}: Error finding container 2fcedb31758e98b1db74a05a53b80c1b5502e4ac6c708a8128f5335d372ac6e5: Status 404 returned error can't find the container with id 2fcedb31758e98b1db74a05a53b80c1b5502e4ac6c708a8128f5335d372ac6e5
Jul 02 20:39:43.494885 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:43.494848    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-r9bqt" event={"ID":"80a4a842-16ed-49c9-a9b6-93735f675111","Type":"ContainerStarted","Data":"2fcedb31758e98b1db74a05a53b80c1b5502e4ac6c708a8128f5335d372ac6e5"}
Jul 02 20:39:43.891727 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:43.891646    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:39:43.992444 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:43.992404    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:39:45.454891 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:45.454867    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7ff9r"
Jul 02 20:39:45.510054 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:45.510023    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-r9bqt" event={"ID":"80a4a842-16ed-49c9-a9b6-93735f675111","Type":"ContainerStarted","Data":"3c6a26bfcb15cc06947a1e33e89c7e5411eff29a94193c43d51356f6a33b6ee3"}
Jul 02 20:39:45.510215 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:45.510173    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-r9bqt"
Jul 02 20:39:45.534182 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:45.534070    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-r9bqt" podStartSLOduration=1.255365148 podStartE2EDuration="3.534054074s" totalImagesPullingTime="2.278688926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:39:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:39:45.531696972 +0000 UTC m=+419.202210470" watchObservedRunningTime="2026-07-02 20:39:45.534054074 +0000 UTC m=+419.204567629"
Jul 02 20:39:47.173588 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:47.173501    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:39:47.331580 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:47.331538    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:39:48.470708 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:48.470673    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtjbc"
Jul 02 20:39:48.525237 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:48.525207    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw9zm" event={"ID":"0192f1eb-c73e-46b3-82fe-d624f408a3d5","Type":"ContainerStarted","Data":"aa10a0bb07a17c11717ba336b6b75ef69a2bf6cb0245a853f3409a0d7466fbe8"}
Jul 02 20:39:48.525403 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:48.525385    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw9zm"
Jul 02 20:39:48.555508 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:48.555450    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw9zm" podStartSLOduration=2.118105491 podStartE2EDuration="9.555435579s" totalImagesPullingTime="7.437330088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:39:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:39:48.554151771 +0000 UTC m=+422.224665259" watchObservedRunningTime="2026-07-02 20:39:48.555435579 +0000 UTC m=+422.225949071"
Jul 02 20:39:48.600743 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:48.600718    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-fbf578b9f-wjgkj"]
Jul 02 20:39:48.604074 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:48.604057    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fbf578b9f-wjgkj"
Jul 02 20:39:48.626458 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:48.626435    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8lhlp\""
Jul 02 20:39:48.629171 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:48.629129    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 02 20:39:48.629497 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:48.629130    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 02 20:39:48.629497 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:48.629380    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 02 20:39:48.629497 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:48.629455    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 02 20:39:48.630279 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:48.630258    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 02 20:39:48.630417 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:48.630396    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 02 20:39:48.634658 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:48.634642    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 02 20:39:48.645000 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:48.644981    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 02 20:39:48.653268 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:48.653241    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fbf578b9f-wjgkj"]
Jul 02 20:39:48.748240 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:48.748172    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/568d007b-2ef4-42a7-8a91-7cb19ddc66ca-service-ca\") pod \"console-fbf578b9f-wjgkj\" (UID: \"568d007b-2ef4-42a7-8a91-7cb19ddc66ca\") " pod="openshift-console/console-fbf578b9f-wjgkj"
Jul 02 20:39:48.748240 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:48.748207    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgg44\" (UniqueName: \"kubernetes.io/projected/568d007b-2ef4-42a7-8a91-7cb19ddc66ca-kube-api-access-sgg44\") pod \"console-fbf578b9f-wjgkj\" (UID: \"568d007b-2ef4-42a7-8a91-7cb19ddc66ca\") " pod="openshift-console/console-fbf578b9f-wjgkj"
Jul 02 20:39:48.748240 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:48.748233    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/568d007b-2ef4-42a7-8a91-7cb19ddc66ca-console-config\") pod \"console-fbf578b9f-wjgkj\" (UID: \"568d007b-2ef4-42a7-8a91-7cb19ddc66ca\") " pod="openshift-console/console-fbf578b9f-wjgkj"
Jul 02 20:39:48.748411 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:48.748307    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/568d007b-2ef4-42a7-8a91-7cb19ddc66ca-console-oauth-config\") pod \"console-fbf578b9f-wjgkj\" (UID: \"568d007b-2ef4-42a7-8a91-7cb19ddc66ca\") " pod="openshift-console/console-fbf578b9f-wjgkj"
Jul 02 20:39:48.748411 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:48.748340    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/568d007b-2ef4-42a7-8a91-7cb19ddc66ca-console-serving-cert\") pod \"console-fbf578b9f-wjgkj\" (UID: \"568d007b-2ef4-42a7-8a91-7cb19ddc66ca\") " pod="openshift-console/console-fbf578b9f-wjgkj"
Jul 02 20:39:48.748411 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:48.748369    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/568d007b-2ef4-42a7-8a91-7cb19ddc66ca-oauth-serving-cert\") pod \"console-fbf578b9f-wjgkj\" (UID: \"568d007b-2ef4-42a7-8a91-7cb19ddc66ca\") " pod="openshift-console/console-fbf578b9f-wjgkj"
Jul 02 20:39:48.748411 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:48.748403    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/568d007b-2ef4-42a7-8a91-7cb19ddc66ca-trusted-ca-bundle\") pod \"console-fbf578b9f-wjgkj\" (UID: \"568d007b-2ef4-42a7-8a91-7cb19ddc66ca\") " pod="openshift-console/console-fbf578b9f-wjgkj"
Jul 02 20:39:48.778046 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:48.778015    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:39:48.849379 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:48.849353    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/568d007b-2ef4-42a7-8a91-7cb19ddc66ca-service-ca\") pod \"console-fbf578b9f-wjgkj\" (UID: \"568d007b-2ef4-42a7-8a91-7cb19ddc66ca\") " pod="openshift-console/console-fbf578b9f-wjgkj"
Jul 02 20:39:48.849491 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:48.849381    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgg44\" (UniqueName: \"kubernetes.io/projected/568d007b-2ef4-42a7-8a91-7cb19ddc66ca-kube-api-access-sgg44\") pod \"console-fbf578b9f-wjgkj\" (UID: \"568d007b-2ef4-42a7-8a91-7cb19ddc66ca\") " pod="openshift-console/console-fbf578b9f-wjgkj"
Jul 02 20:39:48.849491 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:48.849404    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/568d007b-2ef4-42a7-8a91-7cb19ddc66ca-console-config\") pod \"console-fbf578b9f-wjgkj\" (UID: \"568d007b-2ef4-42a7-8a91-7cb19ddc66ca\") " pod="openshift-console/console-fbf578b9f-wjgkj"
Jul 02 20:39:48.849491 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:48.849426    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/568d007b-2ef4-42a7-8a91-7cb19ddc66ca-console-oauth-config\") pod \"console-fbf578b9f-wjgkj\" (UID: \"568d007b-2ef4-42a7-8a91-7cb19ddc66ca\") " pod="openshift-console/console-fbf578b9f-wjgkj"
Jul 02 20:39:48.849491 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:48.849471    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/568d007b-2ef4-42a7-8a91-7cb19ddc66ca-console-serving-cert\") pod \"console-fbf578b9f-wjgkj\" (UID: \"568d007b-2ef4-42a7-8a91-7cb19ddc66ca\") " pod="openshift-console/console-fbf578b9f-wjgkj"
Jul 02 20:39:48.849723 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:48.849503    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/568d007b-2ef4-42a7-8a91-7cb19ddc66ca-oauth-serving-cert\") pod \"console-fbf578b9f-wjgkj\" (UID: \"568d007b-2ef4-42a7-8a91-7cb19ddc66ca\") " pod="openshift-console/console-fbf578b9f-wjgkj"
Jul 02 20:39:48.849723 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:48.849540    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/568d007b-2ef4-42a7-8a91-7cb19ddc66ca-trusted-ca-bundle\") pod \"console-fbf578b9f-wjgkj\" (UID: \"568d007b-2ef4-42a7-8a91-7cb19ddc66ca\") " pod="openshift-console/console-fbf578b9f-wjgkj"
Jul 02 20:39:48.850194 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:48.850174    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/568d007b-2ef4-42a7-8a91-7cb19ddc66ca-service-ca\") pod \"console-fbf578b9f-wjgkj\" (UID: \"568d007b-2ef4-42a7-8a91-7cb19ddc66ca\") " pod="openshift-console/console-fbf578b9f-wjgkj"
Jul 02 20:39:48.850319 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:48.850297    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/568d007b-2ef4-42a7-8a91-7cb19ddc66ca-oauth-serving-cert\") pod \"console-fbf578b9f-wjgkj\" (UID: \"568d007b-2ef4-42a7-8a91-7cb19ddc66ca\") " pod="openshift-console/console-fbf578b9f-wjgkj"
Jul 02 20:39:48.850367 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:48.850316    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/568d007b-2ef4-42a7-8a91-7cb19ddc66ca-console-config\") pod \"console-fbf578b9f-wjgkj\" (UID: \"568d007b-2ef4-42a7-8a91-7cb19ddc66ca\") " pod="openshift-console/console-fbf578b9f-wjgkj"
Jul 02 20:39:48.850489 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:48.850473    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/568d007b-2ef4-42a7-8a91-7cb19ddc66ca-trusted-ca-bundle\") pod \"console-fbf578b9f-wjgkj\" (UID: \"568d007b-2ef4-42a7-8a91-7cb19ddc66ca\") " pod="openshift-console/console-fbf578b9f-wjgkj"
Jul 02 20:39:48.851951 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:48.851921    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/568d007b-2ef4-42a7-8a91-7cb19ddc66ca-console-oauth-config\") pod \"console-fbf578b9f-wjgkj\" (UID: \"568d007b-2ef4-42a7-8a91-7cb19ddc66ca\") " pod="openshift-console/console-fbf578b9f-wjgkj"
Jul 02 20:39:48.852030 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:48.851965    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/568d007b-2ef4-42a7-8a91-7cb19ddc66ca-console-serving-cert\") pod \"console-fbf578b9f-wjgkj\" (UID: \"568d007b-2ef4-42a7-8a91-7cb19ddc66ca\") " pod="openshift-console/console-fbf578b9f-wjgkj"
Jul 02 20:39:48.865984 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:48.865965    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgg44\" (UniqueName: \"kubernetes.io/projected/568d007b-2ef4-42a7-8a91-7cb19ddc66ca-kube-api-access-sgg44\") pod \"console-fbf578b9f-wjgkj\" (UID: \"568d007b-2ef4-42a7-8a91-7cb19ddc66ca\") " pod="openshift-console/console-fbf578b9f-wjgkj"
Jul 02 20:39:48.882918 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:48.882884    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:39:48.913213 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:48.913193    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fbf578b9f-wjgkj"
Jul 02 20:39:49.059976 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:49.059954    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fbf578b9f-wjgkj"]
Jul 02 20:39:49.064975 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:39:49.064935    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod568d007b_2ef4_42a7_8a91_7cb19ddc66ca.slice/crio-3979a7dcdcddd98f19fe0206f1e4df7b147b2d1adfa952c96528e2bd308088ea WatchSource:0}: Error finding container 3979a7dcdcddd98f19fe0206f1e4df7b147b2d1adfa952c96528e2bd308088ea: Status 404 returned error can't find the container with id 3979a7dcdcddd98f19fe0206f1e4df7b147b2d1adfa952c96528e2bd308088ea
Jul 02 20:39:49.531877 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:49.531843    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fbf578b9f-wjgkj" event={"ID":"568d007b-2ef4-42a7-8a91-7cb19ddc66ca","Type":"ContainerStarted","Data":"7751ccb5587b0c6daccf5517ff9a6bbadd95f32a4d92c827832960143c7465f6"}
Jul 02 20:39:49.532308 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:49.531895    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fbf578b9f-wjgkj" event={"ID":"568d007b-2ef4-42a7-8a91-7cb19ddc66ca","Type":"ContainerStarted","Data":"3979a7dcdcddd98f19fe0206f1e4df7b147b2d1adfa952c96528e2bd308088ea"}
Jul 02 20:39:49.569099 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:49.569054    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-fbf578b9f-wjgkj" podStartSLOduration=1.5690386950000001 podStartE2EDuration="1.569038695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:39:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:39:49.568200866 +0000 UTC m=+423.238714358" watchObservedRunningTime="2026-07-02 20:39:49.569038695 +0000 UTC m=+423.239552187"
Jul 02 20:39:50.399130 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:50.399094    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-r88qf"]
Jul 02 20:39:50.403890 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:50.403868    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r88qf"
Jul 02 20:39:50.406428 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:50.406408    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 02 20:39:50.406694 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:50.406677    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-z69l8\""
Jul 02 20:39:50.406895 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:50.406879    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 02 20:39:50.411291 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:50.411262    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:39:50.412462 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:50.412434    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-r88qf"]
Jul 02 20:39:50.569576 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:50.569545    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/15f2c5d0-573b-4e0f-aaa2-0e98abb647a6-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-r88qf\" (UID: \"15f2c5d0-573b-4e0f-aaa2-0e98abb647a6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r88qf"
Jul 02 20:39:50.569950 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:50.569608    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgpcb\" (UniqueName: \"kubernetes.io/projected/15f2c5d0-573b-4e0f-aaa2-0e98abb647a6-kube-api-access-cgpcb\") pod \"kuadrant-console-plugin-66b5774985-r88qf\" (UID: \"15f2c5d0-573b-4e0f-aaa2-0e98abb647a6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r88qf"
Jul 02 20:39:50.569950 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:50.569670    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/15f2c5d0-573b-4e0f-aaa2-0e98abb647a6-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-r88qf\" (UID: \"15f2c5d0-573b-4e0f-aaa2-0e98abb647a6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r88qf"
Jul 02 20:39:50.616196 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:50.616166    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:39:50.670438 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:50.670386    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/15f2c5d0-573b-4e0f-aaa2-0e98abb647a6-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-r88qf\" (UID: \"15f2c5d0-573b-4e0f-aaa2-0e98abb647a6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r88qf"
Jul 02 20:39:50.670701 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:50.670662    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/15f2c5d0-573b-4e0f-aaa2-0e98abb647a6-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-r88qf\" (UID: \"15f2c5d0-573b-4e0f-aaa2-0e98abb647a6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r88qf"
Jul 02 20:39:50.670813 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:50.670798    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgpcb\" (UniqueName: \"kubernetes.io/projected/15f2c5d0-573b-4e0f-aaa2-0e98abb647a6-kube-api-access-cgpcb\") pod \"kuadrant-console-plugin-66b5774985-r88qf\" (UID: \"15f2c5d0-573b-4e0f-aaa2-0e98abb647a6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r88qf"
Jul 02 20:39:50.671150 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:50.671116    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/15f2c5d0-573b-4e0f-aaa2-0e98abb647a6-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-r88qf\" (UID: \"15f2c5d0-573b-4e0f-aaa2-0e98abb647a6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r88qf"
Jul 02 20:39:50.672934 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:50.672913    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/15f2c5d0-573b-4e0f-aaa2-0e98abb647a6-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-r88qf\" (UID: \"15f2c5d0-573b-4e0f-aaa2-0e98abb647a6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r88qf"
Jul 02 20:39:50.681099 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:50.681081    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgpcb\" (UniqueName: \"kubernetes.io/projected/15f2c5d0-573b-4e0f-aaa2-0e98abb647a6-kube-api-access-cgpcb\") pod \"kuadrant-console-plugin-66b5774985-r88qf\" (UID: \"15f2c5d0-573b-4e0f-aaa2-0e98abb647a6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r88qf"
Jul 02 20:39:50.714041 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:50.714026    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r88qf"
Jul 02 20:39:50.716083 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:50.716050    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:39:50.840617 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:50.840586    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-r88qf"]
Jul 02 20:39:50.843676 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:39:50.843639    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod15f2c5d0_573b_4e0f_aaa2_0e98abb647a6.slice/crio-8ec261a0ce633146a5e76c53454e311ecfc8e7a4f73d27f185340b4dcae88954 WatchSource:0}: Error finding container 8ec261a0ce633146a5e76c53454e311ecfc8e7a4f73d27f185340b4dcae88954: Status 404 returned error can't find the container with id 8ec261a0ce633146a5e76c53454e311ecfc8e7a4f73d27f185340b4dcae88954
Jul 02 20:39:51.544613 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:51.544581    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r88qf" event={"ID":"15f2c5d0-573b-4e0f-aaa2-0e98abb647a6","Type":"ContainerStarted","Data":"8ec261a0ce633146a5e76c53454e311ecfc8e7a4f73d27f185340b4dcae88954"}
Jul 02 20:39:56.516151 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:56.516103    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-r9bqt"
Jul 02 20:39:58.914032 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:58.913996    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-fbf578b9f-wjgkj"
Jul 02 20:39:58.914485 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:58.914055    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-fbf578b9f-wjgkj"
Jul 02 20:39:58.920664 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:58.920639    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-fbf578b9f-wjgkj"
Jul 02 20:39:59.211327 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:59.211291    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:39:59.314340 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:59.314293    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:39:59.535262 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:59.535179    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw9zm"
Jul 02 20:39:59.596101 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:59.596074    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-fbf578b9f-wjgkj"
Jul 02 20:39:59.822173 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:59.822039    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:39:59.913958 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:39:59.913915    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:00.015163 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:00.015109    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:01.107188 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.107126    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-479d4"]
Jul 02 20:40:01.134366 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.134336    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-479d4"
Jul 02 20:40:01.134366 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.134345    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-479d4"]
Jul 02 20:40:01.264956 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.264918    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5d018d8-3f35-43d0-8ca4-941addf0a488-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-479d4\" (UID: \"e5d018d8-3f35-43d0-8ca4-941addf0a488\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-479d4"
Jul 02 20:40:01.265156 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.264971    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gskm\" (UniqueName: \"kubernetes.io/projected/e5d018d8-3f35-43d0-8ca4-941addf0a488-kube-api-access-4gskm\") pod \"kuadrant-operator-controller-manager-86878c769f-479d4\" (UID: \"e5d018d8-3f35-43d0-8ca4-941addf0a488\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-479d4"
Jul 02 20:40:01.271628 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.271602    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw9zm"]
Jul 02 20:40:01.271865 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.271838    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw9zm" podUID="0192f1eb-c73e-46b3-82fe-d624f408a3d5" containerName="manager" containerID="cri-o://aa10a0bb07a17c11717ba336b6b75ef69a2bf6cb0245a853f3409a0d7466fbe8" gracePeriod=2
Jul 02 20:40:01.282438 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.282411    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw9zm"]
Jul 02 20:40:01.289323 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:40:01.289287    2581 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"0192f1eb-c73e-46b3-82fe-d624f408a3d5\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-kw9zm\": pods \"kuadrant-operator-controller-manager-8684c9ff49-kw9zm\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw9zm"
Jul 02 20:40:01.302287 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.302167    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-479d4"]
Jul 02 20:40:01.302519 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:40:01.302459    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-4gskm], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-479d4" podUID="e5d018d8-3f35-43d0-8ca4-941addf0a488"
Jul 02 20:40:01.307009 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.305959    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-479d4"]
Jul 02 20:40:01.319828 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.319806    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5svc"]
Jul 02 20:40:01.320432 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.320413    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0192f1eb-c73e-46b3-82fe-d624f408a3d5" containerName="manager"
Jul 02 20:40:01.320578 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.320560    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0192f1eb-c73e-46b3-82fe-d624f408a3d5" containerName="manager"
Jul 02 20:40:01.320723 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.320704    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0192f1eb-c73e-46b3-82fe-d624f408a3d5" containerName="manager"
Jul 02 20:40:01.325240 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.325221    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtjbc"]
Jul 02 20:40:01.325354 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.325332    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5svc"
Jul 02 20:40:01.325639 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.325608    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtjbc" podUID="a564abdf-416c-4c04-a56d-05cbd41397ee" containerName="manager" containerID="cri-o://9ca6fcf7b63113b6f708eaa9cad0f125680ecba6ed13d22f0ab4d2e9d78c2be9" gracePeriod=2
Jul 02 20:40:01.328321 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:40:01.328290    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kw9zm\" is forbidden: User \"system:node:ip-10-0-135-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-220.ec2.internal' and this object" podUID="0192f1eb-c73e-46b3-82fe-d624f408a3d5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw9zm"
Jul 02 20:40:01.336675 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.336620    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtjbc"]
Jul 02 20:40:01.339682 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.339476    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s8nbx"]
Jul 02 20:40:01.340561 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.339908    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a564abdf-416c-4c04-a56d-05cbd41397ee" containerName="manager"
Jul 02 20:40:01.340561 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.339927    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a564abdf-416c-4c04-a56d-05cbd41397ee" containerName="manager"
Jul 02 20:40:01.340561 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.340012    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a564abdf-416c-4c04-a56d-05cbd41397ee" containerName="manager"
Jul 02 20:40:01.344276 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.344255    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s8nbx"
Jul 02 20:40:01.348542 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.348506    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5svc"]
Jul 02 20:40:01.365580 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.365519    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5d018d8-3f35-43d0-8ca4-941addf0a488-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-479d4\" (UID: \"e5d018d8-3f35-43d0-8ca4-941addf0a488\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-479d4"
Jul 02 20:40:01.365666 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.365587    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gskm\" (UniqueName: \"kubernetes.io/projected/e5d018d8-3f35-43d0-8ca4-941addf0a488-kube-api-access-4gskm\") pod \"kuadrant-operator-controller-manager-86878c769f-479d4\" (UID: \"e5d018d8-3f35-43d0-8ca4-941addf0a488\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-479d4"
Jul 02 20:40:01.365940 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.365919    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5d018d8-3f35-43d0-8ca4-941addf0a488-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-479d4\" (UID: \"e5d018d8-3f35-43d0-8ca4-941addf0a488\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-479d4"
Jul 02 20:40:01.375519 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:40:01.375249    2581 projected.go:196] Error preparing data for projected volume kube-api-access-4gskm for pod kuadrant-system/kuadrant-operator-controller-manager-86878c769f-479d4: failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-479d4" not found
Jul 02 20:40:01.375519 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:40:01.375321    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e5d018d8-3f35-43d0-8ca4-941addf0a488-kube-api-access-4gskm podName:e5d018d8-3f35-43d0-8ca4-941addf0a488 nodeName:}" failed. No retries permitted until 2026-07-02 20:40:01.875300018 +0000 UTC m=+435.545813511 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4gskm" (UniqueName: "kubernetes.io/projected/e5d018d8-3f35-43d0-8ca4-941addf0a488-kube-api-access-4gskm") pod "kuadrant-operator-controller-manager-86878c769f-479d4" (UID: "e5d018d8-3f35-43d0-8ca4-941addf0a488") : failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-479d4" not found
Jul 02 20:40:01.375519 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.375258    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s8nbx"]
Jul 02 20:40:01.393615 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:40:01.393527    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vtjbc\" is forbidden: User \"system:node:ip-10-0-135-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-220.ec2.internal' and this object" podUID="a564abdf-416c-4c04-a56d-05cbd41397ee" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtjbc"
Jul 02 20:40:01.425951 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:40:01.425921    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kw9zm\" is forbidden: User \"system:node:ip-10-0-135-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-220.ec2.internal' and this object" podUID="0192f1eb-c73e-46b3-82fe-d624f408a3d5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw9zm"
Jul 02 20:40:01.466376 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.466337    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6dbg\" (UniqueName: \"kubernetes.io/projected/00ec8f73-b108-4b11-a453-8a45d4dd2a7d-kube-api-access-x6dbg\") pod \"kuadrant-operator-controller-manager-86878c769f-s8nbx\" (UID: \"00ec8f73-b108-4b11-a453-8a45d4dd2a7d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s8nbx"
Jul 02 20:40:01.466482 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.466387    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/00ec8f73-b108-4b11-a453-8a45d4dd2a7d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-s8nbx\" (UID: \"00ec8f73-b108-4b11-a453-8a45d4dd2a7d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s8nbx"
Jul 02 20:40:01.466534 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.466517    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c85d33c3-c110-4e08-b14a-4eea91db4bca-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v5svc\" (UID: \"c85d33c3-c110-4e08-b14a-4eea91db4bca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5svc"
Jul 02 20:40:01.466585 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.466569    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4kpl\" (UniqueName: \"kubernetes.io/projected/c85d33c3-c110-4e08-b14a-4eea91db4bca-kube-api-access-d4kpl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v5svc\" (UID: \"c85d33c3-c110-4e08-b14a-4eea91db4bca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5svc"
Jul 02 20:40:01.567351 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.567304    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c85d33c3-c110-4e08-b14a-4eea91db4bca-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v5svc\" (UID: \"c85d33c3-c110-4e08-b14a-4eea91db4bca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5svc"
Jul 02 20:40:01.567510 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.567470    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4kpl\" (UniqueName: \"kubernetes.io/projected/c85d33c3-c110-4e08-b14a-4eea91db4bca-kube-api-access-d4kpl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v5svc\" (UID: \"c85d33c3-c110-4e08-b14a-4eea91db4bca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5svc"
Jul 02 20:40:01.567591 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.567555    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6dbg\" (UniqueName: \"kubernetes.io/projected/00ec8f73-b108-4b11-a453-8a45d4dd2a7d-kube-api-access-x6dbg\") pod \"kuadrant-operator-controller-manager-86878c769f-s8nbx\" (UID: \"00ec8f73-b108-4b11-a453-8a45d4dd2a7d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s8nbx"
Jul 02 20:40:01.567643 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.567598    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/00ec8f73-b108-4b11-a453-8a45d4dd2a7d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-s8nbx\" (UID: \"00ec8f73-b108-4b11-a453-8a45d4dd2a7d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s8nbx"
Jul 02 20:40:01.567752 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.567732    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c85d33c3-c110-4e08-b14a-4eea91db4bca-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v5svc\" (UID: \"c85d33c3-c110-4e08-b14a-4eea91db4bca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5svc"
Jul 02 20:40:01.567967 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.567947    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/00ec8f73-b108-4b11-a453-8a45d4dd2a7d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-s8nbx\" (UID: \"00ec8f73-b108-4b11-a453-8a45d4dd2a7d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s8nbx"
Jul 02 20:40:01.579459 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.579439    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6dbg\" (UniqueName: \"kubernetes.io/projected/00ec8f73-b108-4b11-a453-8a45d4dd2a7d-kube-api-access-x6dbg\") pod \"kuadrant-operator-controller-manager-86878c769f-s8nbx\" (UID: \"00ec8f73-b108-4b11-a453-8a45d4dd2a7d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s8nbx"
Jul 02 20:40:01.580154 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.580124    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4kpl\" (UniqueName: \"kubernetes.io/projected/c85d33c3-c110-4e08-b14a-4eea91db4bca-kube-api-access-d4kpl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v5svc\" (UID: \"c85d33c3-c110-4e08-b14a-4eea91db4bca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5svc"
Jul 02 20:40:01.602224 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.602201    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-479d4"
Jul 02 20:40:01.604501 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:40:01.604467    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-479d4\" is forbidden: User \"system:node:ip-10-0-135-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-220.ec2.internal' and this object" podUID="e5d018d8-3f35-43d0-8ca4-941addf0a488" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-479d4"
Jul 02 20:40:01.606451 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:40:01.606421    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vtjbc\" is forbidden: User \"system:node:ip-10-0-135-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-220.ec2.internal' and this object" podUID="a564abdf-416c-4c04-a56d-05cbd41397ee" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtjbc"
Jul 02 20:40:01.608453 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:40:01.608423    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kw9zm\" is forbidden: User \"system:node:ip-10-0-135-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-220.ec2.internal' and this object" podUID="0192f1eb-c73e-46b3-82fe-d624f408a3d5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw9zm"
Jul 02 20:40:01.613282 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.613264    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-479d4"
Jul 02 20:40:01.615857 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:40:01.615806    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vtjbc\" is forbidden: User \"system:node:ip-10-0-135-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-220.ec2.internal' and this object" podUID="a564abdf-416c-4c04-a56d-05cbd41397ee" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtjbc"
Jul 02 20:40:01.618152 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:40:01.618116    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kw9zm\" is forbidden: User \"system:node:ip-10-0-135-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-220.ec2.internal' and this object" podUID="0192f1eb-c73e-46b3-82fe-d624f408a3d5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw9zm"
Jul 02 20:40:01.620126 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:40:01.620099    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-479d4\" is forbidden: User \"system:node:ip-10-0-135-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-220.ec2.internal' and this object" podUID="e5d018d8-3f35-43d0-8ca4-941addf0a488" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-479d4"
Jul 02 20:40:01.689749 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.689720    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5svc"
Jul 02 20:40:01.699201 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.699176    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s8nbx"
Jul 02 20:40:01.769614 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.769574    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5d018d8-3f35-43d0-8ca4-941addf0a488-extensions-socket-volume\") pod \"e5d018d8-3f35-43d0-8ca4-941addf0a488\" (UID: \"e5d018d8-3f35-43d0-8ca4-941addf0a488\") "
Jul 02 20:40:01.769842 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.769808    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5d018d8-3f35-43d0-8ca4-941addf0a488-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e5d018d8-3f35-43d0-8ca4-941addf0a488" (UID: "e5d018d8-3f35-43d0-8ca4-941addf0a488"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:40:01.769909 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.769848    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4gskm\" (UniqueName: \"kubernetes.io/projected/e5d018d8-3f35-43d0-8ca4-941addf0a488-kube-api-access-4gskm\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:40:01.867130 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.867027    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:01.870830 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.870806    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5d018d8-3f35-43d0-8ca4-941addf0a488-extensions-socket-volume\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:40:01.956155 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:01.956100    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:02.607470 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:02.607439    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-479d4"
Jul 02 20:40:02.610059 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:40:02.610024    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-479d4\" is forbidden: User \"system:node:ip-10-0-135-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-220.ec2.internal' and this object" podUID="e5d018d8-3f35-43d0-8ca4-941addf0a488" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-479d4"
Jul 02 20:40:02.611940 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:40:02.611916    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vtjbc\" is forbidden: User \"system:node:ip-10-0-135-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-220.ec2.internal' and this object" podUID="a564abdf-416c-4c04-a56d-05cbd41397ee" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtjbc"
Jul 02 20:40:02.613843 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:40:02.613805    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kw9zm\" is forbidden: User \"system:node:ip-10-0-135-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-220.ec2.internal' and this object" podUID="0192f1eb-c73e-46b3-82fe-d624f408a3d5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw9zm"
Jul 02 20:40:02.616094 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:40:02.616070    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-479d4\" is forbidden: User \"system:node:ip-10-0-135-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-220.ec2.internal' and this object" podUID="e5d018d8-3f35-43d0-8ca4-941addf0a488" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-479d4"
Jul 02 20:40:02.618062 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:40:02.618034    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vtjbc\" is forbidden: User \"system:node:ip-10-0-135-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-220.ec2.internal' and this object" podUID="a564abdf-416c-4c04-a56d-05cbd41397ee" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtjbc"
Jul 02 20:40:02.619919 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:40:02.619889    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kw9zm\" is forbidden: User \"system:node:ip-10-0-135-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-220.ec2.internal' and this object" podUID="0192f1eb-c73e-46b3-82fe-d624f408a3d5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw9zm"
Jul 02 20:40:02.881782 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:02.881703    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5d018d8-3f35-43d0-8ca4-941addf0a488" path="/var/lib/kubelet/pods/e5d018d8-3f35-43d0-8ca4-941addf0a488/volumes"
Jul 02 20:40:05.059629 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:05.059590    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:05.178800 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:05.178744    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:08.604402 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:08.604353    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:08.706359 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:08.706312    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:10.655563 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:10.655526    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:12.507559 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:12.507528    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s8nbx"]
Jul 02 20:40:12.508587 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:40:12.508560    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00ec8f73_b108_4b11_a453_8a45d4dd2a7d.slice/crio-c575e3d00ea01840975497ff849b17b0c904b84c5e7739c659ee759d6ba3f7f3 WatchSource:0}: Error finding container c575e3d00ea01840975497ff849b17b0c904b84c5e7739c659ee759d6ba3f7f3: Status 404 returned error can't find the container with id c575e3d00ea01840975497ff849b17b0c904b84c5e7739c659ee759d6ba3f7f3
Jul 02 20:40:12.511888 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:12.511866    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtjbc"
Jul 02 20:40:12.514011 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:12.513989    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw9zm"
Jul 02 20:40:12.514500 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:40:12.514475    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vtjbc\" is forbidden: User \"system:node:ip-10-0-135-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-220.ec2.internal' and this object" podUID="a564abdf-416c-4c04-a56d-05cbd41397ee" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtjbc"
Jul 02 20:40:12.517231 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:40:12.517122    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kw9zm\" is forbidden: User \"system:node:ip-10-0-135-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-220.ec2.internal' and this object" podUID="0192f1eb-c73e-46b3-82fe-d624f408a3d5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw9zm"
Jul 02 20:40:12.519150 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:40:12.519113    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vtjbc\" is forbidden: User \"system:node:ip-10-0-135-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-220.ec2.internal' and this object" podUID="a564abdf-416c-4c04-a56d-05cbd41397ee" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtjbc"
Jul 02 20:40:12.537964 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:12.537940    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5svc"]
Jul 02 20:40:12.540309 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:40:12.540282    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc85d33c3_c110_4e08_b14a_4eea91db4bca.slice/crio-722517afc90eeebac98a8ec10bd80d08031dfc1cf4ce8adbc2f0038d776e4f1a WatchSource:0}: Error finding container 722517afc90eeebac98a8ec10bd80d08031dfc1cf4ce8adbc2f0038d776e4f1a: Status 404 returned error can't find the container with id 722517afc90eeebac98a8ec10bd80d08031dfc1cf4ce8adbc2f0038d776e4f1a
Jul 02 20:40:12.567998 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:12.567935    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52xm6\" (UniqueName: \"kubernetes.io/projected/0192f1eb-c73e-46b3-82fe-d624f408a3d5-kube-api-access-52xm6\") pod \"0192f1eb-c73e-46b3-82fe-d624f408a3d5\" (UID: \"0192f1eb-c73e-46b3-82fe-d624f408a3d5\") "
Jul 02 20:40:12.568074 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:12.568030    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0192f1eb-c73e-46b3-82fe-d624f408a3d5-extensions-socket-volume\") pod \"0192f1eb-c73e-46b3-82fe-d624f408a3d5\" (UID: \"0192f1eb-c73e-46b3-82fe-d624f408a3d5\") "
Jul 02 20:40:12.568133 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:12.568117    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5sf2\" (UniqueName: \"kubernetes.io/projected/a564abdf-416c-4c04-a56d-05cbd41397ee-kube-api-access-q5sf2\") pod \"a564abdf-416c-4c04-a56d-05cbd41397ee\" (UID: \"a564abdf-416c-4c04-a56d-05cbd41397ee\") "
Jul 02 20:40:12.569095 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:12.569056    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0192f1eb-c73e-46b3-82fe-d624f408a3d5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0192f1eb-c73e-46b3-82fe-d624f408a3d5" (UID: "0192f1eb-c73e-46b3-82fe-d624f408a3d5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:40:12.570456 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:12.570428    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0192f1eb-c73e-46b3-82fe-d624f408a3d5-kube-api-access-52xm6" (OuterVolumeSpecName: "kube-api-access-52xm6") pod "0192f1eb-c73e-46b3-82fe-d624f408a3d5" (UID: "0192f1eb-c73e-46b3-82fe-d624f408a3d5"). InnerVolumeSpecName "kube-api-access-52xm6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:40:12.570855 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:12.570821    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a564abdf-416c-4c04-a56d-05cbd41397ee-kube-api-access-q5sf2" (OuterVolumeSpecName: "kube-api-access-q5sf2") pod "a564abdf-416c-4c04-a56d-05cbd41397ee" (UID: "a564abdf-416c-4c04-a56d-05cbd41397ee"). InnerVolumeSpecName "kube-api-access-q5sf2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:40:12.661613 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:12.661526    2581 generic.go:356] "Generic (PLEG): container finished" podID="a564abdf-416c-4c04-a56d-05cbd41397ee" containerID="9ca6fcf7b63113b6f708eaa9cad0f125680ecba6ed13d22f0ab4d2e9d78c2be9" exitCode=0
Jul 02 20:40:12.661613 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:12.661577    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtjbc"
Jul 02 20:40:12.661833 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:12.661630    2581 scope.go:117] "RemoveContainer" containerID="9ca6fcf7b63113b6f708eaa9cad0f125680ecba6ed13d22f0ab4d2e9d78c2be9"
Jul 02 20:40:12.663011 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:12.662973    2581 generic.go:356] "Generic (PLEG): container finished" podID="0192f1eb-c73e-46b3-82fe-d624f408a3d5" containerID="aa10a0bb07a17c11717ba336b6b75ef69a2bf6cb0245a853f3409a0d7466fbe8" exitCode=0
Jul 02 20:40:12.663011 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:12.663006    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw9zm"
Jul 02 20:40:12.664089 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:40:12.664064    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kw9zm\" is forbidden: User \"system:node:ip-10-0-135-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-220.ec2.internal' and this object" podUID="0192f1eb-c73e-46b3-82fe-d624f408a3d5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw9zm"
Jul 02 20:40:12.664979 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:12.664953    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s8nbx" event={"ID":"00ec8f73-b108-4b11-a453-8a45d4dd2a7d","Type":"ContainerStarted","Data":"cc9ed2093eb2ee6a682b71bd8ed4cc7b5a9ca93e429b763614a12ad2a46407d2"}
Jul 02 20:40:12.665089 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:12.665005    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s8nbx" event={"ID":"00ec8f73-b108-4b11-a453-8a45d4dd2a7d","Type":"ContainerStarted","Data":"c575e3d00ea01840975497ff849b17b0c904b84c5e7739c659ee759d6ba3f7f3"}
Jul 02 20:40:12.665089 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:12.665036    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s8nbx"
Jul 02 20:40:12.666004 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:40:12.665976    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vtjbc\" is forbidden: User \"system:node:ip-10-0-135-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-220.ec2.internal' and this object" podUID="a564abdf-416c-4c04-a56d-05cbd41397ee" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtjbc"
Jul 02 20:40:12.666884 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:12.666861    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5svc" event={"ID":"c85d33c3-c110-4e08-b14a-4eea91db4bca","Type":"ContainerStarted","Data":"f536da00e67897f3120a9d3d6872759a1be2deb95f450529916ce932b2d262ea"}
Jul 02 20:40:12.666997 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:12.666915    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5svc"
Jul 02 20:40:12.666997 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:12.666937    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5svc" event={"ID":"c85d33c3-c110-4e08-b14a-4eea91db4bca","Type":"ContainerStarted","Data":"722517afc90eeebac98a8ec10bd80d08031dfc1cf4ce8adbc2f0038d776e4f1a"}
Jul 02 20:40:12.668578 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:12.668545    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r88qf" event={"ID":"15f2c5d0-573b-4e0f-aaa2-0e98abb647a6","Type":"ContainerStarted","Data":"6d764afa065dc23b9e3de6916ab6ca75858818844c0032ee1030f0603df9593e"}
Jul 02 20:40:12.668767 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:12.668750    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52xm6\" (UniqueName: \"kubernetes.io/projected/0192f1eb-c73e-46b3-82fe-d624f408a3d5-kube-api-access-52xm6\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:40:12.668836 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:12.668773    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0192f1eb-c73e-46b3-82fe-d624f408a3d5-extensions-socket-volume\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:40:12.668836 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:12.668787    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5sf2\" (UniqueName: \"kubernetes.io/projected/a564abdf-416c-4c04-a56d-05cbd41397ee-kube-api-access-q5sf2\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:40:12.670953 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:12.670938    2581 scope.go:117] "RemoveContainer" containerID="9ca6fcf7b63113b6f708eaa9cad0f125680ecba6ed13d22f0ab4d2e9d78c2be9"
Jul 02 20:40:12.671224 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:40:12.671202    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ca6fcf7b63113b6f708eaa9cad0f125680ecba6ed13d22f0ab4d2e9d78c2be9\": container with ID starting with 9ca6fcf7b63113b6f708eaa9cad0f125680ecba6ed13d22f0ab4d2e9d78c2be9 not found: ID does not exist" containerID="9ca6fcf7b63113b6f708eaa9cad0f125680ecba6ed13d22f0ab4d2e9d78c2be9"
Jul 02 20:40:12.671329 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:12.671227    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ca6fcf7b63113b6f708eaa9cad0f125680ecba6ed13d22f0ab4d2e9d78c2be9"} err="failed to get container status \"9ca6fcf7b63113b6f708eaa9cad0f125680ecba6ed13d22f0ab4d2e9d78c2be9\": rpc error: code = NotFound desc = could not find container \"9ca6fcf7b63113b6f708eaa9cad0f125680ecba6ed13d22f0ab4d2e9d78c2be9\": container with ID starting with 9ca6fcf7b63113b6f708eaa9cad0f125680ecba6ed13d22f0ab4d2e9d78c2be9 not found: ID does not exist"
Jul 02 20:40:12.671329 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:12.671243    2581 scope.go:117] "RemoveContainer" containerID="aa10a0bb07a17c11717ba336b6b75ef69a2bf6cb0245a853f3409a0d7466fbe8"
Jul 02 20:40:12.679055 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:12.679037    2581 scope.go:117] "RemoveContainer" containerID="aa10a0bb07a17c11717ba336b6b75ef69a2bf6cb0245a853f3409a0d7466fbe8"
Jul 02 20:40:12.679343 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:40:12.679320    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa10a0bb07a17c11717ba336b6b75ef69a2bf6cb0245a853f3409a0d7466fbe8\": container with ID starting with aa10a0bb07a17c11717ba336b6b75ef69a2bf6cb0245a853f3409a0d7466fbe8 not found: ID does not exist" containerID="aa10a0bb07a17c11717ba336b6b75ef69a2bf6cb0245a853f3409a0d7466fbe8"
Jul 02 20:40:12.679404 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:12.679352    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa10a0bb07a17c11717ba336b6b75ef69a2bf6cb0245a853f3409a0d7466fbe8"} err="failed to get container status \"aa10a0bb07a17c11717ba336b6b75ef69a2bf6cb0245a853f3409a0d7466fbe8\": rpc error: code = NotFound desc = could not find container \"aa10a0bb07a17c11717ba336b6b75ef69a2bf6cb0245a853f3409a0d7466fbe8\": container with ID starting with aa10a0bb07a17c11717ba336b6b75ef69a2bf6cb0245a853f3409a0d7466fbe8 not found: ID does not exist"
Jul 02 20:40:12.688105 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:12.688067    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s8nbx" podStartSLOduration=11.688055632 podStartE2EDuration="11.688055632s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:40:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:40:12.687043259 +0000 UTC m=+446.357556752" watchObservedRunningTime="2026-07-02 20:40:12.688055632 +0000 UTC m=+446.358569124"
Jul 02 20:40:12.688921 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:40:12.688899    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kw9zm\" is forbidden: User \"system:node:ip-10-0-135-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-220.ec2.internal' and this object" podUID="0192f1eb-c73e-46b3-82fe-d624f408a3d5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw9zm"
Jul 02 20:40:12.691007 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:40:12.690983    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vtjbc\" is forbidden: User \"system:node:ip-10-0-135-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-220.ec2.internal' and this object" podUID="a564abdf-416c-4c04-a56d-05cbd41397ee" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtjbc"
Jul 02 20:40:12.692581 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:40:12.692560    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kw9zm\" is forbidden: User \"system:node:ip-10-0-135-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-220.ec2.internal' and this object" podUID="0192f1eb-c73e-46b3-82fe-d624f408a3d5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw9zm"
Jul 02 20:40:12.709804 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:12.709765    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r88qf" podStartSLOduration=1.114197257 podStartE2EDuration="22.709752665s" totalImagesPullingTime="21.595555408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:39:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:40:12.70765995 +0000 UTC m=+446.378173443" watchObservedRunningTime="2026-07-02 20:40:12.709752665 +0000 UTC m=+446.380266157"
Jul 02 20:40:12.734776 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:12.734720    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5svc" podStartSLOduration=11.73470118 podStartE2EDuration="11.73470118s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:40:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:40:12.7323092 +0000 UTC m=+446.402822716" watchObservedRunningTime="2026-07-02 20:40:12.73470118 +0000 UTC m=+446.405214675"
Jul 02 20:40:12.738355 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:40:12.738324    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vtjbc\" is forbidden: User \"system:node:ip-10-0-135-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-220.ec2.internal' and this object" podUID="a564abdf-416c-4c04-a56d-05cbd41397ee" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtjbc"
Jul 02 20:40:12.881546 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:12.881515    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0192f1eb-c73e-46b3-82fe-d624f408a3d5" path="/var/lib/kubelet/pods/0192f1eb-c73e-46b3-82fe-d624f408a3d5/volumes"
Jul 02 20:40:12.881835 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:12.881813    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a564abdf-416c-4c04-a56d-05cbd41397ee" path="/var/lib/kubelet/pods/a564abdf-416c-4c04-a56d-05cbd41397ee/volumes"
Jul 02 20:40:18.395769 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:18.395730    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:18.498324 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:18.498288    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:19.025514 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:19.025482    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:19.152385 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:19.152348    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:23.677933 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:23.677900    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s8nbx"
Jul 02 20:40:23.678483 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:23.677981    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5svc"
Jul 02 20:40:23.769255 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:23.769226    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5svc"]
Jul 02 20:40:23.769436 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:23.769411    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5svc" podUID="c85d33c3-c110-4e08-b14a-4eea91db4bca" containerName="manager" containerID="cri-o://f536da00e67897f3120a9d3d6872759a1be2deb95f450529916ce932b2d262ea" gracePeriod=10
Jul 02 20:40:24.018881 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:24.018859    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5svc"
Jul 02 20:40:24.154597 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:24.154570    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4kpl\" (UniqueName: \"kubernetes.io/projected/c85d33c3-c110-4e08-b14a-4eea91db4bca-kube-api-access-d4kpl\") pod \"c85d33c3-c110-4e08-b14a-4eea91db4bca\" (UID: \"c85d33c3-c110-4e08-b14a-4eea91db4bca\") "
Jul 02 20:40:24.154747 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:24.154660    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c85d33c3-c110-4e08-b14a-4eea91db4bca-extensions-socket-volume\") pod \"c85d33c3-c110-4e08-b14a-4eea91db4bca\" (UID: \"c85d33c3-c110-4e08-b14a-4eea91db4bca\") "
Jul 02 20:40:24.155034 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:24.155012    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c85d33c3-c110-4e08-b14a-4eea91db4bca-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c85d33c3-c110-4e08-b14a-4eea91db4bca" (UID: "c85d33c3-c110-4e08-b14a-4eea91db4bca"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:40:24.156432 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:24.156412    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c85d33c3-c110-4e08-b14a-4eea91db4bca-kube-api-access-d4kpl" (OuterVolumeSpecName: "kube-api-access-d4kpl") pod "c85d33c3-c110-4e08-b14a-4eea91db4bca" (UID: "c85d33c3-c110-4e08-b14a-4eea91db4bca"). InnerVolumeSpecName "kube-api-access-d4kpl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:40:24.255602 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:24.255576    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c85d33c3-c110-4e08-b14a-4eea91db4bca-extensions-socket-volume\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:40:24.255602 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:24.255601    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4kpl\" (UniqueName: \"kubernetes.io/projected/c85d33c3-c110-4e08-b14a-4eea91db4bca-kube-api-access-d4kpl\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:40:24.729960 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:24.729927    2581 generic.go:356] "Generic (PLEG): container finished" podID="c85d33c3-c110-4e08-b14a-4eea91db4bca" containerID="f536da00e67897f3120a9d3d6872759a1be2deb95f450529916ce932b2d262ea" exitCode=0
Jul 02 20:40:24.730414 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:24.729965    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5svc"
Jul 02 20:40:24.730414 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:24.729981    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5svc" event={"ID":"c85d33c3-c110-4e08-b14a-4eea91db4bca","Type":"ContainerDied","Data":"f536da00e67897f3120a9d3d6872759a1be2deb95f450529916ce932b2d262ea"}
Jul 02 20:40:24.730414 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:24.730031    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5svc" event={"ID":"c85d33c3-c110-4e08-b14a-4eea91db4bca","Type":"ContainerDied","Data":"722517afc90eeebac98a8ec10bd80d08031dfc1cf4ce8adbc2f0038d776e4f1a"}
Jul 02 20:40:24.730414 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:24.730062    2581 scope.go:117] "RemoveContainer" containerID="f536da00e67897f3120a9d3d6872759a1be2deb95f450529916ce932b2d262ea"
Jul 02 20:40:24.740828 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:24.740809    2581 scope.go:117] "RemoveContainer" containerID="f536da00e67897f3120a9d3d6872759a1be2deb95f450529916ce932b2d262ea"
Jul 02 20:40:24.741100 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:40:24.741083    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f536da00e67897f3120a9d3d6872759a1be2deb95f450529916ce932b2d262ea\": container with ID starting with f536da00e67897f3120a9d3d6872759a1be2deb95f450529916ce932b2d262ea not found: ID does not exist" containerID="f536da00e67897f3120a9d3d6872759a1be2deb95f450529916ce932b2d262ea"
Jul 02 20:40:24.741170 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:24.741109    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f536da00e67897f3120a9d3d6872759a1be2deb95f450529916ce932b2d262ea"} err="failed to get container status \"f536da00e67897f3120a9d3d6872759a1be2deb95f450529916ce932b2d262ea\": rpc error: code = NotFound desc = could not find container \"f536da00e67897f3120a9d3d6872759a1be2deb95f450529916ce932b2d262ea\": container with ID starting with f536da00e67897f3120a9d3d6872759a1be2deb95f450529916ce932b2d262ea not found: ID does not exist"
Jul 02 20:40:24.764717 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:24.764696    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5svc"]
Jul 02 20:40:24.769905 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:24.769887    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v5svc"]
Jul 02 20:40:24.881251 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:24.881226    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c85d33c3-c110-4e08-b14a-4eea91db4bca" path="/var/lib/kubelet/pods/c85d33c3-c110-4e08-b14a-4eea91db4bca/volumes"
Jul 02 20:40:40.241509 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:40.241475    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql"]
Jul 02 20:40:40.241873 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:40.241772    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c85d33c3-c110-4e08-b14a-4eea91db4bca" containerName="manager"
Jul 02 20:40:40.241873 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:40.241787    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c85d33c3-c110-4e08-b14a-4eea91db4bca" containerName="manager"
Jul 02 20:40:40.241873 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:40.241870    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c85d33c3-c110-4e08-b14a-4eea91db4bca" containerName="manager"
Jul 02 20:40:40.282782 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:40.282752    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:40.312682 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:40.312656    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql"]
Jul 02 20:40:40.312906 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:40.312740    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql"
Jul 02 20:40:40.316041 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:40.316020    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-52bg8\""
Jul 02 20:40:40.316249 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:40.316231    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 02 20:40:40.379026 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:40.378996    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90f49378-c489-4ee5-a8fc-502c5f8043e0-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hd9ql\" (UID: \"90f49378-c489-4ee5-a8fc-502c5f8043e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql"
Jul 02 20:40:40.379193 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:40.379033    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90f49378-c489-4ee5-a8fc-502c5f8043e0-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hd9ql\" (UID: \"90f49378-c489-4ee5-a8fc-502c5f8043e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql"
Jul 02 20:40:40.379193 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:40.379051    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90f49378-c489-4ee5-a8fc-502c5f8043e0-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hd9ql\" (UID: \"90f49378-c489-4ee5-a8fc-502c5f8043e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql"
Jul 02 20:40:40.379193 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:40.379093    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90f49378-c489-4ee5-a8fc-502c5f8043e0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hd9ql\" (UID: \"90f49378-c489-4ee5-a8fc-502c5f8043e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql"
Jul 02 20:40:40.379193 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:40.379155    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90f49378-c489-4ee5-a8fc-502c5f8043e0-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hd9ql\" (UID: \"90f49378-c489-4ee5-a8fc-502c5f8043e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql"
Jul 02 20:40:40.379193 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:40.379185    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90f49378-c489-4ee5-a8fc-502c5f8043e0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hd9ql\" (UID: \"90f49378-c489-4ee5-a8fc-502c5f8043e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql"
Jul 02 20:40:40.379385 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:40.379231    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90f49378-c489-4ee5-a8fc-502c5f8043e0-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hd9ql\" (UID: \"90f49378-c489-4ee5-a8fc-502c5f8043e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql"
Jul 02 20:40:40.379385 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:40.379274    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90f49378-c489-4ee5-a8fc-502c5f8043e0-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hd9ql\" (UID: \"90f49378-c489-4ee5-a8fc-502c5f8043e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql"
Jul 02 20:40:40.379385 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:40.379302    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vkgk\" (UniqueName: \"kubernetes.io/projected/90f49378-c489-4ee5-a8fc-502c5f8043e0-kube-api-access-6vkgk\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hd9ql\" (UID: \"90f49378-c489-4ee5-a8fc-502c5f8043e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql"
Jul 02 20:40:40.434735 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:40.434704    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:40.480650 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:40.480615    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90f49378-c489-4ee5-a8fc-502c5f8043e0-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hd9ql\" (UID: \"90f49378-c489-4ee5-a8fc-502c5f8043e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql"
Jul 02 20:40:40.480796 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:40.480654    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vkgk\" (UniqueName: \"kubernetes.io/projected/90f49378-c489-4ee5-a8fc-502c5f8043e0-kube-api-access-6vkgk\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hd9ql\" (UID: \"90f49378-c489-4ee5-a8fc-502c5f8043e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql"
Jul 02 20:40:40.480796 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:40.480701    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90f49378-c489-4ee5-a8fc-502c5f8043e0-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hd9ql\" (UID: \"90f49378-c489-4ee5-a8fc-502c5f8043e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql"
Jul 02 20:40:40.480796 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:40.480731    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90f49378-c489-4ee5-a8fc-502c5f8043e0-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hd9ql\" (UID: \"90f49378-c489-4ee5-a8fc-502c5f8043e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql"
Jul 02 20:40:40.480796 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:40.480753    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90f49378-c489-4ee5-a8fc-502c5f8043e0-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hd9ql\" (UID: \"90f49378-c489-4ee5-a8fc-502c5f8043e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql"
Jul 02 20:40:40.480796 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:40.480777    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90f49378-c489-4ee5-a8fc-502c5f8043e0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hd9ql\" (UID: \"90f49378-c489-4ee5-a8fc-502c5f8043e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql"
Jul 02 20:40:40.481103 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:40.480811    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90f49378-c489-4ee5-a8fc-502c5f8043e0-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hd9ql\" (UID: \"90f49378-c489-4ee5-a8fc-502c5f8043e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql"
Jul 02 20:40:40.481103 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:40.480882    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90f49378-c489-4ee5-a8fc-502c5f8043e0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hd9ql\" (UID: \"90f49378-c489-4ee5-a8fc-502c5f8043e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql"
Jul 02 20:40:40.481103 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:40.480936    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90f49378-c489-4ee5-a8fc-502c5f8043e0-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hd9ql\" (UID: \"90f49378-c489-4ee5-a8fc-502c5f8043e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql"
Jul 02 20:40:40.481308 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:40.481122    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90f49378-c489-4ee5-a8fc-502c5f8043e0-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hd9ql\" (UID: \"90f49378-c489-4ee5-a8fc-502c5f8043e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql"
Jul 02 20:40:40.481308 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:40.481223    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90f49378-c489-4ee5-a8fc-502c5f8043e0-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hd9ql\" (UID: \"90f49378-c489-4ee5-a8fc-502c5f8043e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql"
Jul 02 20:40:40.481409 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:40.481329    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90f49378-c489-4ee5-a8fc-502c5f8043e0-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hd9ql\" (UID: \"90f49378-c489-4ee5-a8fc-502c5f8043e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql"
Jul 02 20:40:40.481460 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:40.481435    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90f49378-c489-4ee5-a8fc-502c5f8043e0-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hd9ql\" (UID: \"90f49378-c489-4ee5-a8fc-502c5f8043e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql"
Jul 02 20:40:40.481547 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:40.481526    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90f49378-c489-4ee5-a8fc-502c5f8043e0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hd9ql\" (UID: \"90f49378-c489-4ee5-a8fc-502c5f8043e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql"
Jul 02 20:40:40.483038 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:40.483020    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90f49378-c489-4ee5-a8fc-502c5f8043e0-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hd9ql\" (UID: \"90f49378-c489-4ee5-a8fc-502c5f8043e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql"
Jul 02 20:40:40.483475 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:40.483459    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90f49378-c489-4ee5-a8fc-502c5f8043e0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hd9ql\" (UID: \"90f49378-c489-4ee5-a8fc-502c5f8043e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql"
Jul 02 20:40:40.491178 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:40.491133    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vkgk\" (UniqueName: \"kubernetes.io/projected/90f49378-c489-4ee5-a8fc-502c5f8043e0-kube-api-access-6vkgk\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hd9ql\" (UID: \"90f49378-c489-4ee5-a8fc-502c5f8043e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql"
Jul 02 20:40:40.497792 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:40.497744    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90f49378-c489-4ee5-a8fc-502c5f8043e0-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hd9ql\" (UID: \"90f49378-c489-4ee5-a8fc-502c5f8043e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql"
Jul 02 20:40:40.623799 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:40.623771    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql"
Jul 02 20:40:40.810652 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:40.810622    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql"]
Jul 02 20:40:40.812346 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:40:40.812321    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90f49378_c489_4ee5_a8fc_502c5f8043e0.slice/crio-0bf1b6273ece5447c1ac2787617b37a2e23fbcf046b8ba518d8fafa2d1f6fc56 WatchSource:0}: Error finding container 0bf1b6273ece5447c1ac2787617b37a2e23fbcf046b8ba518d8fafa2d1f6fc56: Status 404 returned error can't find the container with id 0bf1b6273ece5447c1ac2787617b37a2e23fbcf046b8ba518d8fafa2d1f6fc56
Jul 02 20:40:41.817263 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:41.817224    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql" event={"ID":"90f49378-c489-4ee5-a8fc-502c5f8043e0","Type":"ContainerStarted","Data":"0bf1b6273ece5447c1ac2787617b37a2e23fbcf046b8ba518d8fafa2d1f6fc56"}
Jul 02 20:40:44.409242 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:44.409203    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:40:44.409546 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:44.409275    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:40:44.409546 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:44.409302    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:40:44.840031 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:44.839992    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql" event={"ID":"90f49378-c489-4ee5-a8fc-502c5f8043e0","Type":"ContainerStarted","Data":"70f5913c6e2cb4885c8db8efa5eec79dd11871e979c747ec735e48d30a454d3c"}
Jul 02 20:40:44.861595 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:44.861545    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql" podStartSLOduration=1.266859679 podStartE2EDuration="4.86152631s" totalImagesPullingTime="3.594666631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:40:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:40:44.860996926 +0000 UTC m=+478.531510422" watchObservedRunningTime="2026-07-02 20:40:44.86152631 +0000 UTC m=+478.532039805"
Jul 02 20:40:45.624517 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:45.624484    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql"
Jul 02 20:40:45.629131 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:45.629100    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql"
Jul 02 20:40:45.844804 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:45.844776    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql"
Jul 02 20:40:45.845744 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:45.845723    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql"
Jul 02 20:40:45.906230 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:45.906131    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:45.913827 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:45.913786    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5bj22"]
Jul 02 20:40:45.917310 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:45.917291    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5bj22"
Jul 02 20:40:45.919847 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:45.919828    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 02 20:40:45.934762 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:45.934744    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5bj22"]
Jul 02 20:40:46.002241 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:46.002204    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5bj22"]
Jul 02 20:40:46.017785 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:46.017755    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:46.030203 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:46.030177    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/afe49b13-aa04-4927-ba13-50ceba8373d9-config-file\") pod \"limitador-limitador-64c94fd64f-5bj22\" (UID: \"afe49b13-aa04-4927-ba13-50ceba8373d9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5bj22"
Jul 02 20:40:46.030331 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:46.030207    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcs4r\" (UniqueName: \"kubernetes.io/projected/afe49b13-aa04-4927-ba13-50ceba8373d9-kube-api-access-fcs4r\") pod \"limitador-limitador-64c94fd64f-5bj22\" (UID: \"afe49b13-aa04-4927-ba13-50ceba8373d9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5bj22"
Jul 02 20:40:46.116517 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:46.116489    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:46.131626 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:46.131603    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/afe49b13-aa04-4927-ba13-50ceba8373d9-config-file\") pod \"limitador-limitador-64c94fd64f-5bj22\" (UID: \"afe49b13-aa04-4927-ba13-50ceba8373d9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5bj22"
Jul 02 20:40:46.131739 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:46.131631    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcs4r\" (UniqueName: \"kubernetes.io/projected/afe49b13-aa04-4927-ba13-50ceba8373d9-kube-api-access-fcs4r\") pod \"limitador-limitador-64c94fd64f-5bj22\" (UID: \"afe49b13-aa04-4927-ba13-50ceba8373d9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5bj22"
Jul 02 20:40:46.132306 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:46.132288    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/afe49b13-aa04-4927-ba13-50ceba8373d9-config-file\") pod \"limitador-limitador-64c94fd64f-5bj22\" (UID: \"afe49b13-aa04-4927-ba13-50ceba8373d9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5bj22"
Jul 02 20:40:46.142516 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:46.142480    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcs4r\" (UniqueName: \"kubernetes.io/projected/afe49b13-aa04-4927-ba13-50ceba8373d9-kube-api-access-fcs4r\") pod \"limitador-limitador-64c94fd64f-5bj22\" (UID: \"afe49b13-aa04-4927-ba13-50ceba8373d9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5bj22"
Jul 02 20:40:46.227718 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:46.227695    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5bj22"
Jul 02 20:40:46.374688 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:46.374663    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5bj22"]
Jul 02 20:40:46.376488 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:40:46.376461    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafe49b13_aa04_4927_ba13_50ceba8373d9.slice/crio-8dba22dc2cebddde1d7828939ab7ad7bf0102bb4bd0181b04b82e97372ac90d6 WatchSource:0}: Error finding container 8dba22dc2cebddde1d7828939ab7ad7bf0102bb4bd0181b04b82e97372ac90d6: Status 404 returned error can't find the container with id 8dba22dc2cebddde1d7828939ab7ad7bf0102bb4bd0181b04b82e97372ac90d6
Jul 02 20:40:46.406383 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:46.406355    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:40:46.410777 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:46.410757    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"
Jul 02 20:40:46.436866 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:46.436844    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:40:46.484423 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:46.484365    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:40:46.535595 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:46.535567    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st749\" (UniqueName: \"kubernetes.io/projected/1f0e4742-3cc9-46b4-b25a-cc4899695998-kube-api-access-st749\") pod \"limitador-limitador-54d6d988d5-nw8gn\" (UID: \"1f0e4742-3cc9-46b4-b25a-cc4899695998\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"
Jul 02 20:40:46.535685 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:46.535630    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1f0e4742-3cc9-46b4-b25a-cc4899695998-config-file\") pod \"limitador-limitador-54d6d988d5-nw8gn\" (UID: \"1f0e4742-3cc9-46b4-b25a-cc4899695998\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"
Jul 02 20:40:46.636292 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:46.636267    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1f0e4742-3cc9-46b4-b25a-cc4899695998-config-file\") pod \"limitador-limitador-54d6d988d5-nw8gn\" (UID: \"1f0e4742-3cc9-46b4-b25a-cc4899695998\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"
Jul 02 20:40:46.636663 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:46.636305    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st749\" (UniqueName: \"kubernetes.io/projected/1f0e4742-3cc9-46b4-b25a-cc4899695998-kube-api-access-st749\") pod \"limitador-limitador-54d6d988d5-nw8gn\" (UID: \"1f0e4742-3cc9-46b4-b25a-cc4899695998\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"
Jul 02 20:40:46.636986 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:46.636964    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1f0e4742-3cc9-46b4-b25a-cc4899695998-config-file\") pod \"limitador-limitador-54d6d988d5-nw8gn\" (UID: \"1f0e4742-3cc9-46b4-b25a-cc4899695998\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"
Jul 02 20:40:46.646060 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:46.646037    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-st749\" (UniqueName: \"kubernetes.io/projected/1f0e4742-3cc9-46b4-b25a-cc4899695998-kube-api-access-st749\") pod \"limitador-limitador-54d6d988d5-nw8gn\" (UID: \"1f0e4742-3cc9-46b4-b25a-cc4899695998\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"
Jul 02 20:40:46.720877 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:46.720853    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"
Jul 02 20:40:46.762126 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:46.761581    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-jkjh2"]
Jul 02 20:40:46.766001 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:46.765984    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jkjh2"
Jul 02 20:40:46.769932 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:46.769907    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-bldrs\""
Jul 02 20:40:46.773221 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:46.773160    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-jkjh2"]
Jul 02 20:40:46.811730 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:46.811686    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:46.851499 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:46.851465    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5bj22" event={"ID":"afe49b13-aa04-4927-ba13-50ceba8373d9","Type":"ContainerStarted","Data":"8dba22dc2cebddde1d7828939ab7ad7bf0102bb4bd0181b04b82e97372ac90d6"}
Jul 02 20:40:46.865026 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:46.865001    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:40:46.867185 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:40:46.867163    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f0e4742_3cc9_46b4_b25a_cc4899695998.slice/crio-690a17d099c81fec6264c0f8f650dc1e53694cc164002a387aee0f4f3751710b WatchSource:0}: Error finding container 690a17d099c81fec6264c0f8f650dc1e53694cc164002a387aee0f4f3751710b: Status 404 returned error can't find the container with id 690a17d099c81fec6264c0f8f650dc1e53694cc164002a387aee0f4f3751710b
Jul 02 20:40:46.907732 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:46.907698    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:40:46.939773 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:46.939749    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtt6p\" (UniqueName: \"kubernetes.io/projected/5c84453c-305a-488b-9634-024ab7db4ed7-kube-api-access-rtt6p\") pod \"authorino-58cd955675-jkjh2\" (UID: \"5c84453c-305a-488b-9634-024ab7db4ed7\") " pod="kuadrant-system/authorino-58cd955675-jkjh2"
Jul 02 20:40:47.041022 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:47.040961    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtt6p\" (UniqueName: \"kubernetes.io/projected/5c84453c-305a-488b-9634-024ab7db4ed7-kube-api-access-rtt6p\") pod \"authorino-58cd955675-jkjh2\" (UID: \"5c84453c-305a-488b-9634-024ab7db4ed7\") " pod="kuadrant-system/authorino-58cd955675-jkjh2"
Jul 02 20:40:47.058721 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:47.058694    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtt6p\" (UniqueName: \"kubernetes.io/projected/5c84453c-305a-488b-9634-024ab7db4ed7-kube-api-access-rtt6p\") pod \"authorino-58cd955675-jkjh2\" (UID: \"5c84453c-305a-488b-9634-024ab7db4ed7\") " pod="kuadrant-system/authorino-58cd955675-jkjh2"
Jul 02 20:40:47.079614 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:47.079590    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jkjh2"
Jul 02 20:40:47.231970 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:47.231001    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-jkjh2"]
Jul 02 20:40:47.234588 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:40:47.234555    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c84453c_305a_488b_9634_024ab7db4ed7.slice/crio-3a616545d48e944273a7b3e77e1109486ce77c19077c277e745e036d5d8698c5 WatchSource:0}: Error finding container 3a616545d48e944273a7b3e77e1109486ce77c19077c277e745e036d5d8698c5: Status 404 returned error can't find the container with id 3a616545d48e944273a7b3e77e1109486ce77c19077c277e745e036d5d8698c5
Jul 02 20:40:47.864031 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:47.863995    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jkjh2" event={"ID":"5c84453c-305a-488b-9634-024ab7db4ed7","Type":"ContainerStarted","Data":"3a616545d48e944273a7b3e77e1109486ce77c19077c277e745e036d5d8698c5"}
Jul 02 20:40:47.866814 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:47.866788    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-nw8gn" event={"ID":"1f0e4742-3cc9-46b4-b25a-cc4899695998","Type":"ContainerStarted","Data":"690a17d099c81fec6264c0f8f650dc1e53694cc164002a387aee0f4f3751710b"}
Jul 02 20:40:50.657468 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:50.657432    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-jkjh2"]
Jul 02 20:40:51.894099 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:51.894063    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5bj22" event={"ID":"afe49b13-aa04-4927-ba13-50ceba8373d9","Type":"ContainerStarted","Data":"977c1999d9473296dd725cb721742ca31186b722ee14065058eb2729086afbf3"}
Jul 02 20:40:51.894528 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:51.894243    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-5bj22"
Jul 02 20:40:51.895535 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:51.895513    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jkjh2" event={"ID":"5c84453c-305a-488b-9634-024ab7db4ed7","Type":"ContainerStarted","Data":"30cf016133239e487b4db72a62c85a270ca23303b0020eb54eeacc96cae68985"}
Jul 02 20:40:51.895600 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:51.895548    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-jkjh2" podUID="5c84453c-305a-488b-9634-024ab7db4ed7" containerName="authorino" containerID="cri-o://30cf016133239e487b4db72a62c85a270ca23303b0020eb54eeacc96cae68985" gracePeriod=30
Jul 02 20:40:51.897184 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:51.897163    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-nw8gn" event={"ID":"1f0e4742-3cc9-46b4-b25a-cc4899695998","Type":"ContainerStarted","Data":"46ddb88d31ce46320f251d4d89e63a67040a489ab9276bf20d91f2c9caff6054"}
Jul 02 20:40:51.897296 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:51.897282    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"
Jul 02 20:40:51.917647 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:51.917608    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-5bj22" podStartSLOduration=1.851278938 podStartE2EDuration="6.91759547s" totalImagesPullingTime="5.066316532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:40:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:40:51.91687705 +0000 UTC m=+485.587390546" watchObservedRunningTime="2026-07-02 20:40:51.91759547 +0000 UTC m=+485.588108963"
Jul 02 20:40:51.934345 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:51.934308    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-jkjh2" podStartSLOduration=1.72891458 podStartE2EDuration="5.934294836s" totalImagesPullingTime="4.205380256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:40:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:40:51.933073833 +0000 UTC m=+485.603587328" watchObservedRunningTime="2026-07-02 20:40:51.934294836 +0000 UTC m=+485.604808385"
Jul 02 20:40:51.949376 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:51.949341    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-nw8gn" podStartSLOduration=1.380515483 podStartE2EDuration="5.949330891s" totalImagesPullingTime="4.568815408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:40:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:40:51.948838892 +0000 UTC m=+485.619352386" watchObservedRunningTime="2026-07-02 20:40:51.949330891 +0000 UTC m=+485.619844384"
Jul 02 20:40:52.133012 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:52.132989    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jkjh2"
Jul 02 20:40:52.290909 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:52.290874    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rtt6p\" (UniqueName: \"kubernetes.io/projected/5c84453c-305a-488b-9634-024ab7db4ed7-kube-api-access-rtt6p\") pod \"5c84453c-305a-488b-9634-024ab7db4ed7\" (UID: \"5c84453c-305a-488b-9634-024ab7db4ed7\") "
Jul 02 20:40:52.292822 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:52.292799    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c84453c-305a-488b-9634-024ab7db4ed7-kube-api-access-rtt6p" (OuterVolumeSpecName: "kube-api-access-rtt6p") pod "5c84453c-305a-488b-9634-024ab7db4ed7" (UID: "5c84453c-305a-488b-9634-024ab7db4ed7"). InnerVolumeSpecName "kube-api-access-rtt6p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:40:52.392226 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:52.392201    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtt6p\" (UniqueName: \"kubernetes.io/projected/5c84453c-305a-488b-9634-024ab7db4ed7-kube-api-access-rtt6p\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:40:52.902856 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:52.902824    2581 generic.go:356] "Generic (PLEG): container finished" podID="5c84453c-305a-488b-9634-024ab7db4ed7" containerID="30cf016133239e487b4db72a62c85a270ca23303b0020eb54eeacc96cae68985" exitCode=0
Jul 02 20:40:52.903257 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:52.902857    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jkjh2"
Jul 02 20:40:52.903257 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:52.902907    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jkjh2" event={"ID":"5c84453c-305a-488b-9634-024ab7db4ed7","Type":"ContainerDied","Data":"30cf016133239e487b4db72a62c85a270ca23303b0020eb54eeacc96cae68985"}
Jul 02 20:40:52.903257 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:52.902950    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jkjh2" event={"ID":"5c84453c-305a-488b-9634-024ab7db4ed7","Type":"ContainerDied","Data":"3a616545d48e944273a7b3e77e1109486ce77c19077c277e745e036d5d8698c5"}
Jul 02 20:40:52.903257 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:52.902976    2581 scope.go:117] "RemoveContainer" containerID="30cf016133239e487b4db72a62c85a270ca23303b0020eb54eeacc96cae68985"
Jul 02 20:40:52.911355 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:52.911331    2581 scope.go:117] "RemoveContainer" containerID="30cf016133239e487b4db72a62c85a270ca23303b0020eb54eeacc96cae68985"
Jul 02 20:40:52.911610 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:40:52.911594    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30cf016133239e487b4db72a62c85a270ca23303b0020eb54eeacc96cae68985\": container with ID starting with 30cf016133239e487b4db72a62c85a270ca23303b0020eb54eeacc96cae68985 not found: ID does not exist" containerID="30cf016133239e487b4db72a62c85a270ca23303b0020eb54eeacc96cae68985"
Jul 02 20:40:52.911650 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:52.911617    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30cf016133239e487b4db72a62c85a270ca23303b0020eb54eeacc96cae68985"} err="failed to get container status \"30cf016133239e487b4db72a62c85a270ca23303b0020eb54eeacc96cae68985\": rpc error: code = NotFound desc = could not find container \"30cf016133239e487b4db72a62c85a270ca23303b0020eb54eeacc96cae68985\": container with ID starting with 30cf016133239e487b4db72a62c85a270ca23303b0020eb54eeacc96cae68985 not found: ID does not exist"
Jul 02 20:40:52.919767 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:52.919745    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-jkjh2"]
Jul 02 20:40:52.923469 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:52.923450    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-jkjh2"]
Jul 02 20:40:54.881451 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:40:54.881409    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c84453c-305a-488b-9634-024ab7db4ed7" path="/var/lib/kubelet/pods/5c84453c-305a-488b-9634-024ab7db4ed7/volumes"
Jul 02 20:41:02.904276 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:02.904245    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"
Jul 02 20:41:02.904659 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:02.904339    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-5bj22"
Jul 02 20:41:02.963665 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:02.963633    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5bj22"]
Jul 02 20:41:02.963835 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:02.963798    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-5bj22" podUID="afe49b13-aa04-4927-ba13-50ceba8373d9" containerName="limitador" containerID="cri-o://977c1999d9473296dd725cb721742ca31186b722ee14065058eb2729086afbf3" gracePeriod=30
Jul 02 20:41:03.496010 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:03.495987    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5bj22"
Jul 02 20:41:03.572411 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:03.572340    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fcs4r\" (UniqueName: \"kubernetes.io/projected/afe49b13-aa04-4927-ba13-50ceba8373d9-kube-api-access-fcs4r\") pod \"afe49b13-aa04-4927-ba13-50ceba8373d9\" (UID: \"afe49b13-aa04-4927-ba13-50ceba8373d9\") "
Jul 02 20:41:03.572411 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:03.572398    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/afe49b13-aa04-4927-ba13-50ceba8373d9-config-file\") pod \"afe49b13-aa04-4927-ba13-50ceba8373d9\" (UID: \"afe49b13-aa04-4927-ba13-50ceba8373d9\") "
Jul 02 20:41:03.572750 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:03.572728    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afe49b13-aa04-4927-ba13-50ceba8373d9-config-file" (OuterVolumeSpecName: "config-file") pod "afe49b13-aa04-4927-ba13-50ceba8373d9" (UID: "afe49b13-aa04-4927-ba13-50ceba8373d9"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:41:03.574407 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:03.574383    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afe49b13-aa04-4927-ba13-50ceba8373d9-kube-api-access-fcs4r" (OuterVolumeSpecName: "kube-api-access-fcs4r") pod "afe49b13-aa04-4927-ba13-50ceba8373d9" (UID: "afe49b13-aa04-4927-ba13-50ceba8373d9"). InnerVolumeSpecName "kube-api-access-fcs4r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:41:03.673159 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:03.673120    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fcs4r\" (UniqueName: \"kubernetes.io/projected/afe49b13-aa04-4927-ba13-50ceba8373d9-kube-api-access-fcs4r\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:41:03.673159 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:03.673160    2581 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/afe49b13-aa04-4927-ba13-50ceba8373d9-config-file\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:41:03.957777 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:03.957700    2581 generic.go:356] "Generic (PLEG): container finished" podID="afe49b13-aa04-4927-ba13-50ceba8373d9" containerID="977c1999d9473296dd725cb721742ca31186b722ee14065058eb2729086afbf3" exitCode=0
Jul 02 20:41:03.957777 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:03.957747    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5bj22"
Jul 02 20:41:03.958237 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:03.957786    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5bj22" event={"ID":"afe49b13-aa04-4927-ba13-50ceba8373d9","Type":"ContainerDied","Data":"977c1999d9473296dd725cb721742ca31186b722ee14065058eb2729086afbf3"}
Jul 02 20:41:03.958237 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:03.957843    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5bj22" event={"ID":"afe49b13-aa04-4927-ba13-50ceba8373d9","Type":"ContainerDied","Data":"8dba22dc2cebddde1d7828939ab7ad7bf0102bb4bd0181b04b82e97372ac90d6"}
Jul 02 20:41:03.958237 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:03.957874    2581 scope.go:117] "RemoveContainer" containerID="977c1999d9473296dd725cb721742ca31186b722ee14065058eb2729086afbf3"
Jul 02 20:41:03.967221 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:03.967051    2581 scope.go:117] "RemoveContainer" containerID="977c1999d9473296dd725cb721742ca31186b722ee14065058eb2729086afbf3"
Jul 02 20:41:03.967349 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:41:03.967330    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"977c1999d9473296dd725cb721742ca31186b722ee14065058eb2729086afbf3\": container with ID starting with 977c1999d9473296dd725cb721742ca31186b722ee14065058eb2729086afbf3 not found: ID does not exist" containerID="977c1999d9473296dd725cb721742ca31186b722ee14065058eb2729086afbf3"
Jul 02 20:41:03.967397 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:03.967358    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"977c1999d9473296dd725cb721742ca31186b722ee14065058eb2729086afbf3"} err="failed to get container status \"977c1999d9473296dd725cb721742ca31186b722ee14065058eb2729086afbf3\": rpc error: code = NotFound desc = could not find container \"977c1999d9473296dd725cb721742ca31186b722ee14065058eb2729086afbf3\": container with ID starting with 977c1999d9473296dd725cb721742ca31186b722ee14065058eb2729086afbf3 not found: ID does not exist"
Jul 02 20:41:03.979781 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:03.979757    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5bj22"]
Jul 02 20:41:03.983241 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:03.983221    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5bj22"]
Jul 02 20:41:04.880400 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:04.880367    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afe49b13-aa04-4927-ba13-50ceba8373d9" path="/var/lib/kubelet/pods/afe49b13-aa04-4927-ba13-50ceba8373d9/volumes"
Jul 02 20:41:07.159035 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:07.159008    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:41:07.263192 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:07.263131    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:41:07.631452 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:07.631408    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:41:20.102602 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:20.102560    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:41:20.317030 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:20.317001    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hqvw8"]
Jul 02 20:41:20.317370 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:20.317356    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c84453c-305a-488b-9634-024ab7db4ed7" containerName="authorino"
Jul 02 20:41:20.317422 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:20.317373    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c84453c-305a-488b-9634-024ab7db4ed7" containerName="authorino"
Jul 02 20:41:20.317422 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:20.317386    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afe49b13-aa04-4927-ba13-50ceba8373d9" containerName="limitador"
Jul 02 20:41:20.317422 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:20.317392    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="afe49b13-aa04-4927-ba13-50ceba8373d9" containerName="limitador"
Jul 02 20:41:20.317553 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:20.317442    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c84453c-305a-488b-9634-024ab7db4ed7" containerName="authorino"
Jul 02 20:41:20.317553 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:20.317453    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="afe49b13-aa04-4927-ba13-50ceba8373d9" containerName="limitador"
Jul 02 20:41:20.416696 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:20.416622    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hqvw8"]
Jul 02 20:41:20.416833 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:20.416716    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hqvw8"
Jul 02 20:41:20.419485 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:20.419463    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-bldrs\""
Jul 02 20:41:20.509614 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:20.509586    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dcm5\" (UniqueName: \"kubernetes.io/projected/3577ec48-4d3a-49d1-ad0c-05e824b94c7b-kube-api-access-4dcm5\") pod \"authorino-5d4b67c446-hqvw8\" (UID: \"3577ec48-4d3a-49d1-ad0c-05e824b94c7b\") " pod="kuadrant-system/authorino-5d4b67c446-hqvw8"
Jul 02 20:41:20.553514 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:20.553485    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hqvw8"]
Jul 02 20:41:20.553715 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:41:20.553697    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-4dcm5], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-hqvw8" podUID="3577ec48-4d3a-49d1-ad0c-05e824b94c7b"
Jul 02 20:41:20.575753 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:20.575727    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7988549467-wd52v"]
Jul 02 20:41:20.600802 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:20.600780    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7988549467-wd52v"]
Jul 02 20:41:20.600916 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:20.600883    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7988549467-wd52v"
Jul 02 20:41:20.610206 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:20.610187    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dcm5\" (UniqueName: \"kubernetes.io/projected/3577ec48-4d3a-49d1-ad0c-05e824b94c7b-kube-api-access-4dcm5\") pod \"authorino-5d4b67c446-hqvw8\" (UID: \"3577ec48-4d3a-49d1-ad0c-05e824b94c7b\") " pod="kuadrant-system/authorino-5d4b67c446-hqvw8"
Jul 02 20:41:20.623008 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:20.622979    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dcm5\" (UniqueName: \"kubernetes.io/projected/3577ec48-4d3a-49d1-ad0c-05e824b94c7b-kube-api-access-4dcm5\") pod \"authorino-5d4b67c446-hqvw8\" (UID: \"3577ec48-4d3a-49d1-ad0c-05e824b94c7b\") " pod="kuadrant-system/authorino-5d4b67c446-hqvw8"
Jul 02 20:41:20.711022 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:20.710998    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5857\" (UniqueName: \"kubernetes.io/projected/4ace369d-3bd7-460f-83b9-761999ecea99-kube-api-access-d5857\") pod \"authorino-7988549467-wd52v\" (UID: \"4ace369d-3bd7-460f-83b9-761999ecea99\") " pod="kuadrant-system/authorino-7988549467-wd52v"
Jul 02 20:41:20.756427 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:20.756396    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:41:20.811508 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:20.811482    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5857\" (UniqueName: \"kubernetes.io/projected/4ace369d-3bd7-460f-83b9-761999ecea99-kube-api-access-d5857\") pod \"authorino-7988549467-wd52v\" (UID: \"4ace369d-3bd7-460f-83b9-761999ecea99\") " pod="kuadrant-system/authorino-7988549467-wd52v"
Jul 02 20:41:20.819981 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:20.819955    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5857\" (UniqueName: \"kubernetes.io/projected/4ace369d-3bd7-460f-83b9-761999ecea99-kube-api-access-d5857\") pod \"authorino-7988549467-wd52v\" (UID: \"4ace369d-3bd7-460f-83b9-761999ecea99\") " pod="kuadrant-system/authorino-7988549467-wd52v"
Jul 02 20:41:20.909845 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:20.909819    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7988549467-wd52v"
Jul 02 20:41:21.040674 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:21.040647    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hqvw8"
Jul 02 20:41:21.054606 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:21.054573    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7988549467-wd52v"]
Jul 02 20:41:21.056943 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:41:21.056920    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4ace369d_3bd7_460f_83b9_761999ecea99.slice/crio-22d308073c474834872da382ee1abddc42bc8178469d3ae3ebab5850385f3c16 WatchSource:0}: Error finding container 22d308073c474834872da382ee1abddc42bc8178469d3ae3ebab5850385f3c16: Status 404 returned error can't find the container with id 22d308073c474834872da382ee1abddc42bc8178469d3ae3ebab5850385f3c16
Jul 02 20:41:21.062593 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:21.062571    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hqvw8"
Jul 02 20:41:21.113964 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:21.113933    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4dcm5\" (UniqueName: \"kubernetes.io/projected/3577ec48-4d3a-49d1-ad0c-05e824b94c7b-kube-api-access-4dcm5\") pod \"3577ec48-4d3a-49d1-ad0c-05e824b94c7b\" (UID: \"3577ec48-4d3a-49d1-ad0c-05e824b94c7b\") "
Jul 02 20:41:21.116015 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:21.115992    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3577ec48-4d3a-49d1-ad0c-05e824b94c7b-kube-api-access-4dcm5" (OuterVolumeSpecName: "kube-api-access-4dcm5") pod "3577ec48-4d3a-49d1-ad0c-05e824b94c7b" (UID: "3577ec48-4d3a-49d1-ad0c-05e824b94c7b"). InnerVolumeSpecName "kube-api-access-4dcm5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:41:21.215169 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:21.215108    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4dcm5\" (UniqueName: \"kubernetes.io/projected/3577ec48-4d3a-49d1-ad0c-05e824b94c7b-kube-api-access-4dcm5\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:41:22.047344 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:22.047305    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7988549467-wd52v" event={"ID":"4ace369d-3bd7-460f-83b9-761999ecea99","Type":"ContainerStarted","Data":"489d7a70b8f94747ff0ef16cd5af7177269b97d13bee3bf3c61dae67658cd5ae"}
Jul 02 20:41:22.047344 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:22.047348    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7988549467-wd52v" event={"ID":"4ace369d-3bd7-460f-83b9-761999ecea99","Type":"ContainerStarted","Data":"22d308073c474834872da382ee1abddc42bc8178469d3ae3ebab5850385f3c16"}
Jul 02 20:41:22.047620 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:22.047472    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hqvw8"
Jul 02 20:41:22.063408 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:22.063360    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7988549467-wd52v" podStartSLOduration=1.481505407 podStartE2EDuration="2.063345126s" totalImagesPullingTime="581.839719ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:41:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:41:22.061758235 +0000 UTC m=+515.732271729" watchObservedRunningTime="2026-07-02 20:41:22.063345126 +0000 UTC m=+515.733858619"
Jul 02 20:41:22.084864 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:22.084833    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hqvw8"]
Jul 02 20:41:22.094682 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:22.094653    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hqvw8"]
Jul 02 20:41:22.315161 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:22.315067    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-df7f9fb75-rn796"]
Jul 02 20:41:22.317203 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:22.317187    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-df7f9fb75-rn796"
Jul 02 20:41:22.319954 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:22.319935    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 02 20:41:22.333199 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:22.333175    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-df7f9fb75-rn796"]
Jul 02 20:41:22.425887 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:22.425854    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ac2d61d4-9778-4308-b401-6195eab135d0-tls-cert\") pod \"authorino-df7f9fb75-rn796\" (UID: \"ac2d61d4-9778-4308-b401-6195eab135d0\") " pod="kuadrant-system/authorino-df7f9fb75-rn796"
Jul 02 20:41:22.426043 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:22.425905    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v6db\" (UniqueName: \"kubernetes.io/projected/ac2d61d4-9778-4308-b401-6195eab135d0-kube-api-access-5v6db\") pod \"authorino-df7f9fb75-rn796\" (UID: \"ac2d61d4-9778-4308-b401-6195eab135d0\") " pod="kuadrant-system/authorino-df7f9fb75-rn796"
Jul 02 20:41:22.526881 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:22.526846    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ac2d61d4-9778-4308-b401-6195eab135d0-tls-cert\") pod \"authorino-df7f9fb75-rn796\" (UID: \"ac2d61d4-9778-4308-b401-6195eab135d0\") " pod="kuadrant-system/authorino-df7f9fb75-rn796"
Jul 02 20:41:22.527072 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:22.526897    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v6db\" (UniqueName: \"kubernetes.io/projected/ac2d61d4-9778-4308-b401-6195eab135d0-kube-api-access-5v6db\") pod \"authorino-df7f9fb75-rn796\" (UID: \"ac2d61d4-9778-4308-b401-6195eab135d0\") " pod="kuadrant-system/authorino-df7f9fb75-rn796"
Jul 02 20:41:22.529352 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:22.529328    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ac2d61d4-9778-4308-b401-6195eab135d0-tls-cert\") pod \"authorino-df7f9fb75-rn796\" (UID: \"ac2d61d4-9778-4308-b401-6195eab135d0\") " pod="kuadrant-system/authorino-df7f9fb75-rn796"
Jul 02 20:41:22.535616 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:22.535590    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v6db\" (UniqueName: \"kubernetes.io/projected/ac2d61d4-9778-4308-b401-6195eab135d0-kube-api-access-5v6db\") pod \"authorino-df7f9fb75-rn796\" (UID: \"ac2d61d4-9778-4308-b401-6195eab135d0\") " pod="kuadrant-system/authorino-df7f9fb75-rn796"
Jul 02 20:41:22.626670 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:22.626589    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-df7f9fb75-rn796"
Jul 02 20:41:22.755510 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:22.755483    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-df7f9fb75-rn796"]
Jul 02 20:41:22.757600 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:41:22.757574    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac2d61d4_9778_4308_b401_6195eab135d0.slice/crio-3a95d0ca4950921ec745234711b423e0cc7b2a29754dd2fce1f3d615fb643d2f WatchSource:0}: Error finding container 3a95d0ca4950921ec745234711b423e0cc7b2a29754dd2fce1f3d615fb643d2f: Status 404 returned error can't find the container with id 3a95d0ca4950921ec745234711b423e0cc7b2a29754dd2fce1f3d615fb643d2f
Jul 02 20:41:22.881042 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:22.880970    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3577ec48-4d3a-49d1-ad0c-05e824b94c7b" path="/var/lib/kubelet/pods/3577ec48-4d3a-49d1-ad0c-05e824b94c7b/volumes"
Jul 02 20:41:23.053316 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:23.053281    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-df7f9fb75-rn796" event={"ID":"ac2d61d4-9778-4308-b401-6195eab135d0","Type":"ContainerStarted","Data":"3a95d0ca4950921ec745234711b423e0cc7b2a29754dd2fce1f3d615fb643d2f"}
Jul 02 20:41:24.062272 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:24.062234    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-df7f9fb75-rn796" event={"ID":"ac2d61d4-9778-4308-b401-6195eab135d0","Type":"ContainerStarted","Data":"61b5a32363ab22a274d10e7f5cb4d95303ff6741e65a7bf648cc300938c87637"}
Jul 02 20:41:24.079424 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:24.079381    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-df7f9fb75-rn796" podStartSLOduration=1.7756552380000001 podStartE2EDuration="2.079365423s" totalImagesPullingTime="303.710185ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:41:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:41:24.07773284 +0000 UTC m=+517.748246333" watchObservedRunningTime="2026-07-02 20:41:24.079365423 +0000 UTC m=+517.749878963"
Jul 02 20:41:24.105118 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:24.105088    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7988549467-wd52v"]
Jul 02 20:41:24.105282 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:24.105256    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7988549467-wd52v" podUID="4ace369d-3bd7-460f-83b9-761999ecea99" containerName="authorino" containerID="cri-o://489d7a70b8f94747ff0ef16cd5af7177269b97d13bee3bf3c61dae67658cd5ae" gracePeriod=30
Jul 02 20:41:24.345448 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:24.345426    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7988549467-wd52v"
Jul 02 20:41:24.441917 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:24.441888    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d5857\" (UniqueName: \"kubernetes.io/projected/4ace369d-3bd7-460f-83b9-761999ecea99-kube-api-access-d5857\") pod \"4ace369d-3bd7-460f-83b9-761999ecea99\" (UID: \"4ace369d-3bd7-460f-83b9-761999ecea99\") "
Jul 02 20:41:24.443876 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:24.443842    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ace369d-3bd7-460f-83b9-761999ecea99-kube-api-access-d5857" (OuterVolumeSpecName: "kube-api-access-d5857") pod "4ace369d-3bd7-460f-83b9-761999ecea99" (UID: "4ace369d-3bd7-460f-83b9-761999ecea99"). InnerVolumeSpecName "kube-api-access-d5857". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:41:24.543387 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:24.543357    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d5857\" (UniqueName: \"kubernetes.io/projected/4ace369d-3bd7-460f-83b9-761999ecea99-kube-api-access-d5857\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:41:25.068967 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:25.068935    2581 generic.go:356] "Generic (PLEG): container finished" podID="4ace369d-3bd7-460f-83b9-761999ecea99" containerID="489d7a70b8f94747ff0ef16cd5af7177269b97d13bee3bf3c61dae67658cd5ae" exitCode=0
Jul 02 20:41:25.069364 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:25.068974    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7988549467-wd52v"
Jul 02 20:41:25.069364 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:25.069063    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7988549467-wd52v" event={"ID":"4ace369d-3bd7-460f-83b9-761999ecea99","Type":"ContainerDied","Data":"489d7a70b8f94747ff0ef16cd5af7177269b97d13bee3bf3c61dae67658cd5ae"}
Jul 02 20:41:25.069364 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:25.069102    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7988549467-wd52v" event={"ID":"4ace369d-3bd7-460f-83b9-761999ecea99","Type":"ContainerDied","Data":"22d308073c474834872da382ee1abddc42bc8178469d3ae3ebab5850385f3c16"}
Jul 02 20:41:25.069364 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:25.069124    2581 scope.go:117] "RemoveContainer" containerID="489d7a70b8f94747ff0ef16cd5af7177269b97d13bee3bf3c61dae67658cd5ae"
Jul 02 20:41:25.077430 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:25.077413    2581 scope.go:117] "RemoveContainer" containerID="489d7a70b8f94747ff0ef16cd5af7177269b97d13bee3bf3c61dae67658cd5ae"
Jul 02 20:41:25.077690 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:41:25.077673    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"489d7a70b8f94747ff0ef16cd5af7177269b97d13bee3bf3c61dae67658cd5ae\": container with ID starting with 489d7a70b8f94747ff0ef16cd5af7177269b97d13bee3bf3c61dae67658cd5ae not found: ID does not exist" containerID="489d7a70b8f94747ff0ef16cd5af7177269b97d13bee3bf3c61dae67658cd5ae"
Jul 02 20:41:25.077749 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:25.077698    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"489d7a70b8f94747ff0ef16cd5af7177269b97d13bee3bf3c61dae67658cd5ae"} err="failed to get container status \"489d7a70b8f94747ff0ef16cd5af7177269b97d13bee3bf3c61dae67658cd5ae\": rpc error: code = NotFound desc = could not find container \"489d7a70b8f94747ff0ef16cd5af7177269b97d13bee3bf3c61dae67658cd5ae\": container with ID starting with 489d7a70b8f94747ff0ef16cd5af7177269b97d13bee3bf3c61dae67658cd5ae not found: ID does not exist"
Jul 02 20:41:25.085866 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:25.085822    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7988549467-wd52v"]
Jul 02 20:41:25.088032 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:25.088013    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7988549467-wd52v"]
Jul 02 20:41:26.532726 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:26.532687    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:41:26.632306 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:26.632267    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:41:26.688339 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:26.688305    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:41:26.873436 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:26.873363    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:41:26.880466 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:26.880441    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ace369d-3bd7-460f-83b9-761999ecea99" path="/var/lib/kubelet/pods/4ace369d-3bd7-460f-83b9-761999ecea99/volumes"
Jul 02 20:41:30.238490 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:30.238440    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:41:30.343286 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:30.343253    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:41:39.941510 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:41:39.941427    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:42:01.722201 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:01.722124    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:42:02.217885 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:02.217850    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:42:02.622455 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:02.622374    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:42:02.719398 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:02.719364    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:42:02.773534 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:02.773498    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-7244n"]
Jul 02 20:42:02.773996 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:02.773965    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ace369d-3bd7-460f-83b9-761999ecea99" containerName="authorino"
Jul 02 20:42:02.773996 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:02.773984    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ace369d-3bd7-460f-83b9-761999ecea99" containerName="authorino"
Jul 02 20:42:02.774109 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:02.774088    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ace369d-3bd7-460f-83b9-761999ecea99" containerName="authorino"
Jul 02 20:42:02.778762 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:02.778743    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-7244n"
Jul 02 20:42:02.781549 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:02.781517    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-k5c69\""
Jul 02 20:42:02.781678 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:02.781514    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 02 20:42:02.784552 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:02.784524    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-7244n"]
Jul 02 20:42:02.788112 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:02.788092    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-tnbmf"]
Jul 02 20:42:02.791344 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:02.791329    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-tnbmf"
Jul 02 20:42:02.806828 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:02.806807    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-tnbmf"]
Jul 02 20:42:02.808577 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:02.808559    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:42:02.825995 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:02.825972    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:42:02.934829 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:02.934751    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7cfb688-311b-4962-bb23-8a484a04d3ce-plugins-config-volume\") pod \"payload-pre-processing-7964457696-7244n\" (UID: \"e7cfb688-311b-4962-bb23-8a484a04d3ce\") " pod="openshift-ingress/payload-pre-processing-7964457696-7244n"
Jul 02 20:42:02.934829 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:02.934800    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kg8k\" (UniqueName: \"kubernetes.io/projected/e7cfb688-311b-4962-bb23-8a484a04d3ce-kube-api-access-5kg8k\") pod \"payload-pre-processing-7964457696-7244n\" (UID: \"e7cfb688-311b-4962-bb23-8a484a04d3ce\") " pod="openshift-ingress/payload-pre-processing-7964457696-7244n"
Jul 02 20:42:02.935029 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:02.934860    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg6bf\" (UniqueName: \"kubernetes.io/projected/eb914c24-2302-4a18-92d5-4bc6b85fda00-kube-api-access-hg6bf\") pod \"payload-processing-58f86c7798-tnbmf\" (UID: \"eb914c24-2302-4a18-92d5-4bc6b85fda00\") " pod="openshift-ingress/payload-processing-58f86c7798-tnbmf"
Jul 02 20:42:02.935029 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:02.934934    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb914c24-2302-4a18-92d5-4bc6b85fda00-plugins-config-volume\") pod \"payload-processing-58f86c7798-tnbmf\" (UID: \"eb914c24-2302-4a18-92d5-4bc6b85fda00\") " pod="openshift-ingress/payload-processing-58f86c7798-tnbmf"
Jul 02 20:42:03.035940 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:03.035912    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kg8k\" (UniqueName: \"kubernetes.io/projected/e7cfb688-311b-4962-bb23-8a484a04d3ce-kube-api-access-5kg8k\") pod \"payload-pre-processing-7964457696-7244n\" (UID: \"e7cfb688-311b-4962-bb23-8a484a04d3ce\") " pod="openshift-ingress/payload-pre-processing-7964457696-7244n"
Jul 02 20:42:03.036117 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:03.035946    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hg6bf\" (UniqueName: \"kubernetes.io/projected/eb914c24-2302-4a18-92d5-4bc6b85fda00-kube-api-access-hg6bf\") pod \"payload-processing-58f86c7798-tnbmf\" (UID: \"eb914c24-2302-4a18-92d5-4bc6b85fda00\") " pod="openshift-ingress/payload-processing-58f86c7798-tnbmf"
Jul 02 20:42:03.036117 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:03.035986    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb914c24-2302-4a18-92d5-4bc6b85fda00-plugins-config-volume\") pod \"payload-processing-58f86c7798-tnbmf\" (UID: \"eb914c24-2302-4a18-92d5-4bc6b85fda00\") " pod="openshift-ingress/payload-processing-58f86c7798-tnbmf"
Jul 02 20:42:03.036275 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:03.036183    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7cfb688-311b-4962-bb23-8a484a04d3ce-plugins-config-volume\") pod \"payload-pre-processing-7964457696-7244n\" (UID: \"e7cfb688-311b-4962-bb23-8a484a04d3ce\") " pod="openshift-ingress/payload-pre-processing-7964457696-7244n"
Jul 02 20:42:03.036642 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:03.036624    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb914c24-2302-4a18-92d5-4bc6b85fda00-plugins-config-volume\") pod \"payload-processing-58f86c7798-tnbmf\" (UID: \"eb914c24-2302-4a18-92d5-4bc6b85fda00\") " pod="openshift-ingress/payload-processing-58f86c7798-tnbmf"
Jul 02 20:42:03.036824 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:03.036808    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7cfb688-311b-4962-bb23-8a484a04d3ce-plugins-config-volume\") pod \"payload-pre-processing-7964457696-7244n\" (UID: \"e7cfb688-311b-4962-bb23-8a484a04d3ce\") " pod="openshift-ingress/payload-pre-processing-7964457696-7244n"
Jul 02 20:42:03.044106 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:03.044084    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg6bf\" (UniqueName: \"kubernetes.io/projected/eb914c24-2302-4a18-92d5-4bc6b85fda00-kube-api-access-hg6bf\") pod \"payload-processing-58f86c7798-tnbmf\" (UID: \"eb914c24-2302-4a18-92d5-4bc6b85fda00\") " pod="openshift-ingress/payload-processing-58f86c7798-tnbmf"
Jul 02 20:42:03.044256 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:03.044116    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kg8k\" (UniqueName: \"kubernetes.io/projected/e7cfb688-311b-4962-bb23-8a484a04d3ce-kube-api-access-5kg8k\") pod \"payload-pre-processing-7964457696-7244n\" (UID: \"e7cfb688-311b-4962-bb23-8a484a04d3ce\") " pod="openshift-ingress/payload-pre-processing-7964457696-7244n"
Jul 02 20:42:03.090131 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:03.090097    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-7244n"
Jul 02 20:42:03.100292 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:03.100263    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-tnbmf"
Jul 02 20:42:03.248826 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:03.248366    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-7244n"]
Jul 02 20:42:03.255323 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:42:03.254667    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7cfb688_311b_4962_bb23_8a484a04d3ce.slice/crio-5bf3a76f4be5e194f2531c1c9f7595cbf40c198f064cf863cdb7afd4cb12820c WatchSource:0}: Error finding container 5bf3a76f4be5e194f2531c1c9f7595cbf40c198f064cf863cdb7afd4cb12820c: Status 404 returned error can't find the container with id 5bf3a76f4be5e194f2531c1c9f7595cbf40c198f064cf863cdb7afd4cb12820c
Jul 02 20:42:03.279181 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:03.279154    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-tnbmf"]
Jul 02 20:42:03.280851 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:42:03.280826    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb914c24_2302_4a18_92d5_4bc6b85fda00.slice/crio-804b729ce2270a93e0e4c7b92052fbcad1878ad4f86ea88896f4c002c9ff30f7 WatchSource:0}: Error finding container 804b729ce2270a93e0e4c7b92052fbcad1878ad4f86ea88896f4c002c9ff30f7: Status 404 returned error can't find the container with id 804b729ce2270a93e0e4c7b92052fbcad1878ad4f86ea88896f4c002c9ff30f7
Jul 02 20:42:04.276231 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:04.276179    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-tnbmf" event={"ID":"eb914c24-2302-4a18-92d5-4bc6b85fda00","Type":"ContainerStarted","Data":"804b729ce2270a93e0e4c7b92052fbcad1878ad4f86ea88896f4c002c9ff30f7"}
Jul 02 20:42:04.277830 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:04.277757    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-7244n" event={"ID":"e7cfb688-311b-4962-bb23-8a484a04d3ce","Type":"ContainerStarted","Data":"5bf3a76f4be5e194f2531c1c9f7595cbf40c198f064cf863cdb7afd4cb12820c"}
Jul 02 20:42:05.284675 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:05.284637    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-tnbmf" event={"ID":"eb914c24-2302-4a18-92d5-4bc6b85fda00","Type":"ContainerStarted","Data":"ccd9248c057ec38d4e8f24bd7ff45b8b35b0ee295d1ea9cff1e758788894350d"}
Jul 02 20:42:05.285129 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:05.284705    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-tnbmf"
Jul 02 20:42:05.286110 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:05.286086    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-7244n" event={"ID":"e7cfb688-311b-4962-bb23-8a484a04d3ce","Type":"ContainerStarted","Data":"c2ef1ff168ebf60a0c0f75217655fd77130b7cb532e7998be180f077b2f3df0f"}
Jul 02 20:42:05.286228 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:05.286216    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-7244n"
Jul 02 20:42:05.323381 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:05.323336    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-tnbmf" podStartSLOduration=1.703908531 podStartE2EDuration="3.323322357s" totalImagesPullingTime="1.619413826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:42:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:42:05.322063696 +0000 UTC m=+558.992577201" watchObservedRunningTime="2026-07-02 20:42:05.323322357 +0000 UTC m=+558.993835849"
Jul 02 20:42:10.314735 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:10.314702    2581 generic.go:356] "Generic (PLEG): container finished" podID="90f49378-c489-4ee5-a8fc-502c5f8043e0" containerID="70f5913c6e2cb4885c8db8efa5eec79dd11871e979c747ec735e48d30a454d3c" exitCode=0
Jul 02 20:42:10.315113 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:10.314757    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql" event={"ID":"90f49378-c489-4ee5-a8fc-502c5f8043e0","Type":"ContainerDied","Data":"70f5913c6e2cb4885c8db8efa5eec79dd11871e979c747ec735e48d30a454d3c"}
Jul 02 20:42:10.315251 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:10.315232    2581 scope.go:117] "RemoveContainer" containerID="70f5913c6e2cb4885c8db8efa5eec79dd11871e979c747ec735e48d30a454d3c"
Jul 02 20:42:10.316350 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:10.316318    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:42:10.316453 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:10.316392    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:42:10.316453 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:10.316425    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:42:10.380024 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:10.379985    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-7244n" podStartSLOduration=6.741715921 podStartE2EDuration="8.379971549s" totalImagesPullingTime="1.638255628s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:42:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:42:05.353301304 +0000 UTC m=+559.023814800" watchObservedRunningTime="2026-07-02 20:42:10.379971549 +0000 UTC m=+564.050485042"
Jul 02 20:42:11.322044 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:11.322007    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql" event={"ID":"90f49378-c489-4ee5-a8fc-502c5f8043e0","Type":"ContainerStarted","Data":"cd0b93392a75ec115d0da826d30ab088aa3021279efc46df5fcaddaf22cca2ab"}
Jul 02 20:42:11.624897 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:11.624803    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql"
Jul 02 20:42:11.626096 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:11.626067    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-hd9ql container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 02 20:42:11.626239 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:11.626117    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql" podUID="90f49378-c489-4ee5-a8fc-502c5f8043e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 02 20:42:12.625011 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:12.624979    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-hd9ql container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 02 20:42:12.625417 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:12.625032    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql" podUID="90f49378-c489-4ee5-a8fc-502c5f8043e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 02 20:42:13.001423 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:13.001386    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:42:13.101461 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:13.101429    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:42:13.624730 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:13.624694    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-hd9ql container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 02 20:42:13.624899 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:13.624754    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql" podUID="90f49378-c489-4ee5-a8fc-502c5f8043e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 02 20:42:14.624467 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:14.624431    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-hd9ql container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 02 20:42:14.624955 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:14.624495    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql" podUID="90f49378-c489-4ee5-a8fc-502c5f8043e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 02 20:42:15.628127 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:15.628101    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql"
Jul 02 20:42:15.628637 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:15.628434    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql"
Jul 02 20:42:15.629154 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:15.629121    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hd9ql"
Jul 02 20:42:16.293129 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:16.293096    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-tnbmf"
Jul 02 20:42:16.293324 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:16.293271    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-7244n"
Jul 02 20:42:18.830792 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:18.830760    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:42:19.299028 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:19.298996    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:42:25.392591 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:25.392507    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-khfq6"]
Jul 02 20:42:25.398107 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:25.398080    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-khfq6"
Jul 02 20:42:25.401419 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:25.401395    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-khfq6"]
Jul 02 20:42:25.401678 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:25.401656    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-zhml8\""
Jul 02 20:42:25.401793 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:25.401690    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 02 20:42:25.401793 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:25.401729    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 02 20:42:25.401793 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:25.401782    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 02 20:42:25.412172 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:25.412133    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:42:25.434679 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:25.434660    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16e99324-0b41-4f56-b493-59d14f5fa4b8-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-khfq6\" (UID: \"16e99324-0b41-4f56-b493-59d14f5fa4b8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-khfq6"
Jul 02 20:42:25.434770 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:25.434688    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t675k\" (UniqueName: \"kubernetes.io/projected/16e99324-0b41-4f56-b493-59d14f5fa4b8-kube-api-access-t675k\") pod \"e2e-distinct-simulated-kserve-59975d69f9-khfq6\" (UID: \"16e99324-0b41-4f56-b493-59d14f5fa4b8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-khfq6"
Jul 02 20:42:25.434770 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:25.434711    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16e99324-0b41-4f56-b493-59d14f5fa4b8-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-khfq6\" (UID: \"16e99324-0b41-4f56-b493-59d14f5fa4b8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-khfq6"
Jul 02 20:42:25.434844 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:25.434799    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16e99324-0b41-4f56-b493-59d14f5fa4b8-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-khfq6\" (UID: \"16e99324-0b41-4f56-b493-59d14f5fa4b8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-khfq6"
Jul 02 20:42:25.434844 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:25.434827    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16e99324-0b41-4f56-b493-59d14f5fa4b8-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-khfq6\" (UID: \"16e99324-0b41-4f56-b493-59d14f5fa4b8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-khfq6"
Jul 02 20:42:25.434911 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:25.434854    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16e99324-0b41-4f56-b493-59d14f5fa4b8-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-khfq6\" (UID: \"16e99324-0b41-4f56-b493-59d14f5fa4b8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-khfq6"
Jul 02 20:42:25.535434 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:25.535402    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16e99324-0b41-4f56-b493-59d14f5fa4b8-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-khfq6\" (UID: \"16e99324-0b41-4f56-b493-59d14f5fa4b8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-khfq6"
Jul 02 20:42:25.535434 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:25.535434    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16e99324-0b41-4f56-b493-59d14f5fa4b8-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-khfq6\" (UID: \"16e99324-0b41-4f56-b493-59d14f5fa4b8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-khfq6"
Jul 02 20:42:25.535615 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:25.535454    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16e99324-0b41-4f56-b493-59d14f5fa4b8-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-khfq6\" (UID: \"16e99324-0b41-4f56-b493-59d14f5fa4b8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-khfq6"
Jul 02 20:42:25.535615 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:25.535479    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16e99324-0b41-4f56-b493-59d14f5fa4b8-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-khfq6\" (UID: \"16e99324-0b41-4f56-b493-59d14f5fa4b8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-khfq6"
Jul 02 20:42:25.535615 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:25.535505    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t675k\" (UniqueName: \"kubernetes.io/projected/16e99324-0b41-4f56-b493-59d14f5fa4b8-kube-api-access-t675k\") pod \"e2e-distinct-simulated-kserve-59975d69f9-khfq6\" (UID: \"16e99324-0b41-4f56-b493-59d14f5fa4b8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-khfq6"
Jul 02 20:42:25.535615 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:25.535537    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16e99324-0b41-4f56-b493-59d14f5fa4b8-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-khfq6\" (UID: \"16e99324-0b41-4f56-b493-59d14f5fa4b8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-khfq6"
Jul 02 20:42:25.535889 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:25.535846    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16e99324-0b41-4f56-b493-59d14f5fa4b8-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-khfq6\" (UID: \"16e99324-0b41-4f56-b493-59d14f5fa4b8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-khfq6"
Jul 02 20:42:25.535969 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:25.535906    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16e99324-0b41-4f56-b493-59d14f5fa4b8-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-khfq6\" (UID: \"16e99324-0b41-4f56-b493-59d14f5fa4b8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-khfq6"
Jul 02 20:42:25.535969 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:25.535937    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16e99324-0b41-4f56-b493-59d14f5fa4b8-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-khfq6\" (UID: \"16e99324-0b41-4f56-b493-59d14f5fa4b8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-khfq6"
Jul 02 20:42:25.537707 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:25.537688    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16e99324-0b41-4f56-b493-59d14f5fa4b8-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-khfq6\" (UID: \"16e99324-0b41-4f56-b493-59d14f5fa4b8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-khfq6"
Jul 02 20:42:25.537961 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:25.537945    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16e99324-0b41-4f56-b493-59d14f5fa4b8-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-khfq6\" (UID: \"16e99324-0b41-4f56-b493-59d14f5fa4b8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-khfq6"
Jul 02 20:42:25.543291 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:25.543270    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t675k\" (UniqueName: \"kubernetes.io/projected/16e99324-0b41-4f56-b493-59d14f5fa4b8-kube-api-access-t675k\") pod \"e2e-distinct-simulated-kserve-59975d69f9-khfq6\" (UID: \"16e99324-0b41-4f56-b493-59d14f5fa4b8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-khfq6"
Jul 02 20:42:25.709451 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:25.709430    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-khfq6"
Jul 02 20:42:25.839863 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:25.839833    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-khfq6"]
Jul 02 20:42:25.842033 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:42:25.842003    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16e99324_0b41_4f56_b493_59d14f5fa4b8.slice/crio-0b3355468cd37a60856cffd55a5bc362bbc4a520e8d2426686bc1f7f7e7a9b21 WatchSource:0}: Error finding container 0b3355468cd37a60856cffd55a5bc362bbc4a520e8d2426686bc1f7f7e7a9b21: Status 404 returned error can't find the container with id 0b3355468cd37a60856cffd55a5bc362bbc4a520e8d2426686bc1f7f7e7a9b21
Jul 02 20:42:26.194990 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:26.194796    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:42:26.410106 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:26.410066    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-khfq6" event={"ID":"16e99324-0b41-4f56-b493-59d14f5fa4b8","Type":"ContainerStarted","Data":"0b3355468cd37a60856cffd55a5bc362bbc4a520e8d2426686bc1f7f7e7a9b21"}
Jul 02 20:42:27.416918 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:27.416886    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-khfq6" event={"ID":"16e99324-0b41-4f56-b493-59d14f5fa4b8","Type":"ContainerStarted","Data":"6a6b8d45a1e913657e00c62d13aca30b32dca29263ff6e556725a9cdec686985"}
Jul 02 20:42:27.434583 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:27.434536    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-khfq6" podStartSLOduration=1.341149885 podStartE2EDuration="2.434521773s" totalImagesPullingTime="1.093371888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:42:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:42:27.433256615 +0000 UTC m=+581.103770109" watchObservedRunningTime="2026-07-02 20:42:27.434521773 +0000 UTC m=+581.105035266"
Jul 02 20:42:35.710318 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:35.710272    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-khfq6"
Jul 02 20:42:35.710823 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:35.710337    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-khfq6"
Jul 02 20:42:35.723278 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:35.723245    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-khfq6"
Jul 02 20:42:36.473510 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:36.473484    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-khfq6"
Jul 02 20:42:37.998109 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:37.998073    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:42:38.050105 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:38.050078    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:42:38.617855 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:38.617812    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:42:38.668892 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:38.668866    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:42:43.190225 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:43.190189    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-js7qc"]
Jul 02 20:42:43.193651 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:43.193629    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-js7qc"
Jul 02 20:42:43.196951 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:43.196928    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 02 20:42:43.199124 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:43.199098    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-js7qc"]
Jul 02 20:42:43.211265 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:43.211233    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:42:43.279260 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:43.279236    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bb8e2bc-21b5-4764-bd30-8646cdddf430-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-js7qc\" (UID: \"8bb8e2bc-21b5-4764-bd30-8646cdddf430\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-js7qc"
Jul 02 20:42:43.279401 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:43.279290    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bb8e2bc-21b5-4764-bd30-8646cdddf430-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-js7qc\" (UID: \"8bb8e2bc-21b5-4764-bd30-8646cdddf430\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-js7qc"
Jul 02 20:42:43.279401 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:43.279372    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bb8e2bc-21b5-4764-bd30-8646cdddf430-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-js7qc\" (UID: \"8bb8e2bc-21b5-4764-bd30-8646cdddf430\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-js7qc"
Jul 02 20:42:43.279522 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:43.279465    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bb8e2bc-21b5-4764-bd30-8646cdddf430-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-js7qc\" (UID: \"8bb8e2bc-21b5-4764-bd30-8646cdddf430\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-js7qc"
Jul 02 20:42:43.279522 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:43.279493    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glp27\" (UniqueName: \"kubernetes.io/projected/8bb8e2bc-21b5-4764-bd30-8646cdddf430-kube-api-access-glp27\") pod \"e2e-trlp-test-simulated-kserve-598466548d-js7qc\" (UID: \"8bb8e2bc-21b5-4764-bd30-8646cdddf430\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-js7qc"
Jul 02 20:42:43.279615 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:43.279523    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8bb8e2bc-21b5-4764-bd30-8646cdddf430-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-js7qc\" (UID: \"8bb8e2bc-21b5-4764-bd30-8646cdddf430\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-js7qc"
Jul 02 20:42:43.380190 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:43.380153    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bb8e2bc-21b5-4764-bd30-8646cdddf430-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-js7qc\" (UID: \"8bb8e2bc-21b5-4764-bd30-8646cdddf430\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-js7qc"
Jul 02 20:42:43.380388 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:43.380211    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bb8e2bc-21b5-4764-bd30-8646cdddf430-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-js7qc\" (UID: \"8bb8e2bc-21b5-4764-bd30-8646cdddf430\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-js7qc"
Jul 02 20:42:43.380388 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:43.380230    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glp27\" (UniqueName: \"kubernetes.io/projected/8bb8e2bc-21b5-4764-bd30-8646cdddf430-kube-api-access-glp27\") pod \"e2e-trlp-test-simulated-kserve-598466548d-js7qc\" (UID: \"8bb8e2bc-21b5-4764-bd30-8646cdddf430\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-js7qc"
Jul 02 20:42:43.380388 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:43.380252    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8bb8e2bc-21b5-4764-bd30-8646cdddf430-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-js7qc\" (UID: \"8bb8e2bc-21b5-4764-bd30-8646cdddf430\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-js7qc"
Jul 02 20:42:43.380388 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:43.380278    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bb8e2bc-21b5-4764-bd30-8646cdddf430-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-js7qc\" (UID: \"8bb8e2bc-21b5-4764-bd30-8646cdddf430\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-js7qc"
Jul 02 20:42:43.380388 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:43.380333    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bb8e2bc-21b5-4764-bd30-8646cdddf430-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-js7qc\" (UID: \"8bb8e2bc-21b5-4764-bd30-8646cdddf430\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-js7qc"
Jul 02 20:42:43.380719 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:43.380699    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bb8e2bc-21b5-4764-bd30-8646cdddf430-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-js7qc\" (UID: \"8bb8e2bc-21b5-4764-bd30-8646cdddf430\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-js7qc"
Jul 02 20:42:43.380785 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:43.380737    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8bb8e2bc-21b5-4764-bd30-8646cdddf430-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-js7qc\" (UID: \"8bb8e2bc-21b5-4764-bd30-8646cdddf430\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-js7qc"
Jul 02 20:42:43.380785 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:43.380757    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bb8e2bc-21b5-4764-bd30-8646cdddf430-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-js7qc\" (UID: \"8bb8e2bc-21b5-4764-bd30-8646cdddf430\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-js7qc"
Jul 02 20:42:43.382564 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:43.382541    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bb8e2bc-21b5-4764-bd30-8646cdddf430-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-js7qc\" (UID: \"8bb8e2bc-21b5-4764-bd30-8646cdddf430\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-js7qc"
Jul 02 20:42:43.382754 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:43.382739    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bb8e2bc-21b5-4764-bd30-8646cdddf430-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-js7qc\" (UID: \"8bb8e2bc-21b5-4764-bd30-8646cdddf430\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-js7qc"
Jul 02 20:42:43.387662 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:43.387642    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glp27\" (UniqueName: \"kubernetes.io/projected/8bb8e2bc-21b5-4764-bd30-8646cdddf430-kube-api-access-glp27\") pod \"e2e-trlp-test-simulated-kserve-598466548d-js7qc\" (UID: \"8bb8e2bc-21b5-4764-bd30-8646cdddf430\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-js7qc"
Jul 02 20:42:43.505154 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:43.505122    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-js7qc"
Jul 02 20:42:43.638206 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:43.638175    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-js7qc"]
Jul 02 20:42:43.639779 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:42:43.639756    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bb8e2bc_21b5_4764_bd30_8646cdddf430.slice/crio-f9eb226ee02e214d340b01a2a6474f36fdc9091c2616f14233df05903b3b1d0d WatchSource:0}: Error finding container f9eb226ee02e214d340b01a2a6474f36fdc9091c2616f14233df05903b3b1d0d: Status 404 returned error can't find the container with id f9eb226ee02e214d340b01a2a6474f36fdc9091c2616f14233df05903b3b1d0d
Jul 02 20:42:44.293591 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:44.293553    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:42:44.508711 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:44.508675    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-js7qc" event={"ID":"8bb8e2bc-21b5-4764-bd30-8646cdddf430","Type":"ContainerStarted","Data":"ef397b8db1840fcdcb835857d00e50e054968f30fe1884f078c8ed6a4ab54eeb"}
Jul 02 20:42:44.508901 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:44.508726    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-js7qc" event={"ID":"8bb8e2bc-21b5-4764-bd30-8646cdddf430","Type":"ContainerStarted","Data":"f9eb226ee02e214d340b01a2a6474f36fdc9091c2616f14233df05903b3b1d0d"}
Jul 02 20:42:44.526467 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:44.526420    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-js7qc" podStartSLOduration=1.350944803 podStartE2EDuration="1.526404959s" totalImagesPullingTime="175.460156ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:42:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:42:44.524475096 +0000 UTC m=+598.194988590" watchObservedRunningTime="2026-07-02 20:42:44.526404959 +0000 UTC m=+598.196918452"
Jul 02 20:42:48.494176 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:48.494103    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:42:49.787212 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:49.787180    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:42:53.506076 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:53.506042    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-js7qc"
Jul 02 20:42:53.506479 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:53.506107    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-js7qc"
Jul 02 20:42:53.518475 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:53.518448    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-js7qc"
Jul 02 20:42:53.566347 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:53.566320    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-js7qc"
Jul 02 20:42:55.358516 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:55.358476    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:42:57.390180 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:42:57.390128    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:43:19.288077 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:43:19.287998    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv"]
Jul 02 20:43:19.291652 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:43:19.291629    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv"
Jul 02 20:43:19.294452 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:43:19.294429    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 02 20:43:19.302547 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:43:19.302522    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv"]
Jul 02 20:43:19.333116 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:43:19.333088    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:43:19.374649 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:43:19.374621    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/50d45ba1-52d8-495f-9bd5-18a547d7d080-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv\" (UID: \"50d45ba1-52d8-495f-9bd5-18a547d7d080\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv"
Jul 02 20:43:19.374774 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:43:19.374655    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/50d45ba1-52d8-495f-9bd5-18a547d7d080-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv\" (UID: \"50d45ba1-52d8-495f-9bd5-18a547d7d080\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv"
Jul 02 20:43:19.374774 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:43:19.374703    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50d45ba1-52d8-495f-9bd5-18a547d7d080-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv\" (UID: \"50d45ba1-52d8-495f-9bd5-18a547d7d080\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv"
Jul 02 20:43:19.374774 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:43:19.374734    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnn8b\" (UniqueName: \"kubernetes.io/projected/50d45ba1-52d8-495f-9bd5-18a547d7d080-kube-api-access-qnn8b\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv\" (UID: \"50d45ba1-52d8-495f-9bd5-18a547d7d080\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv"
Jul 02 20:43:19.374774 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:43:19.374762    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50d45ba1-52d8-495f-9bd5-18a547d7d080-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv\" (UID: \"50d45ba1-52d8-495f-9bd5-18a547d7d080\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv"
Jul 02 20:43:19.374941 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:43:19.374813    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50d45ba1-52d8-495f-9bd5-18a547d7d080-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv\" (UID: \"50d45ba1-52d8-495f-9bd5-18a547d7d080\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv"
Jul 02 20:43:19.475697 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:43:19.475665    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/50d45ba1-52d8-495f-9bd5-18a547d7d080-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv\" (UID: \"50d45ba1-52d8-495f-9bd5-18a547d7d080\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv"
Jul 02 20:43:19.475832 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:43:19.475704    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/50d45ba1-52d8-495f-9bd5-18a547d7d080-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv\" (UID: \"50d45ba1-52d8-495f-9bd5-18a547d7d080\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv"
Jul 02 20:43:19.475891 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:43:19.475831    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50d45ba1-52d8-495f-9bd5-18a547d7d080-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv\" (UID: \"50d45ba1-52d8-495f-9bd5-18a547d7d080\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv"
Jul 02 20:43:19.475891 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:43:19.475868    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnn8b\" (UniqueName: \"kubernetes.io/projected/50d45ba1-52d8-495f-9bd5-18a547d7d080-kube-api-access-qnn8b\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv\" (UID: \"50d45ba1-52d8-495f-9bd5-18a547d7d080\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv"
Jul 02 20:43:19.475996 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:43:19.475890    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50d45ba1-52d8-495f-9bd5-18a547d7d080-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv\" (UID: \"50d45ba1-52d8-495f-9bd5-18a547d7d080\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv"
Jul 02 20:43:19.475996 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:43:19.475937    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50d45ba1-52d8-495f-9bd5-18a547d7d080-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv\" (UID: \"50d45ba1-52d8-495f-9bd5-18a547d7d080\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv"
Jul 02 20:43:19.476158 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:43:19.476121    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/50d45ba1-52d8-495f-9bd5-18a547d7d080-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv\" (UID: \"50d45ba1-52d8-495f-9bd5-18a547d7d080\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv"
Jul 02 20:43:19.476246 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:43:19.476227    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50d45ba1-52d8-495f-9bd5-18a547d7d080-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv\" (UID: \"50d45ba1-52d8-495f-9bd5-18a547d7d080\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv"
Jul 02 20:43:19.476351 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:43:19.476328    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50d45ba1-52d8-495f-9bd5-18a547d7d080-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv\" (UID: \"50d45ba1-52d8-495f-9bd5-18a547d7d080\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv"
Jul 02 20:43:19.477922 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:43:19.477901    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/50d45ba1-52d8-495f-9bd5-18a547d7d080-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv\" (UID: \"50d45ba1-52d8-495f-9bd5-18a547d7d080\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv"
Jul 02 20:43:19.478414 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:43:19.478394    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50d45ba1-52d8-495f-9bd5-18a547d7d080-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv\" (UID: \"50d45ba1-52d8-495f-9bd5-18a547d7d080\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv"
Jul 02 20:43:19.483659 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:43:19.483641    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnn8b\" (UniqueName: \"kubernetes.io/projected/50d45ba1-52d8-495f-9bd5-18a547d7d080-kube-api-access-qnn8b\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv\" (UID: \"50d45ba1-52d8-495f-9bd5-18a547d7d080\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv"
Jul 02 20:43:19.601633 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:43:19.601559    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv"
Jul 02 20:43:19.731418 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:43:19.731393    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv"]
Jul 02 20:43:19.733260 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:43:19.733228    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod50d45ba1_52d8_495f_9bd5_18a547d7d080.slice/crio-1ad746641c30b1c16bcf037897c7e5eaaf0794798283b8caa317ceda193005e0 WatchSource:0}: Error finding container 1ad746641c30b1c16bcf037897c7e5eaaf0794798283b8caa317ceda193005e0: Status 404 returned error can't find the container with id 1ad746641c30b1c16bcf037897c7e5eaaf0794798283b8caa317ceda193005e0
Jul 02 20:43:19.734669 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:43:19.734652    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 20:43:20.694266 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:43:20.694230    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv" event={"ID":"50d45ba1-52d8-495f-9bd5-18a547d7d080","Type":"ContainerStarted","Data":"782fe5155efccee9363fedd5034fadb64626ca668f75f188310d0b22ca79a670"}
Jul 02 20:43:20.694637 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:43:20.694272    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv" event={"ID":"50d45ba1-52d8-495f-9bd5-18a547d7d080","Type":"ContainerStarted","Data":"1ad746641c30b1c16bcf037897c7e5eaaf0794798283b8caa317ceda193005e0"}
Jul 02 20:43:20.711405 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:43:20.711361    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv" podStartSLOduration=1.528991319 podStartE2EDuration="1.71134641s" totalImagesPullingTime="182.355091ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:43:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:43:20.71082334 +0000 UTC m=+634.381336833" watchObservedRunningTime="2026-07-02 20:43:20.71134641 +0000 UTC m=+634.381859881"
Jul 02 20:43:21.592918 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:43:21.592884    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:43:22.198594 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:43:22.198559    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:43:22.299565 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:43:22.299528    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:43:29.602672 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:43:29.602643    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv"
Jul 02 20:43:29.603046 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:43:29.602706    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv"
Jul 02 20:43:29.614946 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:43:29.614919    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv"
Jul 02 20:43:29.758495 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:43:29.758467    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv"
Jul 02 20:44:07.067882 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:44:07.067848    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-665d585cf8-9vqwd"]
Jul 02 20:44:07.071358 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:44:07.071342    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-665d585cf8-9vqwd"
Jul 02 20:44:07.079934 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:44:07.079910    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-665d585cf8-9vqwd"]
Jul 02 20:44:07.165578 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:44:07.165545    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4g4c\" (UniqueName: \"kubernetes.io/projected/a3775f1e-d556-486a-b4f2-11bf02dfa2e2-kube-api-access-s4g4c\") pod \"authorino-665d585cf8-9vqwd\" (UID: \"a3775f1e-d556-486a-b4f2-11bf02dfa2e2\") " pod="kuadrant-system/authorino-665d585cf8-9vqwd"
Jul 02 20:44:07.165705 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:44:07.165586    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a3775f1e-d556-486a-b4f2-11bf02dfa2e2-tls-cert\") pod \"authorino-665d585cf8-9vqwd\" (UID: \"a3775f1e-d556-486a-b4f2-11bf02dfa2e2\") " pod="kuadrant-system/authorino-665d585cf8-9vqwd"
Jul 02 20:44:07.266523 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:44:07.266497    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4g4c\" (UniqueName: \"kubernetes.io/projected/a3775f1e-d556-486a-b4f2-11bf02dfa2e2-kube-api-access-s4g4c\") pod \"authorino-665d585cf8-9vqwd\" (UID: \"a3775f1e-d556-486a-b4f2-11bf02dfa2e2\") " pod="kuadrant-system/authorino-665d585cf8-9vqwd"
Jul 02 20:44:07.266635 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:44:07.266531    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a3775f1e-d556-486a-b4f2-11bf02dfa2e2-tls-cert\") pod \"authorino-665d585cf8-9vqwd\" (UID: \"a3775f1e-d556-486a-b4f2-11bf02dfa2e2\") " pod="kuadrant-system/authorino-665d585cf8-9vqwd"
Jul 02 20:44:07.268843 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:44:07.268814    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a3775f1e-d556-486a-b4f2-11bf02dfa2e2-tls-cert\") pod \"authorino-665d585cf8-9vqwd\" (UID: \"a3775f1e-d556-486a-b4f2-11bf02dfa2e2\") " pod="kuadrant-system/authorino-665d585cf8-9vqwd"
Jul 02 20:44:07.274420 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:44:07.274400    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4g4c\" (UniqueName: \"kubernetes.io/projected/a3775f1e-d556-486a-b4f2-11bf02dfa2e2-kube-api-access-s4g4c\") pod \"authorino-665d585cf8-9vqwd\" (UID: \"a3775f1e-d556-486a-b4f2-11bf02dfa2e2\") " pod="kuadrant-system/authorino-665d585cf8-9vqwd"
Jul 02 20:44:07.380853 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:44:07.380796    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-665d585cf8-9vqwd"
Jul 02 20:44:07.528867 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:44:07.528835    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-665d585cf8-9vqwd"]
Jul 02 20:44:07.532598 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:44:07.531295    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda3775f1e_d556_486a_b4f2_11bf02dfa2e2.slice/crio-a94d7e9a75ecf726a84585f0241d1d056d9a0e2b99a44d3327a9dc94e7acba7d WatchSource:0}: Error finding container a94d7e9a75ecf726a84585f0241d1d056d9a0e2b99a44d3327a9dc94e7acba7d: Status 404 returned error can't find the container with id a94d7e9a75ecf726a84585f0241d1d056d9a0e2b99a44d3327a9dc94e7acba7d
Jul 02 20:44:07.545911 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:44:07.545860    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:44:07.697982 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:44:07.697915    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:44:07.939432 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:44:07.939403    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-665d585cf8-9vqwd" event={"ID":"a3775f1e-d556-486a-b4f2-11bf02dfa2e2","Type":"ContainerStarted","Data":"a94d7e9a75ecf726a84585f0241d1d056d9a0e2b99a44d3327a9dc94e7acba7d"}
Jul 02 20:44:08.737502 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:44:08.737464    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:44:08.836570 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:44:08.836534    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:44:08.947610 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:44:08.947576    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-665d585cf8-9vqwd" event={"ID":"a3775f1e-d556-486a-b4f2-11bf02dfa2e2","Type":"ContainerStarted","Data":"3ed7c02f0112de9cabb494987a54293a4253b44d57d2a7425788d987e4927be7"}
Jul 02 20:44:08.973022 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:44:08.972809    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-665d585cf8-9vqwd" podStartSLOduration=1.490748508 podStartE2EDuration="1.97278953s" totalImagesPullingTime="482.041022ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:44:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:44:08.970160915 +0000 UTC m=+682.640674409" watchObservedRunningTime="2026-07-02 20:44:08.97278953 +0000 UTC m=+682.643303023"
Jul 02 20:44:09.024523 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:44:09.024443    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-df7f9fb75-rn796"]
Jul 02 20:44:09.024679 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:44:09.024637    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-df7f9fb75-rn796" podUID="ac2d61d4-9778-4308-b401-6195eab135d0" containerName="authorino" containerID="cri-o://61b5a32363ab22a274d10e7f5cb4d95303ff6741e65a7bf648cc300938c87637" gracePeriod=30
Jul 02 20:44:09.290496 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:44:09.290431    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-df7f9fb75-rn796"
Jul 02 20:44:09.384733 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:44:09.384698    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5v6db\" (UniqueName: \"kubernetes.io/projected/ac2d61d4-9778-4308-b401-6195eab135d0-kube-api-access-5v6db\") pod \"ac2d61d4-9778-4308-b401-6195eab135d0\" (UID: \"ac2d61d4-9778-4308-b401-6195eab135d0\") "
Jul 02 20:44:09.384902 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:44:09.384851    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ac2d61d4-9778-4308-b401-6195eab135d0-tls-cert\") pod \"ac2d61d4-9778-4308-b401-6195eab135d0\" (UID: \"ac2d61d4-9778-4308-b401-6195eab135d0\") "
Jul 02 20:44:09.386694 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:44:09.386656    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac2d61d4-9778-4308-b401-6195eab135d0-kube-api-access-5v6db" (OuterVolumeSpecName: "kube-api-access-5v6db") pod "ac2d61d4-9778-4308-b401-6195eab135d0" (UID: "ac2d61d4-9778-4308-b401-6195eab135d0"). InnerVolumeSpecName "kube-api-access-5v6db". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:44:09.394839 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:44:09.394815    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac2d61d4-9778-4308-b401-6195eab135d0-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "ac2d61d4-9778-4308-b401-6195eab135d0" (UID: "ac2d61d4-9778-4308-b401-6195eab135d0"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:44:09.486047 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:44:09.486009    2581 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ac2d61d4-9778-4308-b401-6195eab135d0-tls-cert\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:44:09.486047 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:44:09.486048    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5v6db\" (UniqueName: \"kubernetes.io/projected/ac2d61d4-9778-4308-b401-6195eab135d0-kube-api-access-5v6db\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:44:09.954134 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:44:09.954085    2581 generic.go:356] "Generic (PLEG): container finished" podID="ac2d61d4-9778-4308-b401-6195eab135d0" containerID="61b5a32363ab22a274d10e7f5cb4d95303ff6741e65a7bf648cc300938c87637" exitCode=0
Jul 02 20:44:09.954611 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:44:09.954125    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-df7f9fb75-rn796"
Jul 02 20:44:09.954611 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:44:09.954184    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-df7f9fb75-rn796" event={"ID":"ac2d61d4-9778-4308-b401-6195eab135d0","Type":"ContainerDied","Data":"61b5a32363ab22a274d10e7f5cb4d95303ff6741e65a7bf648cc300938c87637"}
Jul 02 20:44:09.954611 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:44:09.954223    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-df7f9fb75-rn796" event={"ID":"ac2d61d4-9778-4308-b401-6195eab135d0","Type":"ContainerDied","Data":"3a95d0ca4950921ec745234711b423e0cc7b2a29754dd2fce1f3d615fb643d2f"}
Jul 02 20:44:09.954611 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:44:09.954242    2581 scope.go:117] "RemoveContainer" containerID="61b5a32363ab22a274d10e7f5cb4d95303ff6741e65a7bf648cc300938c87637"
Jul 02 20:44:09.963425 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:44:09.963356    2581 scope.go:117] "RemoveContainer" containerID="61b5a32363ab22a274d10e7f5cb4d95303ff6741e65a7bf648cc300938c87637"
Jul 02 20:44:09.963802 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:44:09.963781    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61b5a32363ab22a274d10e7f5cb4d95303ff6741e65a7bf648cc300938c87637\": container with ID starting with 61b5a32363ab22a274d10e7f5cb4d95303ff6741e65a7bf648cc300938c87637 not found: ID does not exist" containerID="61b5a32363ab22a274d10e7f5cb4d95303ff6741e65a7bf648cc300938c87637"
Jul 02 20:44:09.963891 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:44:09.963811    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61b5a32363ab22a274d10e7f5cb4d95303ff6741e65a7bf648cc300938c87637"} err="failed to get container status \"61b5a32363ab22a274d10e7f5cb4d95303ff6741e65a7bf648cc300938c87637\": rpc error: code = NotFound desc = could not find container \"61b5a32363ab22a274d10e7f5cb4d95303ff6741e65a7bf648cc300938c87637\": container with ID starting with 61b5a32363ab22a274d10e7f5cb4d95303ff6741e65a7bf648cc300938c87637 not found: ID does not exist"
Jul 02 20:44:09.978297 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:44:09.978278    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-df7f9fb75-rn796"]
Jul 02 20:44:09.988981 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:44:09.988960    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-df7f9fb75-rn796"]
Jul 02 20:44:10.881275 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:44:10.881243    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac2d61d4-9778-4308-b401-6195eab135d0" path="/var/lib/kubelet/pods/ac2d61d4-9778-4308-b401-6195eab135d0/volumes"
Jul 02 20:44:13.599603 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:44:13.599561    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:44:13.656081 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:44:13.656045    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:44:36.494378 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:44:36.494342    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:44:45.789024 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:44:45.788931    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:44:56.996053 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:44:56.996023    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:45:02.589370 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:45:02.589320    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:45:05.893408 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:45:05.893373    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:45:06.318882 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:45:06.318834    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:45:16.389670 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:45:16.389636    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:45:18.911747 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:45:18.911705    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:45:20.675940 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:45:20.675906    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:45:40.863734 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:45:40.863692    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:45:42.503482 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:45:42.503451    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:45:53.797445 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:45:53.797407    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:45:54.462043 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:45:54.462005    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:45:54.608987 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:45:54.608953    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:45:54.706608 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:45:54.706575    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:46:00.560385 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:46:00.560343    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:46:00.778885 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:46:00.778851    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:46:00.883383 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:46:00.883313    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:46:00.981371 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:46:00.981340    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:46:06.760053 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:46:06.760022    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:46:06.821108 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:46:06.821073    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:46:07.080595 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:46:07.080520    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:46:19.096001 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:46:19.095917    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:46:23.527888 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:46:23.527859    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:46:33.090561 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:46:33.090526    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:46:41.803673 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:46:41.803636    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:46:50.784877 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:46:50.784841    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:47:01.391766 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:47:01.391729    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:47:10.106429 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:47:10.106389    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:47:22.190301 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:47:22.190272    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:47:31.498452 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:47:31.498418    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:47:54.385805 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:47:54.385769    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:48:03.491402 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:48:03.491356    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:48:25.894996 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:48:25.894954    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:48:36.491629 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:48:36.491592    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:48:36.666654 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:48:36.666614    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:48:38.307939 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:48:38.307899    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:48:52.499220 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:48:52.499181    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:49:02.488270 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:49:02.488235    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:49:13.887050 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:49:13.886973    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:49:23.082697 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:49:23.082662    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:49:31.786308 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:49:31.786264    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:49:57.917538 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:49:57.917498    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s8nbx"]
Jul 02 20:49:57.918177 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:49:57.917741    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s8nbx" podUID="00ec8f73-b108-4b11-a453-8a45d4dd2a7d" containerName="manager" containerID="cri-o://cc9ed2093eb2ee6a682b71bd8ed4cc7b5a9ca93e429b763614a12ad2a46407d2" gracePeriod=10
Jul 02 20:50:00.064323 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:50:00.064297    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s8nbx"
Jul 02 20:50:00.089101 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:50:00.089033    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6dbg\" (UniqueName: \"kubernetes.io/projected/00ec8f73-b108-4b11-a453-8a45d4dd2a7d-kube-api-access-x6dbg\") pod \"00ec8f73-b108-4b11-a453-8a45d4dd2a7d\" (UID: \"00ec8f73-b108-4b11-a453-8a45d4dd2a7d\") "
Jul 02 20:50:00.089288 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:50:00.089260    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/00ec8f73-b108-4b11-a453-8a45d4dd2a7d-extensions-socket-volume\") pod \"00ec8f73-b108-4b11-a453-8a45d4dd2a7d\" (UID: \"00ec8f73-b108-4b11-a453-8a45d4dd2a7d\") "
Jul 02 20:50:00.089637 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:50:00.089597    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00ec8f73-b108-4b11-a453-8a45d4dd2a7d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "00ec8f73-b108-4b11-a453-8a45d4dd2a7d" (UID: "00ec8f73-b108-4b11-a453-8a45d4dd2a7d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:50:00.091351 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:50:00.091300    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00ec8f73-b108-4b11-a453-8a45d4dd2a7d-kube-api-access-x6dbg" (OuterVolumeSpecName: "kube-api-access-x6dbg") pod "00ec8f73-b108-4b11-a453-8a45d4dd2a7d" (UID: "00ec8f73-b108-4b11-a453-8a45d4dd2a7d"). InnerVolumeSpecName "kube-api-access-x6dbg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:50:00.190023 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:50:00.189987    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/00ec8f73-b108-4b11-a453-8a45d4dd2a7d-extensions-socket-volume\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:50:00.190023 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:50:00.190020    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6dbg\" (UniqueName: \"kubernetes.io/projected/00ec8f73-b108-4b11-a453-8a45d4dd2a7d-kube-api-access-x6dbg\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:50:00.765619 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:50:00.765584    2581 generic.go:356] "Generic (PLEG): container finished" podID="00ec8f73-b108-4b11-a453-8a45d4dd2a7d" containerID="cc9ed2093eb2ee6a682b71bd8ed4cc7b5a9ca93e429b763614a12ad2a46407d2" exitCode=0
Jul 02 20:50:00.765779 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:50:00.765622    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s8nbx"
Jul 02 20:50:00.765779 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:50:00.765672    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s8nbx" event={"ID":"00ec8f73-b108-4b11-a453-8a45d4dd2a7d","Type":"ContainerDied","Data":"cc9ed2093eb2ee6a682b71bd8ed4cc7b5a9ca93e429b763614a12ad2a46407d2"}
Jul 02 20:50:00.765779 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:50:00.765751    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s8nbx" event={"ID":"00ec8f73-b108-4b11-a453-8a45d4dd2a7d","Type":"ContainerDied","Data":"c575e3d00ea01840975497ff849b17b0c904b84c5e7739c659ee759d6ba3f7f3"}
Jul 02 20:50:00.765779 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:50:00.765774    2581 scope.go:117] "RemoveContainer" containerID="cc9ed2093eb2ee6a682b71bd8ed4cc7b5a9ca93e429b763614a12ad2a46407d2"
Jul 02 20:50:00.775876 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:50:00.775860    2581 scope.go:117] "RemoveContainer" containerID="cc9ed2093eb2ee6a682b71bd8ed4cc7b5a9ca93e429b763614a12ad2a46407d2"
Jul 02 20:50:00.776108 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:50:00.776092    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc9ed2093eb2ee6a682b71bd8ed4cc7b5a9ca93e429b763614a12ad2a46407d2\": container with ID starting with cc9ed2093eb2ee6a682b71bd8ed4cc7b5a9ca93e429b763614a12ad2a46407d2 not found: ID does not exist" containerID="cc9ed2093eb2ee6a682b71bd8ed4cc7b5a9ca93e429b763614a12ad2a46407d2"
Jul 02 20:50:00.776169 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:50:00.776116    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc9ed2093eb2ee6a682b71bd8ed4cc7b5a9ca93e429b763614a12ad2a46407d2"} err="failed to get container status \"cc9ed2093eb2ee6a682b71bd8ed4cc7b5a9ca93e429b763614a12ad2a46407d2\": rpc error: code = NotFound desc = could not find container \"cc9ed2093eb2ee6a682b71bd8ed4cc7b5a9ca93e429b763614a12ad2a46407d2\": container with ID starting with cc9ed2093eb2ee6a682b71bd8ed4cc7b5a9ca93e429b763614a12ad2a46407d2 not found: ID does not exist"
Jul 02 20:50:00.788793 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:50:00.788767    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s8nbx"]
Jul 02 20:50:00.794630 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:50:00.794612    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s8nbx"]
Jul 02 20:50:00.882275 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:50:00.882240    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00ec8f73-b108-4b11-a453-8a45d4dd2a7d" path="/var/lib/kubelet/pods/00ec8f73-b108-4b11-a453-8a45d4dd2a7d/volumes"
Jul 02 20:50:59.053689 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:50:59.053654    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lsg5b"]
Jul 02 20:50:59.054129 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:50:59.054002    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac2d61d4-9778-4308-b401-6195eab135d0" containerName="authorino"
Jul 02 20:50:59.054129 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:50:59.054014    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac2d61d4-9778-4308-b401-6195eab135d0" containerName="authorino"
Jul 02 20:50:59.054129 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:50:59.054037    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00ec8f73-b108-4b11-a453-8a45d4dd2a7d" containerName="manager"
Jul 02 20:50:59.054129 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:50:59.054042    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="00ec8f73-b108-4b11-a453-8a45d4dd2a7d" containerName="manager"
Jul 02 20:50:59.054129 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:50:59.054097    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac2d61d4-9778-4308-b401-6195eab135d0" containerName="authorino"
Jul 02 20:50:59.054129 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:50:59.054105    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="00ec8f73-b108-4b11-a453-8a45d4dd2a7d" containerName="manager"
Jul 02 20:50:59.058111 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:50:59.058093    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lsg5b"
Jul 02 20:50:59.059217 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:50:59.059196    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdwmw\" (UniqueName: \"kubernetes.io/projected/e3c3a701-7fda-4441-a5b3-93c65bc3cddf-kube-api-access-kdwmw\") pod \"kuadrant-operator-controller-manager-86878c769f-lsg5b\" (UID: \"e3c3a701-7fda-4441-a5b3-93c65bc3cddf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lsg5b"
Jul 02 20:50:59.059287 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:50:59.059238    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3c3a701-7fda-4441-a5b3-93c65bc3cddf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lsg5b\" (UID: \"e3c3a701-7fda-4441-a5b3-93c65bc3cddf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lsg5b"
Jul 02 20:50:59.060690 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:50:59.060673    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wtvgr\""
Jul 02 20:50:59.072838 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:50:59.072803    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lsg5b"]
Jul 02 20:50:59.159734 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:50:59.159708    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdwmw\" (UniqueName: \"kubernetes.io/projected/e3c3a701-7fda-4441-a5b3-93c65bc3cddf-kube-api-access-kdwmw\") pod \"kuadrant-operator-controller-manager-86878c769f-lsg5b\" (UID: \"e3c3a701-7fda-4441-a5b3-93c65bc3cddf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lsg5b"
Jul 02 20:50:59.159877 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:50:59.159753    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3c3a701-7fda-4441-a5b3-93c65bc3cddf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lsg5b\" (UID: \"e3c3a701-7fda-4441-a5b3-93c65bc3cddf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lsg5b"
Jul 02 20:50:59.160078 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:50:59.160056    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3c3a701-7fda-4441-a5b3-93c65bc3cddf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lsg5b\" (UID: \"e3c3a701-7fda-4441-a5b3-93c65bc3cddf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lsg5b"
Jul 02 20:50:59.169327 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:50:59.169303    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdwmw\" (UniqueName: \"kubernetes.io/projected/e3c3a701-7fda-4441-a5b3-93c65bc3cddf-kube-api-access-kdwmw\") pod \"kuadrant-operator-controller-manager-86878c769f-lsg5b\" (UID: \"e3c3a701-7fda-4441-a5b3-93c65bc3cddf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lsg5b"
Jul 02 20:50:59.368476 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:50:59.368373    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lsg5b"
Jul 02 20:50:59.512286 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:50:59.512261    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lsg5b"]
Jul 02 20:50:59.514566 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:50:59.514539    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3c3a701_7fda_4441_a5b3_93c65bc3cddf.slice/crio-596d00e349010a186be050ff5b8a5093da7d73c57c9c7a16cc3740c661345aea WatchSource:0}: Error finding container 596d00e349010a186be050ff5b8a5093da7d73c57c9c7a16cc3740c661345aea: Status 404 returned error can't find the container with id 596d00e349010a186be050ff5b8a5093da7d73c57c9c7a16cc3740c661345aea
Jul 02 20:51:00.049401 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:51:00.049367    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lsg5b" event={"ID":"e3c3a701-7fda-4441-a5b3-93c65bc3cddf","Type":"ContainerStarted","Data":"045ce38773dde8e641c8a1170bb7abc187fbb1b87784fb84fb17efe191133f56"}
Jul 02 20:51:00.049606 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:51:00.049421    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lsg5b" event={"ID":"e3c3a701-7fda-4441-a5b3-93c65bc3cddf","Type":"ContainerStarted","Data":"596d00e349010a186be050ff5b8a5093da7d73c57c9c7a16cc3740c661345aea"}
Jul 02 20:51:00.049606 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:51:00.049442    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lsg5b"
Jul 02 20:51:00.073939 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:51:00.073892    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lsg5b" podStartSLOduration=1.073864891 podStartE2EDuration="1.073864891s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:50:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:51:00.072871118 +0000 UTC m=+1093.743384612" watchObservedRunningTime="2026-07-02 20:51:00.073864891 +0000 UTC m=+1093.744378385"
Jul 02 20:51:11.056471 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:51:11.056439    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lsg5b"
Jul 02 20:51:21.588518 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:51:21.588481    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:51:30.894134 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:51:30.894099    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:51:43.194051 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:51:43.194016    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:51:51.798151 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:51:51.798106    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:52:00.995580 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:52:00.995542    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:52:10.800035 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:52:10.799995    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:52:21.001187 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:52:21.001155    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:52:31.506921 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:52:31.506877    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:52:31.860244 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:52:31.860157    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:52:31.945021 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:52:31.944991    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:52:41.406010 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:52:41.405975    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:52:51.697548 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:52:51.697508    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:53:03.495786 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:53:03.495738    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:53:11.234495 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:53:11.234460    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:53:11.572031 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:53:11.571947    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:53:29.195679 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:53:29.195645    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:53:38.492040 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:53:38.492004    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:53:47.806865 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:53:47.806825    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:53:59.989118 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:53:59.989088    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:54:09.689069 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:54:09.689029    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:54:11.237588 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:54:11.237545    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:54:13.794285 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:54:13.794254    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:54:24.896594 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:54:24.896561    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:54:32.984391 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:54:32.984357    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:54:43.493910 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:54:43.493861    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:54:52.299413 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:54:52.299371    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:55:01.588861 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:55:01.588829    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:55:07.198094 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:55:07.198053    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:55:16.593480 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:55:16.593390    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:55:25.495542 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:55:25.495509    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:55:34.887924 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:55:34.887883    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:55:46.788452 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:55:46.788415    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:55:58.086348 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:55:58.086307    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:56:02.536493 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:56:02.536439    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:56:05.401447 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:56:05.401410    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:56:21.595992 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:56:21.595956    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:56:31.994550 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:56:31.994511    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:56:44.485186 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:56:44.485093    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:56:45.982566 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:56:45.982536    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:56:46.677260 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:56:46.677225    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:56:53.461449 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:56:53.461413    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:56:56.696561 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:56:56.696520    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:57:01.706043 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:01.706003    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:04.890626 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:04.890592    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:57:06.815888 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:06.815860    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:09.713357 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:09.713312    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:09.813818 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:09.813781    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:10.193596 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:10.193492    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:16.024066 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:16.024031    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:57:16.290063 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:16.289987    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:16.392355 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:16.392327    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:16.476042 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:16.476007    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c"]
Jul 02 20:57:16.479840 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:16.479821    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c"
Jul 02 20:57:16.482489 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:16.482469    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-473c1531-openshift-default-dockercfg-kkd4q\""
Jul 02 20:57:16.506337 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:16.506312    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c"]
Jul 02 20:57:16.525688 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:16.525664    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:16.617649 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:16.617576    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:16.623784 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:16.623760    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-istio-data\") pod \"e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c\" (UID: \"988ba4c8-dd9f-48a4-b20a-4ddca34ea220\") " pod="openshift-ingress/e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c"
Jul 02 20:57:16.623886 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:16.623800    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-workload-certs\") pod \"e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c\" (UID: \"988ba4c8-dd9f-48a4-b20a-4ddca34ea220\") " pod="openshift-ingress/e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c"
Jul 02 20:57:16.623886 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:16.623821    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-credential-socket\") pod \"e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c\" (UID: \"988ba4c8-dd9f-48a4-b20a-4ddca34ea220\") " pod="openshift-ingress/e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c"
Jul 02 20:57:16.623886 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:16.623875    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdbjw\" (UniqueName: \"kubernetes.io/projected/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-kube-api-access-gdbjw\") pod \"e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c\" (UID: \"988ba4c8-dd9f-48a4-b20a-4ddca34ea220\") " pod="openshift-ingress/e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c"
Jul 02 20:57:16.624060 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:16.623895    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-istiod-ca-cert\") pod \"e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c\" (UID: \"988ba4c8-dd9f-48a4-b20a-4ddca34ea220\") " pod="openshift-ingress/e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c"
Jul 02 20:57:16.624060 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:16.623973    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-istio-podinfo\") pod \"e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c\" (UID: \"988ba4c8-dd9f-48a4-b20a-4ddca34ea220\") " pod="openshift-ingress/e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c"
Jul 02 20:57:16.624060 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:16.624014    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-istio-envoy\") pod \"e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c\" (UID: \"988ba4c8-dd9f-48a4-b20a-4ddca34ea220\") " pod="openshift-ingress/e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c"
Jul 02 20:57:16.624060 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:16.624031    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-istio-token\") pod \"e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c\" (UID: \"988ba4c8-dd9f-48a4-b20a-4ddca34ea220\") " pod="openshift-ingress/e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c"
Jul 02 20:57:16.624220 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:16.624076    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-workload-socket\") pod \"e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c\" (UID: \"988ba4c8-dd9f-48a4-b20a-4ddca34ea220\") " pod="openshift-ingress/e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c"
Jul 02 20:57:16.724994 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:16.724968    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-workload-certs\") pod \"e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c\" (UID: \"988ba4c8-dd9f-48a4-b20a-4ddca34ea220\") " pod="openshift-ingress/e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c"
Jul 02 20:57:16.725114 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:16.725003    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-credential-socket\") pod \"e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c\" (UID: \"988ba4c8-dd9f-48a4-b20a-4ddca34ea220\") " pod="openshift-ingress/e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c"
Jul 02 20:57:16.725114 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:16.725028    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdbjw\" (UniqueName: \"kubernetes.io/projected/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-kube-api-access-gdbjw\") pod \"e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c\" (UID: \"988ba4c8-dd9f-48a4-b20a-4ddca34ea220\") " pod="openshift-ingress/e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c"
Jul 02 20:57:16.725114 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:16.725047    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-istiod-ca-cert\") pod \"e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c\" (UID: \"988ba4c8-dd9f-48a4-b20a-4ddca34ea220\") " pod="openshift-ingress/e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c"
Jul 02 20:57:16.725114 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:16.725080    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-istio-podinfo\") pod \"e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c\" (UID: \"988ba4c8-dd9f-48a4-b20a-4ddca34ea220\") " pod="openshift-ingress/e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c"
Jul 02 20:57:16.725114 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:16.725104    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-istio-envoy\") pod \"e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c\" (UID: \"988ba4c8-dd9f-48a4-b20a-4ddca34ea220\") " pod="openshift-ingress/e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c"
Jul 02 20:57:16.725398 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:16.725119    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-istio-token\") pod \"e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c\" (UID: \"988ba4c8-dd9f-48a4-b20a-4ddca34ea220\") " pod="openshift-ingress/e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c"
Jul 02 20:57:16.725398 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:16.725380    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-workload-socket\") pod \"e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c\" (UID: \"988ba4c8-dd9f-48a4-b20a-4ddca34ea220\") " pod="openshift-ingress/e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c"
Jul 02 20:57:16.725507 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:16.725434    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-credential-socket\") pod \"e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c\" (UID: \"988ba4c8-dd9f-48a4-b20a-4ddca34ea220\") " pod="openshift-ingress/e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c"
Jul 02 20:57:16.725507 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:16.725443    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-istio-data\") pod \"e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c\" (UID: \"988ba4c8-dd9f-48a4-b20a-4ddca34ea220\") " pod="openshift-ingress/e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c"
Jul 02 20:57:16.725507 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:16.725461    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-workload-certs\") pod \"e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c\" (UID: \"988ba4c8-dd9f-48a4-b20a-4ddca34ea220\") " pod="openshift-ingress/e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c"
Jul 02 20:57:16.725665 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:16.725655    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-istio-data\") pod \"e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c\" (UID: \"988ba4c8-dd9f-48a4-b20a-4ddca34ea220\") " pod="openshift-ingress/e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c"
Jul 02 20:57:16.725728 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:16.725695    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-workload-socket\") pod \"e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c\" (UID: \"988ba4c8-dd9f-48a4-b20a-4ddca34ea220\") " pod="openshift-ingress/e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c"
Jul 02 20:57:16.725882 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:16.725851    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-istiod-ca-cert\") pod \"e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c\" (UID: \"988ba4c8-dd9f-48a4-b20a-4ddca34ea220\") " pod="openshift-ingress/e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c"
Jul 02 20:57:16.727932 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:16.727912    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-istio-envoy\") pod \"e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c\" (UID: \"988ba4c8-dd9f-48a4-b20a-4ddca34ea220\") " pod="openshift-ingress/e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c"
Jul 02 20:57:16.728072 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:16.728053    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-istio-podinfo\") pod \"e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c\" (UID: \"988ba4c8-dd9f-48a4-b20a-4ddca34ea220\") " pod="openshift-ingress/e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c"
Jul 02 20:57:16.734270 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:16.734247    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-istio-token\") pod \"e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c\" (UID: \"988ba4c8-dd9f-48a4-b20a-4ddca34ea220\") " pod="openshift-ingress/e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c"
Jul 02 20:57:16.734670 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:16.734648    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdbjw\" (UniqueName: \"kubernetes.io/projected/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-kube-api-access-gdbjw\") pod \"e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c\" (UID: \"988ba4c8-dd9f-48a4-b20a-4ddca34ea220\") " pod="openshift-ingress/e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c"
Jul 02 20:57:16.795010 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:16.794986    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c"
Jul 02 20:57:16.943515 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:16.943490    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c"]
Jul 02 20:57:16.945362 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:57:16.945329    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod988ba4c8_dd9f_48a4_b20a_4ddca34ea220.slice/crio-94775cd84baf8314b415f3e8d682ee9f3d173f6677a91c981f1290ac553a5e41 WatchSource:0}: Error finding container 94775cd84baf8314b415f3e8d682ee9f3d173f6677a91c981f1290ac553a5e41: Status 404 returned error can't find the container with id 94775cd84baf8314b415f3e8d682ee9f3d173f6677a91c981f1290ac553a5e41
Jul 02 20:57:16.947622 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:16.947588    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:57:16.947708 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:16.947657    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:57:16.947708 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:16.947683    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:57:17.057913 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:17.057870    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c" event={"ID":"988ba4c8-dd9f-48a4-b20a-4ddca34ea220","Type":"ContainerStarted","Data":"672bdd9a0ec4dd2789d7b55a183758e83fa64fbd259dc086b0cca46ec2b5aec3"}
Jul 02 20:57:17.057913 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:17.057919    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c" event={"ID":"988ba4c8-dd9f-48a4-b20a-4ddca34ea220","Type":"ContainerStarted","Data":"94775cd84baf8314b415f3e8d682ee9f3d173f6677a91c981f1290ac553a5e41"}
Jul 02 20:57:17.091203 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:17.091150    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c" podStartSLOduration=1.09112182 podStartE2EDuration="1.09112182s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:57:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:57:17.090927144 +0000 UTC m=+1470.761440637" watchObservedRunningTime="2026-07-02 20:57:17.09112182 +0000 UTC m=+1470.761635312"
Jul 02 20:57:17.760266 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:17.760231    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:17.795860 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:17.795834    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c"
Jul 02 20:57:17.801080 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:17.801057    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c"
Jul 02 20:57:17.868468 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:17.868437    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:17.976953 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:17.976920    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:18.063118 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:18.063040    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c"
Jul 02 20:57:18.063919 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:18.063903    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c"
Jul 02 20:57:18.306925 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:18.306888    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:18.569693 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:18.569650    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:18.669485 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:18.669456    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:20.359489 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:20.359448    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:22.868642 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:22.868607    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:23.023966 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:23.023928    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c"]
Jul 02 20:57:23.024217 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:23.024188    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c" podUID="988ba4c8-dd9f-48a4-b20a-4ddca34ea220" containerName="istio-proxy" containerID="cri-o://672bdd9a0ec4dd2789d7b55a183758e83fa64fbd259dc086b0cca46ec2b5aec3" gracePeriod=30
Jul 02 20:57:23.043910 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:23.043756    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:23.144072 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:23.143946    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:23.233975 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:23.233940    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:24.638763 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:24.638732    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:28.827346 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:28.827317    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:28.882166 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:28.882095    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c"
Jul 02 20:57:28.909108 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:28.909069    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:28.930679 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:28.930651    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdbjw\" (UniqueName: \"kubernetes.io/projected/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-kube-api-access-gdbjw\") pod \"988ba4c8-dd9f-48a4-b20a-4ddca34ea220\" (UID: \"988ba4c8-dd9f-48a4-b20a-4ddca34ea220\") "
Jul 02 20:57:28.930805 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:28.930708    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-workload-socket\") pod \"988ba4c8-dd9f-48a4-b20a-4ddca34ea220\" (UID: \"988ba4c8-dd9f-48a4-b20a-4ddca34ea220\") "
Jul 02 20:57:28.930805 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:28.930737    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-istio-token\") pod \"988ba4c8-dd9f-48a4-b20a-4ddca34ea220\" (UID: \"988ba4c8-dd9f-48a4-b20a-4ddca34ea220\") "
Jul 02 20:57:28.930898 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:28.930807    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-workload-certs\") pod \"988ba4c8-dd9f-48a4-b20a-4ddca34ea220\" (UID: \"988ba4c8-dd9f-48a4-b20a-4ddca34ea220\") "
Jul 02 20:57:28.930898 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:28.930860    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-istiod-ca-cert\") pod \"988ba4c8-dd9f-48a4-b20a-4ddca34ea220\" (UID: \"988ba4c8-dd9f-48a4-b20a-4ddca34ea220\") "
Jul 02 20:57:28.930898 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:28.930890    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-istio-data\") pod \"988ba4c8-dd9f-48a4-b20a-4ddca34ea220\" (UID: \"988ba4c8-dd9f-48a4-b20a-4ddca34ea220\") "
Jul 02 20:57:28.931054 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:28.930943    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-credential-socket\") pod \"988ba4c8-dd9f-48a4-b20a-4ddca34ea220\" (UID: \"988ba4c8-dd9f-48a4-b20a-4ddca34ea220\") "
Jul 02 20:57:28.931054 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:28.930970    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-istio-podinfo\") pod \"988ba4c8-dd9f-48a4-b20a-4ddca34ea220\" (UID: \"988ba4c8-dd9f-48a4-b20a-4ddca34ea220\") "
Jul 02 20:57:28.931054 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:28.931016    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-istio-envoy\") pod \"988ba4c8-dd9f-48a4-b20a-4ddca34ea220\" (UID: \"988ba4c8-dd9f-48a4-b20a-4ddca34ea220\") "
Jul 02 20:57:28.931248 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:28.931048    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "988ba4c8-dd9f-48a4-b20a-4ddca34ea220" (UID: "988ba4c8-dd9f-48a4-b20a-4ddca34ea220"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:57:28.931310 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:28.931285    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "988ba4c8-dd9f-48a4-b20a-4ddca34ea220" (UID: "988ba4c8-dd9f-48a4-b20a-4ddca34ea220"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:57:28.931310 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:28.931286    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-workload-socket\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:57:28.931415 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:28.931381    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "988ba4c8-dd9f-48a4-b20a-4ddca34ea220" (UID: "988ba4c8-dd9f-48a4-b20a-4ddca34ea220"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:57:28.931415 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:28.931385    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "988ba4c8-dd9f-48a4-b20a-4ddca34ea220" (UID: "988ba4c8-dd9f-48a4-b20a-4ddca34ea220"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:57:28.932230 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:28.932193    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-istio-data" (OuterVolumeSpecName: "istio-data") pod "988ba4c8-dd9f-48a4-b20a-4ddca34ea220" (UID: "988ba4c8-dd9f-48a4-b20a-4ddca34ea220"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:57:28.933672 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:28.933636    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "988ba4c8-dd9f-48a4-b20a-4ddca34ea220" (UID: "988ba4c8-dd9f-48a4-b20a-4ddca34ea220"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:57:28.933764 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:28.933733    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-kube-api-access-gdbjw" (OuterVolumeSpecName: "kube-api-access-gdbjw") pod "988ba4c8-dd9f-48a4-b20a-4ddca34ea220" (UID: "988ba4c8-dd9f-48a4-b20a-4ddca34ea220"). InnerVolumeSpecName "kube-api-access-gdbjw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:57:28.933837 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:28.933796    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-istio-token" (OuterVolumeSpecName: "istio-token") pod "988ba4c8-dd9f-48a4-b20a-4ddca34ea220" (UID: "988ba4c8-dd9f-48a4-b20a-4ddca34ea220"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:57:28.933837 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:28.933803    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "988ba4c8-dd9f-48a4-b20a-4ddca34ea220" (UID: "988ba4c8-dd9f-48a4-b20a-4ddca34ea220"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 20:57:29.010715 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.010683    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj"]
Jul 02 20:57:29.011220 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.011199    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="988ba4c8-dd9f-48a4-b20a-4ddca34ea220" containerName="istio-proxy"
Jul 02 20:57:29.011306 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.011221    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="988ba4c8-dd9f-48a4-b20a-4ddca34ea220" containerName="istio-proxy"
Jul 02 20:57:29.011361 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.011324    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="988ba4c8-dd9f-48a4-b20a-4ddca34ea220" containerName="istio-proxy"
Jul 02 20:57:29.015826 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.015801    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj"
Jul 02 20:57:29.018211 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.018183    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-d9de6a34-openshift-default-dockercfg-lt5b9\""
Jul 02 20:57:29.026700 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.026676    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj"]
Jul 02 20:57:29.032204 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.032176    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzrgf\" (UniqueName: \"kubernetes.io/projected/b694e898-b914-46f1-b5e9-00618fd28764-kube-api-access-dzrgf\") pod \"e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj\" (UID: \"b694e898-b914-46f1-b5e9-00618fd28764\") " pod="openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj"
Jul 02 20:57:29.032311 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.032222    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b694e898-b914-46f1-b5e9-00618fd28764-credential-socket\") pod \"e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj\" (UID: \"b694e898-b914-46f1-b5e9-00618fd28764\") " pod="openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj"
Jul 02 20:57:29.032311 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.032267    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b694e898-b914-46f1-b5e9-00618fd28764-istio-data\") pod \"e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj\" (UID: \"b694e898-b914-46f1-b5e9-00618fd28764\") " pod="openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj"
Jul 02 20:57:29.032311 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.032303    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b694e898-b914-46f1-b5e9-00618fd28764-workload-certs\") pod \"e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj\" (UID: \"b694e898-b914-46f1-b5e9-00618fd28764\") " pod="openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj"
Jul 02 20:57:29.032489 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.032353    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b694e898-b914-46f1-b5e9-00618fd28764-istio-token\") pod \"e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj\" (UID: \"b694e898-b914-46f1-b5e9-00618fd28764\") " pod="openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj"
Jul 02 20:57:29.032489 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.032368    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b694e898-b914-46f1-b5e9-00618fd28764-istiod-ca-cert\") pod \"e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj\" (UID: \"b694e898-b914-46f1-b5e9-00618fd28764\") " pod="openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj"
Jul 02 20:57:29.032489 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.032420    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b694e898-b914-46f1-b5e9-00618fd28764-istio-podinfo\") pod \"e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj\" (UID: \"b694e898-b914-46f1-b5e9-00618fd28764\") " pod="openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj"
Jul 02 20:57:29.032489 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.032477    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b694e898-b914-46f1-b5e9-00618fd28764-workload-socket\") pod \"e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj\" (UID: \"b694e898-b914-46f1-b5e9-00618fd28764\") " pod="openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj"
Jul 02 20:57:29.032713 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.032498    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b694e898-b914-46f1-b5e9-00618fd28764-istio-envoy\") pod \"e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj\" (UID: \"b694e898-b914-46f1-b5e9-00618fd28764\") " pod="openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj"
Jul 02 20:57:29.032713 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.032544    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-istiod-ca-cert\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:57:29.032713 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.032576    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-istio-data\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:57:29.032713 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.032590    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-credential-socket\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:57:29.032713 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.032598    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-istio-podinfo\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:57:29.032713 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.032606    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-istio-envoy\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:57:29.032713 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.032616    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdbjw\" (UniqueName: \"kubernetes.io/projected/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-kube-api-access-gdbjw\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:57:29.032713 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.032627    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-istio-token\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:57:29.032713 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.032635    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/988ba4c8-dd9f-48a4-b20a-4ddca34ea220-workload-certs\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:57:29.054284 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.054258    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:29.116346 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.116314    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:29.122255 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.122229    2581 generic.go:356] "Generic (PLEG): container finished" podID="988ba4c8-dd9f-48a4-b20a-4ddca34ea220" containerID="672bdd9a0ec4dd2789d7b55a183758e83fa64fbd259dc086b0cca46ec2b5aec3" exitCode=0
Jul 02 20:57:29.122356 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.122280    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c"
Jul 02 20:57:29.122356 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.122310    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c" event={"ID":"988ba4c8-dd9f-48a4-b20a-4ddca34ea220","Type":"ContainerDied","Data":"672bdd9a0ec4dd2789d7b55a183758e83fa64fbd259dc086b0cca46ec2b5aec3"}
Jul 02 20:57:29.122442 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.122361    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c" event={"ID":"988ba4c8-dd9f-48a4-b20a-4ddca34ea220","Type":"ContainerDied","Data":"94775cd84baf8314b415f3e8d682ee9f3d173f6677a91c981f1290ac553a5e41"}
Jul 02 20:57:29.122442 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.122384    2581 scope.go:117] "RemoveContainer" containerID="672bdd9a0ec4dd2789d7b55a183758e83fa64fbd259dc086b0cca46ec2b5aec3"
Jul 02 20:57:29.132835 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.132818    2581 scope.go:117] "RemoveContainer" containerID="672bdd9a0ec4dd2789d7b55a183758e83fa64fbd259dc086b0cca46ec2b5aec3"
Jul 02 20:57:29.133092 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:57:29.133072    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"672bdd9a0ec4dd2789d7b55a183758e83fa64fbd259dc086b0cca46ec2b5aec3\": container with ID starting with 672bdd9a0ec4dd2789d7b55a183758e83fa64fbd259dc086b0cca46ec2b5aec3 not found: ID does not exist" containerID="672bdd9a0ec4dd2789d7b55a183758e83fa64fbd259dc086b0cca46ec2b5aec3"
Jul 02 20:57:29.133171 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.133094    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b694e898-b914-46f1-b5e9-00618fd28764-workload-certs\") pod \"e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj\" (UID: \"b694e898-b914-46f1-b5e9-00618fd28764\") " pod="openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj"
Jul 02 20:57:29.133171 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.133101    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"672bdd9a0ec4dd2789d7b55a183758e83fa64fbd259dc086b0cca46ec2b5aec3"} err="failed to get container status \"672bdd9a0ec4dd2789d7b55a183758e83fa64fbd259dc086b0cca46ec2b5aec3\": rpc error: code = NotFound desc = could not find container \"672bdd9a0ec4dd2789d7b55a183758e83fa64fbd259dc086b0cca46ec2b5aec3\": container with ID starting with 672bdd9a0ec4dd2789d7b55a183758e83fa64fbd259dc086b0cca46ec2b5aec3 not found: ID does not exist"
Jul 02 20:57:29.133171 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.133160    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b694e898-b914-46f1-b5e9-00618fd28764-istio-token\") pod \"e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj\" (UID: \"b694e898-b914-46f1-b5e9-00618fd28764\") " pod="openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj"
Jul 02 20:57:29.133300 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.133180    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b694e898-b914-46f1-b5e9-00618fd28764-istiod-ca-cert\") pod \"e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj\" (UID: \"b694e898-b914-46f1-b5e9-00618fd28764\") " pod="openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj"
Jul 02 20:57:29.133300 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.133199    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b694e898-b914-46f1-b5e9-00618fd28764-istio-podinfo\") pod \"e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj\" (UID: \"b694e898-b914-46f1-b5e9-00618fd28764\") " pod="openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj"
Jul 02 20:57:29.133300 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.133225    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b694e898-b914-46f1-b5e9-00618fd28764-workload-socket\") pod \"e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj\" (UID: \"b694e898-b914-46f1-b5e9-00618fd28764\") " pod="openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj"
Jul 02 20:57:29.133445 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.133361    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b694e898-b914-46f1-b5e9-00618fd28764-istio-envoy\") pod \"e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj\" (UID: \"b694e898-b914-46f1-b5e9-00618fd28764\") " pod="openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj"
Jul 02 20:57:29.133445 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.133426    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b694e898-b914-46f1-b5e9-00618fd28764-workload-certs\") pod \"e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj\" (UID: \"b694e898-b914-46f1-b5e9-00618fd28764\") " pod="openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj"
Jul 02 20:57:29.133548 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.133518    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b694e898-b914-46f1-b5e9-00618fd28764-workload-socket\") pod \"e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj\" (UID: \"b694e898-b914-46f1-b5e9-00618fd28764\") " pod="openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj"
Jul 02 20:57:29.133586 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.133524    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzrgf\" (UniqueName: \"kubernetes.io/projected/b694e898-b914-46f1-b5e9-00618fd28764-kube-api-access-dzrgf\") pod \"e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj\" (UID: \"b694e898-b914-46f1-b5e9-00618fd28764\") " pod="openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj"
Jul 02 20:57:29.133630 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.133592    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b694e898-b914-46f1-b5e9-00618fd28764-credential-socket\") pod \"e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj\" (UID: \"b694e898-b914-46f1-b5e9-00618fd28764\") " pod="openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj"
Jul 02 20:57:29.133630 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.133619    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b694e898-b914-46f1-b5e9-00618fd28764-istio-data\") pod \"e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj\" (UID: \"b694e898-b914-46f1-b5e9-00618fd28764\") " pod="openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj"
Jul 02 20:57:29.133926 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.133902    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b694e898-b914-46f1-b5e9-00618fd28764-istio-data\") pod \"e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj\" (UID: \"b694e898-b914-46f1-b5e9-00618fd28764\") " pod="openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj"
Jul 02 20:57:29.134005 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.133933    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b694e898-b914-46f1-b5e9-00618fd28764-credential-socket\") pod \"e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj\" (UID: \"b694e898-b914-46f1-b5e9-00618fd28764\") " pod="openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj"
Jul 02 20:57:29.134202 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.134184    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b694e898-b914-46f1-b5e9-00618fd28764-istiod-ca-cert\") pod \"e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj\" (UID: \"b694e898-b914-46f1-b5e9-00618fd28764\") " pod="openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj"
Jul 02 20:57:29.135552 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.135534    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b694e898-b914-46f1-b5e9-00618fd28764-istio-envoy\") pod \"e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj\" (UID: \"b694e898-b914-46f1-b5e9-00618fd28764\") " pod="openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj"
Jul 02 20:57:29.135622 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.135594    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b694e898-b914-46f1-b5e9-00618fd28764-istio-podinfo\") pod \"e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj\" (UID: \"b694e898-b914-46f1-b5e9-00618fd28764\") " pod="openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj"
Jul 02 20:57:29.148196 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.148175    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b694e898-b914-46f1-b5e9-00618fd28764-istio-token\") pod \"e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj\" (UID: \"b694e898-b914-46f1-b5e9-00618fd28764\") " pod="openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj"
Jul 02 20:57:29.148599 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.148582    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzrgf\" (UniqueName: \"kubernetes.io/projected/b694e898-b914-46f1-b5e9-00618fd28764-kube-api-access-dzrgf\") pod \"e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj\" (UID: \"b694e898-b914-46f1-b5e9-00618fd28764\") " pod="openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj"
Jul 02 20:57:29.152197 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.152176    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c"]
Jul 02 20:57:29.155897 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.155879    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-473c1531-openshift-default-7885f69cb9-wds8c"]
Jul 02 20:57:29.327862 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.327835    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj"
Jul 02 20:57:29.461581 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.461557    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj"]
Jul 02 20:57:29.463626 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:57:29.463606    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb694e898_b914_46f1_b5e9_00618fd28764.slice/crio-b81804ba46853504fba2ba2ee9132c357379108340845f5a835a816f1fa4303f WatchSource:0}: Error finding container b81804ba46853504fba2ba2ee9132c357379108340845f5a835a816f1fa4303f: Status 404 returned error can't find the container with id b81804ba46853504fba2ba2ee9132c357379108340845f5a835a816f1fa4303f
Jul 02 20:57:29.465680 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.465647    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:57:29.465778 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.465733    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:57:29.465843 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:29.465779    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:57:30.129995 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:30.129960    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj" event={"ID":"b694e898-b914-46f1-b5e9-00618fd28764","Type":"ContainerStarted","Data":"3d1c0c884fd01b329f16e037e8767829a595cc71a798601e29b4d6fc8409fa64"}
Jul 02 20:57:30.130446 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:30.130008    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj" event={"ID":"b694e898-b914-46f1-b5e9-00618fd28764","Type":"ContainerStarted","Data":"b81804ba46853504fba2ba2ee9132c357379108340845f5a835a816f1fa4303f"}
Jul 02 20:57:30.158373 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:30.158330    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj" podStartSLOduration=2.158315473 podStartE2EDuration="2.158315473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:57:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:57:30.156812287 +0000 UTC m=+1483.827325780" watchObservedRunningTime="2026-07-02 20:57:30.158315473 +0000 UTC m=+1483.828828967"
Jul 02 20:57:30.257397 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:30.257357    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:30.328612 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:30.328578    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj"
Jul 02 20:57:30.334387 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:30.334364    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj"
Jul 02 20:57:30.361644 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:30.361616    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:30.483915 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:30.483887    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:30.767324 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:30.767227    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:30.882600 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:30.882571    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="988ba4c8-dd9f-48a4-b20a-4ddca34ea220" path="/var/lib/kubelet/pods/988ba4c8-dd9f-48a4-b20a-4ddca34ea220/volumes"
Jul 02 20:57:30.995628 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:30.995592    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:31.098222 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:31.098132    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:31.135980 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:31.135953    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj"
Jul 02 20:57:31.136892 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:31.136876    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj"
Jul 02 20:57:32.050081 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:32.050047    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:32.776391 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:32.776354    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:33.193168 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:33.193053    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:57:35.391489 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:35.391454    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:35.760803 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:35.760755    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:41.194996 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:41.194904    2581 generic.go:356] "Generic (PLEG): container finished" podID="b694e898-b914-46f1-b5e9-00618fd28764" containerID="3d1c0c884fd01b329f16e037e8767829a595cc71a798601e29b4d6fc8409fa64" exitCode=0
Jul 02 20:57:41.194996 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:41.194980    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj" event={"ID":"b694e898-b914-46f1-b5e9-00618fd28764","Type":"ContainerDied","Data":"3d1c0c884fd01b329f16e037e8767829a595cc71a798601e29b4d6fc8409fa64"}
Jul 02 20:57:41.195454 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:41.195401    2581 scope.go:117] "RemoveContainer" containerID="3d1c0c884fd01b329f16e037e8767829a595cc71a798601e29b4d6fc8409fa64"
Jul 02 20:57:41.196514 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:41.196482    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:57:41.196611 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:41.196568    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:57:41.196674 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:41.196612    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:57:41.732539 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:41.732506    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj"]
Jul 02 20:57:41.752974 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:41.752940    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:41.853942 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:41.853904    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:42.207616 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:42.207521    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj" event={"ID":"b694e898-b914-46f1-b5e9-00618fd28764","Type":"ContainerStarted","Data":"d4bea99cc8d210c11844dd929ccaeef3b539c8151cb4b2476601189407217f72"}
Jul 02 20:57:42.208059 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:42.207631    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj" podUID="b694e898-b914-46f1-b5e9-00618fd28764" containerName="istio-proxy" containerID="cri-o://d4bea99cc8d210c11844dd929ccaeef3b539c8151cb4b2476601189407217f72" gracePeriod=30
Jul 02 20:57:44.347207 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:44.347175    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:57:44.453836 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:44.453804    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:46.136817 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:46.136785    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj"
Jul 02 20:57:47.457322 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:47.457300    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj"
Jul 02 20:57:47.597182 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:47.597071    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b694e898-b914-46f1-b5e9-00618fd28764-istio-envoy\") pod \"b694e898-b914-46f1-b5e9-00618fd28764\" (UID: \"b694e898-b914-46f1-b5e9-00618fd28764\") "
Jul 02 20:57:47.597182 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:47.597131    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b694e898-b914-46f1-b5e9-00618fd28764-istio-data\") pod \"b694e898-b914-46f1-b5e9-00618fd28764\" (UID: \"b694e898-b914-46f1-b5e9-00618fd28764\") "
Jul 02 20:57:47.597182 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:47.597171    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b694e898-b914-46f1-b5e9-00618fd28764-workload-certs\") pod \"b694e898-b914-46f1-b5e9-00618fd28764\" (UID: \"b694e898-b914-46f1-b5e9-00618fd28764\") "
Jul 02 20:57:47.597468 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:47.597195    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b694e898-b914-46f1-b5e9-00618fd28764-istio-token\") pod \"b694e898-b914-46f1-b5e9-00618fd28764\" (UID: \"b694e898-b914-46f1-b5e9-00618fd28764\") "
Jul 02 20:57:47.597468 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:47.597227    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzrgf\" (UniqueName: \"kubernetes.io/projected/b694e898-b914-46f1-b5e9-00618fd28764-kube-api-access-dzrgf\") pod \"b694e898-b914-46f1-b5e9-00618fd28764\" (UID: \"b694e898-b914-46f1-b5e9-00618fd28764\") "
Jul 02 20:57:47.597468 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:47.597249    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b694e898-b914-46f1-b5e9-00618fd28764-istio-podinfo\") pod \"b694e898-b914-46f1-b5e9-00618fd28764\" (UID: \"b694e898-b914-46f1-b5e9-00618fd28764\") "
Jul 02 20:57:47.597468 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:47.597326    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b694e898-b914-46f1-b5e9-00618fd28764-istiod-ca-cert\") pod \"b694e898-b914-46f1-b5e9-00618fd28764\" (UID: \"b694e898-b914-46f1-b5e9-00618fd28764\") "
Jul 02 20:57:47.597468 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:47.597386    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b694e898-b914-46f1-b5e9-00618fd28764-workload-socket\") pod \"b694e898-b914-46f1-b5e9-00618fd28764\" (UID: \"b694e898-b914-46f1-b5e9-00618fd28764\") "
Jul 02 20:57:47.597468 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:47.597423    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b694e898-b914-46f1-b5e9-00618fd28764-credential-socket\") pod \"b694e898-b914-46f1-b5e9-00618fd28764\" (UID: \"b694e898-b914-46f1-b5e9-00618fd28764\") "
Jul 02 20:57:47.597773 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:47.597515    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b694e898-b914-46f1-b5e9-00618fd28764-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b694e898-b914-46f1-b5e9-00618fd28764" (UID: "b694e898-b914-46f1-b5e9-00618fd28764"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:57:47.597773 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:47.597737    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b694e898-b914-46f1-b5e9-00618fd28764-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b694e898-b914-46f1-b5e9-00618fd28764" (UID: "b694e898-b914-46f1-b5e9-00618fd28764"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:57:47.597773 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:47.597763    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b694e898-b914-46f1-b5e9-00618fd28764-workload-certs\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:57:47.597992 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:47.597966    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b694e898-b914-46f1-b5e9-00618fd28764-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b694e898-b914-46f1-b5e9-00618fd28764" (UID: "b694e898-b914-46f1-b5e9-00618fd28764"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:57:47.598085 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:47.598047    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b694e898-b914-46f1-b5e9-00618fd28764-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b694e898-b914-46f1-b5e9-00618fd28764" (UID: "b694e898-b914-46f1-b5e9-00618fd28764"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:57:47.598134 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:47.598102    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b694e898-b914-46f1-b5e9-00618fd28764-istio-data" (OuterVolumeSpecName: "istio-data") pod "b694e898-b914-46f1-b5e9-00618fd28764" (UID: "b694e898-b914-46f1-b5e9-00618fd28764"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:57:47.599456 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:47.599423    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b694e898-b914-46f1-b5e9-00618fd28764-istio-token" (OuterVolumeSpecName: "istio-token") pod "b694e898-b914-46f1-b5e9-00618fd28764" (UID: "b694e898-b914-46f1-b5e9-00618fd28764"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:57:47.599456 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:47.599423    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b694e898-b914-46f1-b5e9-00618fd28764-kube-api-access-dzrgf" (OuterVolumeSpecName: "kube-api-access-dzrgf") pod "b694e898-b914-46f1-b5e9-00618fd28764" (UID: "b694e898-b914-46f1-b5e9-00618fd28764"). InnerVolumeSpecName "kube-api-access-dzrgf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:57:47.599725 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:47.599696    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b694e898-b914-46f1-b5e9-00618fd28764-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b694e898-b914-46f1-b5e9-00618fd28764" (UID: "b694e898-b914-46f1-b5e9-00618fd28764"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:57:47.599813 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:47.599697    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b694e898-b914-46f1-b5e9-00618fd28764-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b694e898-b914-46f1-b5e9-00618fd28764" (UID: "b694e898-b914-46f1-b5e9-00618fd28764"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 20:57:47.698276 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:47.698241    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b694e898-b914-46f1-b5e9-00618fd28764-istio-data\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:57:47.698276 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:47.698273    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b694e898-b914-46f1-b5e9-00618fd28764-istio-token\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:57:47.698276 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:47.698283    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzrgf\" (UniqueName: \"kubernetes.io/projected/b694e898-b914-46f1-b5e9-00618fd28764-kube-api-access-dzrgf\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:57:47.698456 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:47.698293    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b694e898-b914-46f1-b5e9-00618fd28764-istio-podinfo\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:57:47.698456 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:47.698302    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b694e898-b914-46f1-b5e9-00618fd28764-istiod-ca-cert\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:57:47.698456 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:47.698310    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b694e898-b914-46f1-b5e9-00618fd28764-workload-socket\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:57:47.698456 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:47.698318    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b694e898-b914-46f1-b5e9-00618fd28764-credential-socket\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:57:47.698456 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:47.698327    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b694e898-b914-46f1-b5e9-00618fd28764-istio-envoy\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:57:48.235520 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.235447    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:48.239012 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.238986    2581 generic.go:356] "Generic (PLEG): container finished" podID="b694e898-b914-46f1-b5e9-00618fd28764" containerID="d4bea99cc8d210c11844dd929ccaeef3b539c8151cb4b2476601189407217f72" exitCode=0
Jul 02 20:57:48.239149 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.239038    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj"
Jul 02 20:57:48.239149 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.239058    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj" event={"ID":"b694e898-b914-46f1-b5e9-00618fd28764","Type":"ContainerDied","Data":"d4bea99cc8d210c11844dd929ccaeef3b539c8151cb4b2476601189407217f72"}
Jul 02 20:57:48.239149 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.239111    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj" event={"ID":"b694e898-b914-46f1-b5e9-00618fd28764","Type":"ContainerDied","Data":"b81804ba46853504fba2ba2ee9132c357379108340845f5a835a816f1fa4303f"}
Jul 02 20:57:48.239274 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.239134    2581 scope.go:117] "RemoveContainer" containerID="d4bea99cc8d210c11844dd929ccaeef3b539c8151cb4b2476601189407217f72"
Jul 02 20:57:48.248824 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.248806    2581 scope.go:117] "RemoveContainer" containerID="3d1c0c884fd01b329f16e037e8767829a595cc71a798601e29b4d6fc8409fa64"
Jul 02 20:57:48.256723 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.256706    2581 scope.go:117] "RemoveContainer" containerID="d4bea99cc8d210c11844dd929ccaeef3b539c8151cb4b2476601189407217f72"
Jul 02 20:57:48.256961 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:57:48.256945    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4bea99cc8d210c11844dd929ccaeef3b539c8151cb4b2476601189407217f72\": container with ID starting with d4bea99cc8d210c11844dd929ccaeef3b539c8151cb4b2476601189407217f72 not found: ID does not exist" containerID="d4bea99cc8d210c11844dd929ccaeef3b539c8151cb4b2476601189407217f72"
Jul 02 20:57:48.257002 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.256968    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4bea99cc8d210c11844dd929ccaeef3b539c8151cb4b2476601189407217f72"} err="failed to get container status \"d4bea99cc8d210c11844dd929ccaeef3b539c8151cb4b2476601189407217f72\": rpc error: code = NotFound desc = could not find container \"d4bea99cc8d210c11844dd929ccaeef3b539c8151cb4b2476601189407217f72\": container with ID starting with d4bea99cc8d210c11844dd929ccaeef3b539c8151cb4b2476601189407217f72 not found: ID does not exist"
Jul 02 20:57:48.257002 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.256987    2581 scope.go:117] "RemoveContainer" containerID="3d1c0c884fd01b329f16e037e8767829a595cc71a798601e29b4d6fc8409fa64"
Jul 02 20:57:48.257225 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:57:48.257206    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d1c0c884fd01b329f16e037e8767829a595cc71a798601e29b4d6fc8409fa64\": container with ID starting with 3d1c0c884fd01b329f16e037e8767829a595cc71a798601e29b4d6fc8409fa64 not found: ID does not exist" containerID="3d1c0c884fd01b329f16e037e8767829a595cc71a798601e29b4d6fc8409fa64"
Jul 02 20:57:48.257284 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.257232    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d1c0c884fd01b329f16e037e8767829a595cc71a798601e29b4d6fc8409fa64"} err="failed to get container status \"3d1c0c884fd01b329f16e037e8767829a595cc71a798601e29b4d6fc8409fa64\": rpc error: code = NotFound desc = could not find container \"3d1c0c884fd01b329f16e037e8767829a595cc71a798601e29b4d6fc8409fa64\": container with ID starting with 3d1c0c884fd01b329f16e037e8767829a595cc71a798601e29b4d6fc8409fa64 not found: ID does not exist"
Jul 02 20:57:48.292236 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.292217    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj"]
Jul 02 20:57:48.300874 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.300855    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-d9de6a34-openshift-default-b6867d9cf-9l8jj"]
Jul 02 20:57:48.423116 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.423088    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:48.562687 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.562611    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6"]
Jul 02 20:57:48.563110 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.562957    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b694e898-b914-46f1-b5e9-00618fd28764" containerName="istio-proxy"
Jul 02 20:57:48.563110 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.562970    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b694e898-b914-46f1-b5e9-00618fd28764" containerName="istio-proxy"
Jul 02 20:57:48.563110 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.562989    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b694e898-b914-46f1-b5e9-00618fd28764" containerName="istio-proxy"
Jul 02 20:57:48.563110 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.562995    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b694e898-b914-46f1-b5e9-00618fd28764" containerName="istio-proxy"
Jul 02 20:57:48.563110 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.563059    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b694e898-b914-46f1-b5e9-00618fd28764" containerName="istio-proxy"
Jul 02 20:57:48.567460 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.567443    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6"
Jul 02 20:57:48.570093 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.570075    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-95ac1704-openshift-default-dockercfg-w54vc\""
Jul 02 20:57:48.595967 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.595948    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6"]
Jul 02 20:57:48.630867 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.630842    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:48.707304 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.707276    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd9de87b-af83-4eba-9594-a050666d6ff0-istio-podinfo\") pod \"e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6\" (UID: \"cd9de87b-af83-4eba-9594-a050666d6ff0\") " pod="openshift-ingress/e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6"
Jul 02 20:57:48.707476 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.707308    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd9de87b-af83-4eba-9594-a050666d6ff0-istio-token\") pod \"e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6\" (UID: \"cd9de87b-af83-4eba-9594-a050666d6ff0\") " pod="openshift-ingress/e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6"
Jul 02 20:57:48.707476 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.707327    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd9de87b-af83-4eba-9594-a050666d6ff0-istiod-ca-cert\") pod \"e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6\" (UID: \"cd9de87b-af83-4eba-9594-a050666d6ff0\") " pod="openshift-ingress/e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6"
Jul 02 20:57:48.707476 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.707355    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd9de87b-af83-4eba-9594-a050666d6ff0-workload-socket\") pod \"e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6\" (UID: \"cd9de87b-af83-4eba-9594-a050666d6ff0\") " pod="openshift-ingress/e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6"
Jul 02 20:57:48.707476 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.707406    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd9de87b-af83-4eba-9594-a050666d6ff0-istio-data\") pod \"e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6\" (UID: \"cd9de87b-af83-4eba-9594-a050666d6ff0\") " pod="openshift-ingress/e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6"
Jul 02 20:57:48.707476 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.707425    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd9de87b-af83-4eba-9594-a050666d6ff0-istio-envoy\") pod \"e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6\" (UID: \"cd9de87b-af83-4eba-9594-a050666d6ff0\") " pod="openshift-ingress/e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6"
Jul 02 20:57:48.707476 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.707447    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd9de87b-af83-4eba-9594-a050666d6ff0-credential-socket\") pod \"e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6\" (UID: \"cd9de87b-af83-4eba-9594-a050666d6ff0\") " pod="openshift-ingress/e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6"
Jul 02 20:57:48.707476 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.707464    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqpm4\" (UniqueName: \"kubernetes.io/projected/cd9de87b-af83-4eba-9594-a050666d6ff0-kube-api-access-vqpm4\") pod \"e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6\" (UID: \"cd9de87b-af83-4eba-9594-a050666d6ff0\") " pod="openshift-ingress/e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6"
Jul 02 20:57:48.707725 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.707487    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd9de87b-af83-4eba-9594-a050666d6ff0-workload-certs\") pod \"e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6\" (UID: \"cd9de87b-af83-4eba-9594-a050666d6ff0\") " pod="openshift-ingress/e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6"
Jul 02 20:57:48.808487 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.808459    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd9de87b-af83-4eba-9594-a050666d6ff0-istio-podinfo\") pod \"e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6\" (UID: \"cd9de87b-af83-4eba-9594-a050666d6ff0\") " pod="openshift-ingress/e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6"
Jul 02 20:57:48.808629 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.808501    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd9de87b-af83-4eba-9594-a050666d6ff0-istio-token\") pod \"e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6\" (UID: \"cd9de87b-af83-4eba-9594-a050666d6ff0\") " pod="openshift-ingress/e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6"
Jul 02 20:57:48.808629 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.808528    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd9de87b-af83-4eba-9594-a050666d6ff0-istiod-ca-cert\") pod \"e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6\" (UID: \"cd9de87b-af83-4eba-9594-a050666d6ff0\") " pod="openshift-ingress/e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6"
Jul 02 20:57:48.808629 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.808570    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd9de87b-af83-4eba-9594-a050666d6ff0-workload-socket\") pod \"e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6\" (UID: \"cd9de87b-af83-4eba-9594-a050666d6ff0\") " pod="openshift-ingress/e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6"
Jul 02 20:57:48.808629 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.808598    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd9de87b-af83-4eba-9594-a050666d6ff0-istio-data\") pod \"e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6\" (UID: \"cd9de87b-af83-4eba-9594-a050666d6ff0\") " pod="openshift-ingress/e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6"
Jul 02 20:57:48.808872 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.808633    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd9de87b-af83-4eba-9594-a050666d6ff0-istio-envoy\") pod \"e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6\" (UID: \"cd9de87b-af83-4eba-9594-a050666d6ff0\") " pod="openshift-ingress/e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6"
Jul 02 20:57:48.808872 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.808671    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd9de87b-af83-4eba-9594-a050666d6ff0-credential-socket\") pod \"e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6\" (UID: \"cd9de87b-af83-4eba-9594-a050666d6ff0\") " pod="openshift-ingress/e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6"
Jul 02 20:57:48.808872 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.808697    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqpm4\" (UniqueName: \"kubernetes.io/projected/cd9de87b-af83-4eba-9594-a050666d6ff0-kube-api-access-vqpm4\") pod \"e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6\" (UID: \"cd9de87b-af83-4eba-9594-a050666d6ff0\") " pod="openshift-ingress/e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6"
Jul 02 20:57:48.808872 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.808741    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd9de87b-af83-4eba-9594-a050666d6ff0-workload-certs\") pod \"e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6\" (UID: \"cd9de87b-af83-4eba-9594-a050666d6ff0\") " pod="openshift-ingress/e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6"
Jul 02 20:57:48.809103 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.808992    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd9de87b-af83-4eba-9594-a050666d6ff0-workload-socket\") pod \"e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6\" (UID: \"cd9de87b-af83-4eba-9594-a050666d6ff0\") " pod="openshift-ingress/e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6"
Jul 02 20:57:48.809103 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.809028    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd9de87b-af83-4eba-9594-a050666d6ff0-credential-socket\") pod \"e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6\" (UID: \"cd9de87b-af83-4eba-9594-a050666d6ff0\") " pod="openshift-ingress/e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6"
Jul 02 20:57:48.809103 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.809080    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd9de87b-af83-4eba-9594-a050666d6ff0-workload-certs\") pod \"e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6\" (UID: \"cd9de87b-af83-4eba-9594-a050666d6ff0\") " pod="openshift-ingress/e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6"
Jul 02 20:57:48.809247 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.809193    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd9de87b-af83-4eba-9594-a050666d6ff0-istio-data\") pod \"e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6\" (UID: \"cd9de87b-af83-4eba-9594-a050666d6ff0\") " pod="openshift-ingress/e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6"
Jul 02 20:57:48.809448 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.809431    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd9de87b-af83-4eba-9594-a050666d6ff0-istiod-ca-cert\") pod \"e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6\" (UID: \"cd9de87b-af83-4eba-9594-a050666d6ff0\") " pod="openshift-ingress/e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6"
Jul 02 20:57:48.811007 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.810988    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd9de87b-af83-4eba-9594-a050666d6ff0-istio-envoy\") pod \"e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6\" (UID: \"cd9de87b-af83-4eba-9594-a050666d6ff0\") " pod="openshift-ingress/e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6"
Jul 02 20:57:48.811124 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.811105    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd9de87b-af83-4eba-9594-a050666d6ff0-istio-podinfo\") pod \"e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6\" (UID: \"cd9de87b-af83-4eba-9594-a050666d6ff0\") " pod="openshift-ingress/e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6"
Jul 02 20:57:48.817648 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.817596    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd9de87b-af83-4eba-9594-a050666d6ff0-istio-token\") pod \"e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6\" (UID: \"cd9de87b-af83-4eba-9594-a050666d6ff0\") " pod="openshift-ingress/e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6"
Jul 02 20:57:48.817648 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.817617    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqpm4\" (UniqueName: \"kubernetes.io/projected/cd9de87b-af83-4eba-9594-a050666d6ff0-kube-api-access-vqpm4\") pod \"e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6\" (UID: \"cd9de87b-af83-4eba-9594-a050666d6ff0\") " pod="openshift-ingress/e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6"
Jul 02 20:57:48.877411 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.877390    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6"
Jul 02 20:57:48.881231 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:48.881205    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b694e898-b914-46f1-b5e9-00618fd28764" path="/var/lib/kubelet/pods/b694e898-b914-46f1-b5e9-00618fd28764/volumes"
Jul 02 20:57:49.039728 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:49.039697    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6"]
Jul 02 20:57:49.044874 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:57:49.044843    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd9de87b_af83_4eba_9594_a050666d6ff0.slice/crio-dcf2696466805a841d59b97ef1802892fd25d06b952c10f515654df25e4709f7 WatchSource:0}: Error finding container dcf2696466805a841d59b97ef1802892fd25d06b952c10f515654df25e4709f7: Status 404 returned error can't find the container with id dcf2696466805a841d59b97ef1802892fd25d06b952c10f515654df25e4709f7
Jul 02 20:57:49.047153 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:49.047104    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:57:49.047224 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:49.047190    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:57:49.047224 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:49.047219    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:57:49.162516 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:49.162471    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:49.247505 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:49.247469    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6" event={"ID":"cd9de87b-af83-4eba-9594-a050666d6ff0","Type":"ContainerStarted","Data":"313c8d6d5834cf71c3d0deb51bba32d50bd191ba1dd490777c5d4c6ca66b9511"}
Jul 02 20:57:49.247672 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:49.247525    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6" event={"ID":"cd9de87b-af83-4eba-9594-a050666d6ff0","Type":"ContainerStarted","Data":"dcf2696466805a841d59b97ef1802892fd25d06b952c10f515654df25e4709f7"}
Jul 02 20:57:49.291707 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:49.291663    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6" podStartSLOduration=1.291645906 podStartE2EDuration="1.291645906s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:57:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:57:49.290212695 +0000 UTC m=+1502.960726189" watchObservedRunningTime="2026-07-02 20:57:49.291645906 +0000 UTC m=+1502.962159401"
Jul 02 20:57:49.314107 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:49.314078    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:49.755714 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:49.755676    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:49.855757 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:49.855721    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:49.877585 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:49.877562    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6"
Jul 02 20:57:49.988230 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:49.988202    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:50.446199 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:50.446167    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:50.546105 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:50.546065    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:50.883058 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:50.883030    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6"
Jul 02 20:57:51.258400 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:51.258371    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6"
Jul 02 20:57:51.259311 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:51.259293    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6"
Jul 02 20:57:52.355737 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:52.355710    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:52.405515 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:52.405487    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:57:54.135068 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:54.135010    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:54.289532 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:54.289493    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6"]
Jul 02 20:57:54.289738 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:54.289697    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6" podUID="cd9de87b-af83-4eba-9594-a050666d6ff0" containerName="istio-proxy" containerID="cri-o://313c8d6d5834cf71c3d0deb51bba32d50bd191ba1dd490777c5d4c6ca66b9511" gracePeriod=30
Jul 02 20:57:54.321975 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:54.321943    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:54.425482 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:54.425392    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:54.517677 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:54.517647    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:57:56.004923 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:57:56.004895    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:00.640544 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:00.640517    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6"
Jul 02 20:58:00.722461 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:00.722436    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd9de87b-af83-4eba-9594-a050666d6ff0-istio-token\") pod \"cd9de87b-af83-4eba-9594-a050666d6ff0\" (UID: \"cd9de87b-af83-4eba-9594-a050666d6ff0\") "
Jul 02 20:58:00.722597 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:00.722489    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd9de87b-af83-4eba-9594-a050666d6ff0-credential-socket\") pod \"cd9de87b-af83-4eba-9594-a050666d6ff0\" (UID: \"cd9de87b-af83-4eba-9594-a050666d6ff0\") "
Jul 02 20:58:00.722597 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:00.722514    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd9de87b-af83-4eba-9594-a050666d6ff0-istio-podinfo\") pod \"cd9de87b-af83-4eba-9594-a050666d6ff0\" (UID: \"cd9de87b-af83-4eba-9594-a050666d6ff0\") "
Jul 02 20:58:00.722597 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:00.722535    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd9de87b-af83-4eba-9594-a050666d6ff0-workload-certs\") pod \"cd9de87b-af83-4eba-9594-a050666d6ff0\" (UID: \"cd9de87b-af83-4eba-9594-a050666d6ff0\") "
Jul 02 20:58:00.722597 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:00.722566    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqpm4\" (UniqueName: \"kubernetes.io/projected/cd9de87b-af83-4eba-9594-a050666d6ff0-kube-api-access-vqpm4\") pod \"cd9de87b-af83-4eba-9594-a050666d6ff0\" (UID: \"cd9de87b-af83-4eba-9594-a050666d6ff0\") "
Jul 02 20:58:00.722597 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:00.722590    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd9de87b-af83-4eba-9594-a050666d6ff0-workload-socket\") pod \"cd9de87b-af83-4eba-9594-a050666d6ff0\" (UID: \"cd9de87b-af83-4eba-9594-a050666d6ff0\") "
Jul 02 20:58:00.722868 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:00.722612    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd9de87b-af83-4eba-9594-a050666d6ff0-istiod-ca-cert\") pod \"cd9de87b-af83-4eba-9594-a050666d6ff0\" (UID: \"cd9de87b-af83-4eba-9594-a050666d6ff0\") "
Jul 02 20:58:00.722868 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:00.722657    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd9de87b-af83-4eba-9594-a050666d6ff0-istio-data\") pod \"cd9de87b-af83-4eba-9594-a050666d6ff0\" (UID: \"cd9de87b-af83-4eba-9594-a050666d6ff0\") "
Jul 02 20:58:00.722868 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:00.722688    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd9de87b-af83-4eba-9594-a050666d6ff0-istio-envoy\") pod \"cd9de87b-af83-4eba-9594-a050666d6ff0\" (UID: \"cd9de87b-af83-4eba-9594-a050666d6ff0\") "
Jul 02 20:58:00.722868 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:00.722853    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd9de87b-af83-4eba-9594-a050666d6ff0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cd9de87b-af83-4eba-9594-a050666d6ff0" (UID: "cd9de87b-af83-4eba-9594-a050666d6ff0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:58:00.723081 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:00.722871    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd9de87b-af83-4eba-9594-a050666d6ff0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cd9de87b-af83-4eba-9594-a050666d6ff0" (UID: "cd9de87b-af83-4eba-9594-a050666d6ff0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:58:00.723081 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:00.723016    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd9de87b-af83-4eba-9594-a050666d6ff0-credential-socket\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:58:00.723081 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:00.723036    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd9de87b-af83-4eba-9594-a050666d6ff0-workload-certs\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:58:00.723309 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:00.723245    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd9de87b-af83-4eba-9594-a050666d6ff0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cd9de87b-af83-4eba-9594-a050666d6ff0" (UID: "cd9de87b-af83-4eba-9594-a050666d6ff0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 20:58:00.723309 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:00.723072    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd9de87b-af83-4eba-9594-a050666d6ff0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cd9de87b-af83-4eba-9594-a050666d6ff0" (UID: "cd9de87b-af83-4eba-9594-a050666d6ff0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:58:00.723640 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:00.723616    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd9de87b-af83-4eba-9594-a050666d6ff0-istio-data" (OuterVolumeSpecName: "istio-data") pod "cd9de87b-af83-4eba-9594-a050666d6ff0" (UID: "cd9de87b-af83-4eba-9594-a050666d6ff0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:58:00.724654 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:00.724633    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cd9de87b-af83-4eba-9594-a050666d6ff0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cd9de87b-af83-4eba-9594-a050666d6ff0" (UID: "cd9de87b-af83-4eba-9594-a050666d6ff0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 20:58:00.724812 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:00.724791    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd9de87b-af83-4eba-9594-a050666d6ff0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cd9de87b-af83-4eba-9594-a050666d6ff0" (UID: "cd9de87b-af83-4eba-9594-a050666d6ff0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:58:00.725039 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:00.725016    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd9de87b-af83-4eba-9594-a050666d6ff0-istio-token" (OuterVolumeSpecName: "istio-token") pod "cd9de87b-af83-4eba-9594-a050666d6ff0" (UID: "cd9de87b-af83-4eba-9594-a050666d6ff0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:58:00.725127 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:00.725040    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd9de87b-af83-4eba-9594-a050666d6ff0-kube-api-access-vqpm4" (OuterVolumeSpecName: "kube-api-access-vqpm4") pod "cd9de87b-af83-4eba-9594-a050666d6ff0" (UID: "cd9de87b-af83-4eba-9594-a050666d6ff0"). InnerVolumeSpecName "kube-api-access-vqpm4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:58:00.824334 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:00.824302    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd9de87b-af83-4eba-9594-a050666d6ff0-istio-token\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:58:00.824334 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:00.824328    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd9de87b-af83-4eba-9594-a050666d6ff0-istio-podinfo\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:58:00.824334 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:00.824337    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqpm4\" (UniqueName: \"kubernetes.io/projected/cd9de87b-af83-4eba-9594-a050666d6ff0-kube-api-access-vqpm4\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:58:00.824523 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:00.824348    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd9de87b-af83-4eba-9594-a050666d6ff0-workload-socket\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:58:00.824523 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:00.824356    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd9de87b-af83-4eba-9594-a050666d6ff0-istiod-ca-cert\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:58:00.824523 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:00.824364    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd9de87b-af83-4eba-9594-a050666d6ff0-istio-data\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:58:00.824523 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:00.824372    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd9de87b-af83-4eba-9594-a050666d6ff0-istio-envoy\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 20:58:01.192120 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:01.192029    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:01.293941 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:01.293909    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:01.313550 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:01.313521    2581 generic.go:356] "Generic (PLEG): container finished" podID="cd9de87b-af83-4eba-9594-a050666d6ff0" containerID="313c8d6d5834cf71c3d0deb51bba32d50bd191ba1dd490777c5d4c6ca66b9511" exitCode=0
Jul 02 20:58:01.313682 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:01.313572    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6"
Jul 02 20:58:01.313682 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:01.313606    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6" event={"ID":"cd9de87b-af83-4eba-9594-a050666d6ff0","Type":"ContainerDied","Data":"313c8d6d5834cf71c3d0deb51bba32d50bd191ba1dd490777c5d4c6ca66b9511"}
Jul 02 20:58:01.313682 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:01.313666    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6" event={"ID":"cd9de87b-af83-4eba-9594-a050666d6ff0","Type":"ContainerDied","Data":"dcf2696466805a841d59b97ef1802892fd25d06b952c10f515654df25e4709f7"}
Jul 02 20:58:01.313862 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:01.313698    2581 scope.go:117] "RemoveContainer" containerID="313c8d6d5834cf71c3d0deb51bba32d50bd191ba1dd490777c5d4c6ca66b9511"
Jul 02 20:58:01.322286 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:01.322270    2581 scope.go:117] "RemoveContainer" containerID="313c8d6d5834cf71c3d0deb51bba32d50bd191ba1dd490777c5d4c6ca66b9511"
Jul 02 20:58:01.322551 ip-10-0-135-220 kubenswrapper[2581]: E0702 20:58:01.322530    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"313c8d6d5834cf71c3d0deb51bba32d50bd191ba1dd490777c5d4c6ca66b9511\": container with ID starting with 313c8d6d5834cf71c3d0deb51bba32d50bd191ba1dd490777c5d4c6ca66b9511 not found: ID does not exist" containerID="313c8d6d5834cf71c3d0deb51bba32d50bd191ba1dd490777c5d4c6ca66b9511"
Jul 02 20:58:01.322644 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:01.322564    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"313c8d6d5834cf71c3d0deb51bba32d50bd191ba1dd490777c5d4c6ca66b9511"} err="failed to get container status \"313c8d6d5834cf71c3d0deb51bba32d50bd191ba1dd490777c5d4c6ca66b9511\": rpc error: code = NotFound desc = could not find container \"313c8d6d5834cf71c3d0deb51bba32d50bd191ba1dd490777c5d4c6ca66b9511\": container with ID starting with 313c8d6d5834cf71c3d0deb51bba32d50bd191ba1dd490777c5d4c6ca66b9511 not found: ID does not exist"
Jul 02 20:58:01.336345 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:01.336319    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6"]
Jul 02 20:58:01.340383 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:01.340363    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-95ac1704-openshift-default-5fd459d855-8cvd6"]
Jul 02 20:58:02.403804 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:02.403762    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:02.881452 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:02.881419    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd9de87b-af83-4eba-9594-a050666d6ff0" path="/var/lib/kubelet/pods/cd9de87b-af83-4eba-9594-a050666d6ff0/volumes"
Jul 02 20:58:04.487269 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:04.487237    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:58:08.736817 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:08.736785    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:08.850567 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:08.850526    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:08.962975 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:08.962905    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:09.135484 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:09.135399    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:09.554654 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:09.554622    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:35.459386 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:35.459352    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:41.431996 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:41.431940    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:41.604215 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:41.604174    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:41.706964 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:41.706882    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:53.127751 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:53.127716    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:58:57.524855 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:58:57.524819    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:03.894967 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:03.894927    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:03.998863 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:03.998831    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:04.097239 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:04.097205    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:14.629730 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:14.629697    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:15.916609 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:15.916574    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:21.315941 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:21.315908    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:21.390749 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:21.390719    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:21.555686 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:21.555659    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:21.705725 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:21.705641    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:22.465448 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:22.465420    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:22.564990 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:22.564956    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:22.666650 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:22.666616    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:23.588535 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:23.588504    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:59:24.283701 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:24.283672    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:30.114396 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:30.114358    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:30.183374 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:30.183337    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:30.787173 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:30.787121    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:31.214166 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:31.214126    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:59:36.551379 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:36.551344    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:36.653963 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:36.653921    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:36.771381 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:36.771340    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:37.052866 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:37.052829    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz"]
Jul 02 20:59:37.053265 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:37.053248    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd9de87b-af83-4eba-9594-a050666d6ff0" containerName="istio-proxy"
Jul 02 20:59:37.053367 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:37.053267    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd9de87b-af83-4eba-9594-a050666d6ff0" containerName="istio-proxy"
Jul 02 20:59:37.053424 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:37.053384    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd9de87b-af83-4eba-9594-a050666d6ff0" containerName="istio-proxy"
Jul 02 20:59:37.053424 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:37.053402    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b694e898-b914-46f1-b5e9-00618fd28764" containerName="istio-proxy"
Jul 02 20:59:37.056439 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:37.056417    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz"
Jul 02 20:59:37.059249 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:37.059229    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-27c57383-openshift-default-dockercfg-p652r\""
Jul 02 20:59:37.080241 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:37.080218    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz"]
Jul 02 20:59:37.083886 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:37.083864    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:37.118987 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:37.118963    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db9cee37-cf1e-495b-aa2a-ffb7f336a658-istio-data\") pod \"e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz\" (UID: \"db9cee37-cf1e-495b-aa2a-ffb7f336a658\") " pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz"
Jul 02 20:59:37.119088 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:37.119011    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db9cee37-cf1e-495b-aa2a-ffb7f336a658-credential-socket\") pod \"e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz\" (UID: \"db9cee37-cf1e-495b-aa2a-ffb7f336a658\") " pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz"
Jul 02 20:59:37.119088 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:37.119034    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db9cee37-cf1e-495b-aa2a-ffb7f336a658-workload-certs\") pod \"e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz\" (UID: \"db9cee37-cf1e-495b-aa2a-ffb7f336a658\") " pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz"
Jul 02 20:59:37.119088 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:37.119049    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db9cee37-cf1e-495b-aa2a-ffb7f336a658-istiod-ca-cert\") pod \"e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz\" (UID: \"db9cee37-cf1e-495b-aa2a-ffb7f336a658\") " pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz"
Jul 02 20:59:37.119088 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:37.119083    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db9cee37-cf1e-495b-aa2a-ffb7f336a658-workload-socket\") pod \"e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz\" (UID: \"db9cee37-cf1e-495b-aa2a-ffb7f336a658\") " pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz"
Jul 02 20:59:37.119275 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:37.119119    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db9cee37-cf1e-495b-aa2a-ffb7f336a658-istio-podinfo\") pod \"e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz\" (UID: \"db9cee37-cf1e-495b-aa2a-ffb7f336a658\") " pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz"
Jul 02 20:59:37.119275 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:37.119165    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqs8n\" (UniqueName: \"kubernetes.io/projected/db9cee37-cf1e-495b-aa2a-ffb7f336a658-kube-api-access-xqs8n\") pod \"e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz\" (UID: \"db9cee37-cf1e-495b-aa2a-ffb7f336a658\") " pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz"
Jul 02 20:59:37.119275 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:37.119222    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db9cee37-cf1e-495b-aa2a-ffb7f336a658-istio-envoy\") pod \"e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz\" (UID: \"db9cee37-cf1e-495b-aa2a-ffb7f336a658\") " pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz"
Jul 02 20:59:37.119275 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:37.119238    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db9cee37-cf1e-495b-aa2a-ffb7f336a658-istio-token\") pod \"e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz\" (UID: \"db9cee37-cf1e-495b-aa2a-ffb7f336a658\") " pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz"
Jul 02 20:59:37.219760 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:37.219724    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db9cee37-cf1e-495b-aa2a-ffb7f336a658-workload-socket\") pod \"e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz\" (UID: \"db9cee37-cf1e-495b-aa2a-ffb7f336a658\") " pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz"
Jul 02 20:59:37.219760 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:37.219763    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db9cee37-cf1e-495b-aa2a-ffb7f336a658-istio-podinfo\") pod \"e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz\" (UID: \"db9cee37-cf1e-495b-aa2a-ffb7f336a658\") " pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz"
Jul 02 20:59:37.220014 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:37.219787    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqs8n\" (UniqueName: \"kubernetes.io/projected/db9cee37-cf1e-495b-aa2a-ffb7f336a658-kube-api-access-xqs8n\") pod \"e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz\" (UID: \"db9cee37-cf1e-495b-aa2a-ffb7f336a658\") " pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz"
Jul 02 20:59:37.220014 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:37.219833    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db9cee37-cf1e-495b-aa2a-ffb7f336a658-istio-envoy\") pod \"e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz\" (UID: \"db9cee37-cf1e-495b-aa2a-ffb7f336a658\") " pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz"
Jul 02 20:59:37.220014 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:37.219855    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db9cee37-cf1e-495b-aa2a-ffb7f336a658-istio-token\") pod \"e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz\" (UID: \"db9cee37-cf1e-495b-aa2a-ffb7f336a658\") " pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz"
Jul 02 20:59:37.220204 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:37.220007    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db9cee37-cf1e-495b-aa2a-ffb7f336a658-istio-data\") pod \"e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz\" (UID: \"db9cee37-cf1e-495b-aa2a-ffb7f336a658\") " pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz"
Jul 02 20:59:37.220204 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:37.220087    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db9cee37-cf1e-495b-aa2a-ffb7f336a658-credential-socket\") pod \"e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz\" (UID: \"db9cee37-cf1e-495b-aa2a-ffb7f336a658\") " pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz"
Jul 02 20:59:37.220204 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:37.220120    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db9cee37-cf1e-495b-aa2a-ffb7f336a658-workload-certs\") pod \"e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz\" (UID: \"db9cee37-cf1e-495b-aa2a-ffb7f336a658\") " pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz"
Jul 02 20:59:37.220204 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:37.220166    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db9cee37-cf1e-495b-aa2a-ffb7f336a658-istiod-ca-cert\") pod \"e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz\" (UID: \"db9cee37-cf1e-495b-aa2a-ffb7f336a658\") " pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz"
Jul 02 20:59:37.220204 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:37.220188    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db9cee37-cf1e-495b-aa2a-ffb7f336a658-workload-socket\") pod \"e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz\" (UID: \"db9cee37-cf1e-495b-aa2a-ffb7f336a658\") " pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz"
Jul 02 20:59:37.220428 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:37.220367    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db9cee37-cf1e-495b-aa2a-ffb7f336a658-istio-data\") pod \"e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz\" (UID: \"db9cee37-cf1e-495b-aa2a-ffb7f336a658\") " pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz"
Jul 02 20:59:37.220477 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:37.220460    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db9cee37-cf1e-495b-aa2a-ffb7f336a658-credential-socket\") pod \"e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz\" (UID: \"db9cee37-cf1e-495b-aa2a-ffb7f336a658\") " pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz"
Jul 02 20:59:37.220550 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:37.220529    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db9cee37-cf1e-495b-aa2a-ffb7f336a658-workload-certs\") pod \"e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz\" (UID: \"db9cee37-cf1e-495b-aa2a-ffb7f336a658\") " pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz"
Jul 02 20:59:37.220776 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:37.220760    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db9cee37-cf1e-495b-aa2a-ffb7f336a658-istiod-ca-cert\") pod \"e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz\" (UID: \"db9cee37-cf1e-495b-aa2a-ffb7f336a658\") " pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz"
Jul 02 20:59:37.222100 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:37.222078    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db9cee37-cf1e-495b-aa2a-ffb7f336a658-istio-envoy\") pod \"e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz\" (UID: \"db9cee37-cf1e-495b-aa2a-ffb7f336a658\") " pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz"
Jul 02 20:59:37.222292 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:37.222275    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db9cee37-cf1e-495b-aa2a-ffb7f336a658-istio-podinfo\") pod \"e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz\" (UID: \"db9cee37-cf1e-495b-aa2a-ffb7f336a658\") " pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz"
Jul 02 20:59:37.227676 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:37.227656    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqs8n\" (UniqueName: \"kubernetes.io/projected/db9cee37-cf1e-495b-aa2a-ffb7f336a658-kube-api-access-xqs8n\") pod \"e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz\" (UID: \"db9cee37-cf1e-495b-aa2a-ffb7f336a658\") " pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz"
Jul 02 20:59:37.227863 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:37.227844    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db9cee37-cf1e-495b-aa2a-ffb7f336a658-istio-token\") pod \"e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz\" (UID: \"db9cee37-cf1e-495b-aa2a-ffb7f336a658\") " pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz"
Jul 02 20:59:37.366796 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:37.366717    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz"
Jul 02 20:59:37.378228 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:37.378202    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:37.505581 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:37.505556    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz"]
Jul 02 20:59:37.506941 ip-10-0-135-220 kubenswrapper[2581]: W0702 20:59:37.506914    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb9cee37_cf1e_495b_aa2a_ffb7f336a658.slice/crio-343d6aff1b4390a7fa698fd45e5536c734068865b5fa420937c353dbb43845ad WatchSource:0}: Error finding container 343d6aff1b4390a7fa698fd45e5536c734068865b5fa420937c353dbb43845ad: Status 404 returned error can't find the container with id 343d6aff1b4390a7fa698fd45e5536c734068865b5fa420937c353dbb43845ad
Jul 02 20:59:37.508936 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:37.508902    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:59:37.509042 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:37.508972    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:59:37.509042 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:37.509004    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:59:37.808393 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:37.808357    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz" event={"ID":"db9cee37-cf1e-495b-aa2a-ffb7f336a658","Type":"ContainerStarted","Data":"ad0868a3bb1d7fc79f72f047e8d8654dc855ed0a6ee811a12c1acd472a89c8b9"}
Jul 02 20:59:37.808871 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:37.808418    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz" event={"ID":"db9cee37-cf1e-495b-aa2a-ffb7f336a658","Type":"ContainerStarted","Data":"343d6aff1b4390a7fa698fd45e5536c734068865b5fa420937c353dbb43845ad"}
Jul 02 20:59:37.831031 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:37.830979    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz" podStartSLOduration=0.830964787 podStartE2EDuration="830.964787ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:59:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:59:37.828832469 +0000 UTC m=+1611.499345961" watchObservedRunningTime="2026-07-02 20:59:37.830964787 +0000 UTC m=+1611.501478280"
Jul 02 20:59:38.367187 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:38.367155    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz"
Jul 02 20:59:38.371859 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:38.371834    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz"
Jul 02 20:59:38.814274 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:38.814246    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz"
Jul 02 20:59:38.815258 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:38.815241    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz"
Jul 02 20:59:39.883984 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:39.883956    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:39.989638 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:39.989605    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:40.142017 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:40.141937    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:40.795560 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:40.795522    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:40.897224 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:40.897196    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:59:40.967278 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:40.967247    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:41.066066 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:41.065993    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:44.377922 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:44.377888    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:45.028578 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:45.028541    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:45.123315 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:45.123275    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:45.453750 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:45.453674    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:51.322955 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:51.322879    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:51.473662 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:51.473620    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 20:59:51.512304 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:51.512271    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:51.776617 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:51.776571    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:52.117262 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:52.117177    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:52.221667 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:52.221626    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:53.825243 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:53.824460    2581 patch_prober.go:28] interesting pod/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": read tcp 10.133.0.2:59128->10.133.0.56:15021: read: connection reset by peer" start-of-body=
Jul 02 20:59:53.825243 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:53.824525    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz" podUID="db9cee37-cf1e-495b-aa2a-ffb7f336a658" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": read tcp 10.133.0.2:59128->10.133.0.56:15021: read: connection reset by peer"
Jul 02 20:59:53.902504 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:53.902478    2581 generic.go:356] "Generic (PLEG): container finished" podID="db9cee37-cf1e-495b-aa2a-ffb7f336a658" containerID="ad0868a3bb1d7fc79f72f047e8d8654dc855ed0a6ee811a12c1acd472a89c8b9" exitCode=0
Jul 02 20:59:53.902630 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:53.902548    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz" event={"ID":"db9cee37-cf1e-495b-aa2a-ffb7f336a658","Type":"ContainerDied","Data":"ad0868a3bb1d7fc79f72f047e8d8654dc855ed0a6ee811a12c1acd472a89c8b9"}
Jul 02 20:59:53.902967 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:53.902950    2581 scope.go:117] "RemoveContainer" containerID="ad0868a3bb1d7fc79f72f047e8d8654dc855ed0a6ee811a12c1acd472a89c8b9"
Jul 02 20:59:53.903966 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:53.903938    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:59:53.904040 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:53.904023    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:59:53.904085 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:53.904072    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 20:59:54.909488 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:54.909457    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz" event={"ID":"db9cee37-cf1e-495b-aa2a-ffb7f336a658","Type":"ContainerStarted","Data":"17ec1c906abcfec3a27733140a2283b1713a2542c1a5c9b665282590bc4dbc97"}
Jul 02 20:59:55.367734 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:55.367696    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz"
Jul 02 20:59:55.367912 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:55.367852    2581 patch_prober.go:28] interesting pod/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 02 20:59:55.367912 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:55.367901    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz" podUID="db9cee37-cf1e-495b-aa2a-ffb7f336a658" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 02 20:59:56.367279 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:56.367246    2581 patch_prober.go:28] interesting pod/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 02 20:59:56.367683 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:56.367308    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz" podUID="db9cee37-cf1e-495b-aa2a-ffb7f336a658" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 02 20:59:57.367880 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:57.367843    2581 patch_prober.go:28] interesting pod/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 02 20:59:57.368290 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:57.367895    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz" podUID="db9cee37-cf1e-495b-aa2a-ffb7f336a658" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 02 20:59:58.136799 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:58.136766    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:58.206965 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:58.206934    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:58.367462 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:58.367429    2581 patch_prober.go:28] interesting pod/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 02 20:59:58.367638 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:58.367490    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz" podUID="db9cee37-cf1e-495b-aa2a-ffb7f336a658" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 02 20:59:58.383008 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:58.382979    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz"]
Jul 02 20:59:58.383435 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:58.383210    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz" podUID="db9cee37-cf1e-495b-aa2a-ffb7f336a658" containerName="istio-proxy" containerID="cri-o://17ec1c906abcfec3a27733140a2283b1713a2542c1a5c9b665282590bc4dbc97" gracePeriod=30
Jul 02 20:59:58.406195 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:58.406114    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:58.755216 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:58.755180    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:58.851573 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:58.851543    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 20:59:58.965204 ip-10-0-135-220 kubenswrapper[2581]: I0702 20:59:58.965168    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:00.788110 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:00.788076    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 21:00:03.934147 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:03.934104    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz"
Jul 02 21:00:03.968101 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:03.968067    2581 generic.go:356] "Generic (PLEG): container finished" podID="db9cee37-cf1e-495b-aa2a-ffb7f336a658" containerID="17ec1c906abcfec3a27733140a2283b1713a2542c1a5c9b665282590bc4dbc97" exitCode=0
Jul 02 21:00:03.968279 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:03.968123    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz"
Jul 02 21:00:03.968279 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:03.968160    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz" event={"ID":"db9cee37-cf1e-495b-aa2a-ffb7f336a658","Type":"ContainerDied","Data":"17ec1c906abcfec3a27733140a2283b1713a2542c1a5c9b665282590bc4dbc97"}
Jul 02 21:00:03.968279 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:03.968239    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz" event={"ID":"db9cee37-cf1e-495b-aa2a-ffb7f336a658","Type":"ContainerDied","Data":"343d6aff1b4390a7fa698fd45e5536c734068865b5fa420937c353dbb43845ad"}
Jul 02 21:00:03.968279 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:03.968262    2581 scope.go:117] "RemoveContainer" containerID="17ec1c906abcfec3a27733140a2283b1713a2542c1a5c9b665282590bc4dbc97"
Jul 02 21:00:03.977349 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:03.977326    2581 scope.go:117] "RemoveContainer" containerID="ad0868a3bb1d7fc79f72f047e8d8654dc855ed0a6ee811a12c1acd472a89c8b9"
Jul 02 21:00:03.984938 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:03.984923    2581 scope.go:117] "RemoveContainer" containerID="17ec1c906abcfec3a27733140a2283b1713a2542c1a5c9b665282590bc4dbc97"
Jul 02 21:00:03.985260 ip-10-0-135-220 kubenswrapper[2581]: E0702 21:00:03.985239    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17ec1c906abcfec3a27733140a2283b1713a2542c1a5c9b665282590bc4dbc97\": container with ID starting with 17ec1c906abcfec3a27733140a2283b1713a2542c1a5c9b665282590bc4dbc97 not found: ID does not exist" containerID="17ec1c906abcfec3a27733140a2283b1713a2542c1a5c9b665282590bc4dbc97"
Jul 02 21:00:03.985329 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:03.985267    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17ec1c906abcfec3a27733140a2283b1713a2542c1a5c9b665282590bc4dbc97"} err="failed to get container status \"17ec1c906abcfec3a27733140a2283b1713a2542c1a5c9b665282590bc4dbc97\": rpc error: code = NotFound desc = could not find container \"17ec1c906abcfec3a27733140a2283b1713a2542c1a5c9b665282590bc4dbc97\": container with ID starting with 17ec1c906abcfec3a27733140a2283b1713a2542c1a5c9b665282590bc4dbc97 not found: ID does not exist"
Jul 02 21:00:03.985329 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:03.985283    2581 scope.go:117] "RemoveContainer" containerID="ad0868a3bb1d7fc79f72f047e8d8654dc855ed0a6ee811a12c1acd472a89c8b9"
Jul 02 21:00:03.985507 ip-10-0-135-220 kubenswrapper[2581]: E0702 21:00:03.985491    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad0868a3bb1d7fc79f72f047e8d8654dc855ed0a6ee811a12c1acd472a89c8b9\": container with ID starting with ad0868a3bb1d7fc79f72f047e8d8654dc855ed0a6ee811a12c1acd472a89c8b9 not found: ID does not exist" containerID="ad0868a3bb1d7fc79f72f047e8d8654dc855ed0a6ee811a12c1acd472a89c8b9"
Jul 02 21:00:03.985546 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:03.985512    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad0868a3bb1d7fc79f72f047e8d8654dc855ed0a6ee811a12c1acd472a89c8b9"} err="failed to get container status \"ad0868a3bb1d7fc79f72f047e8d8654dc855ed0a6ee811a12c1acd472a89c8b9\": rpc error: code = NotFound desc = could not find container \"ad0868a3bb1d7fc79f72f047e8d8654dc855ed0a6ee811a12c1acd472a89c8b9\": container with ID starting with ad0868a3bb1d7fc79f72f047e8d8654dc855ed0a6ee811a12c1acd472a89c8b9 not found: ID does not exist"
Jul 02 21:00:04.049660 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:04.049635    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db9cee37-cf1e-495b-aa2a-ffb7f336a658-credential-socket\") pod \"db9cee37-cf1e-495b-aa2a-ffb7f336a658\" (UID: \"db9cee37-cf1e-495b-aa2a-ffb7f336a658\") "
Jul 02 21:00:04.049789 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:04.049672    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db9cee37-cf1e-495b-aa2a-ffb7f336a658-workload-certs\") pod \"db9cee37-cf1e-495b-aa2a-ffb7f336a658\" (UID: \"db9cee37-cf1e-495b-aa2a-ffb7f336a658\") "
Jul 02 21:00:04.049789 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:04.049690    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db9cee37-cf1e-495b-aa2a-ffb7f336a658-istio-token\") pod \"db9cee37-cf1e-495b-aa2a-ffb7f336a658\" (UID: \"db9cee37-cf1e-495b-aa2a-ffb7f336a658\") "
Jul 02 21:00:04.049789 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:04.049707    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db9cee37-cf1e-495b-aa2a-ffb7f336a658-workload-socket\") pod \"db9cee37-cf1e-495b-aa2a-ffb7f336a658\" (UID: \"db9cee37-cf1e-495b-aa2a-ffb7f336a658\") "
Jul 02 21:00:04.049789 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:04.049778    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db9cee37-cf1e-495b-aa2a-ffb7f336a658-istio-podinfo\") pod \"db9cee37-cf1e-495b-aa2a-ffb7f336a658\" (UID: \"db9cee37-cf1e-495b-aa2a-ffb7f336a658\") "
Jul 02 21:00:04.050023 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:04.049830    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db9cee37-cf1e-495b-aa2a-ffb7f336a658-istio-envoy\") pod \"db9cee37-cf1e-495b-aa2a-ffb7f336a658\" (UID: \"db9cee37-cf1e-495b-aa2a-ffb7f336a658\") "
Jul 02 21:00:04.050023 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:04.049872    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db9cee37-cf1e-495b-aa2a-ffb7f336a658-istio-data\") pod \"db9cee37-cf1e-495b-aa2a-ffb7f336a658\" (UID: \"db9cee37-cf1e-495b-aa2a-ffb7f336a658\") "
Jul 02 21:00:04.050023 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:04.049897    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db9cee37-cf1e-495b-aa2a-ffb7f336a658-istiod-ca-cert\") pod \"db9cee37-cf1e-495b-aa2a-ffb7f336a658\" (UID: \"db9cee37-cf1e-495b-aa2a-ffb7f336a658\") "
Jul 02 21:00:04.050023 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:04.049937    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqs8n\" (UniqueName: \"kubernetes.io/projected/db9cee37-cf1e-495b-aa2a-ffb7f336a658-kube-api-access-xqs8n\") pod \"db9cee37-cf1e-495b-aa2a-ffb7f336a658\" (UID: \"db9cee37-cf1e-495b-aa2a-ffb7f336a658\") "
Jul 02 21:00:04.050023 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:04.049936    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db9cee37-cf1e-495b-aa2a-ffb7f336a658-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "db9cee37-cf1e-495b-aa2a-ffb7f336a658" (UID: "db9cee37-cf1e-495b-aa2a-ffb7f336a658"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:00:04.050023 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:04.049952    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db9cee37-cf1e-495b-aa2a-ffb7f336a658-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "db9cee37-cf1e-495b-aa2a-ffb7f336a658" (UID: "db9cee37-cf1e-495b-aa2a-ffb7f336a658"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:00:04.050345 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:04.050101    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db9cee37-cf1e-495b-aa2a-ffb7f336a658-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "db9cee37-cf1e-495b-aa2a-ffb7f336a658" (UID: "db9cee37-cf1e-495b-aa2a-ffb7f336a658"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:00:04.050345 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:04.050305    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db9cee37-cf1e-495b-aa2a-ffb7f336a658-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "db9cee37-cf1e-495b-aa2a-ffb7f336a658" (UID: "db9cee37-cf1e-495b-aa2a-ffb7f336a658"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:00:04.050711 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:04.050684    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db9cee37-cf1e-495b-aa2a-ffb7f336a658-istiod-ca-cert\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:00:04.050711 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:04.050707    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db9cee37-cf1e-495b-aa2a-ffb7f336a658-credential-socket\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:00:04.050864 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:04.050722    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db9cee37-cf1e-495b-aa2a-ffb7f336a658-workload-certs\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:00:04.050864 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:04.050739    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db9cee37-cf1e-495b-aa2a-ffb7f336a658-workload-socket\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:00:04.050864 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:04.050772    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db9cee37-cf1e-495b-aa2a-ffb7f336a658-istio-data" (OuterVolumeSpecName: "istio-data") pod "db9cee37-cf1e-495b-aa2a-ffb7f336a658" (UID: "db9cee37-cf1e-495b-aa2a-ffb7f336a658"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:00:04.051830 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:04.051809    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db9cee37-cf1e-495b-aa2a-ffb7f336a658-istio-token" (OuterVolumeSpecName: "istio-token") pod "db9cee37-cf1e-495b-aa2a-ffb7f336a658" (UID: "db9cee37-cf1e-495b-aa2a-ffb7f336a658"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:00:04.052099 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:04.052075    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db9cee37-cf1e-495b-aa2a-ffb7f336a658-kube-api-access-xqs8n" (OuterVolumeSpecName: "kube-api-access-xqs8n") pod "db9cee37-cf1e-495b-aa2a-ffb7f336a658" (UID: "db9cee37-cf1e-495b-aa2a-ffb7f336a658"). InnerVolumeSpecName "kube-api-access-xqs8n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:00:04.052306 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:04.052287    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db9cee37-cf1e-495b-aa2a-ffb7f336a658-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "db9cee37-cf1e-495b-aa2a-ffb7f336a658" (UID: "db9cee37-cf1e-495b-aa2a-ffb7f336a658"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:00:04.052363 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:04.052328    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/db9cee37-cf1e-495b-aa2a-ffb7f336a658-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "db9cee37-cf1e-495b-aa2a-ffb7f336a658" (UID: "db9cee37-cf1e-495b-aa2a-ffb7f336a658"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 21:00:04.151079 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:04.151047    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db9cee37-cf1e-495b-aa2a-ffb7f336a658-istio-podinfo\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:00:04.151079 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:04.151073    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db9cee37-cf1e-495b-aa2a-ffb7f336a658-istio-envoy\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:00:04.151079 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:04.151083    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db9cee37-cf1e-495b-aa2a-ffb7f336a658-istio-data\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:00:04.151401 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:04.151091    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqs8n\" (UniqueName: \"kubernetes.io/projected/db9cee37-cf1e-495b-aa2a-ffb7f336a658-kube-api-access-xqs8n\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:00:04.151401 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:04.151101    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db9cee37-cf1e-495b-aa2a-ffb7f336a658-istio-token\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:00:04.292182 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:04.292152    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz"]
Jul 02 21:00:04.298376 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:04.298350    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-27c57383-openshift-default-7cbdf6f547-r8zqz"]
Jul 02 21:00:04.881877 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:04.881832    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db9cee37-cf1e-495b-aa2a-ffb7f336a658" path="/var/lib/kubelet/pods/db9cee37-cf1e-495b-aa2a-ffb7f336a658/volumes"
Jul 02 21:00:05.117803 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:05.117769    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:05.207658 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:05.207550    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:05.397281 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:05.397234    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:10.971493 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:10.971463    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:11.071451 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:11.071416    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:17.402689 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:17.402655    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:17.699815 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:17.699736    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74"]
Jul 02 21:00:17.700088 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:17.700076    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db9cee37-cf1e-495b-aa2a-ffb7f336a658" containerName="istio-proxy"
Jul 02 21:00:17.700131 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:17.700090    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="db9cee37-cf1e-495b-aa2a-ffb7f336a658" containerName="istio-proxy"
Jul 02 21:00:17.700184 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:17.700172    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="db9cee37-cf1e-495b-aa2a-ffb7f336a658" containerName="istio-proxy"
Jul 02 21:00:17.700184 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:17.700181    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="db9cee37-cf1e-495b-aa2a-ffb7f336a658" containerName="istio-proxy"
Jul 02 21:00:17.704574 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:17.704557    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74"
Jul 02 21:00:17.707369 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:17.707347    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-7600a295-openshift-default-dockercfg-xz28b\""
Jul 02 21:00:17.717240 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:17.717216    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74"]
Jul 02 21:00:17.725497 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:17.725472    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:17.761444 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:17.761415    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12b2dc75-baa4-4840-b6d4-0755e7ba34da-istio-podinfo\") pod \"e2e-mt-7600a295-openshift-default-99bd76df9-l7s74\" (UID: \"12b2dc75-baa4-4840-b6d4-0755e7ba34da\") " pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74"
Jul 02 21:00:17.761613 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:17.761449    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12b2dc75-baa4-4840-b6d4-0755e7ba34da-istiod-ca-cert\") pod \"e2e-mt-7600a295-openshift-default-99bd76df9-l7s74\" (UID: \"12b2dc75-baa4-4840-b6d4-0755e7ba34da\") " pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74"
Jul 02 21:00:17.761613 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:17.761478    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pztst\" (UniqueName: \"kubernetes.io/projected/12b2dc75-baa4-4840-b6d4-0755e7ba34da-kube-api-access-pztst\") pod \"e2e-mt-7600a295-openshift-default-99bd76df9-l7s74\" (UID: \"12b2dc75-baa4-4840-b6d4-0755e7ba34da\") " pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74"
Jul 02 21:00:17.761613 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:17.761511    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12b2dc75-baa4-4840-b6d4-0755e7ba34da-workload-certs\") pod \"e2e-mt-7600a295-openshift-default-99bd76df9-l7s74\" (UID: \"12b2dc75-baa4-4840-b6d4-0755e7ba34da\") " pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74"
Jul 02 21:00:17.761613 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:17.761532    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12b2dc75-baa4-4840-b6d4-0755e7ba34da-istio-data\") pod \"e2e-mt-7600a295-openshift-default-99bd76df9-l7s74\" (UID: \"12b2dc75-baa4-4840-b6d4-0755e7ba34da\") " pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74"
Jul 02 21:00:17.761613 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:17.761589    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12b2dc75-baa4-4840-b6d4-0755e7ba34da-workload-socket\") pod \"e2e-mt-7600a295-openshift-default-99bd76df9-l7s74\" (UID: \"12b2dc75-baa4-4840-b6d4-0755e7ba34da\") " pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74"
Jul 02 21:00:17.761921 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:17.761621    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12b2dc75-baa4-4840-b6d4-0755e7ba34da-credential-socket\") pod \"e2e-mt-7600a295-openshift-default-99bd76df9-l7s74\" (UID: \"12b2dc75-baa4-4840-b6d4-0755e7ba34da\") " pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74"
Jul 02 21:00:17.761921 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:17.761650    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12b2dc75-baa4-4840-b6d4-0755e7ba34da-istio-token\") pod \"e2e-mt-7600a295-openshift-default-99bd76df9-l7s74\" (UID: \"12b2dc75-baa4-4840-b6d4-0755e7ba34da\") " pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74"
Jul 02 21:00:17.761921 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:17.761678    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12b2dc75-baa4-4840-b6d4-0755e7ba34da-istio-envoy\") pod \"e2e-mt-7600a295-openshift-default-99bd76df9-l7s74\" (UID: \"12b2dc75-baa4-4840-b6d4-0755e7ba34da\") " pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74"
Jul 02 21:00:17.862791 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:17.862749    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12b2dc75-baa4-4840-b6d4-0755e7ba34da-workload-certs\") pod \"e2e-mt-7600a295-openshift-default-99bd76df9-l7s74\" (UID: \"12b2dc75-baa4-4840-b6d4-0755e7ba34da\") " pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74"
Jul 02 21:00:17.862791 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:17.862793    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12b2dc75-baa4-4840-b6d4-0755e7ba34da-istio-data\") pod \"e2e-mt-7600a295-openshift-default-99bd76df9-l7s74\" (UID: \"12b2dc75-baa4-4840-b6d4-0755e7ba34da\") " pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74"
Jul 02 21:00:17.863048 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:17.862849    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12b2dc75-baa4-4840-b6d4-0755e7ba34da-workload-socket\") pod \"e2e-mt-7600a295-openshift-default-99bd76df9-l7s74\" (UID: \"12b2dc75-baa4-4840-b6d4-0755e7ba34da\") " pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74"
Jul 02 21:00:17.863048 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:17.862888    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12b2dc75-baa4-4840-b6d4-0755e7ba34da-credential-socket\") pod \"e2e-mt-7600a295-openshift-default-99bd76df9-l7s74\" (UID: \"12b2dc75-baa4-4840-b6d4-0755e7ba34da\") " pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74"
Jul 02 21:00:17.863048 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:17.863032    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12b2dc75-baa4-4840-b6d4-0755e7ba34da-istio-token\") pod \"e2e-mt-7600a295-openshift-default-99bd76df9-l7s74\" (UID: \"12b2dc75-baa4-4840-b6d4-0755e7ba34da\") " pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74"
Jul 02 21:00:17.863240 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:17.863090    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12b2dc75-baa4-4840-b6d4-0755e7ba34da-istio-envoy\") pod \"e2e-mt-7600a295-openshift-default-99bd76df9-l7s74\" (UID: \"12b2dc75-baa4-4840-b6d4-0755e7ba34da\") " pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74"
Jul 02 21:00:17.863240 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:17.863213    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12b2dc75-baa4-4840-b6d4-0755e7ba34da-istio-podinfo\") pod \"e2e-mt-7600a295-openshift-default-99bd76df9-l7s74\" (UID: \"12b2dc75-baa4-4840-b6d4-0755e7ba34da\") " pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74"
Jul 02 21:00:17.863355 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:17.863244    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12b2dc75-baa4-4840-b6d4-0755e7ba34da-istiod-ca-cert\") pod \"e2e-mt-7600a295-openshift-default-99bd76df9-l7s74\" (UID: \"12b2dc75-baa4-4840-b6d4-0755e7ba34da\") " pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74"
Jul 02 21:00:17.863355 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:17.863279    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12b2dc75-baa4-4840-b6d4-0755e7ba34da-workload-socket\") pod \"e2e-mt-7600a295-openshift-default-99bd76df9-l7s74\" (UID: \"12b2dc75-baa4-4840-b6d4-0755e7ba34da\") " pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74"
Jul 02 21:00:17.863355 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:17.863284    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12b2dc75-baa4-4840-b6d4-0755e7ba34da-workload-certs\") pod \"e2e-mt-7600a295-openshift-default-99bd76df9-l7s74\" (UID: \"12b2dc75-baa4-4840-b6d4-0755e7ba34da\") " pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74"
Jul 02 21:00:17.863355 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:17.863284    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pztst\" (UniqueName: \"kubernetes.io/projected/12b2dc75-baa4-4840-b6d4-0755e7ba34da-kube-api-access-pztst\") pod \"e2e-mt-7600a295-openshift-default-99bd76df9-l7s74\" (UID: \"12b2dc75-baa4-4840-b6d4-0755e7ba34da\") " pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74"
Jul 02 21:00:17.863658 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:17.863563    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12b2dc75-baa4-4840-b6d4-0755e7ba34da-credential-socket\") pod \"e2e-mt-7600a295-openshift-default-99bd76df9-l7s74\" (UID: \"12b2dc75-baa4-4840-b6d4-0755e7ba34da\") " pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74"
Jul 02 21:00:17.863887 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:17.863862    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12b2dc75-baa4-4840-b6d4-0755e7ba34da-istio-data\") pod \"e2e-mt-7600a295-openshift-default-99bd76df9-l7s74\" (UID: \"12b2dc75-baa4-4840-b6d4-0755e7ba34da\") " pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74"
Jul 02 21:00:17.864276 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:17.864232    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12b2dc75-baa4-4840-b6d4-0755e7ba34da-istiod-ca-cert\") pod \"e2e-mt-7600a295-openshift-default-99bd76df9-l7s74\" (UID: \"12b2dc75-baa4-4840-b6d4-0755e7ba34da\") " pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74"
Jul 02 21:00:17.866208 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:17.866166    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12b2dc75-baa4-4840-b6d4-0755e7ba34da-istio-envoy\") pod \"e2e-mt-7600a295-openshift-default-99bd76df9-l7s74\" (UID: \"12b2dc75-baa4-4840-b6d4-0755e7ba34da\") " pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74"
Jul 02 21:00:17.866526 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:17.866505    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12b2dc75-baa4-4840-b6d4-0755e7ba34da-istio-podinfo\") pod \"e2e-mt-7600a295-openshift-default-99bd76df9-l7s74\" (UID: \"12b2dc75-baa4-4840-b6d4-0755e7ba34da\") " pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74"
Jul 02 21:00:17.871361 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:17.871338    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12b2dc75-baa4-4840-b6d4-0755e7ba34da-istio-token\") pod \"e2e-mt-7600a295-openshift-default-99bd76df9-l7s74\" (UID: \"12b2dc75-baa4-4840-b6d4-0755e7ba34da\") " pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74"
Jul 02 21:00:17.871964 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:17.871944    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pztst\" (UniqueName: \"kubernetes.io/projected/12b2dc75-baa4-4840-b6d4-0755e7ba34da-kube-api-access-pztst\") pod \"e2e-mt-7600a295-openshift-default-99bd76df9-l7s74\" (UID: \"12b2dc75-baa4-4840-b6d4-0755e7ba34da\") " pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74"
Jul 02 21:00:18.015066 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:18.015028    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74"
Jul 02 21:00:18.153178 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:18.153155    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74"]
Jul 02 21:00:18.155567 ip-10-0-135-220 kubenswrapper[2581]: W0702 21:00:18.155538    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12b2dc75_baa4_4840_b6d4_0755e7ba34da.slice/crio-2df155bbf8045c477df780185dcd5d5698c1ab2d92729d7dc36f64d6cf58dbd4 WatchSource:0}: Error finding container 2df155bbf8045c477df780185dcd5d5698c1ab2d92729d7dc36f64d6cf58dbd4: Status 404 returned error can't find the container with id 2df155bbf8045c477df780185dcd5d5698c1ab2d92729d7dc36f64d6cf58dbd4
Jul 02 21:00:18.157825 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:18.157790    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 21:00:18.157934 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:18.157862    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 21:00:18.157934 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:18.157888    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 21:00:18.581115 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:18.581071    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:19.049519 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:19.049478    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74" event={"ID":"12b2dc75-baa4-4840-b6d4-0755e7ba34da","Type":"ContainerStarted","Data":"3a2500fe0e7798ccec229fad54b27c6ded6235578e62a378264823666ac1e69e"}
Jul 02 21:00:19.049717 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:19.049540    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74" event={"ID":"12b2dc75-baa4-4840-b6d4-0755e7ba34da","Type":"ContainerStarted","Data":"2df155bbf8045c477df780185dcd5d5698c1ab2d92729d7dc36f64d6cf58dbd4"}
Jul 02 21:00:19.071710 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:19.071662    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74" podStartSLOduration=2.071646116 podStartE2EDuration="2.071646116s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:00:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:00:19.070626084 +0000 UTC m=+1652.741139571" watchObservedRunningTime="2026-07-02 21:00:19.071646116 +0000 UTC m=+1652.742159610"
Jul 02 21:00:20.015686 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:20.015653    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74"
Jul 02 21:00:20.020405 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:20.020380    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74"
Jul 02 21:00:20.054750 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:20.054716    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74"
Jul 02 21:00:20.055588 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:20.055572    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74"
Jul 02 21:00:21.052866 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:21.052831    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:21.152467 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:21.152421    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:21.294915 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:21.294882    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:21.530333 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:21.530294    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:21.857385 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:21.857307    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:21.957221 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:21.957185    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:25.547797 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:25.547763    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:26.291878 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:26.291838    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 21:00:32.293822 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:32.293779    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-7600a295/e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7"]
Jul 02 21:00:32.294315 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:32.294176    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db9cee37-cf1e-495b-aa2a-ffb7f336a658" containerName="istio-proxy"
Jul 02 21:00:32.294315 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:32.294190    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="db9cee37-cf1e-495b-aa2a-ffb7f336a658" containerName="istio-proxy"
Jul 02 21:00:32.297709 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:32.297684    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-7600a295/e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7"
Jul 02 21:00:32.300962 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:32.300937    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-7600a295\"/\"openshift-service-ca.crt\""
Jul 02 21:00:32.301074 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:32.301031    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-7600a295\"/\"default-dockercfg-jdp2k\""
Jul 02 21:00:32.301167 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:32.301071    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-7600a295\"/\"e2e-lifecycle-model-7600a295-kserve-self-signed-certs\""
Jul 02 21:00:32.301167 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:32.301074    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-7600a295\"/\"kube-root-ca.crt\""
Jul 02 21:00:32.306426 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:32.306358    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-7600a295/e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7"]
Jul 02 21:00:32.322380 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:32.322356    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:32.403001 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:32.402972    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b977c07b-a083-45e0-8ea8-64adb2db94a6-tls-certs\") pod \"e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7\" (UID: \"b977c07b-a083-45e0-8ea8-64adb2db94a6\") " pod="ai-tenant-e2e-mt-7600a295/e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7"
Jul 02 21:00:32.403150 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:32.403023    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b977c07b-a083-45e0-8ea8-64adb2db94a6-home\") pod \"e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7\" (UID: \"b977c07b-a083-45e0-8ea8-64adb2db94a6\") " pod="ai-tenant-e2e-mt-7600a295/e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7"
Jul 02 21:00:32.403150 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:32.403050    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b977c07b-a083-45e0-8ea8-64adb2db94a6-tmp-dir\") pod \"e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7\" (UID: \"b977c07b-a083-45e0-8ea8-64adb2db94a6\") " pod="ai-tenant-e2e-mt-7600a295/e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7"
Jul 02 21:00:32.403150 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:32.403109    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b977c07b-a083-45e0-8ea8-64adb2db94a6-dshm\") pod \"e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7\" (UID: \"b977c07b-a083-45e0-8ea8-64adb2db94a6\") " pod="ai-tenant-e2e-mt-7600a295/e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7"
Jul 02 21:00:32.403260 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:32.403172    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps8m7\" (UniqueName: \"kubernetes.io/projected/b977c07b-a083-45e0-8ea8-64adb2db94a6-kube-api-access-ps8m7\") pod \"e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7\" (UID: \"b977c07b-a083-45e0-8ea8-64adb2db94a6\") " pod="ai-tenant-e2e-mt-7600a295/e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7"
Jul 02 21:00:32.403260 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:32.403203    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b977c07b-a083-45e0-8ea8-64adb2db94a6-model-cache\") pod \"e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7\" (UID: \"b977c07b-a083-45e0-8ea8-64adb2db94a6\") " pod="ai-tenant-e2e-mt-7600a295/e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7"
Jul 02 21:00:32.503789 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:32.503751    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b977c07b-a083-45e0-8ea8-64adb2db94a6-tmp-dir\") pod \"e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7\" (UID: \"b977c07b-a083-45e0-8ea8-64adb2db94a6\") " pod="ai-tenant-e2e-mt-7600a295/e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7"
Jul 02 21:00:32.503939 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:32.503804    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b977c07b-a083-45e0-8ea8-64adb2db94a6-dshm\") pod \"e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7\" (UID: \"b977c07b-a083-45e0-8ea8-64adb2db94a6\") " pod="ai-tenant-e2e-mt-7600a295/e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7"
Jul 02 21:00:32.503939 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:32.503916    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps8m7\" (UniqueName: \"kubernetes.io/projected/b977c07b-a083-45e0-8ea8-64adb2db94a6-kube-api-access-ps8m7\") pod \"e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7\" (UID: \"b977c07b-a083-45e0-8ea8-64adb2db94a6\") " pod="ai-tenant-e2e-mt-7600a295/e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7"
Jul 02 21:00:32.504052 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:32.503973    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b977c07b-a083-45e0-8ea8-64adb2db94a6-model-cache\") pod \"e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7\" (UID: \"b977c07b-a083-45e0-8ea8-64adb2db94a6\") " pod="ai-tenant-e2e-mt-7600a295/e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7"
Jul 02 21:00:32.504108 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:32.504052    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b977c07b-a083-45e0-8ea8-64adb2db94a6-tls-certs\") pod \"e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7\" (UID: \"b977c07b-a083-45e0-8ea8-64adb2db94a6\") " pod="ai-tenant-e2e-mt-7600a295/e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7"
Jul 02 21:00:32.504194 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:32.504119    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b977c07b-a083-45e0-8ea8-64adb2db94a6-home\") pod \"e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7\" (UID: \"b977c07b-a083-45e0-8ea8-64adb2db94a6\") " pod="ai-tenant-e2e-mt-7600a295/e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7"
Jul 02 21:00:32.504255 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:32.504217    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b977c07b-a083-45e0-8ea8-64adb2db94a6-tmp-dir\") pod \"e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7\" (UID: \"b977c07b-a083-45e0-8ea8-64adb2db94a6\") " pod="ai-tenant-e2e-mt-7600a295/e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7"
Jul 02 21:00:32.504426 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:32.504408    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b977c07b-a083-45e0-8ea8-64adb2db94a6-home\") pod \"e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7\" (UID: \"b977c07b-a083-45e0-8ea8-64adb2db94a6\") " pod="ai-tenant-e2e-mt-7600a295/e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7"
Jul 02 21:00:32.504507 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:32.504411    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b977c07b-a083-45e0-8ea8-64adb2db94a6-model-cache\") pod \"e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7\" (UID: \"b977c07b-a083-45e0-8ea8-64adb2db94a6\") " pod="ai-tenant-e2e-mt-7600a295/e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7"
Jul 02 21:00:32.506081 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:32.506059    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b977c07b-a083-45e0-8ea8-64adb2db94a6-dshm\") pod \"e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7\" (UID: \"b977c07b-a083-45e0-8ea8-64adb2db94a6\") " pod="ai-tenant-e2e-mt-7600a295/e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7"
Jul 02 21:00:32.506446 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:32.506425    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b977c07b-a083-45e0-8ea8-64adb2db94a6-tls-certs\") pod \"e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7\" (UID: \"b977c07b-a083-45e0-8ea8-64adb2db94a6\") " pod="ai-tenant-e2e-mt-7600a295/e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7"
Jul 02 21:00:32.512478 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:32.512455    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps8m7\" (UniqueName: \"kubernetes.io/projected/b977c07b-a083-45e0-8ea8-64adb2db94a6-kube-api-access-ps8m7\") pod \"e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7\" (UID: \"b977c07b-a083-45e0-8ea8-64adb2db94a6\") " pod="ai-tenant-e2e-mt-7600a295/e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7"
Jul 02 21:00:32.609699 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:32.609622    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-7600a295/e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7"
Jul 02 21:00:32.745117 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:32.745089    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-7600a295/e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7"]
Jul 02 21:00:32.747844 ip-10-0-135-220 kubenswrapper[2581]: W0702 21:00:32.747815    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb977c07b_a083_45e0_8ea8_64adb2db94a6.slice/crio-a0c9021b2c975f29783f13fd5e42a90af732d99fca3f623aff2496bc79bc340f WatchSource:0}: Error finding container a0c9021b2c975f29783f13fd5e42a90af732d99fca3f623aff2496bc79bc340f: Status 404 returned error can't find the container with id a0c9021b2c975f29783f13fd5e42a90af732d99fca3f623aff2496bc79bc340f
Jul 02 21:00:33.124354 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:33.124322    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-7600a295/e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7" event={"ID":"b977c07b-a083-45e0-8ea8-64adb2db94a6","Type":"ContainerStarted","Data":"fe5e511c51822c8313548537b33d2e0f3359cc3cecfa2b03ad88a7f43e82a041"}
Jul 02 21:00:33.124354 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:33.124361    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-7600a295/e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7" event={"ID":"b977c07b-a083-45e0-8ea8-64adb2db94a6","Type":"ContainerStarted","Data":"a0c9021b2c975f29783f13fd5e42a90af732d99fca3f623aff2496bc79bc340f"}
Jul 02 21:00:33.144396 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:33.144349    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-7600a295/e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7" podStartSLOduration=1.14433566 podStartE2EDuration="1.14433566s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:00:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:00:33.14157685 +0000 UTC m=+1666.812090342" watchObservedRunningTime="2026-07-02 21:00:33.14433566 +0000 UTC m=+1666.814849152"
Jul 02 21:00:34.131200 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:34.131169    2581 generic.go:356] "Generic (PLEG): container finished" podID="12b2dc75-baa4-4840-b6d4-0755e7ba34da" containerID="3a2500fe0e7798ccec229fad54b27c6ded6235578e62a378264823666ac1e69e" exitCode=0
Jul 02 21:00:34.131655 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:34.131221    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74" event={"ID":"12b2dc75-baa4-4840-b6d4-0755e7ba34da","Type":"ContainerDied","Data":"3a2500fe0e7798ccec229fad54b27c6ded6235578e62a378264823666ac1e69e"}
Jul 02 21:00:34.131655 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:34.131583    2581 scope.go:117] "RemoveContainer" containerID="3a2500fe0e7798ccec229fad54b27c6ded6235578e62a378264823666ac1e69e"
Jul 02 21:00:34.132512 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:34.132483    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 21:00:34.132576 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:34.132553    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 21:00:34.132616 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:34.132582    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 21:00:35.054961 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:35.054910    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74"
Jul 02 21:00:35.145793 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:35.145750    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74" event={"ID":"12b2dc75-baa4-4840-b6d4-0755e7ba34da","Type":"ContainerStarted","Data":"e5104b5c07ae275a21c69b37be000997d62d0589fb50931ce65d67d9d538c31e"}
Jul 02 21:00:36.015897 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:36.015862    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74"
Jul 02 21:00:36.016937 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:36.016919    2581 patch_prober.go:28] interesting pod/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 02 21:00:36.016998 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:36.016970    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74" podUID="12b2dc75-baa4-4840-b6d4-0755e7ba34da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 02 21:00:36.090824 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:36.090793    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 21:00:37.016206 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:37.016170    2581 patch_prober.go:28] interesting pod/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 02 21:00:37.016598 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:37.016223    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74" podUID="12b2dc75-baa4-4840-b6d4-0755e7ba34da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 02 21:00:38.016133 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:38.016097    2581 patch_prober.go:28] interesting pod/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 02 21:00:38.016334 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:38.016172    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74" podUID="12b2dc75-baa4-4840-b6d4-0755e7ba34da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 02 21:00:39.019793 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:39.019765    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74"
Jul 02 21:00:39.020258 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:39.020171    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74"
Jul 02 21:00:39.020745 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:39.020729    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74"
Jul 02 21:00:41.279219 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:41.279185    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:41.774332 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:41.774299    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:42.542257 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:42.542221    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:42.610000 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:42.609965    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-7600a295/e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7"
Jul 02 21:00:42.610000 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:42.610004    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-7600a295/e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7"
Jul 02 21:00:42.622578 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:42.622549    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-7600a295/e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7"
Jul 02 21:00:42.644295 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:42.644264    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:00:43.200806 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:00:43.200773    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-7600a295/e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7"
Jul 02 21:01:00.678406 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:00.678367    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 21:01:03.126561 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:03.126528    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:01:03.596303 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:03.596276    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:01:09.194978 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:09.194903    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:01:14.181978 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:14.181946    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-7600a295/e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7"]
Jul 02 21:01:14.275932 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:14.275895    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:01:14.795993 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:14.795960    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 21:01:24.094834 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:24.094803    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:01:24.153649 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:24.153617    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:01:29.201961 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:29.201915    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-7600a295/e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7" podUID="b977c07b-a083-45e0-8ea8-64adb2db94a6" containerName="main" containerID="cri-o://fe5e511c51822c8313548537b33d2e0f3359cc3cecfa2b03ad88a7f43e82a041" gracePeriod=45
Jul 02 21:01:29.439971 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:29.439938    2581 generic.go:356] "Generic (PLEG): container finished" podID="b977c07b-a083-45e0-8ea8-64adb2db94a6" containerID="fe5e511c51822c8313548537b33d2e0f3359cc3cecfa2b03ad88a7f43e82a041" exitCode=0
Jul 02 21:01:29.440080 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:29.439988    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-7600a295/e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7" event={"ID":"b977c07b-a083-45e0-8ea8-64adb2db94a6","Type":"ContainerDied","Data":"fe5e511c51822c8313548537b33d2e0f3359cc3cecfa2b03ad88a7f43e82a041"}
Jul 02 21:01:29.440080 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:29.440030    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-7600a295/e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7" event={"ID":"b977c07b-a083-45e0-8ea8-64adb2db94a6","Type":"ContainerDied","Data":"a0c9021b2c975f29783f13fd5e42a90af732d99fca3f623aff2496bc79bc340f"}
Jul 02 21:01:29.440080 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:29.440041    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a0c9021b2c975f29783f13fd5e42a90af732d99fca3f623aff2496bc79bc340f"
Jul 02 21:01:29.453526 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:29.453481    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-7600a295/e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7"
Jul 02 21:01:29.610835 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:29.610809    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b977c07b-a083-45e0-8ea8-64adb2db94a6-tmp-dir\") pod \"b977c07b-a083-45e0-8ea8-64adb2db94a6\" (UID: \"b977c07b-a083-45e0-8ea8-64adb2db94a6\") "
Jul 02 21:01:29.610835 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:29.610837    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b977c07b-a083-45e0-8ea8-64adb2db94a6-dshm\") pod \"b977c07b-a083-45e0-8ea8-64adb2db94a6\" (UID: \"b977c07b-a083-45e0-8ea8-64adb2db94a6\") "
Jul 02 21:01:29.611057 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:29.610860    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b977c07b-a083-45e0-8ea8-64adb2db94a6-tls-certs\") pod \"b977c07b-a083-45e0-8ea8-64adb2db94a6\" (UID: \"b977c07b-a083-45e0-8ea8-64adb2db94a6\") "
Jul 02 21:01:29.611057 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:29.610925    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ps8m7\" (UniqueName: \"kubernetes.io/projected/b977c07b-a083-45e0-8ea8-64adb2db94a6-kube-api-access-ps8m7\") pod \"b977c07b-a083-45e0-8ea8-64adb2db94a6\" (UID: \"b977c07b-a083-45e0-8ea8-64adb2db94a6\") "
Jul 02 21:01:29.611057 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:29.610944    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b977c07b-a083-45e0-8ea8-64adb2db94a6-model-cache\") pod \"b977c07b-a083-45e0-8ea8-64adb2db94a6\" (UID: \"b977c07b-a083-45e0-8ea8-64adb2db94a6\") "
Jul 02 21:01:29.611057 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:29.611024    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b977c07b-a083-45e0-8ea8-64adb2db94a6-home\") pod \"b977c07b-a083-45e0-8ea8-64adb2db94a6\" (UID: \"b977c07b-a083-45e0-8ea8-64adb2db94a6\") "
Jul 02 21:01:29.611314 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:29.611087    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b977c07b-a083-45e0-8ea8-64adb2db94a6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b977c07b-a083-45e0-8ea8-64adb2db94a6" (UID: "b977c07b-a083-45e0-8ea8-64adb2db94a6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:01:29.611314 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:29.611290    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b977c07b-a083-45e0-8ea8-64adb2db94a6-model-cache" (OuterVolumeSpecName: "model-cache") pod "b977c07b-a083-45e0-8ea8-64adb2db94a6" (UID: "b977c07b-a083-45e0-8ea8-64adb2db94a6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:01:29.611314 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:29.611300    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b977c07b-a083-45e0-8ea8-64adb2db94a6-home" (OuterVolumeSpecName: "home") pod "b977c07b-a083-45e0-8ea8-64adb2db94a6" (UID: "b977c07b-a083-45e0-8ea8-64adb2db94a6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:01:29.611314 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:29.611301    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b977c07b-a083-45e0-8ea8-64adb2db94a6-tmp-dir\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:01:29.613067 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:29.613047    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b977c07b-a083-45e0-8ea8-64adb2db94a6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b977c07b-a083-45e0-8ea8-64adb2db94a6" (UID: "b977c07b-a083-45e0-8ea8-64adb2db94a6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:01:29.613188 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:29.613106    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b977c07b-a083-45e0-8ea8-64adb2db94a6-kube-api-access-ps8m7" (OuterVolumeSpecName: "kube-api-access-ps8m7") pod "b977c07b-a083-45e0-8ea8-64adb2db94a6" (UID: "b977c07b-a083-45e0-8ea8-64adb2db94a6"). InnerVolumeSpecName "kube-api-access-ps8m7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:01:29.613255 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:29.613189    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b977c07b-a083-45e0-8ea8-64adb2db94a6-dshm" (OuterVolumeSpecName: "dshm") pod "b977c07b-a083-45e0-8ea8-64adb2db94a6" (UID: "b977c07b-a083-45e0-8ea8-64adb2db94a6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:01:29.711700 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:29.711679    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b977c07b-a083-45e0-8ea8-64adb2db94a6-tls-certs\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:01:29.711800 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:29.711702    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ps8m7\" (UniqueName: \"kubernetes.io/projected/b977c07b-a083-45e0-8ea8-64adb2db94a6-kube-api-access-ps8m7\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:01:29.711800 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:29.711712    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b977c07b-a083-45e0-8ea8-64adb2db94a6-model-cache\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:01:29.711800 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:29.711727    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b977c07b-a083-45e0-8ea8-64adb2db94a6-home\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:01:29.711800 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:29.711734    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b977c07b-a083-45e0-8ea8-64adb2db94a6-dshm\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:01:30.444988 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:30.444956    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-7600a295/e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7"
Jul 02 21:01:30.465565 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:30.465544    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-7600a295/e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7"]
Jul 02 21:01:30.469201 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:30.469181    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-7600a295/e2e-lifecycle-model-7600a295-kserve-744bc5976c-htvk7"]
Jul 02 21:01:30.881122 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:30.881090    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b977c07b-a083-45e0-8ea8-64adb2db94a6" path="/var/lib/kubelet/pods/b977c07b-a083-45e0-8ea8-64adb2db94a6/volumes"
Jul 02 21:01:50.322820 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:50.322786    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:01:52.032567 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:52.032526    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:01:53.493125 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:53.493090    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 21:01:57.606074 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:57.606039    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:01:57.706031 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:57.706004    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:01:57.836395 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:57.836362    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:01:57.866835 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:57.866758    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74"]
Jul 02 21:01:57.867000 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:57.866975    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74" podUID="12b2dc75-baa4-4840-b6d4-0755e7ba34da" containerName="istio-proxy" containerID="cri-o://e5104b5c07ae275a21c69b37be000997d62d0589fb50931ce65d67d9d538c31e" gracePeriod=30
Jul 02 21:01:57.907751 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:57.907718    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:01:59.188158 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:59.188104    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:01:59.286850 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:59.286822    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:01:59.387275 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:01:59.387235    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:02:00.095629 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:00.095589    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:02:00.195471 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:00.195435    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:02:00.294596 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:00.294562    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:02:01.742916 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:01.742880    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:02:02.798762 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:02.798727    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 21:02:03.126641 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:03.126615    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74"
Jul 02 21:02:03.191472 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:03.191444    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12b2dc75-baa4-4840-b6d4-0755e7ba34da-workload-certs\") pod \"12b2dc75-baa4-4840-b6d4-0755e7ba34da\" (UID: \"12b2dc75-baa4-4840-b6d4-0755e7ba34da\") "
Jul 02 21:02:03.191612 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:03.191482    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12b2dc75-baa4-4840-b6d4-0755e7ba34da-istio-token\") pod \"12b2dc75-baa4-4840-b6d4-0755e7ba34da\" (UID: \"12b2dc75-baa4-4840-b6d4-0755e7ba34da\") "
Jul 02 21:02:03.191612 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:03.191535    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12b2dc75-baa4-4840-b6d4-0755e7ba34da-istio-data\") pod \"12b2dc75-baa4-4840-b6d4-0755e7ba34da\" (UID: \"12b2dc75-baa4-4840-b6d4-0755e7ba34da\") "
Jul 02 21:02:03.191612 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:03.191568    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12b2dc75-baa4-4840-b6d4-0755e7ba34da-istiod-ca-cert\") pod \"12b2dc75-baa4-4840-b6d4-0755e7ba34da\" (UID: \"12b2dc75-baa4-4840-b6d4-0755e7ba34da\") "
Jul 02 21:02:03.191612 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:03.191595    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12b2dc75-baa4-4840-b6d4-0755e7ba34da-istio-envoy\") pod \"12b2dc75-baa4-4840-b6d4-0755e7ba34da\" (UID: \"12b2dc75-baa4-4840-b6d4-0755e7ba34da\") "
Jul 02 21:02:03.191830 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:03.191639    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pztst\" (UniqueName: \"kubernetes.io/projected/12b2dc75-baa4-4840-b6d4-0755e7ba34da-kube-api-access-pztst\") pod \"12b2dc75-baa4-4840-b6d4-0755e7ba34da\" (UID: \"12b2dc75-baa4-4840-b6d4-0755e7ba34da\") "
Jul 02 21:02:03.191830 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:03.191672    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12b2dc75-baa4-4840-b6d4-0755e7ba34da-credential-socket\") pod \"12b2dc75-baa4-4840-b6d4-0755e7ba34da\" (UID: \"12b2dc75-baa4-4840-b6d4-0755e7ba34da\") "
Jul 02 21:02:03.191830 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:03.191696    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12b2dc75-baa4-4840-b6d4-0755e7ba34da-workload-socket\") pod \"12b2dc75-baa4-4840-b6d4-0755e7ba34da\" (UID: \"12b2dc75-baa4-4840-b6d4-0755e7ba34da\") "
Jul 02 21:02:03.191830 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:03.191746    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12b2dc75-baa4-4840-b6d4-0755e7ba34da-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "12b2dc75-baa4-4840-b6d4-0755e7ba34da" (UID: "12b2dc75-baa4-4840-b6d4-0755e7ba34da"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:02:03.191830 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:03.191756    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12b2dc75-baa4-4840-b6d4-0755e7ba34da-istio-podinfo\") pod \"12b2dc75-baa4-4840-b6d4-0755e7ba34da\" (UID: \"12b2dc75-baa4-4840-b6d4-0755e7ba34da\") "
Jul 02 21:02:03.192092 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:03.191920    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12b2dc75-baa4-4840-b6d4-0755e7ba34da-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "12b2dc75-baa4-4840-b6d4-0755e7ba34da" (UID: "12b2dc75-baa4-4840-b6d4-0755e7ba34da"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:02:03.192092 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:03.191970    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12b2dc75-baa4-4840-b6d4-0755e7ba34da-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "12b2dc75-baa4-4840-b6d4-0755e7ba34da" (UID: "12b2dc75-baa4-4840-b6d4-0755e7ba34da"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:02:03.192092 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:03.192025    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12b2dc75-baa4-4840-b6d4-0755e7ba34da-workload-certs\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:02:03.192092 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:03.192043    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12b2dc75-baa4-4840-b6d4-0755e7ba34da-istiod-ca-cert\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:02:03.192331 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:03.192189    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12b2dc75-baa4-4840-b6d4-0755e7ba34da-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "12b2dc75-baa4-4840-b6d4-0755e7ba34da" (UID: "12b2dc75-baa4-4840-b6d4-0755e7ba34da"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:02:03.192457 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:03.192437    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12b2dc75-baa4-4840-b6d4-0755e7ba34da-istio-data" (OuterVolumeSpecName: "istio-data") pod "12b2dc75-baa4-4840-b6d4-0755e7ba34da" (UID: "12b2dc75-baa4-4840-b6d4-0755e7ba34da"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:02:03.193886 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:03.193846    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/12b2dc75-baa4-4840-b6d4-0755e7ba34da-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "12b2dc75-baa4-4840-b6d4-0755e7ba34da" (UID: "12b2dc75-baa4-4840-b6d4-0755e7ba34da"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 21:02:03.193886 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:03.193879    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12b2dc75-baa4-4840-b6d4-0755e7ba34da-istio-token" (OuterVolumeSpecName: "istio-token") pod "12b2dc75-baa4-4840-b6d4-0755e7ba34da" (UID: "12b2dc75-baa4-4840-b6d4-0755e7ba34da"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:02:03.194226 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:03.194205    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12b2dc75-baa4-4840-b6d4-0755e7ba34da-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "12b2dc75-baa4-4840-b6d4-0755e7ba34da" (UID: "12b2dc75-baa4-4840-b6d4-0755e7ba34da"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:02:03.194299 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:03.194227    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12b2dc75-baa4-4840-b6d4-0755e7ba34da-kube-api-access-pztst" (OuterVolumeSpecName: "kube-api-access-pztst") pod "12b2dc75-baa4-4840-b6d4-0755e7ba34da" (UID: "12b2dc75-baa4-4840-b6d4-0755e7ba34da"). InnerVolumeSpecName "kube-api-access-pztst". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:02:03.292841 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:03.292809    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12b2dc75-baa4-4840-b6d4-0755e7ba34da-istio-data\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:02:03.292841 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:03.292835    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12b2dc75-baa4-4840-b6d4-0755e7ba34da-istio-envoy\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:02:03.292841 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:03.292844    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pztst\" (UniqueName: \"kubernetes.io/projected/12b2dc75-baa4-4840-b6d4-0755e7ba34da-kube-api-access-pztst\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:02:03.293036 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:03.292854    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12b2dc75-baa4-4840-b6d4-0755e7ba34da-credential-socket\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:02:03.293036 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:03.292863    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12b2dc75-baa4-4840-b6d4-0755e7ba34da-workload-socket\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:02:03.293036 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:03.292871    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12b2dc75-baa4-4840-b6d4-0755e7ba34da-istio-podinfo\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:02:03.293036 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:03.292878    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12b2dc75-baa4-4840-b6d4-0755e7ba34da-istio-token\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:02:03.614454 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:03.614417    2581 generic.go:356] "Generic (PLEG): container finished" podID="12b2dc75-baa4-4840-b6d4-0755e7ba34da" containerID="e5104b5c07ae275a21c69b37be000997d62d0589fb50931ce65d67d9d538c31e" exitCode=0
Jul 02 21:02:03.614635 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:03.614476    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74" event={"ID":"12b2dc75-baa4-4840-b6d4-0755e7ba34da","Type":"ContainerDied","Data":"e5104b5c07ae275a21c69b37be000997d62d0589fb50931ce65d67d9d538c31e"}
Jul 02 21:02:03.614635 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:03.614525    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74" event={"ID":"12b2dc75-baa4-4840-b6d4-0755e7ba34da","Type":"ContainerDied","Data":"2df155bbf8045c477df780185dcd5d5698c1ab2d92729d7dc36f64d6cf58dbd4"}
Jul 02 21:02:03.614635 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:03.614480    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74"
Jul 02 21:02:03.614765 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:03.614554    2581 scope.go:117] "RemoveContainer" containerID="e5104b5c07ae275a21c69b37be000997d62d0589fb50931ce65d67d9d538c31e"
Jul 02 21:02:03.623837 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:03.623822    2581 scope.go:117] "RemoveContainer" containerID="3a2500fe0e7798ccec229fad54b27c6ded6235578e62a378264823666ac1e69e"
Jul 02 21:02:03.634247 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:03.634229    2581 scope.go:117] "RemoveContainer" containerID="e5104b5c07ae275a21c69b37be000997d62d0589fb50931ce65d67d9d538c31e"
Jul 02 21:02:03.634504 ip-10-0-135-220 kubenswrapper[2581]: E0702 21:02:03.634486    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5104b5c07ae275a21c69b37be000997d62d0589fb50931ce65d67d9d538c31e\": container with ID starting with e5104b5c07ae275a21c69b37be000997d62d0589fb50931ce65d67d9d538c31e not found: ID does not exist" containerID="e5104b5c07ae275a21c69b37be000997d62d0589fb50931ce65d67d9d538c31e"
Jul 02 21:02:03.634571 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:03.634511    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5104b5c07ae275a21c69b37be000997d62d0589fb50931ce65d67d9d538c31e"} err="failed to get container status \"e5104b5c07ae275a21c69b37be000997d62d0589fb50931ce65d67d9d538c31e\": rpc error: code = NotFound desc = could not find container \"e5104b5c07ae275a21c69b37be000997d62d0589fb50931ce65d67d9d538c31e\": container with ID starting with e5104b5c07ae275a21c69b37be000997d62d0589fb50931ce65d67d9d538c31e not found: ID does not exist"
Jul 02 21:02:03.634571 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:03.634527    2581 scope.go:117] "RemoveContainer" containerID="3a2500fe0e7798ccec229fad54b27c6ded6235578e62a378264823666ac1e69e"
Jul 02 21:02:03.634772 ip-10-0-135-220 kubenswrapper[2581]: E0702 21:02:03.634751    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a2500fe0e7798ccec229fad54b27c6ded6235578e62a378264823666ac1e69e\": container with ID starting with 3a2500fe0e7798ccec229fad54b27c6ded6235578e62a378264823666ac1e69e not found: ID does not exist" containerID="3a2500fe0e7798ccec229fad54b27c6ded6235578e62a378264823666ac1e69e"
Jul 02 21:02:03.634826 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:03.634782    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a2500fe0e7798ccec229fad54b27c6ded6235578e62a378264823666ac1e69e"} err="failed to get container status \"3a2500fe0e7798ccec229fad54b27c6ded6235578e62a378264823666ac1e69e\": rpc error: code = NotFound desc = could not find container \"3a2500fe0e7798ccec229fad54b27c6ded6235578e62a378264823666ac1e69e\": container with ID starting with 3a2500fe0e7798ccec229fad54b27c6ded6235578e62a378264823666ac1e69e not found: ID does not exist"
Jul 02 21:02:03.641056 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:03.641035    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74"]
Jul 02 21:02:03.643102 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:03.643081    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-7600a295-openshift-default-99bd76df9-l7s74"]
Jul 02 21:02:04.884606 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:04.884571    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12b2dc75-baa4-4840-b6d4-0755e7ba34da" path="/var/lib/kubelet/pods/12b2dc75-baa4-4840-b6d4-0755e7ba34da/volumes"
Jul 02 21:02:07.458881 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:07.458850    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:02:07.557686 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:07.557657    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:02:08.195194 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:08.195160    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:02:13.888825 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:13.888785    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:02:13.992747 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:13.992719    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:02:14.086456 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:14.086415    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:02:15.695928 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:15.695894    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 21:02:24.611361 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:24.611325    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:02:24.955893 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:24.955806    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:02:45.992948 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:45.992915    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:02:51.859018 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:51.858990    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:02:51.921605 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:51.921578    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:02:52.235821 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:52.235793    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:02:52.538701 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:52.538625    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr"]
Jul 02 21:02:52.539002 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:52.538989    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b977c07b-a083-45e0-8ea8-64adb2db94a6" containerName="main"
Jul 02 21:02:52.539045 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:52.539006    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b977c07b-a083-45e0-8ea8-64adb2db94a6" containerName="main"
Jul 02 21:02:52.539045 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:52.539030    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12b2dc75-baa4-4840-b6d4-0755e7ba34da" containerName="istio-proxy"
Jul 02 21:02:52.539045 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:52.539037    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="12b2dc75-baa4-4840-b6d4-0755e7ba34da" containerName="istio-proxy"
Jul 02 21:02:52.539045 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:52.539044    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12b2dc75-baa4-4840-b6d4-0755e7ba34da" containerName="istio-proxy"
Jul 02 21:02:52.539193 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:52.539049    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="12b2dc75-baa4-4840-b6d4-0755e7ba34da" containerName="istio-proxy"
Jul 02 21:02:52.539193 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:52.539107    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="12b2dc75-baa4-4840-b6d4-0755e7ba34da" containerName="istio-proxy"
Jul 02 21:02:52.539193 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:52.539116    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b977c07b-a083-45e0-8ea8-64adb2db94a6" containerName="main"
Jul 02 21:02:52.539193 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:52.539123    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="12b2dc75-baa4-4840-b6d4-0755e7ba34da" containerName="istio-proxy"
Jul 02 21:02:52.542008 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:52.541991    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr"
Jul 02 21:02:52.544553 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:52.544534    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-c36b13-openshift-default-dockercfg-plscj\""
Jul 02 21:02:52.557713 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:52.557683    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr"]
Jul 02 21:02:52.564866 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:52.564840    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:02:52.603828 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:52.603803    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/959bdb1e-f4e7-4219-9d97-3d5263c68965-istio-token\") pod \"e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr\" (UID: \"959bdb1e-f4e7-4219-9d97-3d5263c68965\") " pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr"
Jul 02 21:02:52.603941 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:52.603832    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/959bdb1e-f4e7-4219-9d97-3d5263c68965-istiod-ca-cert\") pod \"e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr\" (UID: \"959bdb1e-f4e7-4219-9d97-3d5263c68965\") " pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr"
Jul 02 21:02:52.603941 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:52.603859    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/959bdb1e-f4e7-4219-9d97-3d5263c68965-istio-data\") pod \"e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr\" (UID: \"959bdb1e-f4e7-4219-9d97-3d5263c68965\") " pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr"
Jul 02 21:02:52.603941 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:52.603915    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/959bdb1e-f4e7-4219-9d97-3d5263c68965-istio-podinfo\") pod \"e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr\" (UID: \"959bdb1e-f4e7-4219-9d97-3d5263c68965\") " pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr"
Jul 02 21:02:52.604050 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:52.603949    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/959bdb1e-f4e7-4219-9d97-3d5263c68965-credential-socket\") pod \"e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr\" (UID: \"959bdb1e-f4e7-4219-9d97-3d5263c68965\") " pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr"
Jul 02 21:02:52.604050 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:52.603988    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/959bdb1e-f4e7-4219-9d97-3d5263c68965-workload-socket\") pod \"e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr\" (UID: \"959bdb1e-f4e7-4219-9d97-3d5263c68965\") " pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr"
Jul 02 21:02:52.604131 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:52.604050    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/959bdb1e-f4e7-4219-9d97-3d5263c68965-istio-envoy\") pod \"e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr\" (UID: \"959bdb1e-f4e7-4219-9d97-3d5263c68965\") " pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr"
Jul 02 21:02:52.604131 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:52.604092    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/959bdb1e-f4e7-4219-9d97-3d5263c68965-workload-certs\") pod \"e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr\" (UID: \"959bdb1e-f4e7-4219-9d97-3d5263c68965\") " pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr"
Jul 02 21:02:52.604219 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:52.604127    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcwlv\" (UniqueName: \"kubernetes.io/projected/959bdb1e-f4e7-4219-9d97-3d5263c68965-kube-api-access-pcwlv\") pod \"e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr\" (UID: \"959bdb1e-f4e7-4219-9d97-3d5263c68965\") " pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr"
Jul 02 21:02:52.705310 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:52.705262    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/959bdb1e-f4e7-4219-9d97-3d5263c68965-istio-podinfo\") pod \"e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr\" (UID: \"959bdb1e-f4e7-4219-9d97-3d5263c68965\") " pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr"
Jul 02 21:02:52.705474 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:52.705334    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/959bdb1e-f4e7-4219-9d97-3d5263c68965-credential-socket\") pod \"e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr\" (UID: \"959bdb1e-f4e7-4219-9d97-3d5263c68965\") " pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr"
Jul 02 21:02:52.705474 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:52.705363    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/959bdb1e-f4e7-4219-9d97-3d5263c68965-workload-socket\") pod \"e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr\" (UID: \"959bdb1e-f4e7-4219-9d97-3d5263c68965\") " pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr"
Jul 02 21:02:52.705474 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:52.705429    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/959bdb1e-f4e7-4219-9d97-3d5263c68965-istio-envoy\") pod \"e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr\" (UID: \"959bdb1e-f4e7-4219-9d97-3d5263c68965\") " pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr"
Jul 02 21:02:52.705474 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:52.705461    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/959bdb1e-f4e7-4219-9d97-3d5263c68965-workload-certs\") pod \"e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr\" (UID: \"959bdb1e-f4e7-4219-9d97-3d5263c68965\") " pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr"
Jul 02 21:02:52.705689 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:52.705487    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcwlv\" (UniqueName: \"kubernetes.io/projected/959bdb1e-f4e7-4219-9d97-3d5263c68965-kube-api-access-pcwlv\") pod \"e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr\" (UID: \"959bdb1e-f4e7-4219-9d97-3d5263c68965\") " pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr"
Jul 02 21:02:52.705689 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:52.705543    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/959bdb1e-f4e7-4219-9d97-3d5263c68965-istio-token\") pod \"e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr\" (UID: \"959bdb1e-f4e7-4219-9d97-3d5263c68965\") " pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr"
Jul 02 21:02:52.705689 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:52.705566    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/959bdb1e-f4e7-4219-9d97-3d5263c68965-istiod-ca-cert\") pod \"e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr\" (UID: \"959bdb1e-f4e7-4219-9d97-3d5263c68965\") " pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr"
Jul 02 21:02:52.705689 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:52.705601    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/959bdb1e-f4e7-4219-9d97-3d5263c68965-istio-data\") pod \"e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr\" (UID: \"959bdb1e-f4e7-4219-9d97-3d5263c68965\") " pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr"
Jul 02 21:02:52.705906 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:52.705731    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/959bdb1e-f4e7-4219-9d97-3d5263c68965-credential-socket\") pod \"e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr\" (UID: \"959bdb1e-f4e7-4219-9d97-3d5263c68965\") " pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr"
Jul 02 21:02:52.705906 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:52.705782    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/959bdb1e-f4e7-4219-9d97-3d5263c68965-workload-socket\") pod \"e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr\" (UID: \"959bdb1e-f4e7-4219-9d97-3d5263c68965\") " pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr"
Jul 02 21:02:52.706084 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:52.706050    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/959bdb1e-f4e7-4219-9d97-3d5263c68965-istio-data\") pod \"e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr\" (UID: \"959bdb1e-f4e7-4219-9d97-3d5263c68965\") " pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr"
Jul 02 21:02:52.706306 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:52.706230    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/959bdb1e-f4e7-4219-9d97-3d5263c68965-workload-certs\") pod \"e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr\" (UID: \"959bdb1e-f4e7-4219-9d97-3d5263c68965\") " pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr"
Jul 02 21:02:52.706306 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:52.706244    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/959bdb1e-f4e7-4219-9d97-3d5263c68965-istiod-ca-cert\") pod \"e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr\" (UID: \"959bdb1e-f4e7-4219-9d97-3d5263c68965\") " pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr"
Jul 02 21:02:52.707647 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:52.707622    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/959bdb1e-f4e7-4219-9d97-3d5263c68965-istio-envoy\") pod \"e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr\" (UID: \"959bdb1e-f4e7-4219-9d97-3d5263c68965\") " pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr"
Jul 02 21:02:52.707848 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:52.707832    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/959bdb1e-f4e7-4219-9d97-3d5263c68965-istio-podinfo\") pod \"e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr\" (UID: \"959bdb1e-f4e7-4219-9d97-3d5263c68965\") " pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr"
Jul 02 21:02:52.713703 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:52.713680    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/959bdb1e-f4e7-4219-9d97-3d5263c68965-istio-token\") pod \"e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr\" (UID: \"959bdb1e-f4e7-4219-9d97-3d5263c68965\") " pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr"
Jul 02 21:02:52.714046 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:52.714028    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcwlv\" (UniqueName: \"kubernetes.io/projected/959bdb1e-f4e7-4219-9d97-3d5263c68965-kube-api-access-pcwlv\") pod \"e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr\" (UID: \"959bdb1e-f4e7-4219-9d97-3d5263c68965\") " pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr"
Jul 02 21:02:52.852379 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:52.852316    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr"
Jul 02 21:02:52.989437 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:52.989410    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr"]
Jul 02 21:02:52.990901 ip-10-0-135-220 kubenswrapper[2581]: W0702 21:02:52.990871    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod959bdb1e_f4e7_4219_9d97_3d5263c68965.slice/crio-8cab2865df8d637fe2c8d7e647c86d727854bc5c46418d69c1ff07402b916c32 WatchSource:0}: Error finding container 8cab2865df8d637fe2c8d7e647c86d727854bc5c46418d69c1ff07402b916c32: Status 404 returned error can't find the container with id 8cab2865df8d637fe2c8d7e647c86d727854bc5c46418d69c1ff07402b916c32
Jul 02 21:02:52.992990 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:52.992958    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 21:02:52.993076 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:52.993021    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 21:02:52.993076 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:52.993049    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 21:02:53.274435 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:53.274397    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:02:53.879391 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:53.879356    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr" event={"ID":"959bdb1e-f4e7-4219-9d97-3d5263c68965","Type":"ContainerStarted","Data":"eebb58dd0f41a116513b3661eb176f89518ae4e9292981cb835e0d614e06d14d"}
Jul 02 21:02:53.879589 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:53.879408    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr" event={"ID":"959bdb1e-f4e7-4219-9d97-3d5263c68965","Type":"ContainerStarted","Data":"8cab2865df8d637fe2c8d7e647c86d727854bc5c46418d69c1ff07402b916c32"}
Jul 02 21:02:53.899456 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:53.899399    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr" podStartSLOduration=1.899381354 podStartE2EDuration="1.899381354s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:02:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:02:53.898850738 +0000 UTC m=+1807.569364254" watchObservedRunningTime="2026-07-02 21:02:53.899381354 +0000 UTC m=+1807.569894849"
Jul 02 21:02:54.852801 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:54.852708    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr"
Jul 02 21:02:54.857506 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:54.857480    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr"
Jul 02 21:02:54.884968 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:54.884940    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr"
Jul 02 21:02:54.885667 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:54.885646    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr"
Jul 02 21:02:56.066275 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:56.066238    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:02:56.159964 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:56.159930    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:02:56.333888 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:56.333771    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:02:56.556347 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:56.556316    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:02:56.857675 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:56.857612    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:02:56.958420 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:02:56.958387    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:03:00.496321 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:00.496282    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:03:00.852943 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:00.852838    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:03:01.130169 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:01.130074    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx"]
Jul 02 21:03:01.134434 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:01.134409    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx"
Jul 02 21:03:01.136968 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:01.136944    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-f407e7-openshift-default-dockercfg-qbpd6\""
Jul 02 21:03:01.150758 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:01.150733    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx"]
Jul 02 21:03:01.167301 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:01.167270    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:03:01.278277 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:01.278237    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4c605b1-be9b-428a-856f-48acc79e2067-istio-data\") pod \"e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx\" (UID: \"f4c605b1-be9b-428a-856f-48acc79e2067\") " pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx"
Jul 02 21:03:01.278436 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:01.278295    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4c605b1-be9b-428a-856f-48acc79e2067-workload-socket\") pod \"e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx\" (UID: \"f4c605b1-be9b-428a-856f-48acc79e2067\") " pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx"
Jul 02 21:03:01.278436 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:01.278320    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4c605b1-be9b-428a-856f-48acc79e2067-istio-podinfo\") pod \"e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx\" (UID: \"f4c605b1-be9b-428a-856f-48acc79e2067\") " pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx"
Jul 02 21:03:01.278436 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:01.278355    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4c605b1-be9b-428a-856f-48acc79e2067-istiod-ca-cert\") pod \"e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx\" (UID: \"f4c605b1-be9b-428a-856f-48acc79e2067\") " pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx"
Jul 02 21:03:01.278436 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:01.278404    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4c605b1-be9b-428a-856f-48acc79e2067-istio-envoy\") pod \"e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx\" (UID: \"f4c605b1-be9b-428a-856f-48acc79e2067\") " pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx"
Jul 02 21:03:01.278436 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:01.278435    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9cxx\" (UniqueName: \"kubernetes.io/projected/f4c605b1-be9b-428a-856f-48acc79e2067-kube-api-access-r9cxx\") pod \"e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx\" (UID: \"f4c605b1-be9b-428a-856f-48acc79e2067\") " pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx"
Jul 02 21:03:01.278612 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:01.278477    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4c605b1-be9b-428a-856f-48acc79e2067-credential-socket\") pod \"e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx\" (UID: \"f4c605b1-be9b-428a-856f-48acc79e2067\") " pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx"
Jul 02 21:03:01.278612 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:01.278498    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4c605b1-be9b-428a-856f-48acc79e2067-istio-token\") pod \"e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx\" (UID: \"f4c605b1-be9b-428a-856f-48acc79e2067\") " pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx"
Jul 02 21:03:01.278612 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:01.278519    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4c605b1-be9b-428a-856f-48acc79e2067-workload-certs\") pod \"e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx\" (UID: \"f4c605b1-be9b-428a-856f-48acc79e2067\") " pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx"
Jul 02 21:03:01.379421 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:01.379387    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4c605b1-be9b-428a-856f-48acc79e2067-istiod-ca-cert\") pod \"e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx\" (UID: \"f4c605b1-be9b-428a-856f-48acc79e2067\") " pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx"
Jul 02 21:03:01.379612 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:01.379435    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4c605b1-be9b-428a-856f-48acc79e2067-istio-envoy\") pod \"e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx\" (UID: \"f4c605b1-be9b-428a-856f-48acc79e2067\") " pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx"
Jul 02 21:03:01.379612 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:01.379460    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9cxx\" (UniqueName: \"kubernetes.io/projected/f4c605b1-be9b-428a-856f-48acc79e2067-kube-api-access-r9cxx\") pod \"e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx\" (UID: \"f4c605b1-be9b-428a-856f-48acc79e2067\") " pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx"
Jul 02 21:03:01.379612 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:01.379495    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4c605b1-be9b-428a-856f-48acc79e2067-credential-socket\") pod \"e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx\" (UID: \"f4c605b1-be9b-428a-856f-48acc79e2067\") " pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx"
Jul 02 21:03:01.379612 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:01.379525    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4c605b1-be9b-428a-856f-48acc79e2067-istio-token\") pod \"e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx\" (UID: \"f4c605b1-be9b-428a-856f-48acc79e2067\") " pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx"
Jul 02 21:03:01.379866 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:01.379713    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4c605b1-be9b-428a-856f-48acc79e2067-workload-certs\") pod \"e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx\" (UID: \"f4c605b1-be9b-428a-856f-48acc79e2067\") " pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx"
Jul 02 21:03:01.379866 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:01.379795    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4c605b1-be9b-428a-856f-48acc79e2067-istio-data\") pod \"e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx\" (UID: \"f4c605b1-be9b-428a-856f-48acc79e2067\") " pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx"
Jul 02 21:03:01.379866 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:01.379844    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4c605b1-be9b-428a-856f-48acc79e2067-workload-socket\") pod \"e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx\" (UID: \"f4c605b1-be9b-428a-856f-48acc79e2067\") " pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx"
Jul 02 21:03:01.379866 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:01.379847    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4c605b1-be9b-428a-856f-48acc79e2067-credential-socket\") pod \"e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx\" (UID: \"f4c605b1-be9b-428a-856f-48acc79e2067\") " pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx"
Jul 02 21:03:01.380085 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:01.379905    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4c605b1-be9b-428a-856f-48acc79e2067-istio-podinfo\") pod \"e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx\" (UID: \"f4c605b1-be9b-428a-856f-48acc79e2067\") " pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx"
Jul 02 21:03:01.380206 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:01.380092    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4c605b1-be9b-428a-856f-48acc79e2067-workload-certs\") pod \"e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx\" (UID: \"f4c605b1-be9b-428a-856f-48acc79e2067\") " pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx"
Jul 02 21:03:01.380206 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:01.380180    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4c605b1-be9b-428a-856f-48acc79e2067-workload-socket\") pod \"e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx\" (UID: \"f4c605b1-be9b-428a-856f-48acc79e2067\") " pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx"
Jul 02 21:03:01.380313 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:01.380279    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4c605b1-be9b-428a-856f-48acc79e2067-istio-data\") pod \"e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx\" (UID: \"f4c605b1-be9b-428a-856f-48acc79e2067\") " pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx"
Jul 02 21:03:01.380313 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:01.380298    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4c605b1-be9b-428a-856f-48acc79e2067-istiod-ca-cert\") pod \"e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx\" (UID: \"f4c605b1-be9b-428a-856f-48acc79e2067\") " pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx"
Jul 02 21:03:01.381763 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:01.381745    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4c605b1-be9b-428a-856f-48acc79e2067-istio-envoy\") pod \"e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx\" (UID: \"f4c605b1-be9b-428a-856f-48acc79e2067\") " pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx"
Jul 02 21:03:01.382474 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:01.382451    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4c605b1-be9b-428a-856f-48acc79e2067-istio-podinfo\") pod \"e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx\" (UID: \"f4c605b1-be9b-428a-856f-48acc79e2067\") " pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx"
Jul 02 21:03:01.388791 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:01.388772    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9cxx\" (UniqueName: \"kubernetes.io/projected/f4c605b1-be9b-428a-856f-48acc79e2067-kube-api-access-r9cxx\") pod \"e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx\" (UID: \"f4c605b1-be9b-428a-856f-48acc79e2067\") " pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx"
Jul 02 21:03:01.388917 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:01.388898    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4c605b1-be9b-428a-856f-48acc79e2067-istio-token\") pod \"e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx\" (UID: \"f4c605b1-be9b-428a-856f-48acc79e2067\") " pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx"
Jul 02 21:03:01.424711 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:01.424685    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:03:01.446951 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:01.446928    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx"
Jul 02 21:03:01.583981 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:01.583958    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx"]
Jul 02 21:03:01.585475 ip-10-0-135-220 kubenswrapper[2581]: W0702 21:03:01.585441    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4c605b1_be9b_428a_856f_48acc79e2067.slice/crio-aca2ce866f19da4c2647bde92592a91d81d9e3f8032cf43ca88a8c193034d7b4 WatchSource:0}: Error finding container aca2ce866f19da4c2647bde92592a91d81d9e3f8032cf43ca88a8c193034d7b4: Status 404 returned error can't find the container with id aca2ce866f19da4c2647bde92592a91d81d9e3f8032cf43ca88a8c193034d7b4
Jul 02 21:03:01.587724 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:01.587686    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 21:03:01.587822 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:01.587765    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 21:03:01.587822 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:01.587791    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 21:03:01.598528 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:01.598504    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 21:03:01.919796 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:01.919706    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx" event={"ID":"f4c605b1-be9b-428a-856f-48acc79e2067","Type":"ContainerStarted","Data":"8f363853b39ca6e6d0bcf3baf217d291a931355b1b34275bbe26a3eef19619b1"}
Jul 02 21:03:01.919796 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:01.919764    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx" event={"ID":"f4c605b1-be9b-428a-856f-48acc79e2067","Type":"ContainerStarted","Data":"aca2ce866f19da4c2647bde92592a91d81d9e3f8032cf43ca88a8c193034d7b4"}
Jul 02 21:03:01.945027 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:01.944976    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx" podStartSLOduration=0.944961164 podStartE2EDuration="944.961164ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:03:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:03:01.942454957 +0000 UTC m=+1815.612968455" watchObservedRunningTime="2026-07-02 21:03:01.944961164 +0000 UTC m=+1815.615474657"
Jul 02 21:03:02.447633 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:02.447604    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx"
Jul 02 21:03:02.452641 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:02.452616    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx"
Jul 02 21:03:02.925446 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:02.925417    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx"
Jul 02 21:03:02.926213 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:02.926193    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx"
Jul 02 21:03:04.023372 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:04.023345    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:03:04.119212 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:04.119171    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:03:04.204760 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:04.204709    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:03:04.336297 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:04.336209    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:03:04.685670 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:04.685586    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:03:04.787115 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:04.787083    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:03:08.538615 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:08.538579    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:03:09.887262 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:09.887222    2581 patch_prober.go:28] interesting pod/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 02 21:03:09.887713 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:09.887291    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr" podUID="959bdb1e-f4e7-4219-9d97-3d5263c68965" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 02 21:03:09.973420 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:09.973385    2581 generic.go:356] "Generic (PLEG): container finished" podID="959bdb1e-f4e7-4219-9d97-3d5263c68965" containerID="eebb58dd0f41a116513b3661eb176f89518ae4e9292981cb835e0d614e06d14d" exitCode=0
Jul 02 21:03:09.973577 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:09.973458    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr" event={"ID":"959bdb1e-f4e7-4219-9d97-3d5263c68965","Type":"ContainerDied","Data":"eebb58dd0f41a116513b3661eb176f89518ae4e9292981cb835e0d614e06d14d"}
Jul 02 21:03:09.973854 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:09.973839    2581 scope.go:117] "RemoveContainer" containerID="eebb58dd0f41a116513b3661eb176f89518ae4e9292981cb835e0d614e06d14d"
Jul 02 21:03:09.974827 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:09.974797    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 21:03:09.974925 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:09.974885    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 21:03:09.974993 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:09.974932    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 21:03:10.984672 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:10.984625    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr" event={"ID":"959bdb1e-f4e7-4219-9d97-3d5263c68965","Type":"ContainerStarted","Data":"743047cd3252b2acddfa7e9f6918e4a6ee86abf31b2ecccbdd7a81f57f72b47a"}
Jul 02 21:03:11.852919 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:11.852885    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr"
Jul 02 21:03:11.853319 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:11.853291    2581 patch_prober.go:28] interesting pod/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 02 21:03:11.853514 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:11.853488    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr" podUID="959bdb1e-f4e7-4219-9d97-3d5263c68965" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 02 21:03:12.853776 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:12.853729    2581 patch_prober.go:28] interesting pod/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 02 21:03:12.854478 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:12.853800    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr" podUID="959bdb1e-f4e7-4219-9d97-3d5263c68965" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 02 21:03:13.852985 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:13.852945    2581 patch_prober.go:28] interesting pod/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 02 21:03:13.853315 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:13.853282    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr" podUID="959bdb1e-f4e7-4219-9d97-3d5263c68965" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 02 21:03:14.857049 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:14.857018    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr"
Jul 02 21:03:14.857480 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:14.857265    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr"
Jul 02 21:03:14.857937 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:14.857918    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr"
Jul 02 21:03:14.887115 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:14.887085    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-c36b13/test-model-c36b13-kserve-5fdfc4c8d5-fz4xx"]
Jul 02 21:03:14.890611 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:14.890589    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c36b13/test-model-c36b13-kserve-5fdfc4c8d5-fz4xx"
Jul 02 21:03:14.892796 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:14.892775    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-c36b13\"/\"test-model-c36b13-kserve-self-signed-certs\""
Jul 02 21:03:14.892796 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:14.892787    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-c36b13\"/\"default-dockercfg-rrh8p\""
Jul 02 21:03:14.892959 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:14.892801    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-c36b13\"/\"kube-root-ca.crt\""
Jul 02 21:03:14.892959 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:14.892903    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-c36b13\"/\"openshift-service-ca.crt\""
Jul 02 21:03:14.897727 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:14.897706    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-c36b13/test-model-c36b13-kserve-5fdfc4c8d5-fz4xx"]
Jul 02 21:03:14.917576 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:14.917544    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:03:15.016103 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:15.015730    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45da3ccf-46be-4a2d-a7d1-778ae5d75922-tls-certs\") pod \"test-model-c36b13-kserve-5fdfc4c8d5-fz4xx\" (UID: \"45da3ccf-46be-4a2d-a7d1-778ae5d75922\") " pod="ai-tenant-e2e-inf-a-c36b13/test-model-c36b13-kserve-5fdfc4c8d5-fz4xx"
Jul 02 21:03:15.016103 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:15.015795    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45da3ccf-46be-4a2d-a7d1-778ae5d75922-tmp-dir\") pod \"test-model-c36b13-kserve-5fdfc4c8d5-fz4xx\" (UID: \"45da3ccf-46be-4a2d-a7d1-778ae5d75922\") " pod="ai-tenant-e2e-inf-a-c36b13/test-model-c36b13-kserve-5fdfc4c8d5-fz4xx"
Jul 02 21:03:15.016103 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:15.015828    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9lxp\" (UniqueName: \"kubernetes.io/projected/45da3ccf-46be-4a2d-a7d1-778ae5d75922-kube-api-access-w9lxp\") pod \"test-model-c36b13-kserve-5fdfc4c8d5-fz4xx\" (UID: \"45da3ccf-46be-4a2d-a7d1-778ae5d75922\") " pod="ai-tenant-e2e-inf-a-c36b13/test-model-c36b13-kserve-5fdfc4c8d5-fz4xx"
Jul 02 21:03:15.016103 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:15.015927    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45da3ccf-46be-4a2d-a7d1-778ae5d75922-home\") pod \"test-model-c36b13-kserve-5fdfc4c8d5-fz4xx\" (UID: \"45da3ccf-46be-4a2d-a7d1-778ae5d75922\") " pod="ai-tenant-e2e-inf-a-c36b13/test-model-c36b13-kserve-5fdfc4c8d5-fz4xx"
Jul 02 21:03:15.016103 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:15.015973    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45da3ccf-46be-4a2d-a7d1-778ae5d75922-model-cache\") pod \"test-model-c36b13-kserve-5fdfc4c8d5-fz4xx\" (UID: \"45da3ccf-46be-4a2d-a7d1-778ae5d75922\") " pod="ai-tenant-e2e-inf-a-c36b13/test-model-c36b13-kserve-5fdfc4c8d5-fz4xx"
Jul 02 21:03:15.016103 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:15.016007    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45da3ccf-46be-4a2d-a7d1-778ae5d75922-dshm\") pod \"test-model-c36b13-kserve-5fdfc4c8d5-fz4xx\" (UID: \"45da3ccf-46be-4a2d-a7d1-778ae5d75922\") " pod="ai-tenant-e2e-inf-a-c36b13/test-model-c36b13-kserve-5fdfc4c8d5-fz4xx"
Jul 02 21:03:15.118104 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:15.118005    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45da3ccf-46be-4a2d-a7d1-778ae5d75922-home\") pod \"test-model-c36b13-kserve-5fdfc4c8d5-fz4xx\" (UID: \"45da3ccf-46be-4a2d-a7d1-778ae5d75922\") " pod="ai-tenant-e2e-inf-a-c36b13/test-model-c36b13-kserve-5fdfc4c8d5-fz4xx"
Jul 02 21:03:15.118104 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:15.118072    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45da3ccf-46be-4a2d-a7d1-778ae5d75922-model-cache\") pod \"test-model-c36b13-kserve-5fdfc4c8d5-fz4xx\" (UID: \"45da3ccf-46be-4a2d-a7d1-778ae5d75922\") " pod="ai-tenant-e2e-inf-a-c36b13/test-model-c36b13-kserve-5fdfc4c8d5-fz4xx"
Jul 02 21:03:15.118390 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:15.118113    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45da3ccf-46be-4a2d-a7d1-778ae5d75922-dshm\") pod \"test-model-c36b13-kserve-5fdfc4c8d5-fz4xx\" (UID: \"45da3ccf-46be-4a2d-a7d1-778ae5d75922\") " pod="ai-tenant-e2e-inf-a-c36b13/test-model-c36b13-kserve-5fdfc4c8d5-fz4xx"
Jul 02 21:03:15.118390 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:15.118265    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45da3ccf-46be-4a2d-a7d1-778ae5d75922-tls-certs\") pod \"test-model-c36b13-kserve-5fdfc4c8d5-fz4xx\" (UID: \"45da3ccf-46be-4a2d-a7d1-778ae5d75922\") " pod="ai-tenant-e2e-inf-a-c36b13/test-model-c36b13-kserve-5fdfc4c8d5-fz4xx"
Jul 02 21:03:15.118509 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:15.118418    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45da3ccf-46be-4a2d-a7d1-778ae5d75922-tmp-dir\") pod \"test-model-c36b13-kserve-5fdfc4c8d5-fz4xx\" (UID: \"45da3ccf-46be-4a2d-a7d1-778ae5d75922\") " pod="ai-tenant-e2e-inf-a-c36b13/test-model-c36b13-kserve-5fdfc4c8d5-fz4xx"
Jul 02 21:03:15.118509 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:15.118464    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9lxp\" (UniqueName: \"kubernetes.io/projected/45da3ccf-46be-4a2d-a7d1-778ae5d75922-kube-api-access-w9lxp\") pod \"test-model-c36b13-kserve-5fdfc4c8d5-fz4xx\" (UID: \"45da3ccf-46be-4a2d-a7d1-778ae5d75922\") " pod="ai-tenant-e2e-inf-a-c36b13/test-model-c36b13-kserve-5fdfc4c8d5-fz4xx"
Jul 02 21:03:15.118624 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:15.118519    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45da3ccf-46be-4a2d-a7d1-778ae5d75922-home\") pod \"test-model-c36b13-kserve-5fdfc4c8d5-fz4xx\" (UID: \"45da3ccf-46be-4a2d-a7d1-778ae5d75922\") " pod="ai-tenant-e2e-inf-a-c36b13/test-model-c36b13-kserve-5fdfc4c8d5-fz4xx"
Jul 02 21:03:15.118855 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:15.118791    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45da3ccf-46be-4a2d-a7d1-778ae5d75922-model-cache\") pod \"test-model-c36b13-kserve-5fdfc4c8d5-fz4xx\" (UID: \"45da3ccf-46be-4a2d-a7d1-778ae5d75922\") " pod="ai-tenant-e2e-inf-a-c36b13/test-model-c36b13-kserve-5fdfc4c8d5-fz4xx"
Jul 02 21:03:15.118944 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:15.118890    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45da3ccf-46be-4a2d-a7d1-778ae5d75922-tmp-dir\") pod \"test-model-c36b13-kserve-5fdfc4c8d5-fz4xx\" (UID: \"45da3ccf-46be-4a2d-a7d1-778ae5d75922\") " pod="ai-tenant-e2e-inf-a-c36b13/test-model-c36b13-kserve-5fdfc4c8d5-fz4xx"
Jul 02 21:03:15.120507 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:15.120485    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45da3ccf-46be-4a2d-a7d1-778ae5d75922-dshm\") pod \"test-model-c36b13-kserve-5fdfc4c8d5-fz4xx\" (UID: \"45da3ccf-46be-4a2d-a7d1-778ae5d75922\") " pod="ai-tenant-e2e-inf-a-c36b13/test-model-c36b13-kserve-5fdfc4c8d5-fz4xx"
Jul 02 21:03:15.120782 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:15.120766    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45da3ccf-46be-4a2d-a7d1-778ae5d75922-tls-certs\") pod \"test-model-c36b13-kserve-5fdfc4c8d5-fz4xx\" (UID: \"45da3ccf-46be-4a2d-a7d1-778ae5d75922\") " pod="ai-tenant-e2e-inf-a-c36b13/test-model-c36b13-kserve-5fdfc4c8d5-fz4xx"
Jul 02 21:03:15.127249 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:15.127225    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9lxp\" (UniqueName: \"kubernetes.io/projected/45da3ccf-46be-4a2d-a7d1-778ae5d75922-kube-api-access-w9lxp\") pod \"test-model-c36b13-kserve-5fdfc4c8d5-fz4xx\" (UID: \"45da3ccf-46be-4a2d-a7d1-778ae5d75922\") " pod="ai-tenant-e2e-inf-a-c36b13/test-model-c36b13-kserve-5fdfc4c8d5-fz4xx"
Jul 02 21:03:15.201613 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:15.201572    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c36b13/test-model-c36b13-kserve-5fdfc4c8d5-fz4xx"
Jul 02 21:03:15.351880 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:15.351838    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-c36b13/test-model-c36b13-kserve-5fdfc4c8d5-fz4xx"]
Jul 02 21:03:15.355724 ip-10-0-135-220 kubenswrapper[2581]: W0702 21:03:15.355695    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45da3ccf_46be_4a2d_a7d1_778ae5d75922.slice/crio-5d509db393d81cc18758d90bda1c6c7299051fda6f75b1982714bbce377b1dfd WatchSource:0}: Error finding container 5d509db393d81cc18758d90bda1c6c7299051fda6f75b1982714bbce377b1dfd: Status 404 returned error can't find the container with id 5d509db393d81cc18758d90bda1c6c7299051fda6f75b1982714bbce377b1dfd
Jul 02 21:03:16.015533 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:16.015496    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c36b13/test-model-c36b13-kserve-5fdfc4c8d5-fz4xx" event={"ID":"45da3ccf-46be-4a2d-a7d1-778ae5d75922","Type":"ContainerStarted","Data":"bd8e928bd9f6092823a78d100e9e60045ae882f652a1178b02f91eedf56d4273"}
Jul 02 21:03:16.015533 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:16.015535    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c36b13/test-model-c36b13-kserve-5fdfc4c8d5-fz4xx" event={"ID":"45da3ccf-46be-4a2d-a7d1-778ae5d75922","Type":"ContainerStarted","Data":"5d509db393d81cc18758d90bda1c6c7299051fda6f75b1982714bbce377b1dfd"}
Jul 02 21:03:16.034633 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:16.034577    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-c36b13/test-model-c36b13-kserve-5fdfc4c8d5-fz4xx" podStartSLOduration=2.034559554 podStartE2EDuration="2.034559554s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:03:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:03:16.031653819 +0000 UTC m=+1829.702167314" watchObservedRunningTime="2026-07-02 21:03:16.034559554 +0000 UTC m=+1829.705073048"
Jul 02 21:03:17.022559 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:17.022527    2581 generic.go:356] "Generic (PLEG): container finished" podID="f4c605b1-be9b-428a-856f-48acc79e2067" containerID="8f363853b39ca6e6d0bcf3baf217d291a931355b1b34275bbe26a3eef19619b1" exitCode=0
Jul 02 21:03:17.022985 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:17.022595    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx" event={"ID":"f4c605b1-be9b-428a-856f-48acc79e2067","Type":"ContainerDied","Data":"8f363853b39ca6e6d0bcf3baf217d291a931355b1b34275bbe26a3eef19619b1"}
Jul 02 21:03:17.023083 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:17.023066    2581 scope.go:117] "RemoveContainer" containerID="8f363853b39ca6e6d0bcf3baf217d291a931355b1b34275bbe26a3eef19619b1"
Jul 02 21:03:17.023957 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:17.023927    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 21:03:17.024013 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:17.024000    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 21:03:17.024064 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:17.024033    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 21:03:17.691683 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:17.691645    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:03:17.925732 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:17.925690    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx"
Jul 02 21:03:18.033430 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:18.033391    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx" event={"ID":"f4c605b1-be9b-428a-856f-48acc79e2067","Type":"ContainerStarted","Data":"6373fc566d554cb3b14275d2dd33b90775cc8356a63e7bb19bdebe51ae67db5d"}
Jul 02 21:03:18.162405 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:18.162373    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:03:18.189562 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:18.189528    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 21:03:18.449254 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:18.449155    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx"
Jul 02 21:03:18.449874 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:18.449845    2581 patch_prober.go:28] interesting pod/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 02 21:03:18.449989 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:18.449912    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx" podUID="f4c605b1-be9b-428a-856f-48acc79e2067" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 02 21:03:19.447867 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:19.447826    2581 patch_prober.go:28] interesting pod/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 02 21:03:19.448372 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:19.447888    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx" podUID="f4c605b1-be9b-428a-856f-48acc79e2067" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 02 21:03:20.448481 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:20.448005    2581 patch_prober.go:28] interesting pod/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 02 21:03:20.448481 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:20.448068    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx" podUID="f4c605b1-be9b-428a-856f-48acc79e2067" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 02 21:03:21.447521 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:21.447479    2581 patch_prober.go:28] interesting pod/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 02 21:03:21.447725 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:21.447545    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx" podUID="f4c605b1-be9b-428a-856f-48acc79e2067" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 02 21:03:22.452045 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:22.452009    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx"
Jul 02 21:03:22.452431 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:22.452393    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx"
Jul 02 21:03:22.453095 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:22.453076    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx"
Jul 02 21:03:25.201875 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:25.201827    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-c36b13/test-model-c36b13-kserve-5fdfc4c8d5-fz4xx"
Jul 02 21:03:25.202304 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:25.201890    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-c36b13/test-model-c36b13-kserve-5fdfc4c8d5-fz4xx"
Jul 02 21:03:25.213986 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:25.213964    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-c36b13/test-model-c36b13-kserve-5fdfc4c8d5-fz4xx"
Jul 02 21:03:26.095979 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:26.095946    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-c36b13/test-model-c36b13-kserve-5fdfc4c8d5-fz4xx"
Jul 02 21:03:26.342213 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:26.342174    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:03:26.438445 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:26.438367    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:03:32.133777 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:32.133744    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 21:03:40.141747 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:40.141715    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:03:45.793686 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:03:45.793645    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 21:04:07.276657 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:07.276623    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-c36b13/test-model-c36b13-kserve-5fdfc4c8d5-fz4xx"]
Jul 02 21:04:07.291910 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:07.291874    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:08.305805 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:08.305775    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:08.467041 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:08.467008    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:08.871410 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:08.871378    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:09.014830 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:09.014765    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:09.120024 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:09.119992    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:09.262787 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:09.262751    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:11.900457 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:11.900423    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 21:04:13.944067 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:13.944037    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:22.297865 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:22.297776    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-c36b13/test-model-c36b13-kserve-5fdfc4c8d5-fz4xx" podUID="45da3ccf-46be-4a2d-a7d1-778ae5d75922" containerName="main" containerID="cri-o://bd8e928bd9f6092823a78d100e9e60045ae882f652a1178b02f91eedf56d4273" gracePeriod=45
Jul 02 21:04:22.547085 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:22.547060    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c36b13/test-model-c36b13-kserve-5fdfc4c8d5-fz4xx"
Jul 02 21:04:22.615893 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:22.615815    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w9lxp\" (UniqueName: \"kubernetes.io/projected/45da3ccf-46be-4a2d-a7d1-778ae5d75922-kube-api-access-w9lxp\") pod \"45da3ccf-46be-4a2d-a7d1-778ae5d75922\" (UID: \"45da3ccf-46be-4a2d-a7d1-778ae5d75922\") "
Jul 02 21:04:22.615893 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:22.615860    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45da3ccf-46be-4a2d-a7d1-778ae5d75922-dshm\") pod \"45da3ccf-46be-4a2d-a7d1-778ae5d75922\" (UID: \"45da3ccf-46be-4a2d-a7d1-778ae5d75922\") "
Jul 02 21:04:22.616083 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:22.615905    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45da3ccf-46be-4a2d-a7d1-778ae5d75922-model-cache\") pod \"45da3ccf-46be-4a2d-a7d1-778ae5d75922\" (UID: \"45da3ccf-46be-4a2d-a7d1-778ae5d75922\") "
Jul 02 21:04:22.616083 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:22.615932    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45da3ccf-46be-4a2d-a7d1-778ae5d75922-tmp-dir\") pod \"45da3ccf-46be-4a2d-a7d1-778ae5d75922\" (UID: \"45da3ccf-46be-4a2d-a7d1-778ae5d75922\") "
Jul 02 21:04:22.616083 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:22.615964    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45da3ccf-46be-4a2d-a7d1-778ae5d75922-tls-certs\") pod \"45da3ccf-46be-4a2d-a7d1-778ae5d75922\" (UID: \"45da3ccf-46be-4a2d-a7d1-778ae5d75922\") "
Jul 02 21:04:22.616083 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:22.616016    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45da3ccf-46be-4a2d-a7d1-778ae5d75922-home\") pod \"45da3ccf-46be-4a2d-a7d1-778ae5d75922\" (UID: \"45da3ccf-46be-4a2d-a7d1-778ae5d75922\") "
Jul 02 21:04:22.616335 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:22.616177    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45da3ccf-46be-4a2d-a7d1-778ae5d75922-model-cache" (OuterVolumeSpecName: "model-cache") pod "45da3ccf-46be-4a2d-a7d1-778ae5d75922" (UID: "45da3ccf-46be-4a2d-a7d1-778ae5d75922"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:04:22.616335 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:22.616231    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45da3ccf-46be-4a2d-a7d1-778ae5d75922-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "45da3ccf-46be-4a2d-a7d1-778ae5d75922" (UID: "45da3ccf-46be-4a2d-a7d1-778ae5d75922"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:04:22.616445 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:22.616366    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45da3ccf-46be-4a2d-a7d1-778ae5d75922-tmp-dir\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:04:22.616445 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:22.616380    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45da3ccf-46be-4a2d-a7d1-778ae5d75922-model-cache\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:04:22.616445 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:22.616395    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45da3ccf-46be-4a2d-a7d1-778ae5d75922-home" (OuterVolumeSpecName: "home") pod "45da3ccf-46be-4a2d-a7d1-778ae5d75922" (UID: "45da3ccf-46be-4a2d-a7d1-778ae5d75922"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:04:22.618130 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:22.618105    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45da3ccf-46be-4a2d-a7d1-778ae5d75922-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "45da3ccf-46be-4a2d-a7d1-778ae5d75922" (UID: "45da3ccf-46be-4a2d-a7d1-778ae5d75922"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:04:22.618233 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:22.618202    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45da3ccf-46be-4a2d-a7d1-778ae5d75922-dshm" (OuterVolumeSpecName: "dshm") pod "45da3ccf-46be-4a2d-a7d1-778ae5d75922" (UID: "45da3ccf-46be-4a2d-a7d1-778ae5d75922"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:04:22.618277 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:22.618238    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45da3ccf-46be-4a2d-a7d1-778ae5d75922-kube-api-access-w9lxp" (OuterVolumeSpecName: "kube-api-access-w9lxp") pod "45da3ccf-46be-4a2d-a7d1-778ae5d75922" (UID: "45da3ccf-46be-4a2d-a7d1-778ae5d75922"). InnerVolumeSpecName "kube-api-access-w9lxp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:04:22.717477 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:22.717441    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45da3ccf-46be-4a2d-a7d1-778ae5d75922-tls-certs\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:04:22.717477 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:22.717470    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45da3ccf-46be-4a2d-a7d1-778ae5d75922-home\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:04:22.717477 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:22.717482    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w9lxp\" (UniqueName: \"kubernetes.io/projected/45da3ccf-46be-4a2d-a7d1-778ae5d75922-kube-api-access-w9lxp\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:04:22.717695 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:22.717493    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45da3ccf-46be-4a2d-a7d1-778ae5d75922-dshm\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:04:23.398154 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:23.398100    2581 generic.go:356] "Generic (PLEG): container finished" podID="45da3ccf-46be-4a2d-a7d1-778ae5d75922" containerID="bd8e928bd9f6092823a78d100e9e60045ae882f652a1178b02f91eedf56d4273" exitCode=0
Jul 02 21:04:23.398622 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:23.398163    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c36b13/test-model-c36b13-kserve-5fdfc4c8d5-fz4xx"
Jul 02 21:04:23.398622 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:23.398194    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c36b13/test-model-c36b13-kserve-5fdfc4c8d5-fz4xx" event={"ID":"45da3ccf-46be-4a2d-a7d1-778ae5d75922","Type":"ContainerDied","Data":"bd8e928bd9f6092823a78d100e9e60045ae882f652a1178b02f91eedf56d4273"}
Jul 02 21:04:23.398622 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:23.398253    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c36b13/test-model-c36b13-kserve-5fdfc4c8d5-fz4xx" event={"ID":"45da3ccf-46be-4a2d-a7d1-778ae5d75922","Type":"ContainerDied","Data":"5d509db393d81cc18758d90bda1c6c7299051fda6f75b1982714bbce377b1dfd"}
Jul 02 21:04:23.398622 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:23.398277    2581 scope.go:117] "RemoveContainer" containerID="bd8e928bd9f6092823a78d100e9e60045ae882f652a1178b02f91eedf56d4273"
Jul 02 21:04:23.407407 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:23.407377    2581 scope.go:117] "RemoveContainer" containerID="bd8e928bd9f6092823a78d100e9e60045ae882f652a1178b02f91eedf56d4273"
Jul 02 21:04:23.407666 ip-10-0-135-220 kubenswrapper[2581]: E0702 21:04:23.407646    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd8e928bd9f6092823a78d100e9e60045ae882f652a1178b02f91eedf56d4273\": container with ID starting with bd8e928bd9f6092823a78d100e9e60045ae882f652a1178b02f91eedf56d4273 not found: ID does not exist" containerID="bd8e928bd9f6092823a78d100e9e60045ae882f652a1178b02f91eedf56d4273"
Jul 02 21:04:23.407733 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:23.407677    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd8e928bd9f6092823a78d100e9e60045ae882f652a1178b02f91eedf56d4273"} err="failed to get container status \"bd8e928bd9f6092823a78d100e9e60045ae882f652a1178b02f91eedf56d4273\": rpc error: code = NotFound desc = could not find container \"bd8e928bd9f6092823a78d100e9e60045ae882f652a1178b02f91eedf56d4273\": container with ID starting with bd8e928bd9f6092823a78d100e9e60045ae882f652a1178b02f91eedf56d4273 not found: ID does not exist"
Jul 02 21:04:23.415043 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:23.415019    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-c36b13/test-model-c36b13-kserve-5fdfc4c8d5-fz4xx"]
Jul 02 21:04:23.419341 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:23.419321    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-c36b13/test-model-c36b13-kserve-5fdfc4c8d5-fz4xx"]
Jul 02 21:04:24.881547 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:24.881517    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45da3ccf-46be-4a2d-a7d1-778ae5d75922" path="/var/lib/kubelet/pods/45da3ccf-46be-4a2d-a7d1-778ae5d75922/volumes"
Jul 02 21:04:26.298931 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:26.298891    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:50.741551 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:50.741517    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:50.982566 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:50.982534    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr"]
Jul 02 21:04:50.982764 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:50.982740    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr" podUID="959bdb1e-f4e7-4219-9d97-3d5263c68965" containerName="istio-proxy" containerID="cri-o://743047cd3252b2acddfa7e9f6918e4a6ee86abf31b2ecccbdd7a81f57f72b47a" gracePeriod=30
Jul 02 21:04:51.014186 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:51.014074    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:51.415325 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:51.415243    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:51.817202 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:51.817165    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:51.944267 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:51.944237    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:52.045791 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:52.045755    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:52.202483 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:52.202409    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:54.990180 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:54.990130    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 21:04:56.246000 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:56.245943    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr"
Jul 02 21:04:56.402197 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:56.402174    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/959bdb1e-f4e7-4219-9d97-3d5263c68965-workload-socket\") pod \"959bdb1e-f4e7-4219-9d97-3d5263c68965\" (UID: \"959bdb1e-f4e7-4219-9d97-3d5263c68965\") "
Jul 02 21:04:56.402361 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:56.402237    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/959bdb1e-f4e7-4219-9d97-3d5263c68965-credential-socket\") pod \"959bdb1e-f4e7-4219-9d97-3d5263c68965\" (UID: \"959bdb1e-f4e7-4219-9d97-3d5263c68965\") "
Jul 02 21:04:56.402361 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:56.402263    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/959bdb1e-f4e7-4219-9d97-3d5263c68965-istio-envoy\") pod \"959bdb1e-f4e7-4219-9d97-3d5263c68965\" (UID: \"959bdb1e-f4e7-4219-9d97-3d5263c68965\") "
Jul 02 21:04:56.402361 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:56.402287    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pcwlv\" (UniqueName: \"kubernetes.io/projected/959bdb1e-f4e7-4219-9d97-3d5263c68965-kube-api-access-pcwlv\") pod \"959bdb1e-f4e7-4219-9d97-3d5263c68965\" (UID: \"959bdb1e-f4e7-4219-9d97-3d5263c68965\") "
Jul 02 21:04:56.402361 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:56.402313    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/959bdb1e-f4e7-4219-9d97-3d5263c68965-workload-certs\") pod \"959bdb1e-f4e7-4219-9d97-3d5263c68965\" (UID: \"959bdb1e-f4e7-4219-9d97-3d5263c68965\") "
Jul 02 21:04:56.402583 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:56.402379    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/959bdb1e-f4e7-4219-9d97-3d5263c68965-istio-podinfo\") pod \"959bdb1e-f4e7-4219-9d97-3d5263c68965\" (UID: \"959bdb1e-f4e7-4219-9d97-3d5263c68965\") "
Jul 02 21:04:56.402583 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:56.402423    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/959bdb1e-f4e7-4219-9d97-3d5263c68965-istio-token\") pod \"959bdb1e-f4e7-4219-9d97-3d5263c68965\" (UID: \"959bdb1e-f4e7-4219-9d97-3d5263c68965\") "
Jul 02 21:04:56.402583 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:56.402452    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/959bdb1e-f4e7-4219-9d97-3d5263c68965-istiod-ca-cert\") pod \"959bdb1e-f4e7-4219-9d97-3d5263c68965\" (UID: \"959bdb1e-f4e7-4219-9d97-3d5263c68965\") "
Jul 02 21:04:56.402583 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:56.402479    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/959bdb1e-f4e7-4219-9d97-3d5263c68965-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "959bdb1e-f4e7-4219-9d97-3d5263c68965" (UID: "959bdb1e-f4e7-4219-9d97-3d5263c68965"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:04:56.402583 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:56.402491    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/959bdb1e-f4e7-4219-9d97-3d5263c68965-istio-data\") pod \"959bdb1e-f4e7-4219-9d97-3d5263c68965\" (UID: \"959bdb1e-f4e7-4219-9d97-3d5263c68965\") "
Jul 02 21:04:56.402848 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:56.402577    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/959bdb1e-f4e7-4219-9d97-3d5263c68965-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "959bdb1e-f4e7-4219-9d97-3d5263c68965" (UID: "959bdb1e-f4e7-4219-9d97-3d5263c68965"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:04:56.402848 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:56.402639    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/959bdb1e-f4e7-4219-9d97-3d5263c68965-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "959bdb1e-f4e7-4219-9d97-3d5263c68965" (UID: "959bdb1e-f4e7-4219-9d97-3d5263c68965"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:04:56.402848 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:56.402836    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/959bdb1e-f4e7-4219-9d97-3d5263c68965-credential-socket\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:04:56.403001 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:56.402855    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/959bdb1e-f4e7-4219-9d97-3d5263c68965-workload-certs\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:04:56.403001 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:56.402870    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/959bdb1e-f4e7-4219-9d97-3d5263c68965-workload-socket\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:04:56.403001 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:56.402906    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/959bdb1e-f4e7-4219-9d97-3d5263c68965-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "959bdb1e-f4e7-4219-9d97-3d5263c68965" (UID: "959bdb1e-f4e7-4219-9d97-3d5263c68965"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:04:56.403478 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:56.403450    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/959bdb1e-f4e7-4219-9d97-3d5263c68965-istio-data" (OuterVolumeSpecName: "istio-data") pod "959bdb1e-f4e7-4219-9d97-3d5263c68965" (UID: "959bdb1e-f4e7-4219-9d97-3d5263c68965"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:04:56.404574 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:56.404549    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/959bdb1e-f4e7-4219-9d97-3d5263c68965-istio-token" (OuterVolumeSpecName: "istio-token") pod "959bdb1e-f4e7-4219-9d97-3d5263c68965" (UID: "959bdb1e-f4e7-4219-9d97-3d5263c68965"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:04:56.404672 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:56.404601    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/959bdb1e-f4e7-4219-9d97-3d5263c68965-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "959bdb1e-f4e7-4219-9d97-3d5263c68965" (UID: "959bdb1e-f4e7-4219-9d97-3d5263c68965"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:04:56.404896 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:56.404877    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/959bdb1e-f4e7-4219-9d97-3d5263c68965-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "959bdb1e-f4e7-4219-9d97-3d5263c68965" (UID: "959bdb1e-f4e7-4219-9d97-3d5263c68965"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 21:04:56.404957 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:56.404908    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/959bdb1e-f4e7-4219-9d97-3d5263c68965-kube-api-access-pcwlv" (OuterVolumeSpecName: "kube-api-access-pcwlv") pod "959bdb1e-f4e7-4219-9d97-3d5263c68965" (UID: "959bdb1e-f4e7-4219-9d97-3d5263c68965"). InnerVolumeSpecName "kube-api-access-pcwlv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:04:56.503642 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:56.503575    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/959bdb1e-f4e7-4219-9d97-3d5263c68965-istio-podinfo\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:04:56.503642 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:56.503600    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/959bdb1e-f4e7-4219-9d97-3d5263c68965-istio-token\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:04:56.503642 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:56.503609    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/959bdb1e-f4e7-4219-9d97-3d5263c68965-istiod-ca-cert\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:04:56.503642 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:56.503617    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/959bdb1e-f4e7-4219-9d97-3d5263c68965-istio-data\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:04:56.503642 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:56.503625    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/959bdb1e-f4e7-4219-9d97-3d5263c68965-istio-envoy\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:04:56.503642 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:56.503634    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pcwlv\" (UniqueName: \"kubernetes.io/projected/959bdb1e-f4e7-4219-9d97-3d5263c68965-kube-api-access-pcwlv\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:04:56.580461 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:56.580435    2581 generic.go:356] "Generic (PLEG): container finished" podID="959bdb1e-f4e7-4219-9d97-3d5263c68965" containerID="743047cd3252b2acddfa7e9f6918e4a6ee86abf31b2ecccbdd7a81f57f72b47a" exitCode=0
Jul 02 21:04:56.580568 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:56.580470    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr" event={"ID":"959bdb1e-f4e7-4219-9d97-3d5263c68965","Type":"ContainerDied","Data":"743047cd3252b2acddfa7e9f6918e4a6ee86abf31b2ecccbdd7a81f57f72b47a"}
Jul 02 21:04:56.580568 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:56.580496    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr"
Jul 02 21:04:56.580568 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:56.580507    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr" event={"ID":"959bdb1e-f4e7-4219-9d97-3d5263c68965","Type":"ContainerDied","Data":"8cab2865df8d637fe2c8d7e647c86d727854bc5c46418d69c1ff07402b916c32"}
Jul 02 21:04:56.580568 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:56.580529    2581 scope.go:117] "RemoveContainer" containerID="743047cd3252b2acddfa7e9f6918e4a6ee86abf31b2ecccbdd7a81f57f72b47a"
Jul 02 21:04:56.590492 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:56.590476    2581 scope.go:117] "RemoveContainer" containerID="eebb58dd0f41a116513b3661eb176f89518ae4e9292981cb835e0d614e06d14d"
Jul 02 21:04:56.598292 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:56.598276    2581 scope.go:117] "RemoveContainer" containerID="743047cd3252b2acddfa7e9f6918e4a6ee86abf31b2ecccbdd7a81f57f72b47a"
Jul 02 21:04:56.598553 ip-10-0-135-220 kubenswrapper[2581]: E0702 21:04:56.598536    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"743047cd3252b2acddfa7e9f6918e4a6ee86abf31b2ecccbdd7a81f57f72b47a\": container with ID starting with 743047cd3252b2acddfa7e9f6918e4a6ee86abf31b2ecccbdd7a81f57f72b47a not found: ID does not exist" containerID="743047cd3252b2acddfa7e9f6918e4a6ee86abf31b2ecccbdd7a81f57f72b47a"
Jul 02 21:04:56.598603 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:56.598561    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"743047cd3252b2acddfa7e9f6918e4a6ee86abf31b2ecccbdd7a81f57f72b47a"} err="failed to get container status \"743047cd3252b2acddfa7e9f6918e4a6ee86abf31b2ecccbdd7a81f57f72b47a\": rpc error: code = NotFound desc = could not find container \"743047cd3252b2acddfa7e9f6918e4a6ee86abf31b2ecccbdd7a81f57f72b47a\": container with ID starting with 743047cd3252b2acddfa7e9f6918e4a6ee86abf31b2ecccbdd7a81f57f72b47a not found: ID does not exist"
Jul 02 21:04:56.598603 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:56.598577    2581 scope.go:117] "RemoveContainer" containerID="eebb58dd0f41a116513b3661eb176f89518ae4e9292981cb835e0d614e06d14d"
Jul 02 21:04:56.598800 ip-10-0-135-220 kubenswrapper[2581]: E0702 21:04:56.598781    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eebb58dd0f41a116513b3661eb176f89518ae4e9292981cb835e0d614e06d14d\": container with ID starting with eebb58dd0f41a116513b3661eb176f89518ae4e9292981cb835e0d614e06d14d not found: ID does not exist" containerID="eebb58dd0f41a116513b3661eb176f89518ae4e9292981cb835e0d614e06d14d"
Jul 02 21:04:56.598856 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:56.598809    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eebb58dd0f41a116513b3661eb176f89518ae4e9292981cb835e0d614e06d14d"} err="failed to get container status \"eebb58dd0f41a116513b3661eb176f89518ae4e9292981cb835e0d614e06d14d\": rpc error: code = NotFound desc = could not find container \"eebb58dd0f41a116513b3661eb176f89518ae4e9292981cb835e0d614e06d14d\": container with ID starting with eebb58dd0f41a116513b3661eb176f89518ae4e9292981cb835e0d614e06d14d not found: ID does not exist"
Jul 02 21:04:56.602611 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:56.602588    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr"]
Jul 02 21:04:56.608068 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:56.608044    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-c36b13-openshift-default-6b4d477b6f-rktkr"]
Jul 02 21:04:56.887286 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:56.887215    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="959bdb1e-f4e7-4219-9d97-3d5263c68965" path="/var/lib/kubelet/pods/959bdb1e-f4e7-4219-9d97-3d5263c68965/volumes"
Jul 02 21:04:57.500272 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:57.500237    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:57.662381 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:57.662338    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:57.741434 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:57.741402    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx"]
Jul 02 21:04:57.741650 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:57.741622    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx" podUID="f4c605b1-be9b-428a-856f-48acc79e2067" containerName="istio-proxy" containerID="cri-o://6373fc566d554cb3b14275d2dd33b90775cc8356a63e7bb19bdebe51ae67db5d" gracePeriod=30
Jul 02 21:04:57.766705 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:57.766627    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:58.340977 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:58.340941    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:58.633999 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:58.633921    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75"]
Jul 02 21:04:58.634475 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:58.634366    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45da3ccf-46be-4a2d-a7d1-778ae5d75922" containerName="main"
Jul 02 21:04:58.634475 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:58.634381    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="45da3ccf-46be-4a2d-a7d1-778ae5d75922" containerName="main"
Jul 02 21:04:58.634475 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:58.634391    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="959bdb1e-f4e7-4219-9d97-3d5263c68965" containerName="istio-proxy"
Jul 02 21:04:58.634475 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:58.634397    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="959bdb1e-f4e7-4219-9d97-3d5263c68965" containerName="istio-proxy"
Jul 02 21:04:58.634620 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:58.634491    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="45da3ccf-46be-4a2d-a7d1-778ae5d75922" containerName="main"
Jul 02 21:04:58.634620 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:58.634502    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="959bdb1e-f4e7-4219-9d97-3d5263c68965" containerName="istio-proxy"
Jul 02 21:04:58.634620 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:58.634510    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="959bdb1e-f4e7-4219-9d97-3d5263c68965" containerName="istio-proxy"
Jul 02 21:04:58.639289 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:58.639272    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75"
Jul 02 21:04:58.641959 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:58.641937    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-d84344-openshift-default-dockercfg-j2p6j\""
Jul 02 21:04:58.649659 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:58.649635    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75"]
Jul 02 21:04:58.666772 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:58.666746    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:58.825365 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:58.825328    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-istiod-ca-cert\") pod \"e2e-api-a-d84344-openshift-default-8555bcd689-z2r75\" (UID: \"8cdacaca-eb16-44ad-912b-4ab5f0f7e584\") " pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75"
Jul 02 21:04:58.825365 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:58.825366    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-credential-socket\") pod \"e2e-api-a-d84344-openshift-default-8555bcd689-z2r75\" (UID: \"8cdacaca-eb16-44ad-912b-4ab5f0f7e584\") " pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75"
Jul 02 21:04:58.825584 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:58.825390    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-istio-envoy\") pod \"e2e-api-a-d84344-openshift-default-8555bcd689-z2r75\" (UID: \"8cdacaca-eb16-44ad-912b-4ab5f0f7e584\") " pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75"
Jul 02 21:04:58.825584 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:58.825420    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-istio-podinfo\") pod \"e2e-api-a-d84344-openshift-default-8555bcd689-z2r75\" (UID: \"8cdacaca-eb16-44ad-912b-4ab5f0f7e584\") " pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75"
Jul 02 21:04:58.825584 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:58.825453    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-workload-certs\") pod \"e2e-api-a-d84344-openshift-default-8555bcd689-z2r75\" (UID: \"8cdacaca-eb16-44ad-912b-4ab5f0f7e584\") " pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75"
Jul 02 21:04:58.825584 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:58.825477    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-istio-data\") pod \"e2e-api-a-d84344-openshift-default-8555bcd689-z2r75\" (UID: \"8cdacaca-eb16-44ad-912b-4ab5f0f7e584\") " pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75"
Jul 02 21:04:58.825584 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:58.825498    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-istio-token\") pod \"e2e-api-a-d84344-openshift-default-8555bcd689-z2r75\" (UID: \"8cdacaca-eb16-44ad-912b-4ab5f0f7e584\") " pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75"
Jul 02 21:04:58.825584 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:58.825521    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n9lg\" (UniqueName: \"kubernetes.io/projected/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-kube-api-access-7n9lg\") pod \"e2e-api-a-d84344-openshift-default-8555bcd689-z2r75\" (UID: \"8cdacaca-eb16-44ad-912b-4ab5f0f7e584\") " pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75"
Jul 02 21:04:58.825584 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:58.825544    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-workload-socket\") pod \"e2e-api-a-d84344-openshift-default-8555bcd689-z2r75\" (UID: \"8cdacaca-eb16-44ad-912b-4ab5f0f7e584\") " pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75"
Jul 02 21:04:58.926816 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:58.926747    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n9lg\" (UniqueName: \"kubernetes.io/projected/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-kube-api-access-7n9lg\") pod \"e2e-api-a-d84344-openshift-default-8555bcd689-z2r75\" (UID: \"8cdacaca-eb16-44ad-912b-4ab5f0f7e584\") " pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75"
Jul 02 21:04:58.926816 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:58.926792    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-workload-socket\") pod \"e2e-api-a-d84344-openshift-default-8555bcd689-z2r75\" (UID: \"8cdacaca-eb16-44ad-912b-4ab5f0f7e584\") " pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75"
Jul 02 21:04:58.927049 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:58.926856    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-istiod-ca-cert\") pod \"e2e-api-a-d84344-openshift-default-8555bcd689-z2r75\" (UID: \"8cdacaca-eb16-44ad-912b-4ab5f0f7e584\") " pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75"
Jul 02 21:04:58.927049 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:58.926875    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-credential-socket\") pod \"e2e-api-a-d84344-openshift-default-8555bcd689-z2r75\" (UID: \"8cdacaca-eb16-44ad-912b-4ab5f0f7e584\") " pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75"
Jul 02 21:04:58.927049 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:58.926894    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-istio-envoy\") pod \"e2e-api-a-d84344-openshift-default-8555bcd689-z2r75\" (UID: \"8cdacaca-eb16-44ad-912b-4ab5f0f7e584\") " pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75"
Jul 02 21:04:58.927049 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:58.926941    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-istio-podinfo\") pod \"e2e-api-a-d84344-openshift-default-8555bcd689-z2r75\" (UID: \"8cdacaca-eb16-44ad-912b-4ab5f0f7e584\") " pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75"
Jul 02 21:04:58.927049 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:58.927025    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-workload-certs\") pod \"e2e-api-a-d84344-openshift-default-8555bcd689-z2r75\" (UID: \"8cdacaca-eb16-44ad-912b-4ab5f0f7e584\") " pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75"
Jul 02 21:04:58.927347 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:58.927079    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-istio-data\") pod \"e2e-api-a-d84344-openshift-default-8555bcd689-z2r75\" (UID: \"8cdacaca-eb16-44ad-912b-4ab5f0f7e584\") " pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75"
Jul 02 21:04:58.927347 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:58.927119    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-istio-token\") pod \"e2e-api-a-d84344-openshift-default-8555bcd689-z2r75\" (UID: \"8cdacaca-eb16-44ad-912b-4ab5f0f7e584\") " pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75"
Jul 02 21:04:58.927580 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:58.927556    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-istio-data\") pod \"e2e-api-a-d84344-openshift-default-8555bcd689-z2r75\" (UID: \"8cdacaca-eb16-44ad-912b-4ab5f0f7e584\") " pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75"
Jul 02 21:04:58.927679 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:58.927607    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-credential-socket\") pod \"e2e-api-a-d84344-openshift-default-8555bcd689-z2r75\" (UID: \"8cdacaca-eb16-44ad-912b-4ab5f0f7e584\") " pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75"
Jul 02 21:04:58.927679 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:58.927636    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-workload-certs\") pod \"e2e-api-a-d84344-openshift-default-8555bcd689-z2r75\" (UID: \"8cdacaca-eb16-44ad-912b-4ab5f0f7e584\") " pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75"
Jul 02 21:04:58.927758 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:58.927709    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-workload-socket\") pod \"e2e-api-a-d84344-openshift-default-8555bcd689-z2r75\" (UID: \"8cdacaca-eb16-44ad-912b-4ab5f0f7e584\") " pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75"
Jul 02 21:04:58.927989 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:58.927970    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-istiod-ca-cert\") pod \"e2e-api-a-d84344-openshift-default-8555bcd689-z2r75\" (UID: \"8cdacaca-eb16-44ad-912b-4ab5f0f7e584\") " pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75"
Jul 02 21:04:58.929517 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:58.929498    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-istio-envoy\") pod \"e2e-api-a-d84344-openshift-default-8555bcd689-z2r75\" (UID: \"8cdacaca-eb16-44ad-912b-4ab5f0f7e584\") " pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75"
Jul 02 21:04:58.929616 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:58.929540    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-istio-podinfo\") pod \"e2e-api-a-d84344-openshift-default-8555bcd689-z2r75\" (UID: \"8cdacaca-eb16-44ad-912b-4ab5f0f7e584\") " pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75"
Jul 02 21:04:58.935346 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:58.935303    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-istio-token\") pod \"e2e-api-a-d84344-openshift-default-8555bcd689-z2r75\" (UID: \"8cdacaca-eb16-44ad-912b-4ab5f0f7e584\") " pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75"
Jul 02 21:04:58.935498 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:58.935480    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n9lg\" (UniqueName: \"kubernetes.io/projected/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-kube-api-access-7n9lg\") pod \"e2e-api-a-d84344-openshift-default-8555bcd689-z2r75\" (UID: \"8cdacaca-eb16-44ad-912b-4ab5f0f7e584\") " pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75"
Jul 02 21:04:58.951263 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:58.951244    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75"
Jul 02 21:04:59.087443 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:59.087414    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75"]
Jul 02 21:04:59.088700 ip-10-0-135-220 kubenswrapper[2581]: W0702 21:04:59.088674    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cdacaca_eb16_44ad_912b_4ab5f0f7e584.slice/crio-8a53608611b73cc3591da29f540ae97b93d86e97f97003ea053cfd1cfa33bba7 WatchSource:0}: Error finding container 8a53608611b73cc3591da29f540ae97b93d86e97f97003ea053cfd1cfa33bba7: Status 404 returned error can't find the container with id 8a53608611b73cc3591da29f540ae97b93d86e97f97003ea053cfd1cfa33bba7
Jul 02 21:04:59.090799 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:59.090765    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 21:04:59.090906 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:59.090843    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 21:04:59.090906 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:59.090888    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 21:04:59.176256 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:59.176220    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:04:59.600507 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:59.600473    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75" event={"ID":"8cdacaca-eb16-44ad-912b-4ab5f0f7e584","Type":"ContainerStarted","Data":"2404e4652e2b0edd4906ab60c537c73c5821b6548e5f772e91f7f6f07c8a5c43"}
Jul 02 21:04:59.600658 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:59.600555    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75" event={"ID":"8cdacaca-eb16-44ad-912b-4ab5f0f7e584","Type":"ContainerStarted","Data":"8a53608611b73cc3591da29f540ae97b93d86e97f97003ea053cfd1cfa33bba7"}
Jul 02 21:04:59.623859 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:59.623811    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75" podStartSLOduration=1.62379521 podStartE2EDuration="1.62379521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:04:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:04:59.621689969 +0000 UTC m=+1933.292203463" watchObservedRunningTime="2026-07-02 21:04:59.62379521 +0000 UTC m=+1933.294308702"
Jul 02 21:04:59.951552 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:04:59.951489    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75"
Jul 02 21:05:00.956543 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:00.956515    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75"
Jul 02 21:05:01.611654 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:01.611622    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75"
Jul 02 21:05:01.612611 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:01.612591    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75"
Jul 02 21:05:01.676298 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:01.676264    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:01.766436 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:01.766399    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:01.842637 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:01.842603    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:01.941255 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:01.941175    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:02.318797 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:02.318763    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:02.419549 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:02.419517    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:02.991318 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:02.991290    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx"
Jul 02 21:05:03.064279 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:03.064208    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4c605b1-be9b-428a-856f-48acc79e2067-istio-envoy\") pod \"f4c605b1-be9b-428a-856f-48acc79e2067\" (UID: \"f4c605b1-be9b-428a-856f-48acc79e2067\") "
Jul 02 21:05:03.064279 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:03.064252    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4c605b1-be9b-428a-856f-48acc79e2067-istiod-ca-cert\") pod \"f4c605b1-be9b-428a-856f-48acc79e2067\" (UID: \"f4c605b1-be9b-428a-856f-48acc79e2067\") "
Jul 02 21:05:03.064279 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:03.064276    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4c605b1-be9b-428a-856f-48acc79e2067-workload-socket\") pod \"f4c605b1-be9b-428a-856f-48acc79e2067\" (UID: \"f4c605b1-be9b-428a-856f-48acc79e2067\") "
Jul 02 21:05:03.064549 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:03.064294    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9cxx\" (UniqueName: \"kubernetes.io/projected/f4c605b1-be9b-428a-856f-48acc79e2067-kube-api-access-r9cxx\") pod \"f4c605b1-be9b-428a-856f-48acc79e2067\" (UID: \"f4c605b1-be9b-428a-856f-48acc79e2067\") "
Jul 02 21:05:03.064549 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:03.064315    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4c605b1-be9b-428a-856f-48acc79e2067-istio-token\") pod \"f4c605b1-be9b-428a-856f-48acc79e2067\" (UID: \"f4c605b1-be9b-428a-856f-48acc79e2067\") "
Jul 02 21:05:03.064549 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:03.064337    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4c605b1-be9b-428a-856f-48acc79e2067-istio-data\") pod \"f4c605b1-be9b-428a-856f-48acc79e2067\" (UID: \"f4c605b1-be9b-428a-856f-48acc79e2067\") "
Jul 02 21:05:03.064549 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:03.064367    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4c605b1-be9b-428a-856f-48acc79e2067-istio-podinfo\") pod \"f4c605b1-be9b-428a-856f-48acc79e2067\" (UID: \"f4c605b1-be9b-428a-856f-48acc79e2067\") "
Jul 02 21:05:03.064549 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:03.064400    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4c605b1-be9b-428a-856f-48acc79e2067-credential-socket\") pod \"f4c605b1-be9b-428a-856f-48acc79e2067\" (UID: \"f4c605b1-be9b-428a-856f-48acc79e2067\") "
Jul 02 21:05:03.064549 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:03.064451    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4c605b1-be9b-428a-856f-48acc79e2067-workload-certs\") pod \"f4c605b1-be9b-428a-856f-48acc79e2067\" (UID: \"f4c605b1-be9b-428a-856f-48acc79e2067\") "
Jul 02 21:05:03.064789 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:03.064569    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4c605b1-be9b-428a-856f-48acc79e2067-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f4c605b1-be9b-428a-856f-48acc79e2067" (UID: "f4c605b1-be9b-428a-856f-48acc79e2067"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:05:03.064789 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:03.064624    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4c605b1-be9b-428a-856f-48acc79e2067-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f4c605b1-be9b-428a-856f-48acc79e2067" (UID: "f4c605b1-be9b-428a-856f-48acc79e2067"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:05:03.064789 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:03.064779    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4c605b1-be9b-428a-856f-48acc79e2067-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f4c605b1-be9b-428a-856f-48acc79e2067" (UID: "f4c605b1-be9b-428a-856f-48acc79e2067"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:05:03.064952 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:03.064812    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4c605b1-be9b-428a-856f-48acc79e2067-istiod-ca-cert\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:05:03.064952 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:03.064854    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4c605b1-be9b-428a-856f-48acc79e2067-workload-socket\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:05:03.064952 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:03.064877    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4c605b1-be9b-428a-856f-48acc79e2067-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f4c605b1-be9b-428a-856f-48acc79e2067" (UID: "f4c605b1-be9b-428a-856f-48acc79e2067"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:05:03.065491 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:03.065467    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4c605b1-be9b-428a-856f-48acc79e2067-istio-data" (OuterVolumeSpecName: "istio-data") pod "f4c605b1-be9b-428a-856f-48acc79e2067" (UID: "f4c605b1-be9b-428a-856f-48acc79e2067"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:05:03.066451 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:03.066422    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4c605b1-be9b-428a-856f-48acc79e2067-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f4c605b1-be9b-428a-856f-48acc79e2067" (UID: "f4c605b1-be9b-428a-856f-48acc79e2067"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:05:03.066558 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:03.066518    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4c605b1-be9b-428a-856f-48acc79e2067-kube-api-access-r9cxx" (OuterVolumeSpecName: "kube-api-access-r9cxx") pod "f4c605b1-be9b-428a-856f-48acc79e2067" (UID: "f4c605b1-be9b-428a-856f-48acc79e2067"). InnerVolumeSpecName "kube-api-access-r9cxx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:05:03.066828 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:03.066808    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f4c605b1-be9b-428a-856f-48acc79e2067-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f4c605b1-be9b-428a-856f-48acc79e2067" (UID: "f4c605b1-be9b-428a-856f-48acc79e2067"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 21:05:03.066899 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:03.066880    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4c605b1-be9b-428a-856f-48acc79e2067-istio-token" (OuterVolumeSpecName: "istio-token") pod "f4c605b1-be9b-428a-856f-48acc79e2067" (UID: "f4c605b1-be9b-428a-856f-48acc79e2067"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:05:03.165558 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:03.165531    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9cxx\" (UniqueName: \"kubernetes.io/projected/f4c605b1-be9b-428a-856f-48acc79e2067-kube-api-access-r9cxx\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:05:03.165558 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:03.165557    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4c605b1-be9b-428a-856f-48acc79e2067-istio-token\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:05:03.165703 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:03.165566    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4c605b1-be9b-428a-856f-48acc79e2067-istio-data\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:05:03.165703 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:03.165574    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4c605b1-be9b-428a-856f-48acc79e2067-istio-podinfo\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:05:03.165703 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:03.165582    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4c605b1-be9b-428a-856f-48acc79e2067-credential-socket\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:05:03.165703 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:03.165590    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4c605b1-be9b-428a-856f-48acc79e2067-workload-certs\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:05:03.165703 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:03.165598    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4c605b1-be9b-428a-856f-48acc79e2067-istio-envoy\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:05:03.624347 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:03.624312    2581 generic.go:356] "Generic (PLEG): container finished" podID="f4c605b1-be9b-428a-856f-48acc79e2067" containerID="6373fc566d554cb3b14275d2dd33b90775cc8356a63e7bb19bdebe51ae67db5d" exitCode=0
Jul 02 21:05:03.624753 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:03.624367    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx"
Jul 02 21:05:03.624753 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:03.624396    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx" event={"ID":"f4c605b1-be9b-428a-856f-48acc79e2067","Type":"ContainerDied","Data":"6373fc566d554cb3b14275d2dd33b90775cc8356a63e7bb19bdebe51ae67db5d"}
Jul 02 21:05:03.624753 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:03.624451    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx" event={"ID":"f4c605b1-be9b-428a-856f-48acc79e2067","Type":"ContainerDied","Data":"aca2ce866f19da4c2647bde92592a91d81d9e3f8032cf43ca88a8c193034d7b4"}
Jul 02 21:05:03.624753 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:03.624474    2581 scope.go:117] "RemoveContainer" containerID="6373fc566d554cb3b14275d2dd33b90775cc8356a63e7bb19bdebe51ae67db5d"
Jul 02 21:05:03.635566 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:03.635545    2581 scope.go:117] "RemoveContainer" containerID="8f363853b39ca6e6d0bcf3baf217d291a931355b1b34275bbe26a3eef19619b1"
Jul 02 21:05:03.644200 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:03.644182    2581 scope.go:117] "RemoveContainer" containerID="6373fc566d554cb3b14275d2dd33b90775cc8356a63e7bb19bdebe51ae67db5d"
Jul 02 21:05:03.644427 ip-10-0-135-220 kubenswrapper[2581]: E0702 21:05:03.644406    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6373fc566d554cb3b14275d2dd33b90775cc8356a63e7bb19bdebe51ae67db5d\": container with ID starting with 6373fc566d554cb3b14275d2dd33b90775cc8356a63e7bb19bdebe51ae67db5d not found: ID does not exist" containerID="6373fc566d554cb3b14275d2dd33b90775cc8356a63e7bb19bdebe51ae67db5d"
Jul 02 21:05:03.644506 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:03.644435    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6373fc566d554cb3b14275d2dd33b90775cc8356a63e7bb19bdebe51ae67db5d"} err="failed to get container status \"6373fc566d554cb3b14275d2dd33b90775cc8356a63e7bb19bdebe51ae67db5d\": rpc error: code = NotFound desc = could not find container \"6373fc566d554cb3b14275d2dd33b90775cc8356a63e7bb19bdebe51ae67db5d\": container with ID starting with 6373fc566d554cb3b14275d2dd33b90775cc8356a63e7bb19bdebe51ae67db5d not found: ID does not exist"
Jul 02 21:05:03.644506 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:03.644458    2581 scope.go:117] "RemoveContainer" containerID="8f363853b39ca6e6d0bcf3baf217d291a931355b1b34275bbe26a3eef19619b1"
Jul 02 21:05:03.644676 ip-10-0-135-220 kubenswrapper[2581]: E0702 21:05:03.644658    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f363853b39ca6e6d0bcf3baf217d291a931355b1b34275bbe26a3eef19619b1\": container with ID starting with 8f363853b39ca6e6d0bcf3baf217d291a931355b1b34275bbe26a3eef19619b1 not found: ID does not exist" containerID="8f363853b39ca6e6d0bcf3baf217d291a931355b1b34275bbe26a3eef19619b1"
Jul 02 21:05:03.644732 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:03.644682    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f363853b39ca6e6d0bcf3baf217d291a931355b1b34275bbe26a3eef19619b1"} err="failed to get container status \"8f363853b39ca6e6d0bcf3baf217d291a931355b1b34275bbe26a3eef19619b1\": rpc error: code = NotFound desc = could not find container \"8f363853b39ca6e6d0bcf3baf217d291a931355b1b34275bbe26a3eef19619b1\": container with ID starting with 8f363853b39ca6e6d0bcf3baf217d291a931355b1b34275bbe26a3eef19619b1 not found: ID does not exist"
Jul 02 21:05:03.649608 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:03.649586    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx"]
Jul 02 21:05:03.651699 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:03.651680    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-f407e7-openshift-default-5db95d989-6n6hx"]
Jul 02 21:05:04.881607 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:04.881574    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4c605b1-be9b-428a-856f-48acc79e2067" path="/var/lib/kubelet/pods/f4c605b1-be9b-428a-856f-48acc79e2067/volumes"
Jul 02 21:05:06.162593 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:06.162558    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:06.594982 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:06.594943    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:06.874261 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:06.874131    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms"]
Jul 02 21:05:06.874651 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:06.874624    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4c605b1-be9b-428a-856f-48acc79e2067" containerName="istio-proxy"
Jul 02 21:05:06.874651 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:06.874645    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4c605b1-be9b-428a-856f-48acc79e2067" containerName="istio-proxy"
Jul 02 21:05:06.874816 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:06.874668    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="959bdb1e-f4e7-4219-9d97-3d5263c68965" containerName="istio-proxy"
Jul 02 21:05:06.874816 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:06.874677    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="959bdb1e-f4e7-4219-9d97-3d5263c68965" containerName="istio-proxy"
Jul 02 21:05:06.874816 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:06.874780    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4c605b1-be9b-428a-856f-48acc79e2067" containerName="istio-proxy"
Jul 02 21:05:06.879422 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:06.879396    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms"
Jul 02 21:05:06.881804 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:06.881784    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-f67bf4-openshift-default-dockercfg-ssnjf\""
Jul 02 21:05:06.889697 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:06.889673    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms"]
Jul 02 21:05:06.898099 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:06.898072    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61cef952-6a21-424a-97aa-47a840260710-credential-socket\") pod \"e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms\" (UID: \"61cef952-6a21-424a-97aa-47a840260710\") " pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms"
Jul 02 21:05:06.898227 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:06.898100    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61cef952-6a21-424a-97aa-47a840260710-istio-podinfo\") pod \"e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms\" (UID: \"61cef952-6a21-424a-97aa-47a840260710\") " pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms"
Jul 02 21:05:06.898227 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:06.898119    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8kcf\" (UniqueName: \"kubernetes.io/projected/61cef952-6a21-424a-97aa-47a840260710-kube-api-access-f8kcf\") pod \"e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms\" (UID: \"61cef952-6a21-424a-97aa-47a840260710\") " pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms"
Jul 02 21:05:06.898227 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:06.898167    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61cef952-6a21-424a-97aa-47a840260710-workload-socket\") pod \"e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms\" (UID: \"61cef952-6a21-424a-97aa-47a840260710\") " pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms"
Jul 02 21:05:06.898413 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:06.898241    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61cef952-6a21-424a-97aa-47a840260710-istio-token\") pod \"e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms\" (UID: \"61cef952-6a21-424a-97aa-47a840260710\") " pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms"
Jul 02 21:05:06.898413 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:06.898292    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61cef952-6a21-424a-97aa-47a840260710-workload-certs\") pod \"e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms\" (UID: \"61cef952-6a21-424a-97aa-47a840260710\") " pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms"
Jul 02 21:05:06.898413 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:06.898321    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61cef952-6a21-424a-97aa-47a840260710-istiod-ca-cert\") pod \"e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms\" (UID: \"61cef952-6a21-424a-97aa-47a840260710\") " pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms"
Jul 02 21:05:06.898413 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:06.898387    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61cef952-6a21-424a-97aa-47a840260710-istio-envoy\") pod \"e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms\" (UID: \"61cef952-6a21-424a-97aa-47a840260710\") " pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms"
Jul 02 21:05:06.898633 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:06.898459    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61cef952-6a21-424a-97aa-47a840260710-istio-data\") pod \"e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms\" (UID: \"61cef952-6a21-424a-97aa-47a840260710\") " pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms"
Jul 02 21:05:06.900401 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:06.900381    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:06.999515 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:06.999479    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61cef952-6a21-424a-97aa-47a840260710-workload-certs\") pod \"e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms\" (UID: \"61cef952-6a21-424a-97aa-47a840260710\") " pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms"
Jul 02 21:05:06.999515 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:06.999520    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61cef952-6a21-424a-97aa-47a840260710-istiod-ca-cert\") pod \"e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms\" (UID: \"61cef952-6a21-424a-97aa-47a840260710\") " pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms"
Jul 02 21:05:06.999729 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:06.999557    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61cef952-6a21-424a-97aa-47a840260710-istio-envoy\") pod \"e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms\" (UID: \"61cef952-6a21-424a-97aa-47a840260710\") " pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms"
Jul 02 21:05:06.999729 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:06.999608    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61cef952-6a21-424a-97aa-47a840260710-istio-data\") pod \"e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms\" (UID: \"61cef952-6a21-424a-97aa-47a840260710\") " pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms"
Jul 02 21:05:06.999729 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:06.999660    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61cef952-6a21-424a-97aa-47a840260710-credential-socket\") pod \"e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms\" (UID: \"61cef952-6a21-424a-97aa-47a840260710\") " pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms"
Jul 02 21:05:06.999729 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:06.999675    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61cef952-6a21-424a-97aa-47a840260710-istio-podinfo\") pod \"e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms\" (UID: \"61cef952-6a21-424a-97aa-47a840260710\") " pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms"
Jul 02 21:05:06.999729 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:06.999694    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8kcf\" (UniqueName: \"kubernetes.io/projected/61cef952-6a21-424a-97aa-47a840260710-kube-api-access-f8kcf\") pod \"e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms\" (UID: \"61cef952-6a21-424a-97aa-47a840260710\") " pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms"
Jul 02 21:05:06.999969 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:06.999732    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61cef952-6a21-424a-97aa-47a840260710-workload-socket\") pod \"e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms\" (UID: \"61cef952-6a21-424a-97aa-47a840260710\") " pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms"
Jul 02 21:05:06.999969 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:06.999764    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61cef952-6a21-424a-97aa-47a840260710-istio-token\") pod \"e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms\" (UID: \"61cef952-6a21-424a-97aa-47a840260710\") " pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms"
Jul 02 21:05:06.999969 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:06.999907    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61cef952-6a21-424a-97aa-47a840260710-workload-certs\") pod \"e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms\" (UID: \"61cef952-6a21-424a-97aa-47a840260710\") " pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms"
Jul 02 21:05:07.000249 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:07.000225    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61cef952-6a21-424a-97aa-47a840260710-credential-socket\") pod \"e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms\" (UID: \"61cef952-6a21-424a-97aa-47a840260710\") " pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms"
Jul 02 21:05:07.000249 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:07.000240    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61cef952-6a21-424a-97aa-47a840260710-istio-data\") pod \"e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms\" (UID: \"61cef952-6a21-424a-97aa-47a840260710\") " pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms"
Jul 02 21:05:07.000375 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:07.000342    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61cef952-6a21-424a-97aa-47a840260710-istiod-ca-cert\") pod \"e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms\" (UID: \"61cef952-6a21-424a-97aa-47a840260710\") " pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms"
Jul 02 21:05:07.000423 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:07.000408    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61cef952-6a21-424a-97aa-47a840260710-workload-socket\") pod \"e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms\" (UID: \"61cef952-6a21-424a-97aa-47a840260710\") " pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms"
Jul 02 21:05:07.002314 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:07.002281    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61cef952-6a21-424a-97aa-47a840260710-istio-envoy\") pod \"e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms\" (UID: \"61cef952-6a21-424a-97aa-47a840260710\") " pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms"
Jul 02 21:05:07.002555 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:07.002533    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61cef952-6a21-424a-97aa-47a840260710-istio-podinfo\") pod \"e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms\" (UID: \"61cef952-6a21-424a-97aa-47a840260710\") " pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms"
Jul 02 21:05:07.007353 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:07.007327    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61cef952-6a21-424a-97aa-47a840260710-istio-token\") pod \"e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms\" (UID: \"61cef952-6a21-424a-97aa-47a840260710\") " pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms"
Jul 02 21:05:07.007718 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:07.007696    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8kcf\" (UniqueName: \"kubernetes.io/projected/61cef952-6a21-424a-97aa-47a840260710-kube-api-access-f8kcf\") pod \"e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms\" (UID: \"61cef952-6a21-424a-97aa-47a840260710\") " pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms"
Jul 02 21:05:07.119343 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:07.119312    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:07.191422 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:07.191348    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms"
Jul 02 21:05:07.329190 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:07.329160    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms"]
Jul 02 21:05:07.331193 ip-10-0-135-220 kubenswrapper[2581]: W0702 21:05:07.331162    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61cef952_6a21_424a_97aa_47a840260710.slice/crio-ede6fba4d985ee6ef9def4a6f3c659ba636baa1427eba262d32e3b539d70b1d1 WatchSource:0}: Error finding container ede6fba4d985ee6ef9def4a6f3c659ba636baa1427eba262d32e3b539d70b1d1: Status 404 returned error can't find the container with id ede6fba4d985ee6ef9def4a6f3c659ba636baa1427eba262d32e3b539d70b1d1
Jul 02 21:05:07.333451 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:07.333416    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 21:05:07.333528 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:07.333485    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 21:05:07.333528 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:07.333513    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 21:05:07.649973 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:07.649940    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms" event={"ID":"61cef952-6a21-424a-97aa-47a840260710","Type":"ContainerStarted","Data":"0c42752fc2f9bd64a3d7121aa5e0561471210afad904f8e3bc3efb0f90663146"}
Jul 02 21:05:07.650162 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:07.649997    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms" event={"ID":"61cef952-6a21-424a-97aa-47a840260710","Type":"ContainerStarted","Data":"ede6fba4d985ee6ef9def4a6f3c659ba636baa1427eba262d32e3b539d70b1d1"}
Jul 02 21:05:07.673010 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:07.672968    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms" podStartSLOduration=1.672953269 podStartE2EDuration="1.672953269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:05:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:05:07.670247791 +0000 UTC m=+1941.340761284" watchObservedRunningTime="2026-07-02 21:05:07.672953269 +0000 UTC m=+1941.343466761"
Jul 02 21:05:08.192307 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:08.192272    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms"
Jul 02 21:05:08.197241 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:08.197216    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms"
Jul 02 21:05:08.657734 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:08.657709    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms"
Jul 02 21:05:08.658603 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:08.658579    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms"
Jul 02 21:05:09.594785 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:09.594751    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 21:05:09.693600 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:09.693555    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:09.778178 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:09.778113    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:09.855009 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:09.854921    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:10.215134 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:10.215095    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:10.315054 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:10.315023    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:10.417069 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:10.417033    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:14.187824 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:14.187787    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:17.652301 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:17.652260    2581 patch_prober.go:28] interesting pod/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 02 21:05:17.652696 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:17.652315    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75" podUID="8cdacaca-eb16-44ad-912b-4ab5f0f7e584" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 02 21:05:18.720826 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:18.720789    2581 generic.go:356] "Generic (PLEG): container finished" podID="8cdacaca-eb16-44ad-912b-4ab5f0f7e584" containerID="2404e4652e2b0edd4906ab60c537c73c5821b6548e5f772e91f7f6f07c8a5c43" exitCode=0
Jul 02 21:05:18.721259 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:18.720860    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75" event={"ID":"8cdacaca-eb16-44ad-912b-4ab5f0f7e584","Type":"ContainerDied","Data":"2404e4652e2b0edd4906ab60c537c73c5821b6548e5f772e91f7f6f07c8a5c43"}
Jul 02 21:05:18.721305 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:18.721266    2581 scope.go:117] "RemoveContainer" containerID="2404e4652e2b0edd4906ab60c537c73c5821b6548e5f772e91f7f6f07c8a5c43"
Jul 02 21:05:18.722279 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:18.722238    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 21:05:18.722358 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:18.722324    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 21:05:18.722395 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:18.722360    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 21:05:19.728126 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:19.728082    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75" event={"ID":"8cdacaca-eb16-44ad-912b-4ab5f0f7e584","Type":"ContainerStarted","Data":"c56dccdaf405210a48239c0947d88bb3ab3b57662715f1f1e4016bccf56766f6"}
Jul 02 21:05:19.951834 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:19.951793    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75"
Jul 02 21:05:19.952025 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:19.951916    2581 patch_prober.go:28] interesting pod/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 02 21:05:19.952025 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:19.951969    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75" podUID="8cdacaca-eb16-44ad-912b-4ab5f0f7e584" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 02 21:05:20.952860 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:20.952822    2581 patch_prober.go:28] interesting pod/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 02 21:05:20.953375 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:20.952888    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75" podUID="8cdacaca-eb16-44ad-912b-4ab5f0f7e584" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 02 21:05:21.952689 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:21.952642    2581 patch_prober.go:28] interesting pod/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 02 21:05:21.952903 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:21.952712    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75" podUID="8cdacaca-eb16-44ad-912b-4ab5f0f7e584" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 02 21:05:22.269747 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:22.269581    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:22.669921 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:22.669782    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:22.769811 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:22.769760    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:22.870833 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:22.870788    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:22.952527 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:22.952441    2581 patch_prober.go:28] interesting pod/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 02 21:05:22.952825 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:22.952793    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75" podUID="8cdacaca-eb16-44ad-912b-4ab5f0f7e584" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 02 21:05:22.966875 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:22.966834    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:23.956134 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:23.956096    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75"
Jul 02 21:05:23.956510 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:23.956493    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75"
Jul 02 21:05:23.957300 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:23.957281    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75"
Jul 02 21:05:24.698288 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:24.698254    2581 patch_prober.go:28] interesting pod/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 02 21:05:24.698649 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:24.698332    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms" podUID="61cef952-6a21-424a-97aa-47a840260710" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 02 21:05:25.896367 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:25.896334    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 21:05:26.776128 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:26.776097    2581 generic.go:356] "Generic (PLEG): container finished" podID="61cef952-6a21-424a-97aa-47a840260710" containerID="0c42752fc2f9bd64a3d7121aa5e0561471210afad904f8e3bc3efb0f90663146" exitCode=0
Jul 02 21:05:26.776318 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:26.776176    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms" event={"ID":"61cef952-6a21-424a-97aa-47a840260710","Type":"ContainerDied","Data":"0c42752fc2f9bd64a3d7121aa5e0561471210afad904f8e3bc3efb0f90663146"}
Jul 02 21:05:26.776533 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:26.776519    2581 scope.go:117] "RemoveContainer" containerID="0c42752fc2f9bd64a3d7121aa5e0561471210afad904f8e3bc3efb0f90663146"
Jul 02 21:05:26.777511 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:26.777482    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 21:05:26.777587 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:26.777557    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 21:05:26.777623 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:26.777592    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 21:05:27.783649 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:27.783619    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms" event={"ID":"61cef952-6a21-424a-97aa-47a840260710","Type":"ContainerStarted","Data":"d3ac5586247fcca1af83a452f6dc3ce55f3c5a4ef99ab9e493655f554fbc33ca"}
Jul 02 21:05:28.192586 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:28.192479    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms"
Jul 02 21:05:28.192745 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:28.192704    2581 patch_prober.go:28] interesting pod/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 02 21:05:28.192789 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:28.192751    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms" podUID="61cef952-6a21-424a-97aa-47a840260710" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 02 21:05:28.706987 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:28.706939    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:28.806989 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:28.806960    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:28.947458 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:28.947416    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75"]
Jul 02 21:05:28.948945 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:28.948902    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75" podUID="8cdacaca-eb16-44ad-912b-4ab5f0f7e584" containerName="istio-proxy" containerID="cri-o://c56dccdaf405210a48239c0947d88bb3ab3b57662715f1f1e4016bccf56766f6" gracePeriod=30
Jul 02 21:05:28.966975 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:28.966944    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:29.191785 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:29.191748    2581 patch_prober.go:28] interesting pod/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 02 21:05:29.191948 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:29.191802    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms" podUID="61cef952-6a21-424a-97aa-47a840260710" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 02 21:05:29.400079 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:29.399986    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:29.909969 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:29.909931    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:30.014489 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:30.014453    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:30.111985 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:30.111944    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:30.191876 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:30.191786    2581 patch_prober.go:28] interesting pod/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 02 21:05:30.191876 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:30.191841    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms" podUID="61cef952-6a21-424a-97aa-47a840260710" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 02 21:05:30.264922 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:30.264888    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:31.192704 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:31.192669    2581 patch_prober.go:28] interesting pod/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 02 21:05:31.193084 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:31.192729    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms" podUID="61cef952-6a21-424a-97aa-47a840260710" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 02 21:05:32.195548 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:32.195516    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms"
Jul 02 21:05:32.195999 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:32.195901    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms"
Jul 02 21:05:32.196445 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:32.196426    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms"
Jul 02 21:05:34.212693 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:34.212667    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75"
Jul 02 21:05:34.371965 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:34.371877    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-workload-socket\") pod \"8cdacaca-eb16-44ad-912b-4ab5f0f7e584\" (UID: \"8cdacaca-eb16-44ad-912b-4ab5f0f7e584\") "
Jul 02 21:05:34.371965 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:34.371921    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-credential-socket\") pod \"8cdacaca-eb16-44ad-912b-4ab5f0f7e584\" (UID: \"8cdacaca-eb16-44ad-912b-4ab5f0f7e584\") "
Jul 02 21:05:34.371965 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:34.371953    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-workload-certs\") pod \"8cdacaca-eb16-44ad-912b-4ab5f0f7e584\" (UID: \"8cdacaca-eb16-44ad-912b-4ab5f0f7e584\") "
Jul 02 21:05:34.372268 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:34.372004    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-istio-envoy\") pod \"8cdacaca-eb16-44ad-912b-4ab5f0f7e584\" (UID: \"8cdacaca-eb16-44ad-912b-4ab5f0f7e584\") "
Jul 02 21:05:34.372268 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:34.372030    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-istio-token\") pod \"8cdacaca-eb16-44ad-912b-4ab5f0f7e584\" (UID: \"8cdacaca-eb16-44ad-912b-4ab5f0f7e584\") "
Jul 02 21:05:34.372268 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:34.372082    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-istio-data\") pod \"8cdacaca-eb16-44ad-912b-4ab5f0f7e584\" (UID: \"8cdacaca-eb16-44ad-912b-4ab5f0f7e584\") "
Jul 02 21:05:34.372268 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:34.372134    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-istio-podinfo\") pod \"8cdacaca-eb16-44ad-912b-4ab5f0f7e584\" (UID: \"8cdacaca-eb16-44ad-912b-4ab5f0f7e584\") "
Jul 02 21:05:34.372268 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:34.372188    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7n9lg\" (UniqueName: \"kubernetes.io/projected/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-kube-api-access-7n9lg\") pod \"8cdacaca-eb16-44ad-912b-4ab5f0f7e584\" (UID: \"8cdacaca-eb16-44ad-912b-4ab5f0f7e584\") "
Jul 02 21:05:34.372268 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:34.372233    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-istiod-ca-cert\") pod \"8cdacaca-eb16-44ad-912b-4ab5f0f7e584\" (UID: \"8cdacaca-eb16-44ad-912b-4ab5f0f7e584\") "
Jul 02 21:05:34.372618 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:34.372236    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8cdacaca-eb16-44ad-912b-4ab5f0f7e584" (UID: "8cdacaca-eb16-44ad-912b-4ab5f0f7e584"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:05:34.372618 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:34.372316    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8cdacaca-eb16-44ad-912b-4ab5f0f7e584" (UID: "8cdacaca-eb16-44ad-912b-4ab5f0f7e584"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:05:34.372618 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:34.372407    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8cdacaca-eb16-44ad-912b-4ab5f0f7e584" (UID: "8cdacaca-eb16-44ad-912b-4ab5f0f7e584"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:05:34.372618 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:34.372588    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-workload-socket\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:05:34.372618 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:34.372603    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-credential-socket\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:05:34.372618 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:34.372613    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-workload-certs\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:05:34.373022 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:34.372663    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8cdacaca-eb16-44ad-912b-4ab5f0f7e584" (UID: "8cdacaca-eb16-44ad-912b-4ab5f0f7e584"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:05:34.373370 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:34.373338    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-istio-data" (OuterVolumeSpecName: "istio-data") pod "8cdacaca-eb16-44ad-912b-4ab5f0f7e584" (UID: "8cdacaca-eb16-44ad-912b-4ab5f0f7e584"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:05:34.374609 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:34.374587    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8cdacaca-eb16-44ad-912b-4ab5f0f7e584" (UID: "8cdacaca-eb16-44ad-912b-4ab5f0f7e584"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 21:05:34.374712 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:34.374681    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-kube-api-access-7n9lg" (OuterVolumeSpecName: "kube-api-access-7n9lg") pod "8cdacaca-eb16-44ad-912b-4ab5f0f7e584" (UID: "8cdacaca-eb16-44ad-912b-4ab5f0f7e584"). InnerVolumeSpecName "kube-api-access-7n9lg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:05:34.374712 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:34.374687    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-istio-token" (OuterVolumeSpecName: "istio-token") pod "8cdacaca-eb16-44ad-912b-4ab5f0f7e584" (UID: "8cdacaca-eb16-44ad-912b-4ab5f0f7e584"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:05:34.374788 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:34.374732    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8cdacaca-eb16-44ad-912b-4ab5f0f7e584" (UID: "8cdacaca-eb16-44ad-912b-4ab5f0f7e584"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:05:34.473361 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:34.473333    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-istio-podinfo\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:05:34.473361 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:34.473358    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7n9lg\" (UniqueName: \"kubernetes.io/projected/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-kube-api-access-7n9lg\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:05:34.473519 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:34.473369    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-istiod-ca-cert\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:05:34.473519 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:34.473378    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-istio-envoy\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:05:34.473519 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:34.473386    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-istio-token\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:05:34.473519 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:34.473393    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8cdacaca-eb16-44ad-912b-4ab5f0f7e584-istio-data\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:05:34.820929 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:34.820899    2581 generic.go:356] "Generic (PLEG): container finished" podID="8cdacaca-eb16-44ad-912b-4ab5f0f7e584" containerID="c56dccdaf405210a48239c0947d88bb3ab3b57662715f1f1e4016bccf56766f6" exitCode=0
Jul 02 21:05:34.821098 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:34.820944    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75"
Jul 02 21:05:34.821098 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:34.820981    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75" event={"ID":"8cdacaca-eb16-44ad-912b-4ab5f0f7e584","Type":"ContainerDied","Data":"c56dccdaf405210a48239c0947d88bb3ab3b57662715f1f1e4016bccf56766f6"}
Jul 02 21:05:34.821098 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:34.821052    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75" event={"ID":"8cdacaca-eb16-44ad-912b-4ab5f0f7e584","Type":"ContainerDied","Data":"8a53608611b73cc3591da29f540ae97b93d86e97f97003ea053cfd1cfa33bba7"}
Jul 02 21:05:34.821098 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:34.821076    2581 scope.go:117] "RemoveContainer" containerID="c56dccdaf405210a48239c0947d88bb3ab3b57662715f1f1e4016bccf56766f6"
Jul 02 21:05:34.832098 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:34.832082    2581 scope.go:117] "RemoveContainer" containerID="2404e4652e2b0edd4906ab60c537c73c5821b6548e5f772e91f7f6f07c8a5c43"
Jul 02 21:05:34.843121 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:34.843091    2581 scope.go:117] "RemoveContainer" containerID="c56dccdaf405210a48239c0947d88bb3ab3b57662715f1f1e4016bccf56766f6"
Jul 02 21:05:34.843392 ip-10-0-135-220 kubenswrapper[2581]: E0702 21:05:34.843374    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c56dccdaf405210a48239c0947d88bb3ab3b57662715f1f1e4016bccf56766f6\": container with ID starting with c56dccdaf405210a48239c0947d88bb3ab3b57662715f1f1e4016bccf56766f6 not found: ID does not exist" containerID="c56dccdaf405210a48239c0947d88bb3ab3b57662715f1f1e4016bccf56766f6"
Jul 02 21:05:34.843460 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:34.843399    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c56dccdaf405210a48239c0947d88bb3ab3b57662715f1f1e4016bccf56766f6"} err="failed to get container status \"c56dccdaf405210a48239c0947d88bb3ab3b57662715f1f1e4016bccf56766f6\": rpc error: code = NotFound desc = could not find container \"c56dccdaf405210a48239c0947d88bb3ab3b57662715f1f1e4016bccf56766f6\": container with ID starting with c56dccdaf405210a48239c0947d88bb3ab3b57662715f1f1e4016bccf56766f6 not found: ID does not exist"
Jul 02 21:05:34.843460 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:34.843415    2581 scope.go:117] "RemoveContainer" containerID="2404e4652e2b0edd4906ab60c537c73c5821b6548e5f772e91f7f6f07c8a5c43"
Jul 02 21:05:34.843676 ip-10-0-135-220 kubenswrapper[2581]: E0702 21:05:34.843662    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2404e4652e2b0edd4906ab60c537c73c5821b6548e5f772e91f7f6f07c8a5c43\": container with ID starting with 2404e4652e2b0edd4906ab60c537c73c5821b6548e5f772e91f7f6f07c8a5c43 not found: ID does not exist" containerID="2404e4652e2b0edd4906ab60c537c73c5821b6548e5f772e91f7f6f07c8a5c43"
Jul 02 21:05:34.843731 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:34.843679    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2404e4652e2b0edd4906ab60c537c73c5821b6548e5f772e91f7f6f07c8a5c43"} err="failed to get container status \"2404e4652e2b0edd4906ab60c537c73c5821b6548e5f772e91f7f6f07c8a5c43\": rpc error: code = NotFound desc = could not find container \"2404e4652e2b0edd4906ab60c537c73c5821b6548e5f772e91f7f6f07c8a5c43\": container with ID starting with 2404e4652e2b0edd4906ab60c537c73c5821b6548e5f772e91f7f6f07c8a5c43 not found: ID does not exist"
Jul 02 21:05:34.845464 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:34.845446    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75"]
Jul 02 21:05:34.848545 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:34.848523    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-d84344-openshift-default-8555bcd689-z2r75"]
Jul 02 21:05:34.881209 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:34.881186    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cdacaca-eb16-44ad-912b-4ab5f0f7e584" path="/var/lib/kubelet/pods/8cdacaca-eb16-44ad-912b-4ab5f0f7e584/volumes"
Jul 02 21:05:35.831850 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:35.831819    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:35.934672 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:35.934640    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:36.094437 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:36.094362    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms"]
Jul 02 21:05:36.094609 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:36.094587    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms" podUID="61cef952-6a21-424a-97aa-47a840260710" containerName="istio-proxy" containerID="cri-o://d3ac5586247fcca1af83a452f6dc3ce55f3c5a4ef99ab9e493655f554fbc33ca" gracePeriod=30
Jul 02 21:05:36.126701 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:36.126669    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:36.673700 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:36.673668    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:36.981789 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:36.981760    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t"]
Jul 02 21:05:36.982163 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:36.982103    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cdacaca-eb16-44ad-912b-4ab5f0f7e584" containerName="istio-proxy"
Jul 02 21:05:36.982163 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:36.982115    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cdacaca-eb16-44ad-912b-4ab5f0f7e584" containerName="istio-proxy"
Jul 02 21:05:36.982163 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:36.982127    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4c605b1-be9b-428a-856f-48acc79e2067" containerName="istio-proxy"
Jul 02 21:05:36.982163 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:36.982133    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4c605b1-be9b-428a-856f-48acc79e2067" containerName="istio-proxy"
Jul 02 21:05:36.982163 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:36.982158    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cdacaca-eb16-44ad-912b-4ab5f0f7e584" containerName="istio-proxy"
Jul 02 21:05:36.982163 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:36.982164    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cdacaca-eb16-44ad-912b-4ab5f0f7e584" containerName="istio-proxy"
Jul 02 21:05:36.982367 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:36.982228    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4c605b1-be9b-428a-856f-48acc79e2067" containerName="istio-proxy"
Jul 02 21:05:36.982367 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:36.982239    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cdacaca-eb16-44ad-912b-4ab5f0f7e584" containerName="istio-proxy"
Jul 02 21:05:36.984987 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:36.984969    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t"
Jul 02 21:05:36.987485 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:36.987453    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-58d1e3-openshift-default-dockercfg-825c2\""
Jul 02 21:05:36.995873 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:36.995847    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:36.996682 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:36.996658    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t"]
Jul 02 21:05:37.095764 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:37.095732    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bg2z8\" (UniqueName: \"kubernetes.io/projected/16540e5a-f90d-4ba4-9285-2754d6c0a66e-kube-api-access-bg2z8\") pod \"e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t\" (UID: \"16540e5a-f90d-4ba4-9285-2754d6c0a66e\") " pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t"
Jul 02 21:05:37.095764 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:37.095767    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16540e5a-f90d-4ba4-9285-2754d6c0a66e-istio-envoy\") pod \"e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t\" (UID: \"16540e5a-f90d-4ba4-9285-2754d6c0a66e\") " pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t"
Jul 02 21:05:37.095965 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:37.095806    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16540e5a-f90d-4ba4-9285-2754d6c0a66e-workload-socket\") pod \"e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t\" (UID: \"16540e5a-f90d-4ba4-9285-2754d6c0a66e\") " pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t"
Jul 02 21:05:37.095965 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:37.095865    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16540e5a-f90d-4ba4-9285-2754d6c0a66e-istiod-ca-cert\") pod \"e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t\" (UID: \"16540e5a-f90d-4ba4-9285-2754d6c0a66e\") " pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t"
Jul 02 21:05:37.095965 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:37.095930    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16540e5a-f90d-4ba4-9285-2754d6c0a66e-credential-socket\") pod \"e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t\" (UID: \"16540e5a-f90d-4ba4-9285-2754d6c0a66e\") " pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t"
Jul 02 21:05:37.096061 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:37.095987    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16540e5a-f90d-4ba4-9285-2754d6c0a66e-workload-certs\") pod \"e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t\" (UID: \"16540e5a-f90d-4ba4-9285-2754d6c0a66e\") " pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t"
Jul 02 21:05:37.096061 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:37.096017    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16540e5a-f90d-4ba4-9285-2754d6c0a66e-istio-token\") pod \"e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t\" (UID: \"16540e5a-f90d-4ba4-9285-2754d6c0a66e\") " pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t"
Jul 02 21:05:37.096061 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:37.096050    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16540e5a-f90d-4ba4-9285-2754d6c0a66e-istio-podinfo\") pod \"e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t\" (UID: \"16540e5a-f90d-4ba4-9285-2754d6c0a66e\") " pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t"
Jul 02 21:05:37.096210 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:37.096071    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16540e5a-f90d-4ba4-9285-2754d6c0a66e-istio-data\") pod \"e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t\" (UID: \"16540e5a-f90d-4ba4-9285-2754d6c0a66e\") " pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t"
Jul 02 21:05:37.196989 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:37.196955    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16540e5a-f90d-4ba4-9285-2754d6c0a66e-credential-socket\") pod \"e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t\" (UID: \"16540e5a-f90d-4ba4-9285-2754d6c0a66e\") " pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t"
Jul 02 21:05:37.197178 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:37.197003    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16540e5a-f90d-4ba4-9285-2754d6c0a66e-workload-certs\") pod \"e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t\" (UID: \"16540e5a-f90d-4ba4-9285-2754d6c0a66e\") " pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t"
Jul 02 21:05:37.197178 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:37.197026    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16540e5a-f90d-4ba4-9285-2754d6c0a66e-istio-token\") pod \"e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t\" (UID: \"16540e5a-f90d-4ba4-9285-2754d6c0a66e\") " pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t"
Jul 02 21:05:37.197178 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:37.197059    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16540e5a-f90d-4ba4-9285-2754d6c0a66e-istio-podinfo\") pod \"e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t\" (UID: \"16540e5a-f90d-4ba4-9285-2754d6c0a66e\") " pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t"
Jul 02 21:05:37.197178 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:37.197087    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16540e5a-f90d-4ba4-9285-2754d6c0a66e-istio-data\") pod \"e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t\" (UID: \"16540e5a-f90d-4ba4-9285-2754d6c0a66e\") " pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t"
Jul 02 21:05:37.197178 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:37.197132    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bg2z8\" (UniqueName: \"kubernetes.io/projected/16540e5a-f90d-4ba4-9285-2754d6c0a66e-kube-api-access-bg2z8\") pod \"e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t\" (UID: \"16540e5a-f90d-4ba4-9285-2754d6c0a66e\") " pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t"
Jul 02 21:05:37.197456 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:37.197185    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16540e5a-f90d-4ba4-9285-2754d6c0a66e-istio-envoy\") pod \"e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t\" (UID: \"16540e5a-f90d-4ba4-9285-2754d6c0a66e\") " pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t"
Jul 02 21:05:37.197456 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:37.197348    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16540e5a-f90d-4ba4-9285-2754d6c0a66e-workload-socket\") pod \"e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t\" (UID: \"16540e5a-f90d-4ba4-9285-2754d6c0a66e\") " pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t"
Jul 02 21:05:37.197456 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:37.197394    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16540e5a-f90d-4ba4-9285-2754d6c0a66e-istiod-ca-cert\") pod \"e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t\" (UID: \"16540e5a-f90d-4ba4-9285-2754d6c0a66e\") " pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t"
Jul 02 21:05:37.197456 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:37.197433    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16540e5a-f90d-4ba4-9285-2754d6c0a66e-credential-socket\") pod \"e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t\" (UID: \"16540e5a-f90d-4ba4-9285-2754d6c0a66e\") " pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t"
Jul 02 21:05:37.197684 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:37.197467    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16540e5a-f90d-4ba4-9285-2754d6c0a66e-workload-certs\") pod \"e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t\" (UID: \"16540e5a-f90d-4ba4-9285-2754d6c0a66e\") " pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t"
Jul 02 21:05:37.197684 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:37.197618    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16540e5a-f90d-4ba4-9285-2754d6c0a66e-istio-data\") pod \"e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t\" (UID: \"16540e5a-f90d-4ba4-9285-2754d6c0a66e\") " pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t"
Jul 02 21:05:37.197684 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:37.197642    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16540e5a-f90d-4ba4-9285-2754d6c0a66e-workload-socket\") pod \"e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t\" (UID: \"16540e5a-f90d-4ba4-9285-2754d6c0a66e\") " pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t"
Jul 02 21:05:37.198023 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:37.198005    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16540e5a-f90d-4ba4-9285-2754d6c0a66e-istiod-ca-cert\") pod \"e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t\" (UID: \"16540e5a-f90d-4ba4-9285-2754d6c0a66e\") " pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t"
Jul 02 21:05:37.199510 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:37.199481    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16540e5a-f90d-4ba4-9285-2754d6c0a66e-istio-envoy\") pod \"e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t\" (UID: \"16540e5a-f90d-4ba4-9285-2754d6c0a66e\") " pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t"
Jul 02 21:05:37.199656 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:37.199642    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16540e5a-f90d-4ba4-9285-2754d6c0a66e-istio-podinfo\") pod \"e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t\" (UID: \"16540e5a-f90d-4ba4-9285-2754d6c0a66e\") " pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t"
Jul 02 21:05:37.205841 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:37.205806    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16540e5a-f90d-4ba4-9285-2754d6c0a66e-istio-token\") pod \"e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t\" (UID: \"16540e5a-f90d-4ba4-9285-2754d6c0a66e\") " pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t"
Jul 02 21:05:37.206037 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:37.206015    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bg2z8\" (UniqueName: \"kubernetes.io/projected/16540e5a-f90d-4ba4-9285-2754d6c0a66e-kube-api-access-bg2z8\") pod \"e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t\" (UID: \"16540e5a-f90d-4ba4-9285-2754d6c0a66e\") " pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t"
Jul 02 21:05:37.289559 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:37.289499    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 21:05:37.295987 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:37.295967    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t"
Jul 02 21:05:37.434594 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:37.434555    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t"]
Jul 02 21:05:37.434594 ip-10-0-135-220 kubenswrapper[2581]: W0702 21:05:37.434598    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16540e5a_f90d_4ba4_9285_2754d6c0a66e.slice/crio-57092db60d05ed0a1a51111901e1f5211ad3d16833619b070e4da685790c704e WatchSource:0}: Error finding container 57092db60d05ed0a1a51111901e1f5211ad3d16833619b070e4da685790c704e: Status 404 returned error can't find the container with id 57092db60d05ed0a1a51111901e1f5211ad3d16833619b070e4da685790c704e
Jul 02 21:05:37.436769 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:37.436737    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 21:05:37.436878 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:37.436811    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 21:05:37.436878 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:37.436856    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 21:05:37.524377 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:37.524342    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:37.840470 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:37.840437    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t" event={"ID":"16540e5a-f90d-4ba4-9285-2754d6c0a66e","Type":"ContainerStarted","Data":"e7118ec9b5416e31fe81f89446babac7a1aea71c1f72f9b5c3f89f6d09a3705f"}
Jul 02 21:05:37.840666 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:37.840520    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t" event={"ID":"16540e5a-f90d-4ba4-9285-2754d6c0a66e","Type":"ContainerStarted","Data":"57092db60d05ed0a1a51111901e1f5211ad3d16833619b070e4da685790c704e"}
Jul 02 21:05:37.861468 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:37.861416    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t" podStartSLOduration=1.861399342 podStartE2EDuration="1.861399342s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:05:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:05:37.859112302 +0000 UTC m=+1971.529625799" watchObservedRunningTime="2026-07-02 21:05:37.861399342 +0000 UTC m=+1971.531912835"
Jul 02 21:05:38.296891 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:38.296858    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t"
Jul 02 21:05:38.301209 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:38.301185    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t"
Jul 02 21:05:38.845905 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:38.845867    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t"
Jul 02 21:05:38.846696 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:38.846674    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t"
Jul 02 21:05:39.855901 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:39.855873    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:39.948502 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:39.948471    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:40.019291 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:40.019255    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:40.123429 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:40.123334    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:40.420232 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:40.420127    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:40.521339 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:40.521305    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:41.344049 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:41.344022    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms"
Jul 02 21:05:41.535232 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:41.535198    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61cef952-6a21-424a-97aa-47a840260710-istio-token\") pod \"61cef952-6a21-424a-97aa-47a840260710\" (UID: \"61cef952-6a21-424a-97aa-47a840260710\") "
Jul 02 21:05:41.535408 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:41.535259    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61cef952-6a21-424a-97aa-47a840260710-istio-podinfo\") pod \"61cef952-6a21-424a-97aa-47a840260710\" (UID: \"61cef952-6a21-424a-97aa-47a840260710\") "
Jul 02 21:05:41.535408 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:41.535291    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61cef952-6a21-424a-97aa-47a840260710-workload-certs\") pod \"61cef952-6a21-424a-97aa-47a840260710\" (UID: \"61cef952-6a21-424a-97aa-47a840260710\") "
Jul 02 21:05:41.535408 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:41.535333    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61cef952-6a21-424a-97aa-47a840260710-istio-data\") pod \"61cef952-6a21-424a-97aa-47a840260710\" (UID: \"61cef952-6a21-424a-97aa-47a840260710\") "
Jul 02 21:05:41.535408 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:41.535373    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61cef952-6a21-424a-97aa-47a840260710-istiod-ca-cert\") pod \"61cef952-6a21-424a-97aa-47a840260710\" (UID: \"61cef952-6a21-424a-97aa-47a840260710\") "
Jul 02 21:05:41.535408 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:41.535402    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61cef952-6a21-424a-97aa-47a840260710-credential-socket\") pod \"61cef952-6a21-424a-97aa-47a840260710\" (UID: \"61cef952-6a21-424a-97aa-47a840260710\") "
Jul 02 21:05:41.535695 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:41.535431    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8kcf\" (UniqueName: \"kubernetes.io/projected/61cef952-6a21-424a-97aa-47a840260710-kube-api-access-f8kcf\") pod \"61cef952-6a21-424a-97aa-47a840260710\" (UID: \"61cef952-6a21-424a-97aa-47a840260710\") "
Jul 02 21:05:41.535695 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:41.535490    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61cef952-6a21-424a-97aa-47a840260710-istio-envoy\") pod \"61cef952-6a21-424a-97aa-47a840260710\" (UID: \"61cef952-6a21-424a-97aa-47a840260710\") "
Jul 02 21:05:41.535695 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:41.535526    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61cef952-6a21-424a-97aa-47a840260710-workload-socket\") pod \"61cef952-6a21-424a-97aa-47a840260710\" (UID: \"61cef952-6a21-424a-97aa-47a840260710\") "
Jul 02 21:05:41.536182 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:41.535951    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61cef952-6a21-424a-97aa-47a840260710-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "61cef952-6a21-424a-97aa-47a840260710" (UID: "61cef952-6a21-424a-97aa-47a840260710"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:05:41.536182 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:41.536022    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61cef952-6a21-424a-97aa-47a840260710-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "61cef952-6a21-424a-97aa-47a840260710" (UID: "61cef952-6a21-424a-97aa-47a840260710"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:05:41.536182 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:41.536088    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61cef952-6a21-424a-97aa-47a840260710-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "61cef952-6a21-424a-97aa-47a840260710" (UID: "61cef952-6a21-424a-97aa-47a840260710"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:05:41.536471 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:41.536223    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61cef952-6a21-424a-97aa-47a840260710-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "61cef952-6a21-424a-97aa-47a840260710" (UID: "61cef952-6a21-424a-97aa-47a840260710"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:05:41.536782 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:41.536760    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61cef952-6a21-424a-97aa-47a840260710-istio-data" (OuterVolumeSpecName: "istio-data") pod "61cef952-6a21-424a-97aa-47a840260710" (UID: "61cef952-6a21-424a-97aa-47a840260710"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:05:41.538489 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:41.538447    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/61cef952-6a21-424a-97aa-47a840260710-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "61cef952-6a21-424a-97aa-47a840260710" (UID: "61cef952-6a21-424a-97aa-47a840260710"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 21:05:41.538576 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:41.538544    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61cef952-6a21-424a-97aa-47a840260710-kube-api-access-f8kcf" (OuterVolumeSpecName: "kube-api-access-f8kcf") pod "61cef952-6a21-424a-97aa-47a840260710" (UID: "61cef952-6a21-424a-97aa-47a840260710"). InnerVolumeSpecName "kube-api-access-f8kcf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:05:41.538648 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:41.538566    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61cef952-6a21-424a-97aa-47a840260710-istio-token" (OuterVolumeSpecName: "istio-token") pod "61cef952-6a21-424a-97aa-47a840260710" (UID: "61cef952-6a21-424a-97aa-47a840260710"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:05:41.538791 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:41.538765    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61cef952-6a21-424a-97aa-47a840260710-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "61cef952-6a21-424a-97aa-47a840260710" (UID: "61cef952-6a21-424a-97aa-47a840260710"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:05:41.636348 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:41.636327    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61cef952-6a21-424a-97aa-47a840260710-istio-podinfo\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:05:41.636348 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:41.636347    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61cef952-6a21-424a-97aa-47a840260710-workload-certs\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:05:41.636489 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:41.636356    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61cef952-6a21-424a-97aa-47a840260710-istio-data\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:05:41.636489 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:41.636365    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61cef952-6a21-424a-97aa-47a840260710-istiod-ca-cert\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:05:41.636489 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:41.636372    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61cef952-6a21-424a-97aa-47a840260710-credential-socket\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:05:41.636489 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:41.636381    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8kcf\" (UniqueName: \"kubernetes.io/projected/61cef952-6a21-424a-97aa-47a840260710-kube-api-access-f8kcf\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:05:41.636489 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:41.636390    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61cef952-6a21-424a-97aa-47a840260710-istio-envoy\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:05:41.636489 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:41.636398    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61cef952-6a21-424a-97aa-47a840260710-workload-socket\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:05:41.636489 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:41.636405    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61cef952-6a21-424a-97aa-47a840260710-istio-token\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:05:41.863156 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:41.863051    2581 generic.go:356] "Generic (PLEG): container finished" podID="61cef952-6a21-424a-97aa-47a840260710" containerID="d3ac5586247fcca1af83a452f6dc3ce55f3c5a4ef99ab9e493655f554fbc33ca" exitCode=0
Jul 02 21:05:41.863156 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:41.863091    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms"
Jul 02 21:05:41.863312 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:41.863154    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms" event={"ID":"61cef952-6a21-424a-97aa-47a840260710","Type":"ContainerDied","Data":"d3ac5586247fcca1af83a452f6dc3ce55f3c5a4ef99ab9e493655f554fbc33ca"}
Jul 02 21:05:41.863312 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:41.863212    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms" event={"ID":"61cef952-6a21-424a-97aa-47a840260710","Type":"ContainerDied","Data":"ede6fba4d985ee6ef9def4a6f3c659ba636baa1427eba262d32e3b539d70b1d1"}
Jul 02 21:05:41.863312 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:41.863235    2581 scope.go:117] "RemoveContainer" containerID="d3ac5586247fcca1af83a452f6dc3ce55f3c5a4ef99ab9e493655f554fbc33ca"
Jul 02 21:05:41.873266 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:41.873248    2581 scope.go:117] "RemoveContainer" containerID="0c42752fc2f9bd64a3d7121aa5e0561471210afad904f8e3bc3efb0f90663146"
Jul 02 21:05:41.881081 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:41.881066    2581 scope.go:117] "RemoveContainer" containerID="d3ac5586247fcca1af83a452f6dc3ce55f3c5a4ef99ab9e493655f554fbc33ca"
Jul 02 21:05:41.881329 ip-10-0-135-220 kubenswrapper[2581]: E0702 21:05:41.881312    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3ac5586247fcca1af83a452f6dc3ce55f3c5a4ef99ab9e493655f554fbc33ca\": container with ID starting with d3ac5586247fcca1af83a452f6dc3ce55f3c5a4ef99ab9e493655f554fbc33ca not found: ID does not exist" containerID="d3ac5586247fcca1af83a452f6dc3ce55f3c5a4ef99ab9e493655f554fbc33ca"
Jul 02 21:05:41.881385 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:41.881338    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3ac5586247fcca1af83a452f6dc3ce55f3c5a4ef99ab9e493655f554fbc33ca"} err="failed to get container status \"d3ac5586247fcca1af83a452f6dc3ce55f3c5a4ef99ab9e493655f554fbc33ca\": rpc error: code = NotFound desc = could not find container \"d3ac5586247fcca1af83a452f6dc3ce55f3c5a4ef99ab9e493655f554fbc33ca\": container with ID starting with d3ac5586247fcca1af83a452f6dc3ce55f3c5a4ef99ab9e493655f554fbc33ca not found: ID does not exist"
Jul 02 21:05:41.881385 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:41.881354    2581 scope.go:117] "RemoveContainer" containerID="0c42752fc2f9bd64a3d7121aa5e0561471210afad904f8e3bc3efb0f90663146"
Jul 02 21:05:41.881556 ip-10-0-135-220 kubenswrapper[2581]: E0702 21:05:41.881538    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c42752fc2f9bd64a3d7121aa5e0561471210afad904f8e3bc3efb0f90663146\": container with ID starting with 0c42752fc2f9bd64a3d7121aa5e0561471210afad904f8e3bc3efb0f90663146 not found: ID does not exist" containerID="0c42752fc2f9bd64a3d7121aa5e0561471210afad904f8e3bc3efb0f90663146"
Jul 02 21:05:41.881599 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:41.881562    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c42752fc2f9bd64a3d7121aa5e0561471210afad904f8e3bc3efb0f90663146"} err="failed to get container status \"0c42752fc2f9bd64a3d7121aa5e0561471210afad904f8e3bc3efb0f90663146\": rpc error: code = NotFound desc = could not find container \"0c42752fc2f9bd64a3d7121aa5e0561471210afad904f8e3bc3efb0f90663146\": container with ID starting with 0c42752fc2f9bd64a3d7121aa5e0561471210afad904f8e3bc3efb0f90663146 not found: ID does not exist"
Jul 02 21:05:41.887018 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:41.886997    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms"]
Jul 02 21:05:41.891988 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:41.891963    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-f67bf4-openshift-default-56bfdbbc5-vlzms"]
Jul 02 21:05:42.106281 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:42.106251    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:42.203569 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:42.203481    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:42.880550 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:42.880514    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61cef952-6a21-424a-97aa-47a840260710" path="/var/lib/kubelet/pods/61cef952-6a21-424a-97aa-47a840260710/volumes"
Jul 02 21:05:44.350573 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:44.350543    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:44.688793 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:44.688715    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:44.974881 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:44.974831    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447"]
Jul 02 21:05:44.975256 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:44.975237    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61cef952-6a21-424a-97aa-47a840260710" containerName="istio-proxy"
Jul 02 21:05:44.975256 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:44.975257    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="61cef952-6a21-424a-97aa-47a840260710" containerName="istio-proxy"
Jul 02 21:05:44.975428 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:44.975400    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="61cef952-6a21-424a-97aa-47a840260710" containerName="istio-proxy"
Jul 02 21:05:44.975428 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:44.975416    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cdacaca-eb16-44ad-912b-4ab5f0f7e584" containerName="istio-proxy"
Jul 02 21:05:44.975428 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:44.975426    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="61cef952-6a21-424a-97aa-47a840260710" containerName="istio-proxy"
Jul 02 21:05:44.978407 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:44.978384    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447"
Jul 02 21:05:44.980943 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:44.980921    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-2217fe-openshift-default-dockercfg-j8lhs\""
Jul 02 21:05:44.990434 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:44.990414    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447"]
Jul 02 21:05:45.006808 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:45.006787    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:45.063028 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:45.062995    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45e79980-be5c-47b3-b78b-53cb5b5480dc-workload-socket\") pod \"e2e-shared-b-2217fe-openshift-default-58db7698ff-77447\" (UID: \"45e79980-be5c-47b3-b78b-53cb5b5480dc\") " pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447"
Jul 02 21:05:45.063229 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:45.063037    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45e79980-be5c-47b3-b78b-53cb5b5480dc-workload-certs\") pod \"e2e-shared-b-2217fe-openshift-default-58db7698ff-77447\" (UID: \"45e79980-be5c-47b3-b78b-53cb5b5480dc\") " pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447"
Jul 02 21:05:45.063229 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:45.063072    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45e79980-be5c-47b3-b78b-53cb5b5480dc-credential-socket\") pod \"e2e-shared-b-2217fe-openshift-default-58db7698ff-77447\" (UID: \"45e79980-be5c-47b3-b78b-53cb5b5480dc\") " pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447"
Jul 02 21:05:45.063229 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:45.063103    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42l58\" (UniqueName: \"kubernetes.io/projected/45e79980-be5c-47b3-b78b-53cb5b5480dc-kube-api-access-42l58\") pod \"e2e-shared-b-2217fe-openshift-default-58db7698ff-77447\" (UID: \"45e79980-be5c-47b3-b78b-53cb5b5480dc\") " pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447"
Jul 02 21:05:45.063229 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:45.063127    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45e79980-be5c-47b3-b78b-53cb5b5480dc-istiod-ca-cert\") pod \"e2e-shared-b-2217fe-openshift-default-58db7698ff-77447\" (UID: \"45e79980-be5c-47b3-b78b-53cb5b5480dc\") " pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447"
Jul 02 21:05:45.063382 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:45.063222    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45e79980-be5c-47b3-b78b-53cb5b5480dc-istio-envoy\") pod \"e2e-shared-b-2217fe-openshift-default-58db7698ff-77447\" (UID: \"45e79980-be5c-47b3-b78b-53cb5b5480dc\") " pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447"
Jul 02 21:05:45.063382 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:45.063249    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45e79980-be5c-47b3-b78b-53cb5b5480dc-istio-data\") pod \"e2e-shared-b-2217fe-openshift-default-58db7698ff-77447\" (UID: \"45e79980-be5c-47b3-b78b-53cb5b5480dc\") " pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447"
Jul 02 21:05:45.063382 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:45.063270    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45e79980-be5c-47b3-b78b-53cb5b5480dc-istio-podinfo\") pod \"e2e-shared-b-2217fe-openshift-default-58db7698ff-77447\" (UID: \"45e79980-be5c-47b3-b78b-53cb5b5480dc\") " pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447"
Jul 02 21:05:45.063382 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:45.063287    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45e79980-be5c-47b3-b78b-53cb5b5480dc-istio-token\") pod \"e2e-shared-b-2217fe-openshift-default-58db7698ff-77447\" (UID: \"45e79980-be5c-47b3-b78b-53cb5b5480dc\") " pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447"
Jul 02 21:05:45.164156 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:45.164103    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42l58\" (UniqueName: \"kubernetes.io/projected/45e79980-be5c-47b3-b78b-53cb5b5480dc-kube-api-access-42l58\") pod \"e2e-shared-b-2217fe-openshift-default-58db7698ff-77447\" (UID: \"45e79980-be5c-47b3-b78b-53cb5b5480dc\") " pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447"
Jul 02 21:05:45.164331 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:45.164167    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45e79980-be5c-47b3-b78b-53cb5b5480dc-istiod-ca-cert\") pod \"e2e-shared-b-2217fe-openshift-default-58db7698ff-77447\" (UID: \"45e79980-be5c-47b3-b78b-53cb5b5480dc\") " pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447"
Jul 02 21:05:45.164331 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:45.164227    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45e79980-be5c-47b3-b78b-53cb5b5480dc-istio-envoy\") pod \"e2e-shared-b-2217fe-openshift-default-58db7698ff-77447\" (UID: \"45e79980-be5c-47b3-b78b-53cb5b5480dc\") " pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447"
Jul 02 21:05:45.164331 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:45.164247    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45e79980-be5c-47b3-b78b-53cb5b5480dc-istio-data\") pod \"e2e-shared-b-2217fe-openshift-default-58db7698ff-77447\" (UID: \"45e79980-be5c-47b3-b78b-53cb5b5480dc\") " pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447"
Jul 02 21:05:45.164331 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:45.164273    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45e79980-be5c-47b3-b78b-53cb5b5480dc-istio-podinfo\") pod \"e2e-shared-b-2217fe-openshift-default-58db7698ff-77447\" (UID: \"45e79980-be5c-47b3-b78b-53cb5b5480dc\") " pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447"
Jul 02 21:05:45.164331 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:45.164293    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45e79980-be5c-47b3-b78b-53cb5b5480dc-istio-token\") pod \"e2e-shared-b-2217fe-openshift-default-58db7698ff-77447\" (UID: \"45e79980-be5c-47b3-b78b-53cb5b5480dc\") " pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447"
Jul 02 21:05:45.164601 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:45.164360    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45e79980-be5c-47b3-b78b-53cb5b5480dc-workload-socket\") pod \"e2e-shared-b-2217fe-openshift-default-58db7698ff-77447\" (UID: \"45e79980-be5c-47b3-b78b-53cb5b5480dc\") " pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447"
Jul 02 21:05:45.164601 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:45.164395    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45e79980-be5c-47b3-b78b-53cb5b5480dc-workload-certs\") pod \"e2e-shared-b-2217fe-openshift-default-58db7698ff-77447\" (UID: \"45e79980-be5c-47b3-b78b-53cb5b5480dc\") " pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447"
Jul 02 21:05:45.164601 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:45.164431    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45e79980-be5c-47b3-b78b-53cb5b5480dc-credential-socket\") pod \"e2e-shared-b-2217fe-openshift-default-58db7698ff-77447\" (UID: \"45e79980-be5c-47b3-b78b-53cb5b5480dc\") " pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447"
Jul 02 21:05:45.164761 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:45.164714    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45e79980-be5c-47b3-b78b-53cb5b5480dc-istio-data\") pod \"e2e-shared-b-2217fe-openshift-default-58db7698ff-77447\" (UID: \"45e79980-be5c-47b3-b78b-53cb5b5480dc\") " pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447"
Jul 02 21:05:45.164856 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:45.164832    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45e79980-be5c-47b3-b78b-53cb5b5480dc-workload-socket\") pod \"e2e-shared-b-2217fe-openshift-default-58db7698ff-77447\" (UID: \"45e79980-be5c-47b3-b78b-53cb5b5480dc\") " pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447"
Jul 02 21:05:45.164922 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:45.164857    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45e79980-be5c-47b3-b78b-53cb5b5480dc-credential-socket\") pod \"e2e-shared-b-2217fe-openshift-default-58db7698ff-77447\" (UID: \"45e79980-be5c-47b3-b78b-53cb5b5480dc\") " pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447"
Jul 02 21:05:45.164922 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:45.164833    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45e79980-be5c-47b3-b78b-53cb5b5480dc-workload-certs\") pod \"e2e-shared-b-2217fe-openshift-default-58db7698ff-77447\" (UID: \"45e79980-be5c-47b3-b78b-53cb5b5480dc\") " pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447"
Jul 02 21:05:45.165132 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:45.165113    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45e79980-be5c-47b3-b78b-53cb5b5480dc-istiod-ca-cert\") pod \"e2e-shared-b-2217fe-openshift-default-58db7698ff-77447\" (UID: \"45e79980-be5c-47b3-b78b-53cb5b5480dc\") " pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447"
Jul 02 21:05:45.166507 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:45.166485    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45e79980-be5c-47b3-b78b-53cb5b5480dc-istio-envoy\") pod \"e2e-shared-b-2217fe-openshift-default-58db7698ff-77447\" (UID: \"45e79980-be5c-47b3-b78b-53cb5b5480dc\") " pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447"
Jul 02 21:05:45.166783 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:45.166766    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45e79980-be5c-47b3-b78b-53cb5b5480dc-istio-podinfo\") pod \"e2e-shared-b-2217fe-openshift-default-58db7698ff-77447\" (UID: \"45e79980-be5c-47b3-b78b-53cb5b5480dc\") " pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447"
Jul 02 21:05:45.176772 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:45.176752    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42l58\" (UniqueName: \"kubernetes.io/projected/45e79980-be5c-47b3-b78b-53cb5b5480dc-kube-api-access-42l58\") pod \"e2e-shared-b-2217fe-openshift-default-58db7698ff-77447\" (UID: \"45e79980-be5c-47b3-b78b-53cb5b5480dc\") " pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447"
Jul 02 21:05:45.180854 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:45.180828    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45e79980-be5c-47b3-b78b-53cb5b5480dc-istio-token\") pod \"e2e-shared-b-2217fe-openshift-default-58db7698ff-77447\" (UID: \"45e79980-be5c-47b3-b78b-53cb5b5480dc\") " pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447"
Jul 02 21:05:45.236171 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:45.236094    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 21:05:45.289285 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:45.289259    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447"
Jul 02 21:05:45.341329 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:45.341293    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:45.432397 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:45.432373    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447"]
Jul 02 21:05:45.434540 ip-10-0-135-220 kubenswrapper[2581]: W0702 21:05:45.434513    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45e79980_be5c_47b3_b78b_53cb5b5480dc.slice/crio-215900f935aeb4f85c54d68ba310d4a997589cad028c52dfebda3e747b700c3d WatchSource:0}: Error finding container 215900f935aeb4f85c54d68ba310d4a997589cad028c52dfebda3e747b700c3d: Status 404 returned error can't find the container with id 215900f935aeb4f85c54d68ba310d4a997589cad028c52dfebda3e747b700c3d
Jul 02 21:05:45.436708 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:45.436673    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 21:05:45.436802 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:45.436737    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 21:05:45.436802 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:45.436766    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 21:05:45.886487 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:45.886401    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447" event={"ID":"45e79980-be5c-47b3-b78b-53cb5b5480dc","Type":"ContainerStarted","Data":"d5aac101fc486b45ff992f9a5e19dc5d5818b8c7fbb63e43df31d3999553f52f"}
Jul 02 21:05:45.886487 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:45.886455    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447" event={"ID":"45e79980-be5c-47b3-b78b-53cb5b5480dc","Type":"ContainerStarted","Data":"215900f935aeb4f85c54d68ba310d4a997589cad028c52dfebda3e747b700c3d"}
Jul 02 21:05:45.905279 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:45.905236    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447" podStartSLOduration=1.905219931 podStartE2EDuration="1.905219931s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:05:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:05:45.904403378 +0000 UTC m=+1979.574916872" watchObservedRunningTime="2026-07-02 21:05:45.905219931 +0000 UTC m=+1979.575733424"
Jul 02 21:05:46.290324 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:46.290287    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447"
Jul 02 21:05:46.295884 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:46.295859    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447"
Jul 02 21:05:46.891550 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:46.891520    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447"
Jul 02 21:05:46.892576 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:46.892559    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447"
Jul 02 21:05:47.907289 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:47.907252    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:47.987812 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:47.987757    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:48.057605 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:48.057568    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:48.465339 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:48.465304    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:48.565294 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:48.565245    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:52.394461 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:52.394418    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:05:53.848081 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:53.848042    2581 patch_prober.go:28] interesting pod/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 02 21:05:53.848760 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:53.848719    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t" podUID="16540e5a-f90d-4ba4-9285-2754d6c0a66e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 02 21:05:53.931986 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:53.931951    2581 generic.go:356] "Generic (PLEG): container finished" podID="16540e5a-f90d-4ba4-9285-2754d6c0a66e" containerID="e7118ec9b5416e31fe81f89446babac7a1aea71c1f72f9b5c3f89f6d09a3705f" exitCode=0
Jul 02 21:05:53.932245 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:53.932105    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t" event={"ID":"16540e5a-f90d-4ba4-9285-2754d6c0a66e","Type":"ContainerDied","Data":"e7118ec9b5416e31fe81f89446babac7a1aea71c1f72f9b5c3f89f6d09a3705f"}
Jul 02 21:05:53.932824 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:53.932804    2581 scope.go:117] "RemoveContainer" containerID="e7118ec9b5416e31fe81f89446babac7a1aea71c1f72f9b5c3f89f6d09a3705f"
Jul 02 21:05:53.934668 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:53.934633    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 21:05:53.934767 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:53.934734    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 21:05:53.934831 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:53.934796    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 21:05:54.943992 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:54.943213    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t" event={"ID":"16540e5a-f90d-4ba4-9285-2754d6c0a66e","Type":"ContainerStarted","Data":"7b366eb292bcad8bea83474060f5b67e425c173bf7b06b39eca32f0d9bda3ea9"}
Jul 02 21:05:55.296242 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:55.296199    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t"
Jul 02 21:05:55.296423 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:55.296339    2581 patch_prober.go:28] interesting pod/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 02 21:05:55.296423 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:55.296393    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t" podUID="16540e5a-f90d-4ba4-9285-2754d6c0a66e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 02 21:05:56.296895 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:56.296861    2581 patch_prober.go:28] interesting pod/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 02 21:05:56.297287 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:56.296909    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t" podUID="16540e5a-f90d-4ba4-9285-2754d6c0a66e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 02 21:05:57.296714 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:57.296667    2581 patch_prober.go:28] interesting pod/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 02 21:05:57.296934 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:57.296736    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t" podUID="16540e5a-f90d-4ba4-9285-2754d6c0a66e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 02 21:05:58.297000 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:58.296961    2581 patch_prober.go:28] interesting pod/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 02 21:05:58.297484 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:58.297017    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t" podUID="16540e5a-f90d-4ba4-9285-2754d6c0a66e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 02 21:05:59.302581 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:59.302546    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t"
Jul 02 21:05:59.305282 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:59.305203    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t"
Jul 02 21:05:59.310739 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:59.310717    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t"
Jul 02 21:05:59.976418 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:59.976386    2581 generic.go:356] "Generic (PLEG): container finished" podID="45e79980-be5c-47b3-b78b-53cb5b5480dc" containerID="d5aac101fc486b45ff992f9a5e19dc5d5818b8c7fbb63e43df31d3999553f52f" exitCode=0
Jul 02 21:05:59.976576 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:59.976456    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447" event={"ID":"45e79980-be5c-47b3-b78b-53cb5b5480dc","Type":"ContainerDied","Data":"d5aac101fc486b45ff992f9a5e19dc5d5818b8c7fbb63e43df31d3999553f52f"}
Jul 02 21:05:59.976947 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:59.976933    2581 scope.go:117] "RemoveContainer" containerID="d5aac101fc486b45ff992f9a5e19dc5d5818b8c7fbb63e43df31d3999553f52f"
Jul 02 21:05:59.977870 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:59.977845    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 21:05:59.977944 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:59.977904    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 21:05:59.977944 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:05:59.977935    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 21:06:00.388630 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:00.388594    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 21:06:00.983941 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:00.983910    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447" event={"ID":"45e79980-be5c-47b3-b78b-53cb5b5480dc","Type":"ContainerStarted","Data":"1e07b5bbb674a01990439d28dea0caa6ef009cc347c91875269f6a78cc0f5c3b"}
Jul 02 21:06:01.198561 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:01.198524    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:01.290443 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:01.290357    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447"
Jul 02 21:06:01.291665 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:01.291637    2581 patch_prober.go:28] interesting pod/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 02 21:06:01.291811 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:01.291757    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447" podUID="45e79980-be5c-47b3-b78b-53cb5b5480dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 02 21:06:01.300774 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:01.300752    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:01.891757 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:01.891716    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447"
Jul 02 21:06:02.289636 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:02.289600    2581 patch_prober.go:28] interesting pod/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 02 21:06:02.289804 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:02.289654    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447" podUID="45e79980-be5c-47b3-b78b-53cb5b5480dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 02 21:06:03.290662 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:03.290626    2581 patch_prober.go:28] interesting pod/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 02 21:06:03.291065 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:03.290715    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447" podUID="45e79980-be5c-47b3-b78b-53cb5b5480dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 02 21:06:04.284976 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:04.284932    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-58d1e3/auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26"]
Jul 02 21:06:04.285495 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:04.285473    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61cef952-6a21-424a-97aa-47a840260710" containerName="istio-proxy"
Jul 02 21:06:04.285495 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:04.285494    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="61cef952-6a21-424a-97aa-47a840260710" containerName="istio-proxy"
Jul 02 21:06:04.287846 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:04.287828    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-58d1e3/auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26"
Jul 02 21:06:04.290210 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:04.290184    2581 patch_prober.go:28] interesting pod/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 02 21:06:04.290323 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:04.290225    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-58d1e3\"/\"openshift-service-ca.crt\""
Jul 02 21:06:04.290323 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:04.290244    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447" podUID="45e79980-be5c-47b3-b78b-53cb5b5480dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 02 21:06:04.290948 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:04.290931    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-58d1e3\"/\"kube-root-ca.crt\""
Jul 02 21:06:04.291266 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:04.291249    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-58d1e3\"/\"default-dockercfg-d624v\""
Jul 02 21:06:04.291333 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:04.291295    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-58d1e3\"/\"auth-test-model-58d1e3-kserve-self-signed-certs\""
Jul 02 21:06:04.298355 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:04.298326    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-58d1e3/auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26"]
Jul 02 21:06:04.316198 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:04.316175    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:04.362494 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:04.362471    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/903f1b02-caf8-4678-86c2-5e08704ac7a7-tmp-dir\") pod \"auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26\" (UID: \"903f1b02-caf8-4678-86c2-5e08704ac7a7\") " pod="ai-tenant-e2e-shared-a-58d1e3/auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26"
Jul 02 21:06:04.362642 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:04.362501    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/903f1b02-caf8-4678-86c2-5e08704ac7a7-dshm\") pod \"auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26\" (UID: \"903f1b02-caf8-4678-86c2-5e08704ac7a7\") " pod="ai-tenant-e2e-shared-a-58d1e3/auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26"
Jul 02 21:06:04.362642 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:04.362521    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/903f1b02-caf8-4678-86c2-5e08704ac7a7-tls-certs\") pod \"auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26\" (UID: \"903f1b02-caf8-4678-86c2-5e08704ac7a7\") " pod="ai-tenant-e2e-shared-a-58d1e3/auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26"
Jul 02 21:06:04.362768 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:04.362645    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gczmr\" (UniqueName: \"kubernetes.io/projected/903f1b02-caf8-4678-86c2-5e08704ac7a7-kube-api-access-gczmr\") pod \"auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26\" (UID: \"903f1b02-caf8-4678-86c2-5e08704ac7a7\") " pod="ai-tenant-e2e-shared-a-58d1e3/auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26"
Jul 02 21:06:04.362768 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:04.362703    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/903f1b02-caf8-4678-86c2-5e08704ac7a7-model-cache\") pod \"auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26\" (UID: \"903f1b02-caf8-4678-86c2-5e08704ac7a7\") " pod="ai-tenant-e2e-shared-a-58d1e3/auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26"
Jul 02 21:06:04.362867 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:04.362764    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/903f1b02-caf8-4678-86c2-5e08704ac7a7-home\") pod \"auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26\" (UID: \"903f1b02-caf8-4678-86c2-5e08704ac7a7\") " pod="ai-tenant-e2e-shared-a-58d1e3/auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26"
Jul 02 21:06:04.463705 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:04.463672    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/903f1b02-caf8-4678-86c2-5e08704ac7a7-tmp-dir\") pod \"auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26\" (UID: \"903f1b02-caf8-4678-86c2-5e08704ac7a7\") " pod="ai-tenant-e2e-shared-a-58d1e3/auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26"
Jul 02 21:06:04.463908 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:04.463733    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/903f1b02-caf8-4678-86c2-5e08704ac7a7-dshm\") pod \"auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26\" (UID: \"903f1b02-caf8-4678-86c2-5e08704ac7a7\") " pod="ai-tenant-e2e-shared-a-58d1e3/auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26"
Jul 02 21:06:04.463908 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:04.463761    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/903f1b02-caf8-4678-86c2-5e08704ac7a7-tls-certs\") pod \"auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26\" (UID: \"903f1b02-caf8-4678-86c2-5e08704ac7a7\") " pod="ai-tenant-e2e-shared-a-58d1e3/auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26"
Jul 02 21:06:04.464029 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:04.463897    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gczmr\" (UniqueName: \"kubernetes.io/projected/903f1b02-caf8-4678-86c2-5e08704ac7a7-kube-api-access-gczmr\") pod \"auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26\" (UID: \"903f1b02-caf8-4678-86c2-5e08704ac7a7\") " pod="ai-tenant-e2e-shared-a-58d1e3/auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26"
Jul 02 21:06:04.464029 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:04.463976    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/903f1b02-caf8-4678-86c2-5e08704ac7a7-model-cache\") pod \"auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26\" (UID: \"903f1b02-caf8-4678-86c2-5e08704ac7a7\") " pod="ai-tenant-e2e-shared-a-58d1e3/auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26"
Jul 02 21:06:04.464174 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:04.464039    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/903f1b02-caf8-4678-86c2-5e08704ac7a7-home\") pod \"auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26\" (UID: \"903f1b02-caf8-4678-86c2-5e08704ac7a7\") " pod="ai-tenant-e2e-shared-a-58d1e3/auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26"
Jul 02 21:06:04.464174 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:04.464105    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/903f1b02-caf8-4678-86c2-5e08704ac7a7-tmp-dir\") pod \"auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26\" (UID: \"903f1b02-caf8-4678-86c2-5e08704ac7a7\") " pod="ai-tenant-e2e-shared-a-58d1e3/auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26"
Jul 02 21:06:04.464444 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:04.464413    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/903f1b02-caf8-4678-86c2-5e08704ac7a7-home\") pod \"auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26\" (UID: \"903f1b02-caf8-4678-86c2-5e08704ac7a7\") " pod="ai-tenant-e2e-shared-a-58d1e3/auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26"
Jul 02 21:06:04.464786 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:04.464767    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/903f1b02-caf8-4678-86c2-5e08704ac7a7-model-cache\") pod \"auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26\" (UID: \"903f1b02-caf8-4678-86c2-5e08704ac7a7\") " pod="ai-tenant-e2e-shared-a-58d1e3/auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26"
Jul 02 21:06:04.466892 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:04.466866    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/903f1b02-caf8-4678-86c2-5e08704ac7a7-dshm\") pod \"auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26\" (UID: \"903f1b02-caf8-4678-86c2-5e08704ac7a7\") " pod="ai-tenant-e2e-shared-a-58d1e3/auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26"
Jul 02 21:06:04.467067 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:04.466998    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/903f1b02-caf8-4678-86c2-5e08704ac7a7-tls-certs\") pod \"auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26\" (UID: \"903f1b02-caf8-4678-86c2-5e08704ac7a7\") " pod="ai-tenant-e2e-shared-a-58d1e3/auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26"
Jul 02 21:06:04.472280 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:04.472248    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gczmr\" (UniqueName: \"kubernetes.io/projected/903f1b02-caf8-4678-86c2-5e08704ac7a7-kube-api-access-gczmr\") pod \"auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26\" (UID: \"903f1b02-caf8-4678-86c2-5e08704ac7a7\") " pod="ai-tenant-e2e-shared-a-58d1e3/auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26"
Jul 02 21:06:04.598231 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:04.598117    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-58d1e3/auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26"
Jul 02 21:06:04.778422 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:04.778341    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-58d1e3/auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26"]
Jul 02 21:06:04.780665 ip-10-0-135-220 kubenswrapper[2581]: W0702 21:06:04.780638    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod903f1b02_caf8_4678_86c2_5e08704ac7a7.slice/crio-3eeca4711e0dedf465a2021b9c7d150982db4a425d91b1dc462a8434b169cf75 WatchSource:0}: Error finding container 3eeca4711e0dedf465a2021b9c7d150982db4a425d91b1dc462a8434b169cf75: Status 404 returned error can't find the container with id 3eeca4711e0dedf465a2021b9c7d150982db4a425d91b1dc462a8434b169cf75
Jul 02 21:06:05.013746 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:05.013717    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-58d1e3/auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26" event={"ID":"903f1b02-caf8-4678-86c2-5e08704ac7a7","Type":"ContainerStarted","Data":"0ff68b9de1250319b98bb75ad9eecf54e9643d38774897ac83e8bfd74c6b388c"}
Jul 02 21:06:05.013958 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:05.013764    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-58d1e3/auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26" event={"ID":"903f1b02-caf8-4678-86c2-5e08704ac7a7","Type":"ContainerStarted","Data":"3eeca4711e0dedf465a2021b9c7d150982db4a425d91b1dc462a8434b169cf75"}
Jul 02 21:06:05.031939 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:05.031878    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-58d1e3/auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26" podStartSLOduration=1.031862736 podStartE2EDuration="1.031862736s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:06:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:06:05.029651857 +0000 UTC m=+1998.700165351" watchObservedRunningTime="2026-07-02 21:06:05.031862736 +0000 UTC m=+1998.702376229"
Jul 02 21:06:05.293661 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:05.293587    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447"
Jul 02 21:06:05.294612 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:05.294593    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447"
Jul 02 21:06:08.952086 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:08.952046    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:09.003557 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:09.003526    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 21:06:09.297757 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:09.297725    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:09.395001 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:09.394973    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:14.598858 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:14.598822    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-58d1e3/auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26"
Jul 02 21:06:14.599279 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:14.598873    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-58d1e3/auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26"
Jul 02 21:06:14.611196 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:14.611173    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-58d1e3/auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26"
Jul 02 21:06:15.077688 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:15.077653    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-58d1e3/auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26"
Jul 02 21:06:38.856508 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:38.856475    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:06:42.097209 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:42.097170    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 21:06:48.098272 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:48.098237    2581 scope.go:117] "RemoveContainer" containerID="fe5e511c51822c8313548537b33d2e0f3359cc3cecfa2b03ad88a7f43e82a041"
Jul 02 21:06:54.996809 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:06:54.996776    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 21:07:11.188432 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:07:11.188355    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 21:07:19.414001 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:07:19.413928    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:07:19.467035 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:07:19.466986    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:07:25.292431 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:07:25.292396    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 21:07:42.187339 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:07:42.187300    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 21:07:58.796888 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:07:58.796854    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 21:08:15.694165 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:15.694114    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 21:08:17.388972 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:17.388913    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:08:28.333981 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:28.333941    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-58d1e3/auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26"]
Jul 02 21:08:28.352401 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:28.352377    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:08:29.296995 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:29.296964    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:08:32.091949 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:32.091914    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-58d1e3/sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8"]
Jul 02 21:08:32.094622 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:32.094605    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-58d1e3/sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8"
Jul 02 21:08:32.096821 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:32.096801    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-58d1e3\"/\"sub-test-model-58d1e3-kserve-self-signed-certs\""
Jul 02 21:08:32.104791 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:32.104769    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-58d1e3/sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8"]
Jul 02 21:08:32.175983 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:32.175956    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsx7s\" (UniqueName: \"kubernetes.io/projected/57ba2bd3-53b0-43af-b3fe-411714314c93-kube-api-access-bsx7s\") pod \"sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8\" (UID: \"57ba2bd3-53b0-43af-b3fe-411714314c93\") " pod="ai-tenant-e2e-shared-a-58d1e3/sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8"
Jul 02 21:08:32.176124 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:32.176012    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57ba2bd3-53b0-43af-b3fe-411714314c93-model-cache\") pod \"sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8\" (UID: \"57ba2bd3-53b0-43af-b3fe-411714314c93\") " pod="ai-tenant-e2e-shared-a-58d1e3/sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8"
Jul 02 21:08:32.176124 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:32.176085    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57ba2bd3-53b0-43af-b3fe-411714314c93-home\") pod \"sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8\" (UID: \"57ba2bd3-53b0-43af-b3fe-411714314c93\") " pod="ai-tenant-e2e-shared-a-58d1e3/sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8"
Jul 02 21:08:32.176261 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:32.176162    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57ba2bd3-53b0-43af-b3fe-411714314c93-dshm\") pod \"sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8\" (UID: \"57ba2bd3-53b0-43af-b3fe-411714314c93\") " pod="ai-tenant-e2e-shared-a-58d1e3/sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8"
Jul 02 21:08:32.176322 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:32.176264    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57ba2bd3-53b0-43af-b3fe-411714314c93-tmp-dir\") pod \"sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8\" (UID: \"57ba2bd3-53b0-43af-b3fe-411714314c93\") " pod="ai-tenant-e2e-shared-a-58d1e3/sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8"
Jul 02 21:08:32.176322 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:32.176302    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57ba2bd3-53b0-43af-b3fe-411714314c93-tls-certs\") pod \"sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8\" (UID: \"57ba2bd3-53b0-43af-b3fe-411714314c93\") " pod="ai-tenant-e2e-shared-a-58d1e3/sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8"
Jul 02 21:08:32.185109 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:32.185071    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:08:32.277744 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:32.277714    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57ba2bd3-53b0-43af-b3fe-411714314c93-dshm\") pod \"sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8\" (UID: \"57ba2bd3-53b0-43af-b3fe-411714314c93\") " pod="ai-tenant-e2e-shared-a-58d1e3/sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8"
Jul 02 21:08:32.277927 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:32.277782    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57ba2bd3-53b0-43af-b3fe-411714314c93-tmp-dir\") pod \"sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8\" (UID: \"57ba2bd3-53b0-43af-b3fe-411714314c93\") " pod="ai-tenant-e2e-shared-a-58d1e3/sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8"
Jul 02 21:08:32.277927 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:32.277817    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57ba2bd3-53b0-43af-b3fe-411714314c93-tls-certs\") pod \"sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8\" (UID: \"57ba2bd3-53b0-43af-b3fe-411714314c93\") " pod="ai-tenant-e2e-shared-a-58d1e3/sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8"
Jul 02 21:08:32.277927 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:32.277863    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsx7s\" (UniqueName: \"kubernetes.io/projected/57ba2bd3-53b0-43af-b3fe-411714314c93-kube-api-access-bsx7s\") pod \"sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8\" (UID: \"57ba2bd3-53b0-43af-b3fe-411714314c93\") " pod="ai-tenant-e2e-shared-a-58d1e3/sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8"
Jul 02 21:08:32.278105 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:32.277927    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57ba2bd3-53b0-43af-b3fe-411714314c93-model-cache\") pod \"sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8\" (UID: \"57ba2bd3-53b0-43af-b3fe-411714314c93\") " pod="ai-tenant-e2e-shared-a-58d1e3/sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8"
Jul 02 21:08:32.278105 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:32.277970    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57ba2bd3-53b0-43af-b3fe-411714314c93-home\") pod \"sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8\" (UID: \"57ba2bd3-53b0-43af-b3fe-411714314c93\") " pod="ai-tenant-e2e-shared-a-58d1e3/sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8"
Jul 02 21:08:32.278331 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:32.278298    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57ba2bd3-53b0-43af-b3fe-411714314c93-tmp-dir\") pod \"sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8\" (UID: \"57ba2bd3-53b0-43af-b3fe-411714314c93\") " pod="ai-tenant-e2e-shared-a-58d1e3/sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8"
Jul 02 21:08:32.278454 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:32.278353    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57ba2bd3-53b0-43af-b3fe-411714314c93-home\") pod \"sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8\" (UID: \"57ba2bd3-53b0-43af-b3fe-411714314c93\") " pod="ai-tenant-e2e-shared-a-58d1e3/sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8"
Jul 02 21:08:32.278625 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:32.278606    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57ba2bd3-53b0-43af-b3fe-411714314c93-model-cache\") pod \"sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8\" (UID: \"57ba2bd3-53b0-43af-b3fe-411714314c93\") " pod="ai-tenant-e2e-shared-a-58d1e3/sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8"
Jul 02 21:08:32.280355 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:32.280331    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57ba2bd3-53b0-43af-b3fe-411714314c93-dshm\") pod \"sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8\" (UID: \"57ba2bd3-53b0-43af-b3fe-411714314c93\") " pod="ai-tenant-e2e-shared-a-58d1e3/sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8"
Jul 02 21:08:32.280735 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:32.280717    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57ba2bd3-53b0-43af-b3fe-411714314c93-tls-certs\") pod \"sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8\" (UID: \"57ba2bd3-53b0-43af-b3fe-411714314c93\") " pod="ai-tenant-e2e-shared-a-58d1e3/sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8"
Jul 02 21:08:32.286275 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:32.286251    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsx7s\" (UniqueName: \"kubernetes.io/projected/57ba2bd3-53b0-43af-b3fe-411714314c93-kube-api-access-bsx7s\") pod \"sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8\" (UID: \"57ba2bd3-53b0-43af-b3fe-411714314c93\") " pod="ai-tenant-e2e-shared-a-58d1e3/sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8"
Jul 02 21:08:32.404081 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:32.404026    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-58d1e3/sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8"
Jul 02 21:08:32.538791 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:32.538664    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-58d1e3/sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8"]
Jul 02 21:08:32.541123 ip-10-0-135-220 kubenswrapper[2581]: W0702 21:08:32.541097    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod57ba2bd3_53b0_43af_b3fe_411714314c93.slice/crio-6daa6209be7bf40ac03b10152a2269378967273b054b23d3d719664d9108f529 WatchSource:0}: Error finding container 6daa6209be7bf40ac03b10152a2269378967273b054b23d3d719664d9108f529: Status 404 returned error can't find the container with id 6daa6209be7bf40ac03b10152a2269378967273b054b23d3d719664d9108f529
Jul 02 21:08:32.788540 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:32.788504    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 21:08:32.798943 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:32.798911    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-58d1e3/sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8" event={"ID":"57ba2bd3-53b0-43af-b3fe-411714314c93","Type":"ContainerStarted","Data":"9206f56036f91192a8bcd63f1b1921dc0e2f821fa4d1ca96faba43110eb039fb"}
Jul 02 21:08:32.799110 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:32.798952    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-58d1e3/sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8" event={"ID":"57ba2bd3-53b0-43af-b3fe-411714314c93","Type":"ContainerStarted","Data":"6daa6209be7bf40ac03b10152a2269378967273b054b23d3d719664d9108f529"}
Jul 02 21:08:32.829183 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:32.829117    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-58d1e3/sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8" podStartSLOduration=0.829103718 podStartE2EDuration="829.103718ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:08:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:08:32.82738512 +0000 UTC m=+2146.497898613" watchObservedRunningTime="2026-07-02 21:08:32.829103718 +0000 UTC m=+2146.499617211"
Jul 02 21:08:42.404222 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:42.404119    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-58d1e3/sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8"
Jul 02 21:08:42.404222 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:42.404190    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-58d1e3/sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8"
Jul 02 21:08:42.416823 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:42.416795    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-58d1e3/sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8"
Jul 02 21:08:42.862774 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:42.862745    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-58d1e3/sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8"
Jul 02 21:08:43.354323 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:43.354283    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-58d1e3/auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26" podUID="903f1b02-caf8-4678-86c2-5e08704ac7a7" containerName="main" containerID="cri-o://0ff68b9de1250319b98bb75ad9eecf54e9643d38774897ac83e8bfd74c6b388c" gracePeriod=45
Jul 02 21:08:43.608801 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:43.608748    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-58d1e3/auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26"
Jul 02 21:08:43.688048 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:43.688016    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/903f1b02-caf8-4678-86c2-5e08704ac7a7-dshm\") pod \"903f1b02-caf8-4678-86c2-5e08704ac7a7\" (UID: \"903f1b02-caf8-4678-86c2-5e08704ac7a7\") "
Jul 02 21:08:43.688227 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:43.688114    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/903f1b02-caf8-4678-86c2-5e08704ac7a7-tls-certs\") pod \"903f1b02-caf8-4678-86c2-5e08704ac7a7\" (UID: \"903f1b02-caf8-4678-86c2-5e08704ac7a7\") "
Jul 02 21:08:43.688227 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:43.688131    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/903f1b02-caf8-4678-86c2-5e08704ac7a7-model-cache\") pod \"903f1b02-caf8-4678-86c2-5e08704ac7a7\" (UID: \"903f1b02-caf8-4678-86c2-5e08704ac7a7\") "
Jul 02 21:08:43.688227 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:43.688179    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/903f1b02-caf8-4678-86c2-5e08704ac7a7-tmp-dir\") pod \"903f1b02-caf8-4678-86c2-5e08704ac7a7\" (UID: \"903f1b02-caf8-4678-86c2-5e08704ac7a7\") "
Jul 02 21:08:43.688227 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:43.688207    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gczmr\" (UniqueName: \"kubernetes.io/projected/903f1b02-caf8-4678-86c2-5e08704ac7a7-kube-api-access-gczmr\") pod \"903f1b02-caf8-4678-86c2-5e08704ac7a7\" (UID: \"903f1b02-caf8-4678-86c2-5e08704ac7a7\") "
Jul 02 21:08:43.688432 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:43.688322    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/903f1b02-caf8-4678-86c2-5e08704ac7a7-home\") pod \"903f1b02-caf8-4678-86c2-5e08704ac7a7\" (UID: \"903f1b02-caf8-4678-86c2-5e08704ac7a7\") "
Jul 02 21:08:43.688483 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:43.688426    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/903f1b02-caf8-4678-86c2-5e08704ac7a7-model-cache" (OuterVolumeSpecName: "model-cache") pod "903f1b02-caf8-4678-86c2-5e08704ac7a7" (UID: "903f1b02-caf8-4678-86c2-5e08704ac7a7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:08:43.688483 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:43.688442    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/903f1b02-caf8-4678-86c2-5e08704ac7a7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "903f1b02-caf8-4678-86c2-5e08704ac7a7" (UID: "903f1b02-caf8-4678-86c2-5e08704ac7a7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:08:43.688596 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:43.688572    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/903f1b02-caf8-4678-86c2-5e08704ac7a7-home" (OuterVolumeSpecName: "home") pod "903f1b02-caf8-4678-86c2-5e08704ac7a7" (UID: "903f1b02-caf8-4678-86c2-5e08704ac7a7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:08:43.688727 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:43.688711    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/903f1b02-caf8-4678-86c2-5e08704ac7a7-model-cache\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:08:43.688775 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:43.688733    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/903f1b02-caf8-4678-86c2-5e08704ac7a7-tmp-dir\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:08:43.688775 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:43.688746    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/903f1b02-caf8-4678-86c2-5e08704ac7a7-home\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:08:43.690396 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:43.690372    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/903f1b02-caf8-4678-86c2-5e08704ac7a7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "903f1b02-caf8-4678-86c2-5e08704ac7a7" (UID: "903f1b02-caf8-4678-86c2-5e08704ac7a7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:08:43.690492 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:43.690443    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/903f1b02-caf8-4678-86c2-5e08704ac7a7-dshm" (OuterVolumeSpecName: "dshm") pod "903f1b02-caf8-4678-86c2-5e08704ac7a7" (UID: "903f1b02-caf8-4678-86c2-5e08704ac7a7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:08:43.690492 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:43.690445    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/903f1b02-caf8-4678-86c2-5e08704ac7a7-kube-api-access-gczmr" (OuterVolumeSpecName: "kube-api-access-gczmr") pod "903f1b02-caf8-4678-86c2-5e08704ac7a7" (UID: "903f1b02-caf8-4678-86c2-5e08704ac7a7"). InnerVolumeSpecName "kube-api-access-gczmr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:08:43.789568 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:43.789540    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/903f1b02-caf8-4678-86c2-5e08704ac7a7-tls-certs\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:08:43.789568 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:43.789562    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gczmr\" (UniqueName: \"kubernetes.io/projected/903f1b02-caf8-4678-86c2-5e08704ac7a7-kube-api-access-gczmr\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:08:43.789568 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:43.789571    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/903f1b02-caf8-4678-86c2-5e08704ac7a7-dshm\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:08:43.859762 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:43.859687    2581 generic.go:356] "Generic (PLEG): container finished" podID="903f1b02-caf8-4678-86c2-5e08704ac7a7" containerID="0ff68b9de1250319b98bb75ad9eecf54e9643d38774897ac83e8bfd74c6b388c" exitCode=0
Jul 02 21:08:43.859762 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:43.859740    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-58d1e3/auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26"
Jul 02 21:08:43.859916 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:43.859772    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-58d1e3/auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26" event={"ID":"903f1b02-caf8-4678-86c2-5e08704ac7a7","Type":"ContainerDied","Data":"0ff68b9de1250319b98bb75ad9eecf54e9643d38774897ac83e8bfd74c6b388c"}
Jul 02 21:08:43.859916 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:43.859818    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-58d1e3/auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26" event={"ID":"903f1b02-caf8-4678-86c2-5e08704ac7a7","Type":"ContainerDied","Data":"3eeca4711e0dedf465a2021b9c7d150982db4a425d91b1dc462a8434b169cf75"}
Jul 02 21:08:43.859916 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:43.859839    2581 scope.go:117] "RemoveContainer" containerID="0ff68b9de1250319b98bb75ad9eecf54e9643d38774897ac83e8bfd74c6b388c"
Jul 02 21:08:43.869295 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:43.869277    2581 scope.go:117] "RemoveContainer" containerID="0ff68b9de1250319b98bb75ad9eecf54e9643d38774897ac83e8bfd74c6b388c"
Jul 02 21:08:43.869533 ip-10-0-135-220 kubenswrapper[2581]: E0702 21:08:43.869516    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ff68b9de1250319b98bb75ad9eecf54e9643d38774897ac83e8bfd74c6b388c\": container with ID starting with 0ff68b9de1250319b98bb75ad9eecf54e9643d38774897ac83e8bfd74c6b388c not found: ID does not exist" containerID="0ff68b9de1250319b98bb75ad9eecf54e9643d38774897ac83e8bfd74c6b388c"
Jul 02 21:08:43.869584 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:43.869542    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ff68b9de1250319b98bb75ad9eecf54e9643d38774897ac83e8bfd74c6b388c"} err="failed to get container status \"0ff68b9de1250319b98bb75ad9eecf54e9643d38774897ac83e8bfd74c6b388c\": rpc error: code = NotFound desc = could not find container \"0ff68b9de1250319b98bb75ad9eecf54e9643d38774897ac83e8bfd74c6b388c\": container with ID starting with 0ff68b9de1250319b98bb75ad9eecf54e9643d38774897ac83e8bfd74c6b388c not found: ID does not exist"
Jul 02 21:08:43.881783 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:43.881762    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-58d1e3/auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26"]
Jul 02 21:08:43.888436 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:43.888416    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-58d1e3/auth-test-model-58d1e3-kserve-594d6b8b7f-j4k26"]
Jul 02 21:08:44.881325 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:44.881293    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="903f1b02-caf8-4678-86c2-5e08704ac7a7" path="/var/lib/kubelet/pods/903f1b02-caf8-4678-86c2-5e08704ac7a7/volumes"
Jul 02 21:08:45.294084 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:45.294051    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 21:08:58.190223 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:58.190190    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-2217fe/sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9"]
Jul 02 21:08:58.190608 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:58.190565    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="903f1b02-caf8-4678-86c2-5e08704ac7a7" containerName="main"
Jul 02 21:08:58.190608 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:58.190591    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="903f1b02-caf8-4678-86c2-5e08704ac7a7" containerName="main"
Jul 02 21:08:58.190730 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:58.190692    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="903f1b02-caf8-4678-86c2-5e08704ac7a7" containerName="main"
Jul 02 21:08:58.192814 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:58.192794    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2217fe/sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9"
Jul 02 21:08:58.196159 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:58.196116    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-2217fe\"/\"sub-test-model-2217fe-kserve-self-signed-certs\""
Jul 02 21:08:58.196159 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:58.196116    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-2217fe\"/\"openshift-service-ca.crt\""
Jul 02 21:08:58.196159 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:58.196156    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-2217fe\"/\"default-dockercfg-chdds\""
Jul 02 21:08:58.196537 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:58.196157    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-2217fe\"/\"kube-root-ca.crt\""
Jul 02 21:08:58.204928 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:58.204906    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-2217fe/sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9"]
Jul 02 21:08:58.225279 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:58.225243    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:08:58.317289 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:58.317260    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/babb1d71-f609-4c3a-bf84-7532e6e4aa15-model-cache\") pod \"sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9\" (UID: \"babb1d71-f609-4c3a-bf84-7532e6e4aa15\") " pod="ai-tenant-e2e-shared-b-2217fe/sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9"
Jul 02 21:08:58.317464 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:58.317293    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c822j\" (UniqueName: \"kubernetes.io/projected/babb1d71-f609-4c3a-bf84-7532e6e4aa15-kube-api-access-c822j\") pod \"sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9\" (UID: \"babb1d71-f609-4c3a-bf84-7532e6e4aa15\") " pod="ai-tenant-e2e-shared-b-2217fe/sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9"
Jul 02 21:08:58.317464 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:58.317315    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/babb1d71-f609-4c3a-bf84-7532e6e4aa15-tmp-dir\") pod \"sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9\" (UID: \"babb1d71-f609-4c3a-bf84-7532e6e4aa15\") " pod="ai-tenant-e2e-shared-b-2217fe/sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9"
Jul 02 21:08:58.317464 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:58.317331    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/babb1d71-f609-4c3a-bf84-7532e6e4aa15-dshm\") pod \"sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9\" (UID: \"babb1d71-f609-4c3a-bf84-7532e6e4aa15\") " pod="ai-tenant-e2e-shared-b-2217fe/sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9"
Jul 02 21:08:58.317464 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:58.317426    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/babb1d71-f609-4c3a-bf84-7532e6e4aa15-home\") pod \"sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9\" (UID: \"babb1d71-f609-4c3a-bf84-7532e6e4aa15\") " pod="ai-tenant-e2e-shared-b-2217fe/sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9"
Jul 02 21:08:58.317670 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:58.317464    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/babb1d71-f609-4c3a-bf84-7532e6e4aa15-tls-certs\") pod \"sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9\" (UID: \"babb1d71-f609-4c3a-bf84-7532e6e4aa15\") " pod="ai-tenant-e2e-shared-b-2217fe/sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9"
Jul 02 21:08:58.418394 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:58.418369    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/babb1d71-f609-4c3a-bf84-7532e6e4aa15-model-cache\") pod \"sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9\" (UID: \"babb1d71-f609-4c3a-bf84-7532e6e4aa15\") " pod="ai-tenant-e2e-shared-b-2217fe/sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9"
Jul 02 21:08:58.418560 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:58.418399    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c822j\" (UniqueName: \"kubernetes.io/projected/babb1d71-f609-4c3a-bf84-7532e6e4aa15-kube-api-access-c822j\") pod \"sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9\" (UID: \"babb1d71-f609-4c3a-bf84-7532e6e4aa15\") " pod="ai-tenant-e2e-shared-b-2217fe/sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9"
Jul 02 21:08:58.418560 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:58.418424    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/babb1d71-f609-4c3a-bf84-7532e6e4aa15-tmp-dir\") pod \"sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9\" (UID: \"babb1d71-f609-4c3a-bf84-7532e6e4aa15\") " pod="ai-tenant-e2e-shared-b-2217fe/sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9"
Jul 02 21:08:58.418560 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:58.418450    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/babb1d71-f609-4c3a-bf84-7532e6e4aa15-dshm\") pod \"sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9\" (UID: \"babb1d71-f609-4c3a-bf84-7532e6e4aa15\") " pod="ai-tenant-e2e-shared-b-2217fe/sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9"
Jul 02 21:08:58.418560 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:58.418491    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/babb1d71-f609-4c3a-bf84-7532e6e4aa15-home\") pod \"sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9\" (UID: \"babb1d71-f609-4c3a-bf84-7532e6e4aa15\") " pod="ai-tenant-e2e-shared-b-2217fe/sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9"
Jul 02 21:08:58.418560 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:58.418530    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/babb1d71-f609-4c3a-bf84-7532e6e4aa15-tls-certs\") pod \"sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9\" (UID: \"babb1d71-f609-4c3a-bf84-7532e6e4aa15\") " pod="ai-tenant-e2e-shared-b-2217fe/sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9"
Jul 02 21:08:58.418834 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:58.418814    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/babb1d71-f609-4c3a-bf84-7532e6e4aa15-model-cache\") pod \"sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9\" (UID: \"babb1d71-f609-4c3a-bf84-7532e6e4aa15\") " pod="ai-tenant-e2e-shared-b-2217fe/sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9"
Jul 02 21:08:58.418882 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:58.418853    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/babb1d71-f609-4c3a-bf84-7532e6e4aa15-tmp-dir\") pod \"sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9\" (UID: \"babb1d71-f609-4c3a-bf84-7532e6e4aa15\") " pod="ai-tenant-e2e-shared-b-2217fe/sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9"
Jul 02 21:08:58.418923 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:58.418877    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/babb1d71-f609-4c3a-bf84-7532e6e4aa15-home\") pod \"sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9\" (UID: \"babb1d71-f609-4c3a-bf84-7532e6e4aa15\") " pod="ai-tenant-e2e-shared-b-2217fe/sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9"
Jul 02 21:08:58.420705 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:58.420686    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/babb1d71-f609-4c3a-bf84-7532e6e4aa15-dshm\") pod \"sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9\" (UID: \"babb1d71-f609-4c3a-bf84-7532e6e4aa15\") " pod="ai-tenant-e2e-shared-b-2217fe/sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9"
Jul 02 21:08:58.420872 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:58.420856    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/babb1d71-f609-4c3a-bf84-7532e6e4aa15-tls-certs\") pod \"sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9\" (UID: \"babb1d71-f609-4c3a-bf84-7532e6e4aa15\") " pod="ai-tenant-e2e-shared-b-2217fe/sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9"
Jul 02 21:08:58.426964 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:58.426940    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c822j\" (UniqueName: \"kubernetes.io/projected/babb1d71-f609-4c3a-bf84-7532e6e4aa15-kube-api-access-c822j\") pod \"sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9\" (UID: \"babb1d71-f609-4c3a-bf84-7532e6e4aa15\") " pod="ai-tenant-e2e-shared-b-2217fe/sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9"
Jul 02 21:08:58.502025 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:58.501993    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2217fe/sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9"
Jul 02 21:08:58.631617 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:58.631588    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-2217fe/sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9"]
Jul 02 21:08:58.633405 ip-10-0-135-220 kubenswrapper[2581]: W0702 21:08:58.633369    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbabb1d71_f609_4c3a_bf84_7532e6e4aa15.slice/crio-b400379ce7ad1e5b257c16026bb2bc0342e571f89194200dbf68426360d93db7 WatchSource:0}: Error finding container b400379ce7ad1e5b257c16026bb2bc0342e571f89194200dbf68426360d93db7: Status 404 returned error can't find the container with id b400379ce7ad1e5b257c16026bb2bc0342e571f89194200dbf68426360d93db7
Jul 02 21:08:58.940417 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:58.940329    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2217fe/sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9" event={"ID":"babb1d71-f609-4c3a-bf84-7532e6e4aa15","Type":"ContainerStarted","Data":"71337a1c90933eb8bce5ff6ed7494f4fdb6e679e4e4965703c42aee6245a7e22"}
Jul 02 21:08:58.940417 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:58.940378    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2217fe/sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9" event={"ID":"babb1d71-f609-4c3a-bf84-7532e6e4aa15","Type":"ContainerStarted","Data":"b400379ce7ad1e5b257c16026bb2bc0342e571f89194200dbf68426360d93db7"}
Jul 02 21:08:58.959246 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:08:58.959200    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-2217fe/sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9" podStartSLOduration=0.959184101 podStartE2EDuration="959.184101ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:08:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:08:58.958520401 +0000 UTC m=+2172.629033894" watchObservedRunningTime="2026-07-02 21:08:58.959184101 +0000 UTC m=+2172.629697594"
Jul 02 21:09:02.191940 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:02.191907    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 21:09:08.502344 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:08.502304    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-2217fe/sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9"
Jul 02 21:09:08.502344 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:08.502351    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-2217fe/sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9"
Jul 02 21:09:08.514940 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:08.514916    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-2217fe/sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9"
Jul 02 21:09:09.009339 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:09.009313    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-2217fe/sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9"
Jul 02 21:09:15.897428 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:15.897393    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 21:09:32.578845 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:32.578804    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-58d1e3/sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8"]
Jul 02 21:09:32.603120 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:32.603092    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:09:33.498370 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:33.498337    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-2217fe/sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9"]
Jul 02 21:09:33.751092 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:33.751002    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:09:37.588352 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:37.588306    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 21:09:43.609156 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:43.609114    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:09:46.493812 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:46.493775    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 21:09:47.107394 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:47.107356    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:09:47.601004 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:47.600960    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-58d1e3/sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8" podUID="57ba2bd3-53b0-43af-b3fe-411714314c93" containerName="main" containerID="cri-o://9206f56036f91192a8bcd63f1b1921dc0e2f821fa4d1ca96faba43110eb039fb" gracePeriod=45
Jul 02 21:09:47.859985 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:47.859926    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-58d1e3/sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8"
Jul 02 21:09:47.967696 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:47.967667    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57ba2bd3-53b0-43af-b3fe-411714314c93-tmp-dir\") pod \"57ba2bd3-53b0-43af-b3fe-411714314c93\" (UID: \"57ba2bd3-53b0-43af-b3fe-411714314c93\") "
Jul 02 21:09:47.967866 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:47.967731    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57ba2bd3-53b0-43af-b3fe-411714314c93-model-cache\") pod \"57ba2bd3-53b0-43af-b3fe-411714314c93\" (UID: \"57ba2bd3-53b0-43af-b3fe-411714314c93\") "
Jul 02 21:09:47.967866 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:47.967757    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57ba2bd3-53b0-43af-b3fe-411714314c93-home\") pod \"57ba2bd3-53b0-43af-b3fe-411714314c93\" (UID: \"57ba2bd3-53b0-43af-b3fe-411714314c93\") "
Jul 02 21:09:47.967866 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:47.967791    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bsx7s\" (UniqueName: \"kubernetes.io/projected/57ba2bd3-53b0-43af-b3fe-411714314c93-kube-api-access-bsx7s\") pod \"57ba2bd3-53b0-43af-b3fe-411714314c93\" (UID: \"57ba2bd3-53b0-43af-b3fe-411714314c93\") "
Jul 02 21:09:47.967866 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:47.967820    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57ba2bd3-53b0-43af-b3fe-411714314c93-dshm\") pod \"57ba2bd3-53b0-43af-b3fe-411714314c93\" (UID: \"57ba2bd3-53b0-43af-b3fe-411714314c93\") "
Jul 02 21:09:47.968088 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:47.967895    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57ba2bd3-53b0-43af-b3fe-411714314c93-tls-certs\") pod \"57ba2bd3-53b0-43af-b3fe-411714314c93\" (UID: \"57ba2bd3-53b0-43af-b3fe-411714314c93\") "
Jul 02 21:09:47.968088 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:47.967957    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57ba2bd3-53b0-43af-b3fe-411714314c93-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "57ba2bd3-53b0-43af-b3fe-411714314c93" (UID: "57ba2bd3-53b0-43af-b3fe-411714314c93"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:09:47.968088 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:47.968042    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57ba2bd3-53b0-43af-b3fe-411714314c93-home" (OuterVolumeSpecName: "home") pod "57ba2bd3-53b0-43af-b3fe-411714314c93" (UID: "57ba2bd3-53b0-43af-b3fe-411714314c93"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:09:47.968088 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:47.968056    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57ba2bd3-53b0-43af-b3fe-411714314c93-model-cache" (OuterVolumeSpecName: "model-cache") pod "57ba2bd3-53b0-43af-b3fe-411714314c93" (UID: "57ba2bd3-53b0-43af-b3fe-411714314c93"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:09:47.968304 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:47.968231    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57ba2bd3-53b0-43af-b3fe-411714314c93-tmp-dir\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:09:47.968304 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:47.968254    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57ba2bd3-53b0-43af-b3fe-411714314c93-model-cache\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:09:47.968304 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:47.968266    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57ba2bd3-53b0-43af-b3fe-411714314c93-home\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:09:47.970028 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:47.970003    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57ba2bd3-53b0-43af-b3fe-411714314c93-dshm" (OuterVolumeSpecName: "dshm") pod "57ba2bd3-53b0-43af-b3fe-411714314c93" (UID: "57ba2bd3-53b0-43af-b3fe-411714314c93"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:09:47.970155 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:47.970035    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57ba2bd3-53b0-43af-b3fe-411714314c93-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "57ba2bd3-53b0-43af-b3fe-411714314c93" (UID: "57ba2bd3-53b0-43af-b3fe-411714314c93"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:09:47.970155 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:47.970052    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57ba2bd3-53b0-43af-b3fe-411714314c93-kube-api-access-bsx7s" (OuterVolumeSpecName: "kube-api-access-bsx7s") pod "57ba2bd3-53b0-43af-b3fe-411714314c93" (UID: "57ba2bd3-53b0-43af-b3fe-411714314c93"). InnerVolumeSpecName "kube-api-access-bsx7s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:09:48.069638 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:48.069609    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bsx7s\" (UniqueName: \"kubernetes.io/projected/57ba2bd3-53b0-43af-b3fe-411714314c93-kube-api-access-bsx7s\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:09:48.069638 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:48.069633    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57ba2bd3-53b0-43af-b3fe-411714314c93-dshm\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:09:48.069774 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:48.069646    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57ba2bd3-53b0-43af-b3fe-411714314c93-tls-certs\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:09:48.209487 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:48.209463    2581 generic.go:356] "Generic (PLEG): container finished" podID="57ba2bd3-53b0-43af-b3fe-411714314c93" containerID="9206f56036f91192a8bcd63f1b1921dc0e2f821fa4d1ca96faba43110eb039fb" exitCode=0
Jul 02 21:09:48.209605 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:48.209510    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-58d1e3/sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8"
Jul 02 21:09:48.209605 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:48.209544    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-58d1e3/sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8" event={"ID":"57ba2bd3-53b0-43af-b3fe-411714314c93","Type":"ContainerDied","Data":"9206f56036f91192a8bcd63f1b1921dc0e2f821fa4d1ca96faba43110eb039fb"}
Jul 02 21:09:48.209605 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:48.209584    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-58d1e3/sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8" event={"ID":"57ba2bd3-53b0-43af-b3fe-411714314c93","Type":"ContainerDied","Data":"6daa6209be7bf40ac03b10152a2269378967273b054b23d3d719664d9108f529"}
Jul 02 21:09:48.209605 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:48.209604    2581 scope.go:117] "RemoveContainer" containerID="9206f56036f91192a8bcd63f1b1921dc0e2f821fa4d1ca96faba43110eb039fb"
Jul 02 21:09:48.219205 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:48.219188    2581 scope.go:117] "RemoveContainer" containerID="9206f56036f91192a8bcd63f1b1921dc0e2f821fa4d1ca96faba43110eb039fb"
Jul 02 21:09:48.219425 ip-10-0-135-220 kubenswrapper[2581]: E0702 21:09:48.219406    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9206f56036f91192a8bcd63f1b1921dc0e2f821fa4d1ca96faba43110eb039fb\": container with ID starting with 9206f56036f91192a8bcd63f1b1921dc0e2f821fa4d1ca96faba43110eb039fb not found: ID does not exist" containerID="9206f56036f91192a8bcd63f1b1921dc0e2f821fa4d1ca96faba43110eb039fb"
Jul 02 21:09:48.219472 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:48.219432    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9206f56036f91192a8bcd63f1b1921dc0e2f821fa4d1ca96faba43110eb039fb"} err="failed to get container status \"9206f56036f91192a8bcd63f1b1921dc0e2f821fa4d1ca96faba43110eb039fb\": rpc error: code = NotFound desc = could not find container \"9206f56036f91192a8bcd63f1b1921dc0e2f821fa4d1ca96faba43110eb039fb\": container with ID starting with 9206f56036f91192a8bcd63f1b1921dc0e2f821fa4d1ca96faba43110eb039fb not found: ID does not exist"
Jul 02 21:09:48.231544 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:48.231523    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-58d1e3/sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8"]
Jul 02 21:09:48.235874 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:48.235851    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-58d1e3/sub-test-model-58d1e3-kserve-5b5b97bdcf-cl9m8"]
Jul 02 21:09:48.518866 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:48.518789    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-2217fe/sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9" podUID="babb1d71-f609-4c3a-bf84-7532e6e4aa15" containerName="main" containerID="cri-o://71337a1c90933eb8bce5ff6ed7494f4fdb6e679e4e4965703c42aee6245a7e22" gracePeriod=45
Jul 02 21:09:48.777661 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:48.777605    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2217fe/sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9"
Jul 02 21:09:48.875897 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:48.875868    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/babb1d71-f609-4c3a-bf84-7532e6e4aa15-tmp-dir\") pod \"babb1d71-f609-4c3a-bf84-7532e6e4aa15\" (UID: \"babb1d71-f609-4c3a-bf84-7532e6e4aa15\") "
Jul 02 21:09:48.876055 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:48.875906    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c822j\" (UniqueName: \"kubernetes.io/projected/babb1d71-f609-4c3a-bf84-7532e6e4aa15-kube-api-access-c822j\") pod \"babb1d71-f609-4c3a-bf84-7532e6e4aa15\" (UID: \"babb1d71-f609-4c3a-bf84-7532e6e4aa15\") "
Jul 02 21:09:48.876055 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:48.875941    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/babb1d71-f609-4c3a-bf84-7532e6e4aa15-model-cache\") pod \"babb1d71-f609-4c3a-bf84-7532e6e4aa15\" (UID: \"babb1d71-f609-4c3a-bf84-7532e6e4aa15\") "
Jul 02 21:09:48.876190 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:48.876095    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/babb1d71-f609-4c3a-bf84-7532e6e4aa15-home\") pod \"babb1d71-f609-4c3a-bf84-7532e6e4aa15\" (UID: \"babb1d71-f609-4c3a-bf84-7532e6e4aa15\") "
Jul 02 21:09:48.876254 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:48.876201    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/babb1d71-f609-4c3a-bf84-7532e6e4aa15-dshm\") pod \"babb1d71-f609-4c3a-bf84-7532e6e4aa15\" (UID: \"babb1d71-f609-4c3a-bf84-7532e6e4aa15\") "
Jul 02 21:09:48.876254 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:48.876213    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/babb1d71-f609-4c3a-bf84-7532e6e4aa15-model-cache" (OuterVolumeSpecName: "model-cache") pod "babb1d71-f609-4c3a-bf84-7532e6e4aa15" (UID: "babb1d71-f609-4c3a-bf84-7532e6e4aa15"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:09:48.876254 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:48.876225    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/babb1d71-f609-4c3a-bf84-7532e6e4aa15-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "babb1d71-f609-4c3a-bf84-7532e6e4aa15" (UID: "babb1d71-f609-4c3a-bf84-7532e6e4aa15"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:09:48.876254 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:48.876238    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/babb1d71-f609-4c3a-bf84-7532e6e4aa15-tls-certs\") pod \"babb1d71-f609-4c3a-bf84-7532e6e4aa15\" (UID: \"babb1d71-f609-4c3a-bf84-7532e6e4aa15\") "
Jul 02 21:09:48.876469 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:48.876434    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/babb1d71-f609-4c3a-bf84-7532e6e4aa15-home" (OuterVolumeSpecName: "home") pod "babb1d71-f609-4c3a-bf84-7532e6e4aa15" (UID: "babb1d71-f609-4c3a-bf84-7532e6e4aa15"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:09:48.876649 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:48.876632    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/babb1d71-f609-4c3a-bf84-7532e6e4aa15-tmp-dir\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:09:48.876715 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:48.876653    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/babb1d71-f609-4c3a-bf84-7532e6e4aa15-model-cache\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:09:48.876715 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:48.876666    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/babb1d71-f609-4c3a-bf84-7532e6e4aa15-home\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:09:48.878416 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:48.878394    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/babb1d71-f609-4c3a-bf84-7532e6e4aa15-dshm" (OuterVolumeSpecName: "dshm") pod "babb1d71-f609-4c3a-bf84-7532e6e4aa15" (UID: "babb1d71-f609-4c3a-bf84-7532e6e4aa15"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:09:48.878416 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:48.878407    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/babb1d71-f609-4c3a-bf84-7532e6e4aa15-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "babb1d71-f609-4c3a-bf84-7532e6e4aa15" (UID: "babb1d71-f609-4c3a-bf84-7532e6e4aa15"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:09:48.878565 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:48.878499    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/babb1d71-f609-4c3a-bf84-7532e6e4aa15-kube-api-access-c822j" (OuterVolumeSpecName: "kube-api-access-c822j") pod "babb1d71-f609-4c3a-bf84-7532e6e4aa15" (UID: "babb1d71-f609-4c3a-bf84-7532e6e4aa15"). InnerVolumeSpecName "kube-api-access-c822j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:09:48.883221 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:48.883188    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57ba2bd3-53b0-43af-b3fe-411714314c93" path="/var/lib/kubelet/pods/57ba2bd3-53b0-43af-b3fe-411714314c93/volumes"
Jul 02 21:09:48.977947 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:48.977915    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/babb1d71-f609-4c3a-bf84-7532e6e4aa15-dshm\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:09:48.977947 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:48.977941    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/babb1d71-f609-4c3a-bf84-7532e6e4aa15-tls-certs\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:09:48.978167 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:48.977956    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c822j\" (UniqueName: \"kubernetes.io/projected/babb1d71-f609-4c3a-bf84-7532e6e4aa15-kube-api-access-c822j\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:09:49.216899 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:49.216866    2581 generic.go:356] "Generic (PLEG): container finished" podID="babb1d71-f609-4c3a-bf84-7532e6e4aa15" containerID="71337a1c90933eb8bce5ff6ed7494f4fdb6e679e4e4965703c42aee6245a7e22" exitCode=0
Jul 02 21:09:49.217065 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:49.216908    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2217fe/sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9"
Jul 02 21:09:49.217065 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:49.216949    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2217fe/sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9" event={"ID":"babb1d71-f609-4c3a-bf84-7532e6e4aa15","Type":"ContainerDied","Data":"71337a1c90933eb8bce5ff6ed7494f4fdb6e679e4e4965703c42aee6245a7e22"}
Jul 02 21:09:49.217065 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:49.216990    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2217fe/sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9" event={"ID":"babb1d71-f609-4c3a-bf84-7532e6e4aa15","Type":"ContainerDied","Data":"b400379ce7ad1e5b257c16026bb2bc0342e571f89194200dbf68426360d93db7"}
Jul 02 21:09:49.217065 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:49.217008    2581 scope.go:117] "RemoveContainer" containerID="71337a1c90933eb8bce5ff6ed7494f4fdb6e679e4e4965703c42aee6245a7e22"
Jul 02 21:09:49.225785 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:49.225756    2581 scope.go:117] "RemoveContainer" containerID="71337a1c90933eb8bce5ff6ed7494f4fdb6e679e4e4965703c42aee6245a7e22"
Jul 02 21:09:49.226034 ip-10-0-135-220 kubenswrapper[2581]: E0702 21:09:49.226016    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71337a1c90933eb8bce5ff6ed7494f4fdb6e679e4e4965703c42aee6245a7e22\": container with ID starting with 71337a1c90933eb8bce5ff6ed7494f4fdb6e679e4e4965703c42aee6245a7e22 not found: ID does not exist" containerID="71337a1c90933eb8bce5ff6ed7494f4fdb6e679e4e4965703c42aee6245a7e22"
Jul 02 21:09:49.226090 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:49.226045    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71337a1c90933eb8bce5ff6ed7494f4fdb6e679e4e4965703c42aee6245a7e22"} err="failed to get container status \"71337a1c90933eb8bce5ff6ed7494f4fdb6e679e4e4965703c42aee6245a7e22\": rpc error: code = NotFound desc = could not find container \"71337a1c90933eb8bce5ff6ed7494f4fdb6e679e4e4965703c42aee6245a7e22\": container with ID starting with 71337a1c90933eb8bce5ff6ed7494f4fdb6e679e4e4965703c42aee6245a7e22 not found: ID does not exist"
Jul 02 21:09:49.233882 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:49.233856    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-2217fe/sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9"]
Jul 02 21:09:49.240404 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:49.240381    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-2217fe/sub-test-model-2217fe-kserve-7dc59f6bc7-kvth9"]
Jul 02 21:09:50.881777 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:09:50.881745    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="babb1d71-f609-4c3a-bf84-7532e6e4aa15" path="/var/lib/kubelet/pods/babb1d71-f609-4c3a-bf84-7532e6e4aa15/volumes"
Jul 02 21:10:01.888429 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:01.888391    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-2217fe/rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl"]
Jul 02 21:10:01.888984 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:01.888966    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="babb1d71-f609-4c3a-bf84-7532e6e4aa15" containerName="main"
Jul 02 21:10:01.889054 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:01.888986    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="babb1d71-f609-4c3a-bf84-7532e6e4aa15" containerName="main"
Jul 02 21:10:01.889054 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:01.889009    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57ba2bd3-53b0-43af-b3fe-411714314c93" containerName="main"
Jul 02 21:10:01.889054 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:01.889016    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="57ba2bd3-53b0-43af-b3fe-411714314c93" containerName="main"
Jul 02 21:10:01.889186 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:01.889076    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="babb1d71-f609-4c3a-bf84-7532e6e4aa15" containerName="main"
Jul 02 21:10:01.889186 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:01.889090    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="57ba2bd3-53b0-43af-b3fe-411714314c93" containerName="main"
Jul 02 21:10:01.891845 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:01.891826    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2217fe/rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl"
Jul 02 21:10:01.894266 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:01.894232    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-2217fe\"/\"openshift-service-ca.crt\""
Jul 02 21:10:01.895151 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:01.895115    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-2217fe\"/\"kube-root-ca.crt\""
Jul 02 21:10:01.895350 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:01.895320    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-2217fe\"/\"default-dockercfg-chdds\""
Jul 02 21:10:01.895350 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:01.895332    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-2217fe\"/\"rate-test-model-2217fe-kserve-self-signed-certs\""
Jul 02 21:10:01.901571 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:01.901553    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-2217fe/rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl"]
Jul 02 21:10:01.990801 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:01.990768    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hz8g\" (UniqueName: \"kubernetes.io/projected/aa739295-655f-437f-ab51-7721c93ae531-kube-api-access-6hz8g\") pod \"rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl\" (UID: \"aa739295-655f-437f-ab51-7721c93ae531\") " pod="ai-tenant-e2e-shared-b-2217fe/rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl"
Jul 02 21:10:01.990967 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:01.990828    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa739295-655f-437f-ab51-7721c93ae531-model-cache\") pod \"rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl\" (UID: \"aa739295-655f-437f-ab51-7721c93ae531\") " pod="ai-tenant-e2e-shared-b-2217fe/rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl"
Jul 02 21:10:01.990967 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:01.990853    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa739295-655f-437f-ab51-7721c93ae531-tls-certs\") pod \"rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl\" (UID: \"aa739295-655f-437f-ab51-7721c93ae531\") " pod="ai-tenant-e2e-shared-b-2217fe/rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl"
Jul 02 21:10:01.990967 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:01.990850    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:10:01.990967 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:01.990956    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa739295-655f-437f-ab51-7721c93ae531-dshm\") pod \"rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl\" (UID: \"aa739295-655f-437f-ab51-7721c93ae531\") " pod="ai-tenant-e2e-shared-b-2217fe/rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl"
Jul 02 21:10:01.991254 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:01.991030    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa739295-655f-437f-ab51-7721c93ae531-home\") pod \"rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl\" (UID: \"aa739295-655f-437f-ab51-7721c93ae531\") " pod="ai-tenant-e2e-shared-b-2217fe/rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl"
Jul 02 21:10:01.991254 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:01.991071    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa739295-655f-437f-ab51-7721c93ae531-tmp-dir\") pod \"rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl\" (UID: \"aa739295-655f-437f-ab51-7721c93ae531\") " pod="ai-tenant-e2e-shared-b-2217fe/rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl"
Jul 02 21:10:02.092258 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:02.092228    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa739295-655f-437f-ab51-7721c93ae531-home\") pod \"rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl\" (UID: \"aa739295-655f-437f-ab51-7721c93ae531\") " pod="ai-tenant-e2e-shared-b-2217fe/rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl"
Jul 02 21:10:02.092258 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:02.092264    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa739295-655f-437f-ab51-7721c93ae531-tmp-dir\") pod \"rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl\" (UID: \"aa739295-655f-437f-ab51-7721c93ae531\") " pod="ai-tenant-e2e-shared-b-2217fe/rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl"
Jul 02 21:10:02.092477 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:02.092318    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hz8g\" (UniqueName: \"kubernetes.io/projected/aa739295-655f-437f-ab51-7721c93ae531-kube-api-access-6hz8g\") pod \"rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl\" (UID: \"aa739295-655f-437f-ab51-7721c93ae531\") " pod="ai-tenant-e2e-shared-b-2217fe/rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl"
Jul 02 21:10:02.092477 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:02.092358    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa739295-655f-437f-ab51-7721c93ae531-model-cache\") pod \"rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl\" (UID: \"aa739295-655f-437f-ab51-7721c93ae531\") " pod="ai-tenant-e2e-shared-b-2217fe/rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl"
Jul 02 21:10:02.092477 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:02.092375    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa739295-655f-437f-ab51-7721c93ae531-tls-certs\") pod \"rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl\" (UID: \"aa739295-655f-437f-ab51-7721c93ae531\") " pod="ai-tenant-e2e-shared-b-2217fe/rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl"
Jul 02 21:10:02.092477 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:02.092420    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa739295-655f-437f-ab51-7721c93ae531-dshm\") pod \"rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl\" (UID: \"aa739295-655f-437f-ab51-7721c93ae531\") " pod="ai-tenant-e2e-shared-b-2217fe/rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl"
Jul 02 21:10:02.092697 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:02.092671    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa739295-655f-437f-ab51-7721c93ae531-home\") pod \"rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl\" (UID: \"aa739295-655f-437f-ab51-7721c93ae531\") " pod="ai-tenant-e2e-shared-b-2217fe/rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl"
Jul 02 21:10:02.092760 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:02.092695    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa739295-655f-437f-ab51-7721c93ae531-tmp-dir\") pod \"rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl\" (UID: \"aa739295-655f-437f-ab51-7721c93ae531\") " pod="ai-tenant-e2e-shared-b-2217fe/rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl"
Jul 02 21:10:02.092760 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:02.092746    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa739295-655f-437f-ab51-7721c93ae531-model-cache\") pod \"rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl\" (UID: \"aa739295-655f-437f-ab51-7721c93ae531\") " pod="ai-tenant-e2e-shared-b-2217fe/rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl"
Jul 02 21:10:02.094724 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:02.094701    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa739295-655f-437f-ab51-7721c93ae531-dshm\") pod \"rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl\" (UID: \"aa739295-655f-437f-ab51-7721c93ae531\") " pod="ai-tenant-e2e-shared-b-2217fe/rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl"
Jul 02 21:10:02.094871 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:02.094852    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa739295-655f-437f-ab51-7721c93ae531-tls-certs\") pod \"rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl\" (UID: \"aa739295-655f-437f-ab51-7721c93ae531\") " pod="ai-tenant-e2e-shared-b-2217fe/rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl"
Jul 02 21:10:02.100387 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:02.100370    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hz8g\" (UniqueName: \"kubernetes.io/projected/aa739295-655f-437f-ab51-7721c93ae531-kube-api-access-6hz8g\") pod \"rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl\" (UID: \"aa739295-655f-437f-ab51-7721c93ae531\") " pod="ai-tenant-e2e-shared-b-2217fe/rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl"
Jul 02 21:10:02.202373 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:02.202305    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2217fe/rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl"
Jul 02 21:10:02.334651 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:02.334624    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-2217fe/rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl"]
Jul 02 21:10:02.337218 ip-10-0-135-220 kubenswrapper[2581]: W0702 21:10:02.337187    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa739295_655f_437f_ab51_7721c93ae531.slice/crio-2fa67d423c41c87f0dde4bede0bdf8516e9f46f88100628767cd33148bf5d98a WatchSource:0}: Error finding container 2fa67d423c41c87f0dde4bede0bdf8516e9f46f88100628767cd33148bf5d98a: Status 404 returned error can't find the container with id 2fa67d423c41c87f0dde4bede0bdf8516e9f46f88100628767cd33148bf5d98a
Jul 02 21:10:03.295912 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:03.295874    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2217fe/rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl" event={"ID":"aa739295-655f-437f-ab51-7721c93ae531","Type":"ContainerStarted","Data":"987c319caf4c8e2c0c5a9c703c11a2d284b2040fea31f31481c319a2c3845249"}
Jul 02 21:10:03.295912 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:03.295917    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2217fe/rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl" event={"ID":"aa739295-655f-437f-ab51-7721c93ae531","Type":"ContainerStarted","Data":"2fa67d423c41c87f0dde4bede0bdf8516e9f46f88100628767cd33148bf5d98a"}
Jul 02 21:10:03.316568 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:03.316516    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-2217fe/rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl" podStartSLOduration=2.316498601 podStartE2EDuration="2.316498601s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:10:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:10:03.313740222 +0000 UTC m=+2236.984253715" watchObservedRunningTime="2026-07-02 21:10:03.316498601 +0000 UTC m=+2236.987012094"
Jul 02 21:10:05.793621 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:05.793587    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 21:10:12.203314 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:12.203234    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-2217fe/rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl"
Jul 02 21:10:12.203314 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:12.203291    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-2217fe/rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl"
Jul 02 21:10:12.215762 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:12.215739    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-2217fe/rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl"
Jul 02 21:10:12.359872 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:12.359844    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-2217fe/rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl"
Jul 02 21:10:15.270356 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:15.270321    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:10:20.391652 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:20.391618    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 21:10:34.896825 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:34.896784    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 21:10:42.581011 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:42.580978    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:10:42.924438 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:42.924356    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:10:43.022057 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:43.022025    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:10:43.470317 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:43.470282    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-2217fe/rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl"]
Jul 02 21:10:43.488475 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:43.488442    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:10:44.534701 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:44.534672    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:10:44.926490 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:44.926386    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:10:45.077952 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:45.077918    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:10:45.178628 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:45.178532    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:10:45.313455 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:45.313420    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:10:49.192088 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:49.192050    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 21:10:49.999428 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:49.999391    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:10:58.490931 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:58.490883    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-2217fe/rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl" podUID="aa739295-655f-437f-ab51-7721c93ae531" containerName="main" containerID="cri-o://987c319caf4c8e2c0c5a9c703c11a2d284b2040fea31f31481c319a2c3845249" gracePeriod=45
Jul 02 21:10:58.748272 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:58.748217    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2217fe/rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl"
Jul 02 21:10:58.890049 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:58.890022    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa739295-655f-437f-ab51-7721c93ae531-tmp-dir\") pod \"aa739295-655f-437f-ab51-7721c93ae531\" (UID: \"aa739295-655f-437f-ab51-7721c93ae531\") "
Jul 02 21:10:58.890268 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:58.890084    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa739295-655f-437f-ab51-7721c93ae531-model-cache\") pod \"aa739295-655f-437f-ab51-7721c93ae531\" (UID: \"aa739295-655f-437f-ab51-7721c93ae531\") "
Jul 02 21:10:58.890268 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:58.890127    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa739295-655f-437f-ab51-7721c93ae531-dshm\") pod \"aa739295-655f-437f-ab51-7721c93ae531\" (UID: \"aa739295-655f-437f-ab51-7721c93ae531\") "
Jul 02 21:10:58.890268 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:58.890167    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa739295-655f-437f-ab51-7721c93ae531-home\") pod \"aa739295-655f-437f-ab51-7721c93ae531\" (UID: \"aa739295-655f-437f-ab51-7721c93ae531\") "
Jul 02 21:10:58.890268 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:58.890219    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa739295-655f-437f-ab51-7721c93ae531-tls-certs\") pod \"aa739295-655f-437f-ab51-7721c93ae531\" (UID: \"aa739295-655f-437f-ab51-7721c93ae531\") "
Jul 02 21:10:58.890497 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:58.890296    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa739295-655f-437f-ab51-7721c93ae531-model-cache" (OuterVolumeSpecName: "model-cache") pod "aa739295-655f-437f-ab51-7721c93ae531" (UID: "aa739295-655f-437f-ab51-7721c93ae531"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:10:58.890497 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:58.890302    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa739295-655f-437f-ab51-7721c93ae531-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "aa739295-655f-437f-ab51-7721c93ae531" (UID: "aa739295-655f-437f-ab51-7721c93ae531"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:10:58.890497 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:58.890305    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6hz8g\" (UniqueName: \"kubernetes.io/projected/aa739295-655f-437f-ab51-7721c93ae531-kube-api-access-6hz8g\") pod \"aa739295-655f-437f-ab51-7721c93ae531\" (UID: \"aa739295-655f-437f-ab51-7721c93ae531\") "
Jul 02 21:10:58.890497 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:58.890477    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa739295-655f-437f-ab51-7721c93ae531-home" (OuterVolumeSpecName: "home") pod "aa739295-655f-437f-ab51-7721c93ae531" (UID: "aa739295-655f-437f-ab51-7721c93ae531"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:10:58.890678 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:58.890602    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa739295-655f-437f-ab51-7721c93ae531-tmp-dir\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:10:58.890678 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:58.890615    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa739295-655f-437f-ab51-7721c93ae531-model-cache\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:10:58.890678 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:58.890623    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa739295-655f-437f-ab51-7721c93ae531-home\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:10:58.892264 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:58.892237    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa739295-655f-437f-ab51-7721c93ae531-dshm" (OuterVolumeSpecName: "dshm") pod "aa739295-655f-437f-ab51-7721c93ae531" (UID: "aa739295-655f-437f-ab51-7721c93ae531"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:10:58.892264 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:58.892251    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa739295-655f-437f-ab51-7721c93ae531-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "aa739295-655f-437f-ab51-7721c93ae531" (UID: "aa739295-655f-437f-ab51-7721c93ae531"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:10:58.892404 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:58.892317    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa739295-655f-437f-ab51-7721c93ae531-kube-api-access-6hz8g" (OuterVolumeSpecName: "kube-api-access-6hz8g") pod "aa739295-655f-437f-ab51-7721c93ae531" (UID: "aa739295-655f-437f-ab51-7721c93ae531"). InnerVolumeSpecName "kube-api-access-6hz8g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:10:58.991433 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:58.991405    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa739295-655f-437f-ab51-7721c93ae531-dshm\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:10:58.991433 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:58.991431    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa739295-655f-437f-ab51-7721c93ae531-tls-certs\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:10:58.991621 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:58.991442    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hz8g\" (UniqueName: \"kubernetes.io/projected/aa739295-655f-437f-ab51-7721c93ae531-kube-api-access-6hz8g\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:10:59.601112 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:59.601079    2581 generic.go:356] "Generic (PLEG): container finished" podID="aa739295-655f-437f-ab51-7721c93ae531" containerID="987c319caf4c8e2c0c5a9c703c11a2d284b2040fea31f31481c319a2c3845249" exitCode=0
Jul 02 21:10:59.601515 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:59.601158    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2217fe/rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl" event={"ID":"aa739295-655f-437f-ab51-7721c93ae531","Type":"ContainerDied","Data":"987c319caf4c8e2c0c5a9c703c11a2d284b2040fea31f31481c319a2c3845249"}
Jul 02 21:10:59.601515 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:59.601190    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2217fe/rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl" event={"ID":"aa739295-655f-437f-ab51-7721c93ae531","Type":"ContainerDied","Data":"2fa67d423c41c87f0dde4bede0bdf8516e9f46f88100628767cd33148bf5d98a"}
Jul 02 21:10:59.601515 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:59.601206    2581 scope.go:117] "RemoveContainer" containerID="987c319caf4c8e2c0c5a9c703c11a2d284b2040fea31f31481c319a2c3845249"
Jul 02 21:10:59.601515 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:59.601164    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2217fe/rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl"
Jul 02 21:10:59.617193 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:59.617171    2581 scope.go:117] "RemoveContainer" containerID="987c319caf4c8e2c0c5a9c703c11a2d284b2040fea31f31481c319a2c3845249"
Jul 02 21:10:59.617469 ip-10-0-135-220 kubenswrapper[2581]: E0702 21:10:59.617447    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"987c319caf4c8e2c0c5a9c703c11a2d284b2040fea31f31481c319a2c3845249\": container with ID starting with 987c319caf4c8e2c0c5a9c703c11a2d284b2040fea31f31481c319a2c3845249 not found: ID does not exist" containerID="987c319caf4c8e2c0c5a9c703c11a2d284b2040fea31f31481c319a2c3845249"
Jul 02 21:10:59.617539 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:59.617482    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"987c319caf4c8e2c0c5a9c703c11a2d284b2040fea31f31481c319a2c3845249"} err="failed to get container status \"987c319caf4c8e2c0c5a9c703c11a2d284b2040fea31f31481c319a2c3845249\": rpc error: code = NotFound desc = could not find container \"987c319caf4c8e2c0c5a9c703c11a2d284b2040fea31f31481c319a2c3845249\": container with ID starting with 987c319caf4c8e2c0c5a9c703c11a2d284b2040fea31f31481c319a2c3845249 not found: ID does not exist"
Jul 02 21:10:59.633971 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:59.633947    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-2217fe/rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl"]
Jul 02 21:10:59.637658 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:10:59.637634    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-2217fe/rate-test-model-2217fe-kserve-ccf99f9cf-7pdfl"]
Jul 02 21:11:00.881728 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:00.881698    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa739295-655f-437f-ab51-7721c93ae531" path="/var/lib/kubelet/pods/aa739295-655f-437f-ab51-7721c93ae531/volumes"
Jul 02 21:11:10.044346 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:10.044316    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:11:10.145159 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:10.145111    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:11:27.137687 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:27.137650    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:11:27.386417 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:27.386384    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t"]
Jul 02 21:11:27.386598 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:27.386573    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t" podUID="16540e5a-f90d-4ba4-9285-2754d6c0a66e" containerName="istio-proxy" containerID="cri-o://7b366eb292bcad8bea83474060f5b67e425c173bf7b06b39eca32f0d9bda3ea9" gracePeriod=30
Jul 02 21:11:27.416153 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:27.416066    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:11:27.837656 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:27.837622    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:11:28.246239 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:28.246207    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:11:28.348379 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:28.348329    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:11:29.307745 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:29.307710    2581 patch_prober.go:28] interesting pod/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 02 21:11:29.308201 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:29.307775    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t" podUID="16540e5a-f90d-4ba4-9285-2754d6c0a66e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 21:11:30.194572 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:30.194536    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nw8gn"]
Jul 02 21:11:32.643982 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:32.643957    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t"
Jul 02 21:11:32.776166 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:32.776121    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16540e5a-f90d-4ba4-9285-2754d6c0a66e-workload-socket\") pod \"16540e5a-f90d-4ba4-9285-2754d6c0a66e\" (UID: \"16540e5a-f90d-4ba4-9285-2754d6c0a66e\") "
Jul 02 21:11:32.776357 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:32.776175    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16540e5a-f90d-4ba4-9285-2754d6c0a66e-istio-podinfo\") pod \"16540e5a-f90d-4ba4-9285-2754d6c0a66e\" (UID: \"16540e5a-f90d-4ba4-9285-2754d6c0a66e\") "
Jul 02 21:11:32.776357 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:32.776200    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16540e5a-f90d-4ba4-9285-2754d6c0a66e-workload-certs\") pod \"16540e5a-f90d-4ba4-9285-2754d6c0a66e\" (UID: \"16540e5a-f90d-4ba4-9285-2754d6c0a66e\") "
Jul 02 21:11:32.776357 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:32.776226    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16540e5a-f90d-4ba4-9285-2754d6c0a66e-credential-socket\") pod \"16540e5a-f90d-4ba4-9285-2754d6c0a66e\" (UID: \"16540e5a-f90d-4ba4-9285-2754d6c0a66e\") "
Jul 02 21:11:32.776357 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:32.776251    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16540e5a-f90d-4ba4-9285-2754d6c0a66e-istio-envoy\") pod \"16540e5a-f90d-4ba4-9285-2754d6c0a66e\" (UID: \"16540e5a-f90d-4ba4-9285-2754d6c0a66e\") "
Jul 02 21:11:32.776357 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:32.776285    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16540e5a-f90d-4ba4-9285-2754d6c0a66e-istio-data\") pod \"16540e5a-f90d-4ba4-9285-2754d6c0a66e\" (UID: \"16540e5a-f90d-4ba4-9285-2754d6c0a66e\") "
Jul 02 21:11:32.776357 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:32.776323    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bg2z8\" (UniqueName: \"kubernetes.io/projected/16540e5a-f90d-4ba4-9285-2754d6c0a66e-kube-api-access-bg2z8\") pod \"16540e5a-f90d-4ba4-9285-2754d6c0a66e\" (UID: \"16540e5a-f90d-4ba4-9285-2754d6c0a66e\") "
Jul 02 21:11:32.776729 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:32.776384    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16540e5a-f90d-4ba4-9285-2754d6c0a66e-istio-token\") pod \"16540e5a-f90d-4ba4-9285-2754d6c0a66e\" (UID: \"16540e5a-f90d-4ba4-9285-2754d6c0a66e\") "
Jul 02 21:11:32.776729 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:32.776424    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16540e5a-f90d-4ba4-9285-2754d6c0a66e-istiod-ca-cert\") pod \"16540e5a-f90d-4ba4-9285-2754d6c0a66e\" (UID: \"16540e5a-f90d-4ba4-9285-2754d6c0a66e\") "
Jul 02 21:11:32.776729 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:32.776434    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16540e5a-f90d-4ba4-9285-2754d6c0a66e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "16540e5a-f90d-4ba4-9285-2754d6c0a66e" (UID: "16540e5a-f90d-4ba4-9285-2754d6c0a66e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:11:32.776729 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:32.776588    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16540e5a-f90d-4ba4-9285-2754d6c0a66e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "16540e5a-f90d-4ba4-9285-2754d6c0a66e" (UID: "16540e5a-f90d-4ba4-9285-2754d6c0a66e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:11:32.776729 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:32.776720    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16540e5a-f90d-4ba4-9285-2754d6c0a66e-workload-socket\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:11:32.777011 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:32.776740    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16540e5a-f90d-4ba4-9285-2754d6c0a66e-workload-certs\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:11:32.777011 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:32.776758    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16540e5a-f90d-4ba4-9285-2754d6c0a66e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "16540e5a-f90d-4ba4-9285-2754d6c0a66e" (UID: "16540e5a-f90d-4ba4-9285-2754d6c0a66e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:11:32.777011 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:32.776882    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16540e5a-f90d-4ba4-9285-2754d6c0a66e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "16540e5a-f90d-4ba4-9285-2754d6c0a66e" (UID: "16540e5a-f90d-4ba4-9285-2754d6c0a66e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:11:32.777690 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:32.777662    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16540e5a-f90d-4ba4-9285-2754d6c0a66e-istio-data" (OuterVolumeSpecName: "istio-data") pod "16540e5a-f90d-4ba4-9285-2754d6c0a66e" (UID: "16540e5a-f90d-4ba4-9285-2754d6c0a66e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:11:32.778708 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:32.778684    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16540e5a-f90d-4ba4-9285-2754d6c0a66e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "16540e5a-f90d-4ba4-9285-2754d6c0a66e" (UID: "16540e5a-f90d-4ba4-9285-2754d6c0a66e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:11:32.778815 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:32.778760    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16540e5a-f90d-4ba4-9285-2754d6c0a66e-kube-api-access-bg2z8" (OuterVolumeSpecName: "kube-api-access-bg2z8") pod "16540e5a-f90d-4ba4-9285-2754d6c0a66e" (UID: "16540e5a-f90d-4ba4-9285-2754d6c0a66e"). InnerVolumeSpecName "kube-api-access-bg2z8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:11:32.778979 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:32.778959    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16540e5a-f90d-4ba4-9285-2754d6c0a66e-istio-token" (OuterVolumeSpecName: "istio-token") pod "16540e5a-f90d-4ba4-9285-2754d6c0a66e" (UID: "16540e5a-f90d-4ba4-9285-2754d6c0a66e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:11:32.779055 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:32.779037    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/16540e5a-f90d-4ba4-9285-2754d6c0a66e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "16540e5a-f90d-4ba4-9285-2754d6c0a66e" (UID: "16540e5a-f90d-4ba4-9285-2754d6c0a66e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 21:11:32.781487 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:32.781458    2581 generic.go:356] "Generic (PLEG): container finished" podID="16540e5a-f90d-4ba4-9285-2754d6c0a66e" containerID="7b366eb292bcad8bea83474060f5b67e425c173bf7b06b39eca32f0d9bda3ea9" exitCode=0
Jul 02 21:11:32.781595 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:32.781503    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t" event={"ID":"16540e5a-f90d-4ba4-9285-2754d6c0a66e","Type":"ContainerDied","Data":"7b366eb292bcad8bea83474060f5b67e425c173bf7b06b39eca32f0d9bda3ea9"}
Jul 02 21:11:32.781595 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:32.781514    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t"
Jul 02 21:11:32.781595 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:32.781590    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t" event={"ID":"16540e5a-f90d-4ba4-9285-2754d6c0a66e","Type":"ContainerDied","Data":"57092db60d05ed0a1a51111901e1f5211ad3d16833619b070e4da685790c704e"}
Jul 02 21:11:32.781763 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:32.781625    2581 scope.go:117] "RemoveContainer" containerID="7b366eb292bcad8bea83474060f5b67e425c173bf7b06b39eca32f0d9bda3ea9"
Jul 02 21:11:32.800376 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:32.800360    2581 scope.go:117] "RemoveContainer" containerID="e7118ec9b5416e31fe81f89446babac7a1aea71c1f72f9b5c3f89f6d09a3705f"
Jul 02 21:11:32.808266 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:32.808251    2581 scope.go:117] "RemoveContainer" containerID="7b366eb292bcad8bea83474060f5b67e425c173bf7b06b39eca32f0d9bda3ea9"
Jul 02 21:11:32.808537 ip-10-0-135-220 kubenswrapper[2581]: E0702 21:11:32.808510    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b366eb292bcad8bea83474060f5b67e425c173bf7b06b39eca32f0d9bda3ea9\": container with ID starting with 7b366eb292bcad8bea83474060f5b67e425c173bf7b06b39eca32f0d9bda3ea9 not found: ID does not exist" containerID="7b366eb292bcad8bea83474060f5b67e425c173bf7b06b39eca32f0d9bda3ea9"
Jul 02 21:11:32.808616 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:32.808549    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b366eb292bcad8bea83474060f5b67e425c173bf7b06b39eca32f0d9bda3ea9"} err="failed to get container status \"7b366eb292bcad8bea83474060f5b67e425c173bf7b06b39eca32f0d9bda3ea9\": rpc error: code = NotFound desc = could not find container \"7b366eb292bcad8bea83474060f5b67e425c173bf7b06b39eca32f0d9bda3ea9\": container with ID starting with 7b366eb292bcad8bea83474060f5b67e425c173bf7b06b39eca32f0d9bda3ea9 not found: ID does not exist"
Jul 02 21:11:32.808616 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:32.808572    2581 scope.go:117] "RemoveContainer" containerID="e7118ec9b5416e31fe81f89446babac7a1aea71c1f72f9b5c3f89f6d09a3705f"
Jul 02 21:11:32.808815 ip-10-0-135-220 kubenswrapper[2581]: E0702 21:11:32.808795    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7118ec9b5416e31fe81f89446babac7a1aea71c1f72f9b5c3f89f6d09a3705f\": container with ID starting with e7118ec9b5416e31fe81f89446babac7a1aea71c1f72f9b5c3f89f6d09a3705f not found: ID does not exist" containerID="e7118ec9b5416e31fe81f89446babac7a1aea71c1f72f9b5c3f89f6d09a3705f"
Jul 02 21:11:32.808857 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:32.808821    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7118ec9b5416e31fe81f89446babac7a1aea71c1f72f9b5c3f89f6d09a3705f"} err="failed to get container status \"e7118ec9b5416e31fe81f89446babac7a1aea71c1f72f9b5c3f89f6d09a3705f\": rpc error: code = NotFound desc = could not find container \"e7118ec9b5416e31fe81f89446babac7a1aea71c1f72f9b5c3f89f6d09a3705f\": container with ID starting with e7118ec9b5416e31fe81f89446babac7a1aea71c1f72f9b5c3f89f6d09a3705f not found: ID does not exist"
Jul 02 21:11:32.831121 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:32.831096    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t"]
Jul 02 21:11:32.833046 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:32.833023    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-58d1e3-openshift-default-94c5f95f-m8f8t"]
Jul 02 21:11:32.877374 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:32.877354    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16540e5a-f90d-4ba4-9285-2754d6c0a66e-istiod-ca-cert\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:11:32.877374 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:32.877374    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16540e5a-f90d-4ba4-9285-2754d6c0a66e-istio-podinfo\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:11:32.877490 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:32.877382    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16540e5a-f90d-4ba4-9285-2754d6c0a66e-credential-socket\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:11:32.877490 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:32.877392    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16540e5a-f90d-4ba4-9285-2754d6c0a66e-istio-envoy\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:11:32.877490 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:32.877400    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16540e5a-f90d-4ba4-9285-2754d6c0a66e-istio-data\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:11:32.877490 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:32.877408    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bg2z8\" (UniqueName: \"kubernetes.io/projected/16540e5a-f90d-4ba4-9285-2754d6c0a66e-kube-api-access-bg2z8\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:11:32.877490 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:32.877416    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16540e5a-f90d-4ba4-9285-2754d6c0a66e-istio-token\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:11:32.881227 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:32.881197    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16540e5a-f90d-4ba4-9285-2754d6c0a66e" path="/var/lib/kubelet/pods/16540e5a-f90d-4ba4-9285-2754d6c0a66e/volumes"
Jul 02 21:11:34.625370 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:34.625333    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:11:34.700885 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:34.700847    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:11:34.893553 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:34.893474    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447"]
Jul 02 21:11:34.893747 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:34.893722    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447" podUID="45e79980-be5c-47b3-b78b-53cb5b5480dc" containerName="istio-proxy" containerID="cri-o://1e07b5bbb674a01990439d28dea0caa6ef009cc347c91875269f6a78cc0f5c3b" gracePeriod=30
Jul 02 21:11:34.920025 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:34.919997    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:11:35.296610 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:35.296570    2581 patch_prober.go:28] interesting pod/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 02 21:11:35.296759 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:35.296630    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447" podUID="45e79980-be5c-47b3-b78b-53cb5b5480dc" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 21:11:35.597445 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:35.597370    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-665d585cf8-9vqwd_a3775f1e-d556-486a-b4f2-11bf02dfa2e2/authorino/0.log"
Jul 02 21:11:40.151657 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:40.151632    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447"
Jul 02 21:11:40.240652 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:40.240622    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45e79980-be5c-47b3-b78b-53cb5b5480dc-workload-certs\") pod \"45e79980-be5c-47b3-b78b-53cb5b5480dc\" (UID: \"45e79980-be5c-47b3-b78b-53cb5b5480dc\") "
Jul 02 21:11:40.240799 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:40.240675    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45e79980-be5c-47b3-b78b-53cb5b5480dc-credential-socket\") pod \"45e79980-be5c-47b3-b78b-53cb5b5480dc\" (UID: \"45e79980-be5c-47b3-b78b-53cb5b5480dc\") "
Jul 02 21:11:40.240799 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:40.240714    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45e79980-be5c-47b3-b78b-53cb5b5480dc-istio-data\") pod \"45e79980-be5c-47b3-b78b-53cb5b5480dc\" (UID: \"45e79980-be5c-47b3-b78b-53cb5b5480dc\") "
Jul 02 21:11:40.240799 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:40.240742    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45e79980-be5c-47b3-b78b-53cb5b5480dc-workload-socket\") pod \"45e79980-be5c-47b3-b78b-53cb5b5480dc\" (UID: \"45e79980-be5c-47b3-b78b-53cb5b5480dc\") "
Jul 02 21:11:40.240799 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:40.240773    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45e79980-be5c-47b3-b78b-53cb5b5480dc-istio-podinfo\") pod \"45e79980-be5c-47b3-b78b-53cb5b5480dc\" (UID: \"45e79980-be5c-47b3-b78b-53cb5b5480dc\") "
Jul 02 21:11:40.240955 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:40.240823    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45e79980-be5c-47b3-b78b-53cb5b5480dc-istiod-ca-cert\") pod \"45e79980-be5c-47b3-b78b-53cb5b5480dc\" (UID: \"45e79980-be5c-47b3-b78b-53cb5b5480dc\") "
Jul 02 21:11:40.240955 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:40.240869    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42l58\" (UniqueName: \"kubernetes.io/projected/45e79980-be5c-47b3-b78b-53cb5b5480dc-kube-api-access-42l58\") pod \"45e79980-be5c-47b3-b78b-53cb5b5480dc\" (UID: \"45e79980-be5c-47b3-b78b-53cb5b5480dc\") "
Jul 02 21:11:40.240955 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:40.240920    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45e79980-be5c-47b3-b78b-53cb5b5480dc-istio-envoy\") pod \"45e79980-be5c-47b3-b78b-53cb5b5480dc\" (UID: \"45e79980-be5c-47b3-b78b-53cb5b5480dc\") "
Jul 02 21:11:40.240955 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:40.240920    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45e79980-be5c-47b3-b78b-53cb5b5480dc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "45e79980-be5c-47b3-b78b-53cb5b5480dc" (UID: "45e79980-be5c-47b3-b78b-53cb5b5480dc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:11:40.240955 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:40.240932    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45e79980-be5c-47b3-b78b-53cb5b5480dc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "45e79980-be5c-47b3-b78b-53cb5b5480dc" (UID: "45e79980-be5c-47b3-b78b-53cb5b5480dc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:11:40.240955 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:40.240945    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45e79980-be5c-47b3-b78b-53cb5b5480dc-istio-token\") pod \"45e79980-be5c-47b3-b78b-53cb5b5480dc\" (UID: \"45e79980-be5c-47b3-b78b-53cb5b5480dc\") "
Jul 02 21:11:40.241226 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:40.241024    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45e79980-be5c-47b3-b78b-53cb5b5480dc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "45e79980-be5c-47b3-b78b-53cb5b5480dc" (UID: "45e79980-be5c-47b3-b78b-53cb5b5480dc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:11:40.241226 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:40.241195    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45e79980-be5c-47b3-b78b-53cb5b5480dc-workload-certs\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:11:40.241226 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:40.241211    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45e79980-be5c-47b3-b78b-53cb5b5480dc-credential-socket\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:11:40.241384 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:40.241226    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45e79980-be5c-47b3-b78b-53cb5b5480dc-workload-socket\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:11:40.241384 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:40.241270    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45e79980-be5c-47b3-b78b-53cb5b5480dc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "45e79980-be5c-47b3-b78b-53cb5b5480dc" (UID: "45e79980-be5c-47b3-b78b-53cb5b5480dc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:11:40.241810 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:40.241786    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45e79980-be5c-47b3-b78b-53cb5b5480dc-istio-data" (OuterVolumeSpecName: "istio-data") pod "45e79980-be5c-47b3-b78b-53cb5b5480dc" (UID: "45e79980-be5c-47b3-b78b-53cb5b5480dc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:11:40.243008 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:40.242988    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45e79980-be5c-47b3-b78b-53cb5b5480dc-istio-token" (OuterVolumeSpecName: "istio-token") pod "45e79980-be5c-47b3-b78b-53cb5b5480dc" (UID: "45e79980-be5c-47b3-b78b-53cb5b5480dc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:11:40.243215 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:40.243113    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45e79980-be5c-47b3-b78b-53cb5b5480dc-kube-api-access-42l58" (OuterVolumeSpecName: "kube-api-access-42l58") pod "45e79980-be5c-47b3-b78b-53cb5b5480dc" (UID: "45e79980-be5c-47b3-b78b-53cb5b5480dc"). InnerVolumeSpecName "kube-api-access-42l58". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:11:40.243448 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:40.243421    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/45e79980-be5c-47b3-b78b-53cb5b5480dc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "45e79980-be5c-47b3-b78b-53cb5b5480dc" (UID: "45e79980-be5c-47b3-b78b-53cb5b5480dc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 21:11:40.243448 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:40.243430    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45e79980-be5c-47b3-b78b-53cb5b5480dc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "45e79980-be5c-47b3-b78b-53cb5b5480dc" (UID: "45e79980-be5c-47b3-b78b-53cb5b5480dc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:11:40.342324 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:40.342299    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45e79980-be5c-47b3-b78b-53cb5b5480dc-istio-podinfo\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:11:40.342324 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:40.342325    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45e79980-be5c-47b3-b78b-53cb5b5480dc-istiod-ca-cert\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:11:40.342486 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:40.342335    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42l58\" (UniqueName: \"kubernetes.io/projected/45e79980-be5c-47b3-b78b-53cb5b5480dc-kube-api-access-42l58\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:11:40.342486 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:40.342345    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45e79980-be5c-47b3-b78b-53cb5b5480dc-istio-envoy\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:11:40.342486 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:40.342354    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45e79980-be5c-47b3-b78b-53cb5b5480dc-istio-token\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:11:40.342486 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:40.342362    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45e79980-be5c-47b3-b78b-53cb5b5480dc-istio-data\") on node \"ip-10-0-135-220.ec2.internal\" DevicePath \"\""
Jul 02 21:11:40.661275 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:40.661167    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-6d4cj_6d131827-61dd-4d81-95df-d3ae5ad17915/server/0.log"
Jul 02 21:11:40.788004 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:40.787966    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-htrmh_f6a3ca25-8474-4b07-b804-21cc151b987f/manager/0.log"
Jul 02 21:11:40.827164 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:40.827121    2581 generic.go:356] "Generic (PLEG): container finished" podID="45e79980-be5c-47b3-b78b-53cb5b5480dc" containerID="1e07b5bbb674a01990439d28dea0caa6ef009cc347c91875269f6a78cc0f5c3b" exitCode=0
Jul 02 21:11:40.827300 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:40.827189    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447"
Jul 02 21:11:40.827300 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:40.827206    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447" event={"ID":"45e79980-be5c-47b3-b78b-53cb5b5480dc","Type":"ContainerDied","Data":"1e07b5bbb674a01990439d28dea0caa6ef009cc347c91875269f6a78cc0f5c3b"}
Jul 02 21:11:40.827300 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:40.827257    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447" event={"ID":"45e79980-be5c-47b3-b78b-53cb5b5480dc","Type":"ContainerDied","Data":"215900f935aeb4f85c54d68ba310d4a997589cad028c52dfebda3e747b700c3d"}
Jul 02 21:11:40.827300 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:40.827279    2581 scope.go:117] "RemoveContainer" containerID="1e07b5bbb674a01990439d28dea0caa6ef009cc347c91875269f6a78cc0f5c3b"
Jul 02 21:11:40.836940 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:40.836919    2581 scope.go:117] "RemoveContainer" containerID="d5aac101fc486b45ff992f9a5e19dc5d5818b8c7fbb63e43df31d3999553f52f"
Jul 02 21:11:40.845023 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:40.845007    2581 scope.go:117] "RemoveContainer" containerID="1e07b5bbb674a01990439d28dea0caa6ef009cc347c91875269f6a78cc0f5c3b"
Jul 02 21:11:40.845262 ip-10-0-135-220 kubenswrapper[2581]: E0702 21:11:40.845244    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e07b5bbb674a01990439d28dea0caa6ef009cc347c91875269f6a78cc0f5c3b\": container with ID starting with 1e07b5bbb674a01990439d28dea0caa6ef009cc347c91875269f6a78cc0f5c3b not found: ID does not exist" containerID="1e07b5bbb674a01990439d28dea0caa6ef009cc347c91875269f6a78cc0f5c3b"
Jul 02 21:11:40.845319 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:40.845268    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e07b5bbb674a01990439d28dea0caa6ef009cc347c91875269f6a78cc0f5c3b"} err="failed to get container status \"1e07b5bbb674a01990439d28dea0caa6ef009cc347c91875269f6a78cc0f5c3b\": rpc error: code = NotFound desc = could not find container \"1e07b5bbb674a01990439d28dea0caa6ef009cc347c91875269f6a78cc0f5c3b\": container with ID starting with 1e07b5bbb674a01990439d28dea0caa6ef009cc347c91875269f6a78cc0f5c3b not found: ID does not exist"
Jul 02 21:11:40.845319 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:40.845285    2581 scope.go:117] "RemoveContainer" containerID="d5aac101fc486b45ff992f9a5e19dc5d5818b8c7fbb63e43df31d3999553f52f"
Jul 02 21:11:40.845505 ip-10-0-135-220 kubenswrapper[2581]: E0702 21:11:40.845486    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5aac101fc486b45ff992f9a5e19dc5d5818b8c7fbb63e43df31d3999553f52f\": container with ID starting with d5aac101fc486b45ff992f9a5e19dc5d5818b8c7fbb63e43df31d3999553f52f not found: ID does not exist" containerID="d5aac101fc486b45ff992f9a5e19dc5d5818b8c7fbb63e43df31d3999553f52f"
Jul 02 21:11:40.845562 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:40.845515    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5aac101fc486b45ff992f9a5e19dc5d5818b8c7fbb63e43df31d3999553f52f"} err="failed to get container status \"d5aac101fc486b45ff992f9a5e19dc5d5818b8c7fbb63e43df31d3999553f52f\": rpc error: code = NotFound desc = could not find container \"d5aac101fc486b45ff992f9a5e19dc5d5818b8c7fbb63e43df31d3999553f52f\": container with ID starting with d5aac101fc486b45ff992f9a5e19dc5d5818b8c7fbb63e43df31d3999553f52f not found: ID does not exist"
Jul 02 21:11:40.852951 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:40.852929    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447"]
Jul 02 21:11:40.857002 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:40.856973    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-2217fe-openshift-default-58db7698ff-77447"]
Jul 02 21:11:40.881658 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:40.881633    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45e79980-be5c-47b3-b78b-53cb5b5480dc" path="/var/lib/kubelet/pods/45e79980-be5c-47b3-b78b-53cb5b5480dc/volumes"
Jul 02 21:11:41.173107 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:41.173080    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68b94c7db-9795d_81040c78-7e3b-4aa2-8843-643ba9554151/copy-manifests/0.log"
Jul 02 21:11:41.186380 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:41.186355    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68b94c7db-9795d_81040c78-7e3b-4aa2-8843-643ba9554151/manager/0.log"
Jul 02 21:11:41.981401 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:41.981364    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkflt_d62e6708-f73f-4c45-a7c1-8885fe64d21b/util/0.log"
Jul 02 21:11:41.988675 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:41.988652    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkflt_d62e6708-f73f-4c45-a7c1-8885fe64d21b/pull/0.log"
Jul 02 21:11:41.995491 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:41.995471    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkflt_d62e6708-f73f-4c45-a7c1-8885fe64d21b/extract/0.log"
Jul 02 21:11:42.113217 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:42.113190    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxlqf_fad2b71e-a9d1-412f-a727-e412b0d438bc/util/0.log"
Jul 02 21:11:42.120520 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:42.120494    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxlqf_fad2b71e-a9d1-412f-a727-e412b0d438bc/pull/0.log"
Jul 02 21:11:42.127302 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:42.127279    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxlqf_fad2b71e-a9d1-412f-a727-e412b0d438bc/extract/0.log"
Jul 02 21:11:42.240022 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:42.239952    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f9klb_122ecb52-2f72-4443-9e00-c876ed5ca369/util/0.log"
Jul 02 21:11:42.247960 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:42.247943    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f9klb_122ecb52-2f72-4443-9e00-c876ed5ca369/pull/0.log"
Jul 02 21:11:42.254766 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:42.254750    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f9klb_122ecb52-2f72-4443-9e00-c876ed5ca369/extract/0.log"
Jul 02 21:11:42.364604 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:42.364582    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6tm4_a77b72cd-490c-42d4-a299-584c5f9535e6/util/0.log"
Jul 02 21:11:42.371591 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:42.371576    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6tm4_a77b72cd-490c-42d4-a299-584c5f9535e6/pull/0.log"
Jul 02 21:11:42.378593 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:42.378577    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6tm4_a77b72cd-490c-42d4-a299-584c5f9535e6/extract/0.log"
Jul 02 21:11:42.496545 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:42.496493    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-665d585cf8-9vqwd_a3775f1e-d556-486a-b4f2-11bf02dfa2e2/authorino/0.log"
Jul 02 21:11:42.621944 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:42.621919    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-r9bqt_80a4a842-16ed-49c9-a9b6-93735f675111/manager/0.log"
Jul 02 21:11:42.734363 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:42.734341    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-7ff9r_655294f6-dcdd-431e-8b12-e7ccfe820f52/manager/0.log"
Jul 02 21:11:42.850375 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:42.850317    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-r88qf_15f2c5d0-573b-4e0f-aaa2-0e98abb647a6/kuadrant-console-plugin/0.log"
Jul 02 21:11:42.962582 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:42.962555    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-sck8x_f1d353ab-cd4d-4e5d-8a8a-d52b4d28d2e9/registry-server/0.log"
Jul 02 21:11:43.090369 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:43.090344    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-lsg5b_e3c3a701-7fda-4441-a5b3-93c65bc3cddf/manager/0.log"
Jul 02 21:11:43.213830 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:43.213808    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-nw8gn_1f0e4742-3cc9-46b4-b25a-cc4899695998/limitador/0.log"
Jul 02 21:11:44.056989 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:44.056963    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b7c78b9ff-mfqm7_5d720f11-000d-4f79-9630-b7fc1aced41d/kube-auth-proxy/0.log"
Jul 02 21:11:44.176730 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:44.176704    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-hd9ql_90f49378-c489-4ee5-a8fc-502c5f8043e0/istio-proxy/1.log"
Jul 02 21:11:44.302191 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:44.302163    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-7244n_e7cfb688-311b-4962-bb23-8a484a04d3ce/payload-pre-processing/0.log"
Jul 02 21:11:44.418360 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:44.418300    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-tnbmf_eb914c24-2302-4a18-92d5-4bc6b85fda00/payload-processing/0.log"
Jul 02 21:11:44.531271 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:44.531237    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7ff689d5-rr6lc_79f2ade3-bf54-4290-bce9-34d8e1758c00/router/0.log"
Jul 02 21:11:45.000208 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:45.000185    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-khfq6_16e99324-0b41-4f56-b493-59d14f5fa4b8/main/0.log"
Jul 02 21:11:45.135720 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:45.135688    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-js7qc_8bb8e2bc-21b5-4764-bd30-8646cdddf430/main/0.log"
Jul 02 21:11:45.490354 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:45.490323    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-f4phv_50d45ba1-52d8-495f-9bd5-18a547d7d080/main/0.log"
Jul 02 21:11:49.842437 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:49.842403    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mgldh/must-gather-kztw7"]
Jul 02 21:11:49.842794 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:49.842724    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa739295-655f-437f-ab51-7721c93ae531" containerName="main"
Jul 02 21:11:49.842794 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:49.842734    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa739295-655f-437f-ab51-7721c93ae531" containerName="main"
Jul 02 21:11:49.842794 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:49.842748    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16540e5a-f90d-4ba4-9285-2754d6c0a66e" containerName="istio-proxy"
Jul 02 21:11:49.842794 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:49.842754    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="16540e5a-f90d-4ba4-9285-2754d6c0a66e" containerName="istio-proxy"
Jul 02 21:11:49.842794 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:49.842759    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45e79980-be5c-47b3-b78b-53cb5b5480dc" containerName="istio-proxy"
Jul 02 21:11:49.842794 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:49.842765    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="45e79980-be5c-47b3-b78b-53cb5b5480dc" containerName="istio-proxy"
Jul 02 21:11:49.842794 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:49.842774    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16540e5a-f90d-4ba4-9285-2754d6c0a66e" containerName="istio-proxy"
Jul 02 21:11:49.842794 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:49.842779    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="16540e5a-f90d-4ba4-9285-2754d6c0a66e" containerName="istio-proxy"
Jul 02 21:11:49.843045 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:49.842835    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="16540e5a-f90d-4ba4-9285-2754d6c0a66e" containerName="istio-proxy"
Jul 02 21:11:49.843045 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:49.842844    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="45e79980-be5c-47b3-b78b-53cb5b5480dc" containerName="istio-proxy"
Jul 02 21:11:49.843045 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:49.842850    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="16540e5a-f90d-4ba4-9285-2754d6c0a66e" containerName="istio-proxy"
Jul 02 21:11:49.843045 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:49.842856    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa739295-655f-437f-ab51-7721c93ae531" containerName="main"
Jul 02 21:11:49.843045 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:49.842862    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="45e79980-be5c-47b3-b78b-53cb5b5480dc" containerName="istio-proxy"
Jul 02 21:11:49.843045 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:49.842921    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45e79980-be5c-47b3-b78b-53cb5b5480dc" containerName="istio-proxy"
Jul 02 21:11:49.843045 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:49.842927    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="45e79980-be5c-47b3-b78b-53cb5b5480dc" containerName="istio-proxy"
Jul 02 21:11:49.844505 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:49.844480    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:11:49.847479 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:49.847463    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mgldh/must-gather-kztw7"
Jul 02 21:11:49.850153 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:49.850117    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mgldh\"/\"default-dockercfg-7xkmp\""
Jul 02 21:11:49.850153 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:49.850125    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mgldh\"/\"openshift-service-ca.crt\""
Jul 02 21:11:49.850326 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:49.850125    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mgldh\"/\"kube-root-ca.crt\""
Jul 02 21:11:49.856217 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:49.856193    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mgldh/must-gather-kztw7"]
Jul 02 21:11:49.915256 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:49.915226    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log" limit=1024
Jul 02 21:11:50.019519 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:50.019492    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jknb8\" (UniqueName: \"kubernetes.io/projected/087b52a3-2e4c-4118-9b48-99dcf06c9dc8-kube-api-access-jknb8\") pod \"must-gather-kztw7\" (UID: \"087b52a3-2e4c-4118-9b48-99dcf06c9dc8\") " pod="openshift-must-gather-mgldh/must-gather-kztw7"
Jul 02 21:11:50.019681 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:50.019599    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/087b52a3-2e4c-4118-9b48-99dcf06c9dc8-must-gather-output\") pod \"must-gather-kztw7\" (UID: \"087b52a3-2e4c-4118-9b48-99dcf06c9dc8\") " pod="openshift-must-gather-mgldh/must-gather-kztw7"
Jul 02 21:11:50.120849 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:50.120772    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jknb8\" (UniqueName: \"kubernetes.io/projected/087b52a3-2e4c-4118-9b48-99dcf06c9dc8-kube-api-access-jknb8\") pod \"must-gather-kztw7\" (UID: \"087b52a3-2e4c-4118-9b48-99dcf06c9dc8\") " pod="openshift-must-gather-mgldh/must-gather-kztw7"
Jul 02 21:11:50.120849 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:50.120823    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/087b52a3-2e4c-4118-9b48-99dcf06c9dc8-must-gather-output\") pod \"must-gather-kztw7\" (UID: \"087b52a3-2e4c-4118-9b48-99dcf06c9dc8\") " pod="openshift-must-gather-mgldh/must-gather-kztw7"
Jul 02 21:11:50.121114 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:50.121099    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/087b52a3-2e4c-4118-9b48-99dcf06c9dc8-must-gather-output\") pod \"must-gather-kztw7\" (UID: \"087b52a3-2e4c-4118-9b48-99dcf06c9dc8\") " pod="openshift-must-gather-mgldh/must-gather-kztw7"
Jul 02 21:11:50.130990 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:50.130961    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jknb8\" (UniqueName: \"kubernetes.io/projected/087b52a3-2e4c-4118-9b48-99dcf06c9dc8-kube-api-access-jknb8\") pod \"must-gather-kztw7\" (UID: \"087b52a3-2e4c-4118-9b48-99dcf06c9dc8\") " pod="openshift-must-gather-mgldh/must-gather-kztw7"
Jul 02 21:11:50.157126 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:50.157103    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mgldh/must-gather-kztw7"
Jul 02 21:11:50.300910 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:50.300888    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mgldh/must-gather-kztw7"]
Jul 02 21:11:50.302329 ip-10-0-135-220 kubenswrapper[2581]: W0702 21:11:50.302303    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod087b52a3_2e4c_4118_9b48_99dcf06c9dc8.slice/crio-1d43462cb93dc37919968e81970983deb2f1ced520be234879a41e037f42fe5f WatchSource:0}: Error finding container 1d43462cb93dc37919968e81970983deb2f1ced520be234879a41e037f42fe5f: Status 404 returned error can't find the container with id 1d43462cb93dc37919968e81970983deb2f1ced520be234879a41e037f42fe5f
Jul 02 21:11:50.304292 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:50.304274    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 21:11:50.883631 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:50.883601    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mgldh/must-gather-kztw7" event={"ID":"087b52a3-2e4c-4118-9b48-99dcf06c9dc8","Type":"ContainerStarted","Data":"1d43462cb93dc37919968e81970983deb2f1ced520be234879a41e037f42fe5f"}
Jul 02 21:11:51.892868 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:51.892835    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mgldh/must-gather-kztw7" event={"ID":"087b52a3-2e4c-4118-9b48-99dcf06c9dc8","Type":"ContainerStarted","Data":"14f4269e92a73132bc067fa13d191f4176819a2bbd0f06bd8cfc6698533389e7"}
Jul 02 21:11:51.892868 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:51.892877    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mgldh/must-gather-kztw7" event={"ID":"087b52a3-2e4c-4118-9b48-99dcf06c9dc8","Type":"ContainerStarted","Data":"5824aeec869aea1712f46752788f894ed2c55a7775c365e978a0651427e5ddf6"}
Jul 02 21:11:51.912039 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:51.911985    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mgldh/must-gather-kztw7" podStartSLOduration=2.139202251 podStartE2EDuration="2.911968219s" totalImagesPullingTime="772.765968ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:11:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:11:51.910088406 +0000 UTC m=+2345.580601899" watchObservedRunningTime="2026-07-02 21:11:51.911968219 +0000 UTC m=+2345.582481711"
Jul 02 21:11:52.685028 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:52.684990    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-57lmx_002584f1-ab2d-4938-976c-f61d553400c5/global-pull-secret-syncer/0.log"
Jul 02 21:11:52.849177 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:52.849125    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9pdnt_4cf8b90d-0190-498c-a52b-327bac88ed94/konnectivity-agent/0.log"
Jul 02 21:11:52.964885 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:52.964860    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-220.ec2.internal_531954a8cc159a19f4ac2e984328d7b3/haproxy/0.log"
Jul 02 21:11:57.628874 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:57.628841    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkflt_d62e6708-f73f-4c45-a7c1-8885fe64d21b/extract/0.log"
Jul 02 21:11:57.655751 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:57.655718    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkflt_d62e6708-f73f-4c45-a7c1-8885fe64d21b/util/0.log"
Jul 02 21:11:57.683092 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:57.683058    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wkflt_d62e6708-f73f-4c45-a7c1-8885fe64d21b/pull/0.log"
Jul 02 21:11:57.716007 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:57.715957    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxlqf_fad2b71e-a9d1-412f-a727-e412b0d438bc/extract/0.log"
Jul 02 21:11:57.741655 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:57.741629    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxlqf_fad2b71e-a9d1-412f-a727-e412b0d438bc/util/0.log"
Jul 02 21:11:57.766876 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:57.766850    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wxlqf_fad2b71e-a9d1-412f-a727-e412b0d438bc/pull/0.log"
Jul 02 21:11:57.797820 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:57.797792    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f9klb_122ecb52-2f72-4443-9e00-c876ed5ca369/extract/0.log"
Jul 02 21:11:57.823490 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:57.823463    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f9klb_122ecb52-2f72-4443-9e00-c876ed5ca369/util/0.log"
Jul 02 21:11:57.846712 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:57.846684    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f9klb_122ecb52-2f72-4443-9e00-c876ed5ca369/pull/0.log"
Jul 02 21:11:57.876844 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:57.876780    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6tm4_a77b72cd-490c-42d4-a299-584c5f9535e6/extract/0.log"
Jul 02 21:11:57.923748 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:57.923607    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6tm4_a77b72cd-490c-42d4-a299-584c5f9535e6/util/0.log"
Jul 02 21:11:57.950554 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:57.950524    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r6tm4_a77b72cd-490c-42d4-a299-584c5f9535e6/pull/0.log"
Jul 02 21:11:58.348172 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:58.346807    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-665d585cf8-9vqwd_a3775f1e-d556-486a-b4f2-11bf02dfa2e2/authorino/0.log"
Jul 02 21:11:58.378160 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:58.378109    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-r9bqt_80a4a842-16ed-49c9-a9b6-93735f675111/manager/0.log"
Jul 02 21:11:58.408062 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:58.408033    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-7ff9r_655294f6-dcdd-431e-8b12-e7ccfe820f52/manager/0.log"
Jul 02 21:11:58.436810 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:58.436784    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-r88qf_15f2c5d0-573b-4e0f-aaa2-0e98abb647a6/kuadrant-console-plugin/0.log"
Jul 02 21:11:58.487704 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:58.487666    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-sck8x_f1d353ab-cd4d-4e5d-8a8a-d52b4d28d2e9/registry-server/0.log"
Jul 02 21:11:58.632208 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:58.631355    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-lsg5b_e3c3a701-7fda-4441-a5b3-93c65bc3cddf/manager/0.log"
Jul 02 21:11:58.660939 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:11:58.660541    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-nw8gn_1f0e4742-3cc9-46b4-b25a-cc4899695998/limitador/0.log"
Jul 02 21:12:00.916570 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:00.916535    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vpvxx_9be1c58b-679c-41a2-a221-00be6b9a82b5/node-exporter/0.log"
Jul 02 21:12:00.989263 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:00.989218    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vpvxx_9be1c58b-679c-41a2-a221-00be6b9a82b5/kube-rbac-proxy/0.log"
Jul 02 21:12:01.039314 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:01.039278    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vpvxx_9be1c58b-679c-41a2-a221-00be6b9a82b5/init-textfile/0.log"
Jul 02 21:12:02.185746 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:02.185709    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mgldh/perf-node-gather-daemonset-rhkfj"]
Jul 02 21:12:02.190603 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:02.190576    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mgldh/perf-node-gather-daemonset-rhkfj"
Jul 02 21:12:02.201242 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:02.201214    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mgldh/perf-node-gather-daemonset-rhkfj"]
Jul 02 21:12:02.250942 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:02.250900    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/42178062-8975-46e2-8b97-39c7879156d8-lib-modules\") pod \"perf-node-gather-daemonset-rhkfj\" (UID: \"42178062-8975-46e2-8b97-39c7879156d8\") " pod="openshift-must-gather-mgldh/perf-node-gather-daemonset-rhkfj"
Jul 02 21:12:02.251508 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:02.251483    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhdqs\" (UniqueName: \"kubernetes.io/projected/42178062-8975-46e2-8b97-39c7879156d8-kube-api-access-fhdqs\") pod \"perf-node-gather-daemonset-rhkfj\" (UID: \"42178062-8975-46e2-8b97-39c7879156d8\") " pod="openshift-must-gather-mgldh/perf-node-gather-daemonset-rhkfj"
Jul 02 21:12:02.251736 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:02.251695    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/42178062-8975-46e2-8b97-39c7879156d8-proc\") pod \"perf-node-gather-daemonset-rhkfj\" (UID: \"42178062-8975-46e2-8b97-39c7879156d8\") " pod="openshift-must-gather-mgldh/perf-node-gather-daemonset-rhkfj"
Jul 02 21:12:02.251964 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:02.251935    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/42178062-8975-46e2-8b97-39c7879156d8-podres\") pod \"perf-node-gather-daemonset-rhkfj\" (UID: \"42178062-8975-46e2-8b97-39c7879156d8\") " pod="openshift-must-gather-mgldh/perf-node-gather-daemonset-rhkfj"
Jul 02 21:12:02.252156 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:02.252118    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42178062-8975-46e2-8b97-39c7879156d8-sys\") pod \"perf-node-gather-daemonset-rhkfj\" (UID: \"42178062-8975-46e2-8b97-39c7879156d8\") " pod="openshift-must-gather-mgldh/perf-node-gather-daemonset-rhkfj"
Jul 02 21:12:02.353645 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:02.353606    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhdqs\" (UniqueName: \"kubernetes.io/projected/42178062-8975-46e2-8b97-39c7879156d8-kube-api-access-fhdqs\") pod \"perf-node-gather-daemonset-rhkfj\" (UID: \"42178062-8975-46e2-8b97-39c7879156d8\") " pod="openshift-must-gather-mgldh/perf-node-gather-daemonset-rhkfj"
Jul 02 21:12:02.354277 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:02.354254    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/42178062-8975-46e2-8b97-39c7879156d8-proc\") pod \"perf-node-gather-daemonset-rhkfj\" (UID: \"42178062-8975-46e2-8b97-39c7879156d8\") " pod="openshift-must-gather-mgldh/perf-node-gather-daemonset-rhkfj"
Jul 02 21:12:02.354659 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:02.354570    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/42178062-8975-46e2-8b97-39c7879156d8-proc\") pod \"perf-node-gather-daemonset-rhkfj\" (UID: \"42178062-8975-46e2-8b97-39c7879156d8\") " pod="openshift-must-gather-mgldh/perf-node-gather-daemonset-rhkfj"
Jul 02 21:12:02.354771 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:02.354662    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/42178062-8975-46e2-8b97-39c7879156d8-podres\") pod \"perf-node-gather-daemonset-rhkfj\" (UID: \"42178062-8975-46e2-8b97-39c7879156d8\") " pod="openshift-must-gather-mgldh/perf-node-gather-daemonset-rhkfj"
Jul 02 21:12:02.354836 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:02.354785    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42178062-8975-46e2-8b97-39c7879156d8-sys\") pod \"perf-node-gather-daemonset-rhkfj\" (UID: \"42178062-8975-46e2-8b97-39c7879156d8\") " pod="openshift-must-gather-mgldh/perf-node-gather-daemonset-rhkfj"
Jul 02 21:12:02.354895 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:02.354836    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/42178062-8975-46e2-8b97-39c7879156d8-lib-modules\") pod \"perf-node-gather-daemonset-rhkfj\" (UID: \"42178062-8975-46e2-8b97-39c7879156d8\") " pod="openshift-must-gather-mgldh/perf-node-gather-daemonset-rhkfj"
Jul 02 21:12:02.354895 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:02.354850    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/42178062-8975-46e2-8b97-39c7879156d8-podres\") pod \"perf-node-gather-daemonset-rhkfj\" (UID: \"42178062-8975-46e2-8b97-39c7879156d8\") " pod="openshift-must-gather-mgldh/perf-node-gather-daemonset-rhkfj"
Jul 02 21:12:02.354982 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:02.354895    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42178062-8975-46e2-8b97-39c7879156d8-sys\") pod \"perf-node-gather-daemonset-rhkfj\" (UID: \"42178062-8975-46e2-8b97-39c7879156d8\") " pod="openshift-must-gather-mgldh/perf-node-gather-daemonset-rhkfj"
Jul 02 21:12:02.355026 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:02.355010    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/42178062-8975-46e2-8b97-39c7879156d8-lib-modules\") pod \"perf-node-gather-daemonset-rhkfj\" (UID: \"42178062-8975-46e2-8b97-39c7879156d8\") " pod="openshift-must-gather-mgldh/perf-node-gather-daemonset-rhkfj"
Jul 02 21:12:02.363177 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:02.363127    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhdqs\" (UniqueName: \"kubernetes.io/projected/42178062-8975-46e2-8b97-39c7879156d8-kube-api-access-fhdqs\") pod \"perf-node-gather-daemonset-rhkfj\" (UID: \"42178062-8975-46e2-8b97-39c7879156d8\") " pod="openshift-must-gather-mgldh/perf-node-gather-daemonset-rhkfj"
Jul 02 21:12:02.505820 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:02.505781    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mgldh/perf-node-gather-daemonset-rhkfj"
Jul 02 21:12:02.711191 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:02.709327    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mgldh/perf-node-gather-daemonset-rhkfj"]
Jul 02 21:12:02.906226 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:02.906196    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-rblfw_52dd8318-3ebb-47ed-98ea-1d4e02bca006/networking-console-plugin/0.log"
Jul 02 21:12:02.975508 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:02.975475    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mgldh/perf-node-gather-daemonset-rhkfj" event={"ID":"42178062-8975-46e2-8b97-39c7879156d8","Type":"ContainerStarted","Data":"3801f425bb8b5ca8fd4ddc095f148226044ffe695d47a0b2d58bcbd7bd39fdad"}
Jul 02 21:12:02.975693 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:02.975535    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mgldh/perf-node-gather-daemonset-rhkfj" event={"ID":"42178062-8975-46e2-8b97-39c7879156d8","Type":"ContainerStarted","Data":"16a00982c78ede5088cbd41d4474e163df2d247d949282ae25ded1b9b3b7448b"}
Jul 02 21:12:02.975693 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:02.975661    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mgldh/perf-node-gather-daemonset-rhkfj"
Jul 02 21:12:02.997230 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:02.997176    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mgldh/perf-node-gather-daemonset-rhkfj" podStartSLOduration=0.997157043 podStartE2EDuration="997.157043ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:12:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:12:02.993404752 +0000 UTC m=+2356.663918246" watchObservedRunningTime="2026-07-02 21:12:02.997157043 +0000 UTC m=+2356.667670530"
Jul 02 21:12:03.899094 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:03.899062    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-fbf578b9f-wjgkj_568d007b-2ef4-42a7-8a91-7cb19ddc66ca/console/0.log"
Jul 02 21:12:05.603095 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:05.603060    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4tmlm_1896b78b-e154-4660-8457-6f3be984428d/dns/0.log"
Jul 02 21:12:05.634634 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:05.634594    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4tmlm_1896b78b-e154-4660-8457-6f3be984428d/kube-rbac-proxy/0.log"
Jul 02 21:12:05.802043 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:05.802011    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l6psk_b8214272-e568-4b9d-bc4e-dcb7f9f45e60/dns-node-resolver/0.log"
Jul 02 21:12:06.522303 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:06.522279    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nq8gr_8a38f5af-61e0-44a2-ba14-181ce7578683/node-ca/0.log"
Jul 02 21:12:07.683850 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:07.683823    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b7c78b9ff-mfqm7_5d720f11-000d-4f79-9630-b7fc1aced41d/kube-auth-proxy/0.log"
Jul 02 21:12:07.733520 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:07.733485    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-hd9ql_90f49378-c489-4ee5-a8fc-502c5f8043e0/istio-proxy/0.log"
Jul 02 21:12:07.770183 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:07.770128    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-hd9ql_90f49378-c489-4ee5-a8fc-502c5f8043e0/istio-proxy/1.log"
Jul 02 21:12:07.821701 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:07.821644    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-7244n_e7cfb688-311b-4962-bb23-8a484a04d3ce/payload-pre-processing/0.log"
Jul 02 21:12:07.895231 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:07.895190    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-tnbmf_eb914c24-2302-4a18-92d5-4bc6b85fda00/payload-processing/0.log"
Jul 02 21:12:07.935244 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:07.935165    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7ff689d5-rr6lc_79f2ade3-bf54-4290-bce9-34d8e1758c00/router/0.log"
Jul 02 21:12:08.677450 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:08.677421    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mhrst_e4fb5458-6e18-4869-b867-8eb520767a3c/serve-healthcheck-canary/0.log"
Jul 02 21:12:09.003210 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:09.003173    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mgldh/perf-node-gather-daemonset-rhkfj"
Jul 02 21:12:09.407117 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:09.407026    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p7g2c_5034a174-b85c-4644-8e53-be58c8dd8b51/kube-rbac-proxy/0.log"
Jul 02 21:12:09.430739 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:09.430709    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p7g2c_5034a174-b85c-4644-8e53-be58c8dd8b51/exporter/0.log"
Jul 02 21:12:09.458200 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:09.458168    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p7g2c_5034a174-b85c-4644-8e53-be58c8dd8b51/extractor/0.log"
Jul 02 21:12:12.208086 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:12.208055    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-6d4cj_6d131827-61dd-4d81-95df-d3ae5ad17915/server/0.log"
Jul 02 21:12:12.301875 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:12.301779    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-htrmh_f6a3ca25-8474-4b07-b804-21cc151b987f/manager/0.log"
Jul 02 21:12:12.519470 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:12.514215    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68b94c7db-9795d_81040c78-7e3b-4aa2-8843-643ba9554151/manager/0.log"
Jul 02 21:12:12.538539 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:12.538513    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68b94c7db-9795d_81040c78-7e3b-4aa2-8843-643ba9554151/copy-manifests/0.log"
Jul 02 21:12:13.204715 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:13.204648    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b7c78b9ff-mfqm7_5d720f11-000d-4f79-9630-b7fc1aced41d/kube-auth-proxy/0.log"
Jul 02 21:12:13.225565 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:13.225541    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-hd9ql_90f49378-c489-4ee5-a8fc-502c5f8043e0/istio-proxy/0.log"
Jul 02 21:12:13.261542 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:13.261511    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-hd9ql_90f49378-c489-4ee5-a8fc-502c5f8043e0/istio-proxy/1.log"
Jul 02 21:12:13.286289 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:13.286265    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-7244n_e7cfb688-311b-4962-bb23-8a484a04d3ce/payload-pre-processing/0.log"
Jul 02 21:12:13.328565 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:13.328532    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-tnbmf_eb914c24-2302-4a18-92d5-4bc6b85fda00/payload-processing/0.log"
Jul 02 21:12:13.342466 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:13.342443    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7ff689d5-rr6lc_79f2ade3-bf54-4290-bce9-34d8e1758c00/router/0.log"
Jul 02 21:12:13.819804 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:13.819775    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-lcr6m_e1dc66e1-24cd-4043-bc61-5697cf51c145/openshift-lws-operator/0.log"
Jul 02 21:12:14.573955 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:14.573923    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b7c78b9ff-mfqm7_5d720f11-000d-4f79-9630-b7fc1aced41d/kube-auth-proxy/0.log"
Jul 02 21:12:14.598285 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:14.598254    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-hd9ql_90f49378-c489-4ee5-a8fc-502c5f8043e0/istio-proxy/0.log"
Jul 02 21:12:14.638033 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:14.637990    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-hd9ql_90f49378-c489-4ee5-a8fc-502c5f8043e0/istio-proxy/1.log"
Jul 02 21:12:14.662586 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:14.662558    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-7244n_e7cfb688-311b-4962-bb23-8a484a04d3ce/payload-pre-processing/0.log"
Jul 02 21:12:14.708971 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:14.708934    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-tnbmf_eb914c24-2302-4a18-92d5-4bc6b85fda00/payload-processing/0.log"
Jul 02 21:12:14.727669 ip-10-0-135-220 kubenswrapper[2581]: I0702 21:12:14.727646    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7ff689d5-rr6lc_79f2ade3-bf54-4290-bce9-34d8e1758c00/router/0.log"